Skip to content
Category

Multimodal interaction

page 1
collaborative software
application software to help people involved in a common task achieve goals
Gemini
family of language models by Google DeepMind
head-up display
transparent display presenting data within normal sight lines of the user
interaction design
specialization of design focused on the experience users have of a product or service
eye tracking
measuring the point of gaze or motion of an eye relative to the head
smartglasses
thumb|upright=1.2|The touch pad built on the side of the 2013 [[Google Glass can communicate with the user's phone via Bluetooth]] thumb|Man wearing a 1998 EyeTap Digital Eye Glass
Memex
thumb|Interpretation of the MEMEX at German Museum of Technology thumb|Vannevar Bush
haptic technology
any form of interaction involving touch
Mundaneum
thumb|Drawers of the Mundaneum's Universal Bibliographical System bibliographic index cards The Mundaneum was an institution which aimed to gather together all the world's knowledge and classify it according to a system known as the Universal Decimal Classification. It was developed at the turn of the 20th century by Belgian lawyers Paul Otlet and Henri La Fontaine. The Mundaneum has been identified as a milestone in the history of data collection and management, and, albeit more tenuously, as a precursor to the Internet.
head-mounted display
device used in virtual reality systems
interactive media
digital media which make use of moving images, animations, videos and audio
computer-supported cooperative work
field studying how people work in groups with the support of computing systems
IBM 3270
family of block-oriented computer terminals introduced by IBM in 1971
CICS
IBM CICS (Customer Information Control System) is a family of mixed-language application servers that provide online transaction management and connectivity for applications on IBM mainframe systems under z/OS and z/VSE.
wired glove
input device for human–computer interaction
brain implant
technological devices that connect directly to a biological subject's brain
sonification
thumb|upright=1.4|Video of air pollution data from Beijing being conveyed as a piece of music Sonification is the use of non-speech audio to convey information or perceptualize data. Auditory perception has advantages in temporal, spatial, amplitude, and frequency resolution that open possibilities as an alternative or complement to visualization techniques.
multimodal learning
machine learning combining different information resources, such as images and text
multimodal interaction
form of human-machine interaction using multiple modes of input/output
automatic identification and data capture
methods of automatically identifying objects by computer system
Psycho-Pass: The Movie
2015 anime film directed by Katsuyuki Motohiro
virtual retinal display
display technology that draws a raster display directly onto the retina of the eye
Sensorama
thumb|The Sensorama, from U.S. Patent #3050870 The Sensorama was a machine that is one of the earliest known examples of immersive, multi-sensory (now known as multimodal) technology. This technology, which was introduced in 1962 by Morton Heilig, is considered one of the earliest virtual reality (VR) systems.
Computer-mediated reality
EyeTap
thumb|275px|Man wearing a one-eyed injection molding|injection-molded EyeTap thumb|275px|EyeTap inventor Steve Mann (inventor)|Steve Mann wearing a metal frame Laser EyeTap (computer-controlled laser light source run from "GlassEye" camera)
Human–Robot Interaction
interdisciplinary research field studying the interaction between humans and robots
Gemma
family of large language models by Google
dialogue system
computer system intended to converse with a human
Reality–virtuality continuum
concept in computer science
Virtuix Omni
VR treadmill
Earcon
An earcon is a brief, distinctive sound that represents a specific event or conveys other information. Earcons are a common feature of computer operating systems and applications, ranging from a simple beep to indicate an error, to the customizable sound schemes of modern operating systems that indicate startup, shutdown, and other events.
Heliodisplay
The Heliodisplay is an air-based display that uses water condensed from the air already present in the operating environment. The system, developed by IO2 Technology in 2001, uses a projection unit focused onto multiple layers of air and micron-sized atomized particles in midair, resulting in a two-dimensional display with no visible projection surface. This is similar in principle to the cinematic technique of rear projection. As dark areas of the image may appear invisible, the image may be more realistic than on a projection screen, although it is not volumetric. The system may be viewed fr
Vuzix
Vuzix Corporation () is an American multinational technology company headquartered in Rochester, New York and founded by Paul Travers in 1997. Vuzix is a supplier of smartglasses and augmented reality display technology. Vuzix manufactures and sells computer display devices and software. Vuzix head-mounted displays are marketed towards mobile and immersive augmented reality applications, such as 3D gaming, manufacturing training, and military tactical equipment. On January 5, 2015, Intel acquired 30% of Vuzix's stock for $24.8 million.
Huawei PanGu
large language model developed by Huawei
Omnidirectional treadmill
treadmill which can convey objects in two dimensions
artificial human companion
artificial Intelligence