Modality (human-computer interaction)

Human–computer interaction

Human–computer Interaction is the study, planning, and design of the interaction between people and computers. It is often regarded as the intersection of computer science, behavioral sciences, design and several other fields of study...

, a modality is the general class of:

a sense
Sense
Senses are physiological capacities of organisms that provide inputs for perception. The senses and their operation, classification, and theory are overlapping topics studied by a variety of fields, most notably neuroscience, cognitive psychology , and philosophy of perception...

through which the human can receive the output
Output
Output is the term denoting either an exit or changes which exit a system and which activate/modify a process. It is an abstract concept, used in the modeling, system design and system exploitation.-In control theory:...

of the computer (for example, vision modality)
a sensor
Sensor
A sensor is a device that measures a physical quantity and converts it into a signal which can be read by an observer or by an instrument. For example, a mercury-in-glass thermometer converts the measured temperature into expansion and contraction of a liquid which can be read on a calibrated...

or device through which the computer can receive the input from the human

In less formal terms, a modality is a path of communication between the human and the computer.

When multiple modalities are available for some tasks or parts of tasks, the system is said to have overlapping modalities. When multiple modalities are available for all tasks, the system is said to have redundant modalities.

Having too many modalities for a particular task is not a smart idea, however if you do not have enough modalities that will not be good as well.

Computer–human modalities

Any human sense can be translated to a modality. In practice, the modalities of seeing

Visual perception

Visual perception is the ability to interpret information and surroundings from the effects of visible light reaching the eye. The resulting perception is also known as eyesight, sight, or vision...

and hearing

Hearing (sense)

Hearing is the ability to perceive sound by detecting vibrations through an organ such as the ear. It is one of the traditional five senses...

are the most commonly employed. The following are modalities through which the computer can send information to the human:

Major modalities
- Seeing
  Visual perception
  Visual perception is the ability to interpret information and surroundings from the effects of visible light reaching the eye. The resulting perception is also known as eyesight, sight, or vision...
  
  or vision modality
- Hearing
  Hearing (sense)
  Hearing is the ability to perceive sound by detecting vibrations through an organ such as the ear. It is one of the traditional five senses...
  
  or audition modality
Haptic modalities
- Touch, tactile or tactition modality — the sense of pressure
- Proprioception modality — the perception of body awareness
Other modalities
- Taste
  Taste
  Taste is one of the traditional five senses. It refers to the ability to detect the flavor of substances such as food, certain minerals, and poisons, etc....
  
  or gustation modality
- Smell or olfaction
  Olfaction
  Olfaction is the sense of smell. This sense is mediated by specialized sensory cells of the nasal cavity of vertebrates, and, by analogy, sensory cells of the antennae of invertebrates...
  
  modality
- Thermoception modality — the sense of heat and the cold
- Nociception modality — the perception of pain
- Equilibrioception modality — the perception of balance

Human–computer modalities

The computer can be equipped with various types of input devices and sensors to allow it to receive information from the human.

Computer–human modalities

Human–computer modalities

See also