Crossmodal
Encyclopedia
Crossmodal perception or cross-modal perception is perception
that involves interactions between two or more different sensory modalities. Examples include synesthesia
, sensory substitution
, and the McGurk effect
, in which vision
and hearing
interact in speech perception.
Crossmodal perception, crossmodal integration and crossmodal plasticity
of the human brain
are increasingly studied in neuroscience
to gain a better understanding of the large-scale and long-term properties of the brain. A related research theme is the study of multisensory perception and multisensory integration.
Perception
Perception is the process of attaining awareness or understanding of the environment by organizing and interpreting sensory information. All perception involves signals in the nervous system, which in turn result from physical stimulation of the sense organs...
that involves interactions between two or more different sensory modalities. Examples include synesthesia
Synesthesia
Synesthesia , from the ancient Greek , "together," and , "sensation," is a neurologically based condition in which stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway...
, sensory substitution
Sensory substitution
Sensory substitution means to transform the characteristics of one sensory modality into stimuli of another sensory modality. It is hoped that sensory substitution systems can help handicapped people by restoring their ability to perceive a certain defective sensory modality by using sensory...
, and the McGurk effect
McGurk effect
The McGurk effect is a perceptual phenomenon which demonstrates an interaction between hearing and vision in speech perception. "It is a compelling illusion in which humans perceive mismatched audiovisual speech as a completely different syllable". The visual information a person gets from seeing a...
, in which vision
Visual perception
Visual perception is the ability to interpret information and surroundings from the effects of visible light reaching the eye. The resulting perception is also known as eyesight, sight, or vision...
and hearing
Hearing (sense)
Hearing is the ability to perceive sound by detecting vibrations through an organ such as the ear. It is one of the traditional five senses...
interact in speech perception.
Crossmodal perception, crossmodal integration and crossmodal plasticity
Neuroplasticity
Neuroplasticity is a non-specific neuroscience term referring to the ability of the brain and nervous system in all species to change structurally and functionally as a result of input from the environment. Plasticity occurs on a variety of levels, ranging from cellular changes involved in...
of the human brain
Brain
The brain is the center of the nervous system in all vertebrate and most invertebrate animals—only a few primitive invertebrates such as sponges, jellyfish, sea squirts and starfishes do not have one. It is located in the head, usually close to primary sensory apparatus such as vision, hearing,...
are increasingly studied in neuroscience
Neuroscience
Neuroscience is the scientific study of the nervous system. Traditionally, neuroscience has been seen as a branch of biology. However, it is currently an interdisciplinary science that collaborates with other fields such as chemistry, computer science, engineering, linguistics, mathematics,...
to gain a better understanding of the large-scale and long-term properties of the brain. A related research theme is the study of multisensory perception and multisensory integration.