Modality (semiotics)
Encyclopedia
In semiotics
, a modality is a particular way in which the information
is to be encoded
for presentation to humans, i.e. to the type of sign
and to the status of reality ascribed to or claimed by a sign, text or genre. It is more closely associated with the semiotics of Charles Peirce (1839-1914) than Saussure
(1857-1913) because meaning
is conceived as an effect of a set of signs. In the Peircean model, a reference is made to an object when the sign (or representamen) is interpreted recursively by another sign (which becomes its interpretant), a conception of meaning that does in fact imply a classification of sign types.
of perception seems to suggest the existence of a common cognitive system which treats all or most sensorily conveyed meanings in the same way. If all signs must also be objects of perception, there is every reason to believe that their modality will determine at least part of their nature. Thus, the sensory modalities will be visual, auditory
, tactile, olfactory, gustatory, kinesthetic, etc. A list of sign types would include: writing
, symbol
, index
, image
, map
, graph
, diagram
, etc. Some combinations of signs can be multi-modal, i.e. different types of signs grouped together for effect. But the distinction between a medium and a modality should be clarified:
So, the modality refers to a certain type of information and/or the representation format in which information is stored. The medium is the means whereby this information is delivered to the senses of the interpreter. Natural language is the primary modality, having many invariant properties across the auditory media as spoken language, the visual media as written language, the tactile media as Braille
, and kinetic media as sign language
. When meaning is conveyed by spoken language, it is converted into sound waves broadcast by the speaker and received by another's ears. Yet this stimulus
cannot be divorced from the visual evidence of the speaker's manner and gestures, and the general awareness of the physical location and its possible connotative
significance. Similarly, meaning that is contained in a visual form cannot be divorced from the iconicity
and implications of the form. If handwritten, is the writing neat or does it evidence emotion in its style. What type of paper is used, what colour ink, what kind of writing instrument: all such questions are relevant to an interpretation of the significance of what is represented. But images are distinguishable from natural language. For Roland Barthes
(1915-80), language functions with relatively determinate meanings whereas images "say" nothing. Nevertheless, there is a rhetoric
for arranging the parts which are to signify, and an emerging, if not yet generally accepted, syntax
that articulates their parts and binds them into an effective whole.
Semiotics
Semiotics, also called semiotic studies or semiology, is the study of signs and sign processes , indication, designation, likeness, analogy, metaphor, symbolism, signification, and communication...
, a modality is a particular way in which the information
Information
Information in its most restricted technical sense is a message or collection of messages that consists of an ordered sequence of symbols, or it is the meaning that can be interpreted from such a message or collection of messages. Information can be recorded or transmitted. It can be recorded as...
is to be encoded
Encode (semiotics)
In semiotics, the process of creating a message for transmission by the addresser to the addressee is called encoding. The act of interpreting the message by the addressee is called decoding.-Discussion:...
for presentation to humans, i.e. to the type of sign
Sign (semiotics)
A sign is understood as a discrete unit of meaning in semiotics. It is defined as "something that stands for something, to someone in some capacity" It includes words, images, gestures, scents, tastes, textures, sounds – essentially all of the ways in which information can be...
and to the status of reality ascribed to or claimed by a sign, text or genre. It is more closely associated with the semiotics of Charles Peirce (1839-1914) than Saussure
Ferdinand de Saussure
Ferdinand de Saussure was a Swiss linguist whose ideas laid a foundation for many significant developments in linguistics in the 20th century. He is widely considered one of the fathers of 20th-century linguistics...
(1857-1913) because meaning
Meaning (semiotics)
In semiotics, the meaning of a sign is its place in a sign relation, in other words, the set of roles that it occupies within a given sign relation. This statement holds whether sign is taken to mean a sign type or a sign token...
is conceived as an effect of a set of signs. In the Peircean model, a reference is made to an object when the sign (or representamen) is interpreted recursively by another sign (which becomes its interpretant), a conception of meaning that does in fact imply a classification of sign types.
Discussion of sign-type
The psychologyPsychology
Psychology is the study of the mind and behavior. Its immediate goal is to understand individuals and groups by both establishing general principles and researching specific cases. For many, the ultimate goal of psychology is to benefit society...
of perception seems to suggest the existence of a common cognitive system which treats all or most sensorily conveyed meanings in the same way. If all signs must also be objects of perception, there is every reason to believe that their modality will determine at least part of their nature. Thus, the sensory modalities will be visual, auditory
Hearing (sense)
Hearing is the ability to perceive sound by detecting vibrations through an organ such as the ear. It is one of the traditional five senses...
, tactile, olfactory, gustatory, kinesthetic, etc. A list of sign types would include: writing
Writing
Writing is the representation of language in a textual medium through the use of a set of signs or symbols . It is distinguished from illustration, such as cave drawing and painting, and non-symbolic preservation of language via non-textual media, such as magnetic tape audio.Writing most likely...
, symbol
Symbol
A symbol is something which represents an idea, a physical entity or a process but is distinct from it. The purpose of a symbol is to communicate meaning. For example, a red octagon may be a symbol for "STOP". On a map, a picture of a tent might represent a campsite. Numerals are symbols for...
, index
Index
Index may refer to:-Business:* Index , a defunct UK catalogue retailer formerly owned by the Littlewoods group and known as Littlewoods Index* INDEX, a market research fair in Lucknow, India* Index fund, a collective investment scheme...
, image
Image
An image is an artifact, for example a two-dimensional picture, that has a similar appearance to some subject—usually a physical object or a person.-Characteristics:...
, map
Map
A map is a visual representation of an area—a symbolic depiction highlighting relationships between elements of that space such as objects, regions, and themes....
, graph
Graphics
Graphics are visual presentations on some surface, such as a wall, canvas, computer screen, paper, or stone to brand, inform, illustrate, or entertain. Examples are photographs, drawings, Line Art, graphs, diagrams, typography, numbers, symbols, geometric designs, maps, engineering drawings,or...
, diagram
Diagram
A diagram is a two-dimensional geometric symbolic representation of information according to some visualization technique. Sometimes, the technique uses a three-dimensional visualization which is then projected onto the two-dimensional surface...
, etc. Some combinations of signs can be multi-modal, i.e. different types of signs grouped together for effect. But the distinction between a medium and a modality should be clarified:
- text is a medium for presenting the modality of natural language;
- image is both a medium and a modality;
- music is a modality for the auditory media.
So, the modality refers to a certain type of information and/or the representation format in which information is stored. The medium is the means whereby this information is delivered to the senses of the interpreter. Natural language is the primary modality, having many invariant properties across the auditory media as spoken language, the visual media as written language, the tactile media as Braille
Braille
The Braille system is a method that is widely used by blind people to read and write, and was the first digital form of writing.Braille was devised in 1825 by Louis Braille, a blind Frenchman. Each Braille character, or cell, is made up of six dot positions, arranged in a rectangle containing two...
, and kinetic media as sign language
Sign language
A sign language is a language which, instead of acoustically conveyed sound patterns, uses visually transmitted sign patterns to convey meaning—simultaneously combining hand shapes, orientation and movement of the hands, arms or body, and facial expressions to fluidly express a speaker's...
. When meaning is conveyed by spoken language, it is converted into sound waves broadcast by the speaker and received by another's ears. Yet this stimulus
Stimulus (physiology)
In physiology, a stimulus is a detectable change in the internal or external environment. The ability of an organism or organ to respond to external stimuli is called sensitivity....
cannot be divorced from the visual evidence of the speaker's manner and gestures, and the general awareness of the physical location and its possible connotative
Connotation (semiotics)
In semiotics, connotation arises when the denotative relationship between a signifier and its signified is inadequate to serve the needs of the community. A second level of meanings is termed connotative...
significance. Similarly, meaning that is contained in a visual form cannot be divorced from the iconicity
Iconicity
In functional-cognitive linguistics, as well as in semiotics, iconicity is the conceived similarity or analogy between the form of a sign and its meaning, as opposed to arbitrariness.Iconic principles:...
and implications of the form. If handwritten, is the writing neat or does it evidence emotion in its style. What type of paper is used, what colour ink, what kind of writing instrument: all such questions are relevant to an interpretation of the significance of what is represented. But images are distinguishable from natural language. For Roland Barthes
Roland Barthes
Roland Gérard Barthes was a French literary theorist, philosopher, critic, and semiotician. Barthes' ideas explored a diverse range of fields and he influenced the development of schools of theory including structuralism, semiotics, existentialism, social theory, Marxism, anthropology and...
(1915-80), language functions with relatively determinate meanings whereas images "say" nothing. Nevertheless, there is a rhetoric
Rhetoric
Rhetoric is the art of discourse, an art that aims to improve the facility of speakers or writers who attempt to inform, persuade, or motivate particular audiences in specific situations. As a subject of formal study and a productive civic practice, rhetoric has played a central role in the Western...
for arranging the parts which are to signify, and an emerging, if not yet generally accepted, syntax
Syntax
In linguistics, syntax is the study of the principles and rules for constructing phrases and sentences in natural languages....
that articulates their parts and binds them into an effective whole.