Multimodal communication

People can combine modes or change modes by context

The ASHA AAC Practice Portal says an AAC system can include existing speech, vocalizations, gestures, and an external system. It describes flexible use of multiple forms based on context, audience, and communicative intent.

Examples include:

• pointing to an AAC symbol while vocalizing
• speaking part of a message and typing the rest
• signing with a familiar partner and using a speech-generating device with someone who does not know the signs
• using eye gaze to choose between two written options
• handing over an object, then using gesture or AAC to clarify the message
• reading a written direction and answering through speech, sign, writing, or AAC

Several modes can appear in one message. A person may also choose one mode at home, another at school, and a faster low-tech backup outdoors. The choice can change during the day as motor access, sensory load, fatigue, pain, privacy, technology, or listener knowledge changes.

Each mode brings different access demands

No single mode is universally fastest, clearest, or most independent. Independence can include self-directed use of equipment, a trained access partner, or an interpreter while preserving the person's authorship and choices.

Multimodal support includes understanding and expression

A person may receive language through speech, sign, text, pictures, demonstration, tactile information, or another accessible form. They may answer through a different mode. Match the input route and response route separately.

The ASHA autism portal recommends assessing verbal and nonverbal expressive means for function and intent and notes that speech difficulty differs from language and social communication. A person who cannot produce clear speech may understand complex language and express it through another route.

Avoid making eye contact, spoken repetition, pointing, or one motor response a universal proof of understanding. Use accessible choices, meaningful tasks, dynamic assessment, and several data sources. Confirm hearing, vision, motor, sensory, language, literacy, and AAC conditions that affect performance.

Total Communication is a related term with a specific history

ASHA's languages and communication systems resource for deaf and hard-of-hearing children describes Total Communication as an approach that may combine signed and spoken languages, amplification, Manually Coded English, Cued Speech, fingerspelling, gesture, body language, facial expression, and AAC. It also says implementation varies and need not use every mode at every moment.

Total Communication and multimodal communication can overlap. The first may name a program philosophy, while the second can simply describe a person's use of several modes. Simultaneous communication, such as speaking and signing at the same time, is another distinct term. Ask which languages, tools, people, and practices the plan actually includes.

A mode map makes support practical

For each important message or routine, record:

1. the person's current and preferred modes
2. receptive input that is accessible in that context
3. equipment, positioning, vocabulary, interpretation, and partner knowledge
4. a backup when the primary route fails
5. how the person confirms, corrects, refuses, pauses, or changes mode
6. privacy, effort, response time, and safety limits
7. the partner's expected acknowledgment or action

The NJC AAC resource calls AAC multimodal and gives examples of people using signs with one partner and a picture system or speech-generating device with another. A mode map should remain flexible as needs and preferences change.

Keep every reliable mode while expanding options. Avoid fading AAC merely because speech emerges, withholding a device to encourage another response, or correcting a harmless mode for appearance. Communication, basic needs, pain care, movement, relationships, and safety remain available regardless of the mode used.

Families can ask whether every setting is prepared

Ask the team:

• Which messages and modes does the person use now, and what do they prefer?
• Who understands each gesture, sign, vocalization, symbol, or typed message?
• Which input modes support understanding at home, school, clinic, community, telehealth, and medical visits?
• What equipment, interpreter, communication partner, vocabulary, positioning, or wait time does each context require?
• Which backup works during charging, repair, travel, water activities, fatigue, or emergency response?
• How will partners respond to dissent, uncertainty, mode changes, and breakdown repairs?
• How will the team measure access and partner response alongside the person's communication?

A speech-language pathologist with relevant expertise can assess language, communication, and AAC within scope. Deaf and hard-of-hearing, vision, occupational, physical, education, and assistive-technology professionals may contribute. A behavior analyst can support observable, meaningful goals and partner practices within competence while coordinating with the communication lead.

A fictional example shows why one rate is insufficient

Mateo is a fictional ten-year-old who uses speech, gesture, writing, and AAC. Across ten planned community routines, at least one chosen expressive mode and one accessible input route are ready at the first check in 8 of 10 routines, or 80%. One routine lacks the AAC backup, and another lacks written directions. Both stay recorded as system gaps.

During the eight access-ready routines, observers record 16 defined opportunities to ask, comment, refuse, clarify, or repair. Mateo communicates a recognizable message through any agreed mode in 12 of 16 opportunities, or 75%. Partners acknowledge the message or explain next steps within a fictional 15-second window for 11 of 12 messages, or 91.7%. Four no-message opportunities sit outside that conditional partner-response denominator.

Mateo uses three modes across the 12 messages and rates six routines workable and two tiring. These small fictional counts have no baseline or comparator. They describe access, mode variety, communication, partner response, and experience without showing a treatment effect.

Measures should preserve modes and context

Useful measures include access-ready routines; messages by purpose and mode; independently authored messages divided by defined opportunities; partner responses divided by emitted messages; repairs; mode changes; latency and effort; backup use; access failures; and the person's rating. Define each event, denominator, window, setting, inclusion rule, and observer procedure.

Report mode patterns without ranking speech above AAC, sign, writing, or gesture. Examine listener knowledge, input access, environment, health, technology, and the person's preferences before treating a change in mode as progress or loss.