The Future of Education: Understanding Multimodal Learning from a Scientific Viewpoint

Did you know when it comes to processing audio/text input and visual input, the human brain works in different ways?  

Recent functional Magnetic Resonance Imaging (fMRI) studies have shown that there exists a dual coding system, where in separated channels, visual input and text/auditory input are processed. This presents us with the opportunity to augment learning.  

This also is in line with the postulation that individuals using a well-designed mix of text and visuals (multimodal design), learn more, compared to those who only use text. 

 

Understanding Multimodal Learning? 

Multimodal learning is about using multiple sensory channels to deliver knowledge for better learning. This may involve a blend of visual (videos and images), kinesthetic (physical activities and gestures), and auditory (music and lectures) modalities to meet the needs of varied learning preferences and styles. When multiple senses are engaged, learning can be enhanced with better engagement, understanding, and retention. 

 

Multimodal Design: A Mix of Visual & Verbal Learning 

Recent advances in the field of neuroscience have enabled us to analyze earlier theories in dual coding, cognitive overload, and multimedia learning. 

This field is relatively new, but studies have depicted that learning can be improved using a well-designed combination of verbal and visual modes. 

The majority of studies haven’t been of longer durations, but they have supported the principles of multimodal learning. However, when the principles were applied to a classroom setting, it led to mixed, but mainly positive outcomes.  

Many learning experts believe that the reason behind those mixed results was the absence of specificity in relation to the type of multimedia intervention. For instance, the studies have not provided detailed information related to the specific combinations of modalities, scaffolding of learners, formats within modalities, learner age, learner attributes, subject complexity, and the various learning goals, etc.  

Notable researchers, including Richard Mayer and Roxanne Moreno, have outlined a set of principles with respect to multimedia and modality: 

1. Multimedia Principle: In comparison to words alone, the combination of words and pictures works better in improving retention. 

2. Spatial Contiguity Principle: When related words and images are placed close to each other, it leads to better learning, compared to when both are placed far from each other on the page or screen. 

3. Temporal Contiguity Principle: When related words and pictures are displayed together, people learn better, compared to when they are presented in a successive manner. 

4. Coherence Principle: When unwanted words, pictures, and sounds are removed, individuals learn better, compared to when these are included. 

5. Modality Principle: Narration and animation result in better learning, compared to on-screen animation and text. 

6. Redundancy Principle: When information is represented via single modality, individuals learn better, since redundancy can possibly interfere with learning. 

7a. Individual Differences Principle: Design impacts are larger for low-knowledge learners, compared to high-knowledge learners. 

7b. Individual Differences Principle: Design impacts are larger for high-spatial learners, compared to low-spatial learners. 

8. Direct Manipulation Principle: With the increasing complexity of learning materials, their direct manipulation effect on transfer also increases.  

Practically, education scientists have seen mixed, but positive outcomes with multimedia design, when it is about augmenting learning. Generally, individuals who make use of multimodal design approaches for learning outperform those who learn using traditional unimodal approaches. 

 

Multimodal vs. Unimodal Learning  

For the comparison, let’s draw some conclusions from the results of several studies, distinguishing effects on learning in relation to basic and higher-order skills. 

 

Based on the image above, the findings are as follows: 

Quadrants I and II:  

• The average student’s score on basic skills assessments increased by 21 percentiles when engaged in non-interactive, multimodal learning (text with visuals, text with audio, watching and listening to animations or lectures that make use of visuals, etc.) versus conventional, unimodal learning. 

 

• When the situation changed from non-interactive to interactive, multimedia learning (modeling, engagement in simulations, and real-world circumstances), there were no major changes to the results, with an average gain of 9 percentiles. Despite not being significant, the results were still positive. 

 

Quadrants III and IV:  

• When the average student was engaged in higher-order thinking, with the use of multimedia in interactive situations, the student’s percentage ranking on higher-order or transfer skills increased by 32 percentile points, in comparison to what the average student would have achieved with the traditional unimodal approach.  

 

• When the context was shifted to non-interactive multimodal learning from interactive multimodal learning, the result diminished to some extent, but it was still significant at 20 percentile points, compared to conventional means. 

 

Final Thoughts 

The research suggests that multimodal learning is more effective than conventional, unimodal learning. In the case of basic or higher-order learning, learning can be improved substantially by adding visuals (video and images) to verbal (text and sound).  

The analysis above helps understand when interactivity can boost multimodal approach-based learning of moderate to complex subjects, or when it can be beneficial for people to work individually when learning basic skills.  

Ultimately, the most effective learning design is one that includes various levels of interactivity, combinations of modalities, learner attributes, a range of media, and pedagogy based on a specific situation. 

A video learning platform is an ideal choice if you want to take advantage of the multimodal learning approach through interactive video training. From educating students to training the workforce or customer base, a video eLearning platform with features like gamification and microlearning can make learning more engaging, fun, and rewarding. 

Try uQualio for Multimodal Learning