Multi-modal learning uses multiple representations and interactions for supporting learning. For example, mathematics can be taught by using number representations, symbols (Latin numbers), or objects (both physical and virtual). It has been shown that many students learn better by using multiple representations and interactions (seeing, talking, doing).
In this project we investigate whether tangible Augmented Reality (AR) can be used for learning data structures. Tangible AR combines real world objects with virtual augmentations. For example, students might use wooden blocks or coloured pieces as list elements and the program augments them with virtual information, e.g., links between elements.
The project continues a SEP4P from last year, which developed a prototype for teaching the linked list data structure. We will extend the current prototype to add more functionalities and learning tasks, investigate adding additional data structures, and perform an extensive user study with stage 1 students investigating the tool’s usability and effectiveness.
Undergraduate
Good self-learning abilities (get familiar with AR/VR authoring tools and libraries for object detection and tracking)
Interested in new technologies
Familiarity, or an interest in game development
Creativity
Proactive and able to work to deadlines (ethics deadlines, user study)
Graphics Lab (303S.595, Lab)