Inclusive Computer Programming Education for the Visually Impaired
Uses tangible, physical blocks to represent different code constructs, providing a hands-on approach that makes programming more accessible to a visually impaired audience. Provides real-time feedback, allowing for immediate guidance and enhancing the learning experience. Scalable and can accommodate a wide range of programming tasks.
Highlights
- Uses tangible, physical blocks to represent different code constructs, providing a hands-on approach that makes programming more accessible to a visually impaired audience.
- Provides real-time feedback, allowing for immediate guidance and enhancing the learning experience. Scalable and can accommodate a wide range of programming tasks.
Opportunity
A research team from the University of Alberta has developed a system designed for teaching computer programming to visually impaired individuals, including children. The system includes tangible, physical blocks, with each block representing a unique code construct. Users are given programming tasks that take the form of missions, which are based on real-life situations familiar to them. These tasks are communicated through AI-powered audio prompts, and users are guided to arrange the blocks to execute the task. Once the blocks are arranged, they are captured in an image and identified in real-time using an integrated computer vision object detection algorithm. The system then analyzes this image to ascertain whether the user has correctly completed the task. Based on this analysis, the system provides immediate feedback and/or guidance to the user through audio prompts. The system not only makes learning programming more engaging but also more accessible for visually impaired individuals.
Competitive advantage
- Designed specifically for visually impaired individuals, thereby opening up the world of computer programming to a group that has traditionally been underserved.
- Integration of real-time computer vision object detection and image analysis enables the provision of immediate feedback and guidance, thus enhancing the learning process.
Status
- Patent Pending
About University of Alberta
The University of Alberta is a large, comprehensive public research university in Edmonton with multiple campuses and a strong applied research culture. Industry engages through co-located labs and pilot-scale facilities, as well as established co-op and internship programs that place talent with partners year-round. Integration with Alberta’s province-wide hospital system supports clinical research and accelerates translation. Companies also benefit from proximity to regional industry clusters and collaboration hubs on and near campus for joint R&D and prototyping. Supported by NSERC, CIHR, SSHRC, and Canada Foundation for Innovation funding—plus provincial and industry support—the tech transfer office manages IP, licensing, and startup formation with streamlined sponsored-research agreements.
delivered to your inbox.