EyeLa is an accessible digital musical instrument (DMI) augmented reality (AR) app, designed for the musical engagement of children with multiple disabilities. It makes available head and eye movements as alternative input methods that are more intuitive and better aligned with natural body movements, empowering children with limited mobility to actively participate in music-making. EyeLa has also been made available as a rhythm game, lowering barriers to musical participation through game-based interaction that is accessible, motivating, and inclusive. A detailed documentation can be found here.

A series of web apps that allows users to trigger musical events using hand gestures and movements through a webcam. These include Shakra (rising fingers up and down to play instrumental notes), Gestura (triggering corresponding solfège syllables through Kodály gestures), and Malmesbury Swaps (a mixture of hand gestures and movements co-designed with children).

A VR game designed as an interactive, walk-in activity within an exhibition space. Players wave their hands to catch flying birds which together trigger a melody to play.

HandI is a motion-based digital musical instrument (DMI) app. Instead of relying on users’ direct-touch finger input as in ordinary mobile apps, this app makes use of the orientation of the smartphone as the input control for musical expression.

Designed for the rehabilitation training of the elderly and people with disabilities, this VR game provides a simulated learning environment for players to develop their motor, cognitive and life skills as well as express through artmaking within the playful experience.