Scientists at the Interdisciplinary Centre for Scientific Research in Music are working on Music via Motion, a system that captures human movement in 3D via infra-red light and transforms it into music.
The infra-red light is projected onto reflective balls attached to clothing and monitored by 12 cameras. The computer recognises the changing positions of the balls and turns different gestures into instructions for music software.
The team, led by Dr Kia Ng, hopes that Music via Motion could widen participation of music making and provide alternative routes to musical creativity for many people, including those unable to play conventional instruments because of physical constraints.
From BBC news.