Motion capture



A hand playing piano through motion capture
Performance captured by Vicon 6-camera passive motion capture system.

View of the motion capture room
Sample motion capture video: Piano performance. [.avi]
See Tactile feedback and timing accuracy in piano performance  [.pdf]
Music and speech require final temporal precision for the accurate communication of information. We track the development of temporal control in motor movements during performance. Motion capture systems are used to track anticipatory (planning) aspects of motor movements in music performance. These fine-grained measurements from tiny (3mm) unfettered markers on finger, hand, wrist and arm joints, combined with acoustic (sound) analyses and MIDI (musical instrument digital interface) music measurements, allow us to test the temporal relationship between anticipatory movements and memory retrieval mechanisms under natural performance conditions.

An active Certus motion capture system (below) allows us to capture fine-angle movements with markers attached to musicians' limbs and to their instrument. Two trackers capture the motion data, which is synchronized with sound recorded via a data acquisition unit. This system is used to measure the role of tactile and auditory feedback in sensorimotor integration.

 Two pianists wearing motion capture headsets and handsets  Motion captured hand playing piano

Back to top