Detection and Tracking of Pianist Hands and Fingers

  1. (PDF, 778 KB)
AuthorSearch for: ; Search for:
ConferenceThird Canadian Conference on Computer and Robot Vision (CRV 2006), June 7-9, 2006., Québec, Québec, Canada
AbstractCurrent MIDI recording and transmitting technology allows teachers to teach piano playing remotely (or off-line): a teacher plays a MIDI-keyboard at one place and a student observes the played piano keys on another MIDI-keyboard at another place. What this technology does not allow is to see how the piano keys are played, namely: which hand and finger was used to play a key. In this paper we present a video recognition tool that makes it possible to provide this information. A video-camera is mounted on top of the piano keyboard and video recognition techniques are then used to calibrate piano image with MIDI sound, then to detect and track pianist hands and then to annotate the fingers that play the piano. The result of the obtained video annotation of piano playing can then be shown on a computer screen for further perusal by a piano teacher or a student.
Publication date
AffiliationNRC Institute for Information Technology; National Research Council Canada
Peer reviewedNo
NRC number48492
NPARC number8913712
Export citationExport as RIS
Report a correctionReport a correction
Record identifier5b4457f1-58fb-4290-9fe9-8d38075a2920
Record created2009-04-22
Record modified2016-05-09
Bookmark and share
  • Share this page with Facebook (Opens in a new window)
  • Share this page with Twitter (Opens in a new window)
  • Share this page with Google+ (Opens in a new window)
  • Share this page with Delicious (Opens in a new window)
Date modified: