I made something very similar to this last year, its really odd and inspiring to play with a live implementation of this sort of thing. Combining different elements of our senses to create or manipulate something otherwise completely unrelated is just fascinating.
Permalink: http://createdigitalmusic.com/2009/09/08/paper-drawing-as-musical-controller-a-round-up/