plnech/leapmidi

LEAPMidi

LEAPMidi

A LEAPMotion -> MIDI Instrument controller

LeapMIDI is a Javascript WebApp that reads your LeapMotion sensor data, transforms them into MIDi ControlChange messages, and sends them to your computer's Midi Through interface to control the instruments you connect to it.

In this proof-of-concept, LeapMidi is used to control ParVagues' track Du Miel's instruments and effects: the CC messages are sent to TidalCycles and SuperCollider to control the music.

Example setup: Left a TidalCycles track, top right LeapMIDI tracking X/Y/Z positions of fingers, normalizing them as 0-127 CC values, and sending them via WebMIDI to SuperCollider via MidiThrough to control the track's instruments and effects. LeapMotion Visualizer bottom right debugs sensor data.

Usage

0. Setup LeapMotion to send messages readable by the SDKs, in a place where it sees your hands
1. Connect your Midi instrument to the MIDI Through port
2. open index.html in your WebMidi-enabled browser
3. Run TidalCycles with ParVagues' Du Miel track or adapt the code to map to another use-case
4. ???
5. Profit!

Demo

In this demo, the left hand controls effects (left thumb -> global filter, left index -> bass distortion, etc) while the right hand controls individual instruments' volume.

Thanks

• TidalCycles for these mind-blowing possibilities of musical livecoding
• WebMIDI for the powerful API and detailed documentation 👏
• LeapJS for the easy setup and great examples