MagicBaton

A smart conducting baton that turns conducting gestures into live musical control. Dual IMUs stream 12-axis motion at ~50 Hz into a real-time edge compute pipeline: a gesture recognition model, jerk-based beat and BPM estimation, MIDI playback, and in-browser Magenta MusicRNN generation — so the baton doesn’t just follow tempo, it steers the music.

Along the way we collected a public dataset of ~934 recordings across eight gesture classes for training and evaluating gesture models.