Video
Today, together with @kyutai_labs, we’re introducing our new Audio-to-MIDI model.
It takes a finished recording, identifies the instruments playing, and returns separate MIDI tracks for each — voice, drums, bass, keys, and more.
Unlike most existing solutions, our model works directly from the full mix rather than requiring separate stems.
It also detects chords, key, and tempo, giving producers broader musical context.
We’ve written more about the model, the problem, and how it works here: https://t.co/GvzH7hLjlg
