Show HN: I trained a 125M model to autocomplete piano on-device
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions…
We haven't written up this one. Hacker News Best has the full story — the link below goes straight to it.
