Show HN: Public Muscriptor Instance (latest, most powerful Audio-to-MIDI model) | Hacker News Reader

Show HN: Public Muscriptor Instance (latest, most powerful Audio-to-MIDI model)

pianoify.net

58 pointsjardy13 comments

GPU powered models to convert any song to piano

https://kyutai.org/blog/2026-07-10-muscriptor/ says We're releasing MuScriptor, the best open model for multi-instrument transcription to date, created in collaboration with Mirelo. Give it a recording: pop, classical, metal, jazz, whatever, and it transcribes the notes played by every instrument into MIDI, without needing to know in advance what instruments are present.

Woah, that's much more interesting, as it seems to handle more than just the lead instrument/piano, as this Show HN does. Thanks for sharing that, very useful!

I wonder what the intent is behind releasing the weights under a CC-BY-NC license. Is it about restricting any commercial use of the weights, including for inference?

absolutely - thanks for the reference.

Wow, this works way better than I expected. Fed it "Shimmer and Out" by Lotus, the intro of which is just a pretty simple guitar riff based around triad shapes - but it's the kind of thing I've seen Chordify just mangle. This produced a transcription that sounds 1:1 to my ear.

Could totally see myself using this as part of the tools I use to learn music - and I could also see someone eating Chordify's lunch by hooking up a model like this and doing note-level theory analysis in addition to whatever spectral analysis model they're using.

ah, thanks mate. this isn't even their most powerful model - i'd recommend using the Mirelo API to access their most powerful variant or self-host on a GPU.

source code: https://github.com/jerryzhou196/pianoify

Nice!

I'm not sure I get it. This looks like a worse repackage of muscriptor but with a 10s limit, making it useless.

you're not wrong. the main problem is the public instance of muscriptor (https://muscriptor.kyutai.org/) is poorly handled in terms of backend infrastructure, and i often run into errors and rate-limiting. this is just a more niche version of it on my own GPU so the public can use it more.

Wow! Perfectly did the whole intro of 'In the end'!

niceee

Claude told me all the stuff to rip out and replace with FOSS. Should have been done that way in the first place, but you can't blame a guy for trying to make money these days. Except Trump...

Reply on news.ycombinator.com