What would you say is a good model for audio to midi transcription?
47 karma · joined January 25, 2019
Since I worked on it on and off, and also did a bunch other related things I'm not sure, but I would be surprised if I spend any less than 1000+ hours on these silly word-games.
Finding solutions for big squares/wordlists in reasonable time is actually not a trivial algorithmic problem. Neither is making good wordlists, I ended up creating what is essentially a Dutch version of the Pile[3] just to collect words. Good fun.
[1] https://old.reddit.com/r/thenetherlands/comments/zgr61e/ik_h... [2] https://i.redd.it/a61yuistbkm61.png [3] http://gigacorpus.nl/
Jufs BMX: hypervlot c.q. zwak ding
- Gradient checkpointing and 2048 batch size in a single go allows ~10% performance improvement on a per sample basis.
- torch.compile doesn't work for me yet (lowest cuda version I got my 4090 to run on was 11.8 but highest cuda version on which I got the model to compile is 11.7).
- I did the optimalisations in https://arxiv.org/abs/2212.14034
I basically throw away everything in the generated .ly files except the notes. But saves a lot of effort regardless.
I never found a a Lilypond -> Musescore conversion that worked really well. I did write a very simply tool based on python-ly to at least get the 'notes' to musicxml so that I can import something into Musescore.
Wang's carpets is a short story about life evolving within a simulation of a naturally occurring computer. (also part of the larger novel Diaspora)
Schild's Ladder is about physicists researching the fundamental 'geometry' of the universe and accidentally create a quickly expanding geometry that is more stable than a regular vaccuum, very unhealthy for all regular matter, but...
Edit: Didn't see the url, makes my old reply obsolete:
Interesting. I tried to avoid clipping/aliasing by using audacity with as high quality audio as my system allows and I can still reproduce pretty much exactly what you hear on those websites. https://vocaroo.com/i/s0Be5CexLgVs is 440hz, then 440hz+880hz, then 440hz+850hz. But I would be interested in any repeatable signal that does not harmonize at all so do share!
And https://musescore.com/groups/counterpoint-and-fugue is one of those well hidden small internet communities centered around contrapuntal writing with many knowledgeable members, original music and in depth essays about contrapuntal details.
Now the overtone series IS important and is not always 'simple ratios', a good example in a real instrument is the strong minor third overtone of a carillon, and as expected writing in major for that instrument is hard.
He trained an NN to predict the pieces and then used Stockfish on the resulting position.
There's a fairly finite set of letters that you might want to enumerate based on both your initial 'seed' text and the letters that are in the numbers especially if you consider 'one [a-z]' as seed text. That is to say, the amount of sets of letters that have different sets of numbers that you can spell with them is small.
If you know what letters you have to write and you know all of those must have 2 or more instances you can add the "'s"'s and single instances of those letters to the seed text. At that point you just need to worry about selecting numbers that including their own letter counts sum to the seed text constant. This can be easily expressed in an ILP.
The ILP will define a 26 boolean array for each possible number we can spell representing whether that number is the count of that letter. We add a constraint that the sum of all active numbers on a given letter == 1. Next we simply add constraints that sum all active numbers their lettercounts to the known constants from the seed text.
But as it turns out that is overkill, a more traditional and flexible solution would involve a tree search that keeps track of the lower and upper bounds of lettercounts and picks number words within those bounds without associating it with a specific letter yet. And you associate at the end. Runtime is a 15 minutes in python for most numeric bases/seed texts/variations.