munch-o-man

I like the technical fun of it, but no musician is ever going to give a crap about this. We have hundreds of years of the evolution of music notation and it is pretty comprehensive. Just because there are only 12 unique notes in western music doesn't mean base-12 to notate it makes sense....that completely strips out context of what you are playing.

For example...in the key of aminor when you make the five chord major to create a resolution back to i (aminor) you raise the 7th scale degree. That means the G becomes G#...Ab is the same pitch but writing it that way is wrong. An EMajor chord is spelled E G# B, not E Ab B. Now if you spell that as 9 0 4 you have stripped all context out of the music. Musicians aren't just player pianos, they analyze the harmonic structure of the music the inform phrasing, shape, tone, volume, and pacing (acelarando, decelerando, ritardando, etc).

Whenever I see something like this trying to reinvent standard notation I feel like it is usually from somebody who can kind of play an instrument but can't read music or can't read it well because they haven't put the years of work it takes to be a proficient sight reader and they haven't studied harmony/music-theory.

One of the most important things about musical standard notation is that it is - standard - you can hand it to any musician on any instrument and they can make sense of it quickly. It is a skill that takes a lot of practice but it is what allows musicians who have never met each other to be hired for a gig and show up and play together without ever rehearsing.

This approach won't teach you to "see" music either. It forces pure mechanical number memory....you won't see harmony and be able to quickly notice that - for example - a line is just moving the chord up in inversions and since you know harmony and your chords you can sight read that part without ever even reading every individual note.

But still a cool idea from a hobby perspective.

why would you want to double the commute miles you put on your car for no added convenience to yourself?

cool man. I only took a quick look but one question I had was if this runs as a service - since you say to point clients at it - then would it not make more sense to cache on the node the client is talking to s3-accelerator on since that is the first hop? Genuinely curious. I've been working on my own s3/blob project for the past year but it's purpose is a bit different than yours but does involve caching for reads and I'm just curious if you had a reason for that decision that I hadn't considered and might change how I view my own project https://github.com/afreidah/s3-orchestrator (we are both so creative at naming lol). Threw a star on yours so I remember to go back and look at it in more detail later.

what could you possibly need 219 built-in tools for and why would I want to watch it move my mouse? Seems like if I'm sitting there watching it I could just move it myself. Where is the code? the github is just sales pitch that eventually admits it is just a wrapper around claude/whatever.

Nobody here is going to run this blackbox-with-a-sales-pitch that - hilariously - STILL doesn't say what this thing supposedly does in any meaningful way that implies it's creator had any understanding what they were creating. Your demo video is a hilarious context-free explosion of chinese and then seemingly just scrolling the README in the github repo with no code in it that you linked.

To top off the audacity of your blackbox that requires access to every aspect of the computer to do [stuff]....you actually are trying to charge money for it. You are an anonymous blackbox wanting access to every part of my computer and I still have to bring my own agent that I pay for to do all the work on top of paying for your ransomware. What exactly are you offering other than moving my mouse and trying to steal my identity?

If you want an evaluation then post the code.

been putting a lot of work into this since last time I shared it...a LOT has changed and improved. Have picked up some users and contributors, been finding and fixing bugs while improving/expanding functionality.

Great for homelabbers who want to take all the always-free tier s3/blob allotments and combine them together and lock them to the free tier quota to make sure you never incur costs. The compression also helps get as much as possible for free.

Great for zero-downtime cloud migrations.

Great to ensure data exists in multiple clouds when written with no complex scheduled tooling shit.

Pair a cloud backend with your local minio/seaweedfs/whatever and set replication factor to 2. Every object will instantly live in the cloud and on your local minio....if you local minio goes down applications will keep working because s3-orchestrator will fail over the reads to the cloud backend...when minio comes back it will make sure all data matches replication factor.

Would love more people to try using it and see what doesn't work or isn't ideal so I can continue improving it....my own use cases aren't going to expose to me everything somebody else might use it for. Also gh issues and PRs are very very welcome...just want to keep improving it.

Just point your applications/clients at s3-orchestrator instead of directly at a real s3 backend...clients don't have to know anything about s3-orchestrator or how it is actually managing the data.

Also, I setup a slightly better auth system for it recently and built a terraform/opentofu provider for handling users/virtual-buckets/permissions published to both public registries.

It also includes a little cloudflare worker that can be utilized to further eliminate costs for backends that are part of the cloudflare data alliance and egress on them routed through cloudflare is free.

shitty project webiste: https://s3-orchestrator.munchbox.cc

cool man, nice. Question, if I'm already doing alloy/tempo/prometheus/grafana does this give me something I'm missing? I don't mean that in a condescending way that a lot of people in forums say like "why would you build this when xyz already exists" as if "for fun" and "to learn" aren't good enough reasons haha. I'm just curious before I dig too deeply into it because I'm pretty busy if there is anything of note that lets this do something that the prometheus-metrics/grafana stack doesn't or doesn't do well. Thanks man!

I'm probably in the minority here, I don't know, but while I haven't dug deeply into the code I'd immediately say throw some comments in dude, at least above functions and shit....for me comments aren't just about what they say, they create a visual breakup of the page which makes it easier to reason about where blocks of functionality begin/end. When you have shitty eyes like me and you have been staring at a screen all day, a wall of code with no comments breaking up the functions/methods starts to blur and is sometimes hard to tell the horizontal alignment at quick glance and differentiate blocks that are full functions and blocks that are large blocks within a function.

Thats just me though...it is more about visual appearance and helping me quickly see the logical breakdown/structure of a file so I can get to the code I want quicker.

I'll try to read through it later, but props to anybody building a project in C...I need to come up with a new pet project in C because I'm so rusty I don't think I've written C in like 7+ years.

probably because he wanted to have fun with the challenge and learn a bit more about package management in the process so he is a more knowledgeable engineer and is trying to keep their C skills sharp...I know mine are shit now because I never have the ability to write C at work so unless I come up with a pet project like this one by this person I end up really badly out of practice and rusty (not a rust pun haha).

how in god's name did you blow your quota in 10 minutes?!?! Are you just queuing up a dozen agents at once to have a "team", putting them all on highest effort, and then letting them run hog wild without having you review each change it wants to make and accept it first?

I must be using claude wrong....I never run out of quota.

I'm genuinely curious what you are doing that would eat your quota that fast because that sounds legitimately insane.

you switch to a different chatbot's free tier /s

how do you make decisions on harmony generation? I mean, no offense, but if your girlfriend wants to create music but can't do more than "create an upbeat song in the style of lil wayne" it would be like me saying "make me sushi in the style of Sugarfish" if I don't know anything about anything about fish, sushi, food preparation, or have any kitchen tools. I should probably just order Sugarfish. What would she be using these AI songs for in the first place?

Then you take it to the next level of insanity with "fast mode"...because creating one song without any knowledge of music is too slow...I need five songs that have no creativity or understanding put into them.

I mean, sort of what is the point of this...I mean this in the nicest way possible? It has no use to somebody who actually understands music and harmony, it has no use to somebody who is talented at poety/lyric writing, it employs no musicians, and deep down if you did "create" a song with this...would you really call it "yours" if you have no idea how it was created or any understanding of it?

There is no understanding of music here, there is just a chatbot that apes existing media as far as I can tell.

also, "weirdness" is definitely not a 'professional' term...in music or any other field. In all my years at music conservatory and gigging professionally nobody ever told me to put 'weirdness' on anything...and if they did, that would be communication between real human musicians that know each other and how each other play basically saying "he dude, go hog wild for a bit and make some noise or something"...to non musicians "weird" can mean something a simple as "minor key arpeggios" because they sound 'creepy'....weirdness could mean totally normal harmony but with a harpsichord or organ sound because to a pop music listener that might sound "weird" but has nothing to do with the harmony.

It would be like saying "build me a web app that does cool web stuff"....doesn't mean literally anything.

is there such thing as 'un-editable midi'? You input midi and it outputs transformed midi.

I really hope you didn't just build a generic web frontend that pipes a midi file into an llm with "criteria" like 'make it cinematic' and it generates a new midi file and you think that is worth $150.

who is the target user for this?

I just want to add that I apologize for coming off harsh....there is almost zero music composition software that can do what you are advertising here and not be complete shit at it. It isn't a dig on you. It is just that people think music analysis is a LOT simpler than it actually is and that harmonic analysis is super easy and obvious and we all just took year years of music theory at a 4 year music conservatory because counting to 12 is hard. If you don't get the counting to 12 joke it just proves my point.

Having said that, I'd love to help hack on some music software so if you aren't just trying to get easy money on blackbox software and actually care about music and software hit me up on discord: afreidah.

but seriously, if you want people to take a look post a github and write software we can run ourselves after clone. If I have to create some third party account so some dickhole has my info and then have to push my data (music) through their servers I honestly have very little interest because there is absolutely no reason why the software you described should be a fucking saas service instead of something I can run locally unless your motives have less to do with functionality and more to do with something else...

I love music and software, hit me up if you need/want help on the software or the music side.

no offense, because I'm very interested in learning more about this since I am a software engineer who's degree is from a music conservatory and has nothing to do with software. BUT....nobody knows who you are or what this does, literally nobody is going to pay you money for an ambiguous black box that theoretically knows how to do music arrangements (how do we know it even does that? What logic does it use for arrangements? Are different orchestral/symphonic instruments correctly gated on their performance range and limitation of execution? How does it handle harmony? What do I get back? 4 part harmony? Is it going to sound like Johann Fux species counterpoint or is it capable of non-rule-based harmonic decisions? Is it going to just shit out stupid atonal shit that isn't creative or useful and only survives because it is "supposed" to sound like shit? When in reality Schoenberg and Berg could get away with it, most composers can't. Does it understand diads, triads, and extended harmony (7th, 9th, 11th, 13th chords and why you would notate one as such)....and since I always check this on music software (and it is almost 100% always wrong) and can't since you didn't share code here....does this shit understand enharmonic equivalents and why a c#m chord is spelled c# e g# and why even though it sounds the same it would be stunningly wrong to write it as db e ab?

Am I wrong is thinking that what you are creating is essentially a way to hand the computer a leadsheet and get back a complete notated arrangement for a given set of instruments?

If I am reading your description correctly, this honestly has very little to do with midi and is entirely a project about doing arrangements of an input piece and it starting and getting rendered back out as midi is irrelevant. You advertise doing harmonic analysis and without being able to see the rules/logic you use to accomplish that I can't really say if this is useful....it could be anything from some crap that makes everything a I IV V church-song progression to doing schenkerian analysis of the harmonies, progressions, and larger over-arching tonal progression. Nobody is going to pay you $150 for software that they can't even verify how it works when you are dealing with such a niche target audience (assuming you mean actual composers and not just minor arpeggios with the harpsichord effect and a drum beat lol.

Just so people reading this can get a better idea of what you are trying to advertise sell....what happens if I give it one hand of a simple Bach invention? What if I hack through a chord-melody version of 'Yesterdays' by Jerome Kern? Can it orchestrate me a big band version based on my right hand hacking out the melody and my left hand hacking out the i-ii-V-i and II-V-I cycles?

I apologize for being a bit harsh and hitting on a lot of shit....but when people post a webpage front for a blackbox application with a signup and payment plan and don't even share the code I assume they aren't in it for the 'hacking' and the 'show' and more in it for the 'pay me' and the 'now' and that the software will generally be shit.

but in all seriousness, if you say something as complex as that it analyzes harmony and harmonic structure and then orchestrates/scores it you need to give proof of how and what rules it is using and how I can explain to it that I want it to sound like baroque 4th species counterpoint or I want it to sound like (mostly ewww) 12 tone music like schoenberg, or if I want it orchestrated in a Classical/Romantic period style (even that is generous as if they are the same and Brahms and Chopin and Haydn sound the same)or perhaps a jazz style.......point being, you provided no code, no breakdown of how something as complicated as harmonic arrangement and orchestration (both harmonic and instrumental) is implemented and what sort of results one should expect.

If it is just a fun project then that is totally fucking awesome and I'd love to see it and help if I could...but then you shouldn't be hiding the code and thinking somebody is going to pay you $150 which is absolutely not going to happen for a black box claiming to do something more complex than I think most people here understand.

As somebody with a very high level education in music who has been doing software engineering for almost two decades and has thought about shit like this at great length.....I doubt you have created something useful to a real musician....if I am wrong, which I would love to be....then please tell me you have gotten actually trained musicians that are professionals (your friend that is 'really good at guitar' but can't read music and has never played publicly with other musicians doesn't count) or that you are a trained musician yourself and actually understand how this works. If you don't know what a Neapolitan chord is or what that roman numeral shit I typed was or the chord spelling shit I typed was then hit me up....I can help.

the first thing you made - as a non-engineer - is a monetized gambling app? ok. I see no issues with this.

yeah but that analogy is sort of false. A better analogy...but then it would make you look absurd...would be "if you don't know how to take apart and re-assemble the engine of a vehicle you shouldn't be allowed to drive it on the road". You get a driver's license if you can remember a few common sense facts and spend a bit of monitored time behind the wheel without doing anything absurdly illegal or injuring/killing somebody

because claude wasn't using enough data center resources we need to give him additional servers in data centers on demand?

why would I need to sign up for something I self host?

how is this any different than the real time stock prices I can get online anyways? I can already ask an agent to analyze stuff for a stock. I'm confused what this offers that is worth paying for. I am also very suspicious of any AI project involving money where all that is posted is a website where I can sign up but no code is shared.

this looks very interesting...I'm gonna give it a test drive later. Threw a star on the repo so I won't forget to come back to it.

at least you didn't put your ticker at seizure-speed like the other post that looks just like this.

I just don't understand the concept of a social network for computer bots...like...is the goal to just use up as much electricity as possible for a product that isn't for people and has no value to advertisers and generates nothing of value? Why would non-real things need to socialize? They aren't people...people need to socialize....computers are just fancy counting machines...they don't have social lives or the concept of social lives. Like, this sounds like a fun high school science experiment if it was run on a small scale but in reality there is no point in something like this existing and I have yet to see anyone explain to me why it should despite having seen posts about social media for ai bots countless times.

Not trying to knock your work, although you didn't even bother to post a description of what you did or why and your only link is to a product site that is painful to the eyes and feels like watching an Indian news station, and you didn't link any code, so I am inclined to believe you are just spamming some crappy ai product that is just super gluing other people's products together haphazardly. Seriously that scrolling ticker on the page makes me want to vomit and have a seizure....it is more visually assaulting than the illegal streaming site I used to watch blacked out dodgers games last year that was covered in communist dating site ads and russian sports betting ads and was hosted in tehran. Ask your bots if they can design a website that doesn't look like a seizure-inducing virus factory.

Prove me wrong, tell us about your project and what issues you ran into and decisions you made. Maybe you actually did something really cool and I just can't tell because your website has temporarily blinded me and left me foaming at the mouth.

seems pretty interesting. So is this meant for actual container/workload orchestration or just monitoring/managing what is already running? Trying to figure out how this compares to something like Nomad.

this is pretty neat. I often toy with making music related shit...I love music theory...went to a music conservatory and then accidentally ended up in software years later...simple ear training is a skill that especially guitar players lack and having an easy way to drill yourself in private is great!

FYI when I went through the third cycle of it, it got stuck cycling through keys but repeating the major arpeggio followed by the note to identify being the ii pattern probably 4 times. Not sure if that was random chance or an actual issue...but very cool. Where is the code? I'd love to star it so that I remember to keep an eye on it..or even drill myself every now and then haha.

This probably won't mean much to a lot of people here, especially since there is sort of an assumed level of understanding going in (scale degrees, roman numeral chord notation with uppercase for major and lowercase for minor, or what a cadence is or what those different types of cadences are) but for those of us that went to music school...especially those who hadn't had a traditional music education from an early age with ear training...definitely would have actually drilled myself with this.

how does it compare to lynx and links2?

I think I saw this on reddit earlier. Looks neat...I starred your repo on github so I can remember to check it out later when I have time.

I mean...it works just fine without internet...host your own registry...or just build your own from Dockerfiles locally. Not saying it is the right use case for everything but I'm confused what you mean by docker doesn't work without the internet. Neither does pip, rubygems, apt, etc...unless you build locally or host your own repository. Can you elaborate on what exactly you mean because you probably have a point that I am just missing.

author here: I've been running this in my homelab nomad/consul/vault cluster for a while now and it has been working great. My temporal job that does nightly backups of nomad/consul/vault/postgres now has an extra step to push to s3-orchestrator too and if it gets an error that no backend has available space it will delete the oldest backup of that type and then try again. Right now I have it doing "spread" routing between OCI and Cloudflare s3-compatible storage because they offer the best always-free s3 storage and I was already using cloudflare and running four nomad clients on oracle cloud connected to my cluster via wireguard (I would never give oracle a cent of my money but when they are offering 26gb of compute in always-free tier I'll take every bit of it thanks).

The coolest way to test this out is to just clone it and then run either:

make nomad-demo

make kubernetes-demo

that will spin up the docker-compose crap used for integration testing (two minio instances and a postgres) then start kubernetes via k3d or nomad via -dev mode, build the docker image, ingest it, run it, and print out a handy list of urls for different dashboards/metrics/ui/etc. The grafana dashboard in the repo is automatically ingested by grafana in the two "-demo" modes so you can literally run one command to run it and immediately play with the ui, see visualizations of the metrics, and start playing with it in a safe sandboxed environment.

For people that aren't just trying to get as much free storage as possible the storage and api/ingress/egress quotas can still be super useful in cost management since you can cap yourself.

The other cool use is if you needed data replicated across two different clouds for [reasons] this will do all that work for you if you set a replication factor and your application doesn't have to know anything about it...just point it at this instead of the actual s3 backend.

Also the ability to drain a backend could be super useful if you are trying to get off a certain cloud without taking downtime.

This is engineered to be highly durable...instead of failing it degrades and returns to healthy when conditions improve and the postgres is back...and it stops all writes when postgres is down since no usage would be tracked.

also, if you have an existing bucket that you want to bring under management by the s3-orchestrator it has sync functionality...the only thing it can't import is the monthly api-calls/ingress/egress from before the sync.

I'm open to all advice and comments. Pretty nervous sharing this.