Comment by Rodeoclash | Hacker News Reader

Comment by Rodeoclash | Hacker News Reader

Parent Full thread

As a musician, the things I want most from generative AI is:

1. Being able to have the AI fill in a track in the song, but use the whole song as input to figure out what to generate. Ideally for drums this would be a combination of individual drum hits, effects and midi so I'm able to tweak it after generation. If it used the Ableton effects and drum rack then that would be perfect.

2. Take my singing and make it both sound great and like any combination of great singers (e.g. give me a bit of Taylor Swift combined with Cat Power)

I've had a play with the style transfer between singers (bullet point 2 above) but when I last tried it, it was garbage in / garbage out, and my singing is garbage.

What I don't want: To just generate a whole song. Adobe does this style of assistive AI well in the photo editing space but no one seems to have brought it to audio yet.

Exactly. I don’t want AI to make me a song. I want it to switch up my baseline or chords or recommend a fill instrument.

Logic Pro comes the closest to this with the addition of virtual drummers. You can assign it to follow certain rhythmic timings by connecting it to a main instrument track, and by labeling sections of your song (bridge, chorus, etc) you can regenerate until you find something you're happy with.

It's a far cry from having a real drummer, but it works in a pinch.

I think the big limiting factor is having it learn what the infinite number of parameters in different synths, etc actually make it sound like, and then being able to make the model be able to produce music by using and configuring them instead of just spaffing out crap music.

If it could do that it'd give the tweakability it needs, but I think it would basically involve training a model for each instrument.

I think you might like https://soundry.ai they are working on a feature that is just like 1.

Spark amp is now advertising with some interesting AI options. https://au.positivegrid.com/products/spark-2 As far as I understand it can attempt to generate backing drums (and music?) for jamming, which sounds great for practicing.

Reply on news.ycombinator.com