I think part of my disatisfaction is due to pattern recognition. As humans we recognize patterns EVERYWHERE, even when they don't exist. So what happens (or what I believe might be happening) is that I think I recognize a pattern, try to play a note to continue it, then the NN decides otherwise. Although the resulting sound may be nice to an outsider it breaks my internal model, making it sound "bad" to me.
I do however like the idea of augmenting insturments to make them easier to play, I'm personally guitly of having many potential songs in my head but not having near enough the skill to execute them.