It's a big enough application, I'm sure some people have issues with it under certain workloads.

I'm the same as you however -- I've never had issues with iTunes performance. I don't love the design, I'm glad they're simplifying it, but it always performed better than Spotify for me (which is the main reason I switched actually; I found the Spotify app to be terrible).