...right up to about 20 kHz, whereafter YOU CAN'T HEAR THEM. Hence 44 kHz sampling.

Seriously, A/B test this, you might be surprised.

Also if you think that's anything like a square wave coming out of a guitar speaker (or that that is even desirable in the most case), I've got a bridge to sell you. And yes, I do play.