Isn't the obvious solution to sample in polar coordinates instead? 0-1 for the radial coordinate, and (0 - 1) * 2pi for the angle.
[0]: https://en.wikipedia.org/wiki/Inverse_transform_sampling
It’s still a useful illustration, though, since MCMC samplers used in practice do end up throwing away lots of the sampled points based on predefined acceptance criteria.