This is a great point. Out of all the ones I've looked into, I think MIT has by far the most complete public curriculum (because of MIT OCW), but Cambridge and Oxford are not far behind, with excellent lecture notes and problem sets.
Agreed, at some point I've used something from all three of those and they're all great! I've seen a surprising amount of great stuff from smaller universities too iirc, if you google around.