Today I learned!
I always thought "downtown" and "uptown" were more like "south from X" and "north from X" where X is some reference point in context (e.g. "where I'm standing"). Turns out, it's more similar to "downwell" and "upwell", i.e. towards or away from some central point (gravity wells being spherical-ish and all).