That's what makes the actual difference :)
"On its last flight, March 6, 1990, Lt. Col. Ed Yielding and Lt. Col. Joseph Vida set a speed record by flying from Los Angeles to Washington, D.C., in 1 hour, 4 minutes, and 20 seconds, averaging 3,418 kilometers (2,124 miles) per hour. At the flight's conclusion, they landed at Washington-Dulles International Airport and turned the airplane over to the Smithsonian." (http://airandspace.si.edu/collections/artifact.cfm?object=na...)
And rumors at the time were that it could have made the USA crossing significantly faster, but the military did not want to reveal the 'true' top speed of the aircraft.
http://www.gcmap.com/mapui?P=BAB-MMK
According to the article they passed south of Greenland, so they took a somewhat longer path. I assume that's because it helped them reach the tankers, or kept them within range of emergency landing spots or potential rescue forces.
It seems to make the mission much more complicated. Why not somewhere in North East USA, or even the UK (as they ended up doing anyway)?
For an even more extreme example, the B-2's home base is in Missouri. It has flown bombing missions into Serbia, Afghanistan, and Iraq directly out of its home base. Since it's not nearly as fast as an SR-71, these missions take a long time. The longest one took nearly two days. Fortunately for the pilots, it's a bit more comfortable than the SR-71 as well, with no space suits, and facilities for bathroom breaks and hot meals.