They could use the exact same setup they have right now.
They'd just serve the exact same (static) html for every twitter.com/username URL. I don't think it's exactly terrible Javascript hackery to look at the location.href and do an ajax call.
They'd probably support web crawlers with the same system they use now. And many web crawlers these days execute javascript anyway.