Lots of browsers format links with just a thin underline and no color change. I actually prefer that approach since it avoids the visual color clutter. Would be nice to have an option to do that instead of color.
Lots of great ideas, especially the format affinity indication/control. Is that just arrow key or arrow with cmd key? If it is only the arrow key, how do you distinguish user intent to actually move the cursor vs change the affinity?