Mt Fuji is only about 100km away from Tokyo. Main problem is there are tons of buildings blocking your view, but if you're at a high enough floor you can see the it even when it's a bit cloudy. For example, see the last pic here:

http://traveljapanblog.com/wordpress/tag/mt-fuji/page/3/