It's not just that. You cannot even save a location manually without enabling tracking (not just your home/work address). It's a shame that Google Maps has such good data, because in every other way it's extremely user hostile.
I added my home and work addresses to my phone's dictionary under the shortcuts "hm" and "wrk". In some ways this is even faster since I don't have to rely on the maps UI to insert my address.