There are various techniques based on time of day and the stars you can see, but if you're not doing it regularly you're going to have to look up the procedure anyway.
And although you might not always be able to rely on GPS, inertial navigation, dead reckoning, and visual navigation using landmarks, celestial navigation has a huge drawback.
It's defeated by cloud cover and fog.