Yep - most people stop instances and come back whenever they're ready to train again. No charges for GPUs while the instance is stopped.

If you have a say 200GB harddrive you're only paying $4/month for storage.