I strongly recommend using colab or a crappy gpu for experimentation and just paying for compute when you want to run jobs that need it. Most tinkering doesn't need any special gpu, so whatever you buy is going to mostly sit idle. Paying for cloud GPUs obviously costs more per hour, but you then only pay for what you need and can scale however you want