What would be an affordable/ cheap way to get hands on with this type of hardware? Right now I have zero knowledge.
Of course, this is all pretty expensive still. If your models are small enough you can get away with even older GPUs with less VRAM like a GTX 1080 Ti. And then of course there's services like Google Collab and vast.ai where you can rent a TPU or GPU in the cloud.
I'd check out Tim Dettmers' guide for buying GPUs: https://timdettmers.com/2023/01/30/which-gpu-for-deep-learni...
https://www.tomsguide.com/news/google-pixel-7s-most-critical...
https://www.macobserver.com/tips/deep-dive/what-is-apple-neu...