there is no reason to train on that thing (except for zero shot classification demos). any cheap/lower end Nvidia gpu would do a much better job, and you would then transfer the model to the embedded thing.
https://colab.research.google.com/notebooks/welcome.ipynb#re...
If your budget is $100 I'd take that money and hunt around for various cloud based solutions. Most have introductory offers and/or cheap/free solutions for hobbyists with modest needs. $100 will go a long way on these services if you're careful. Once you've used up your $100 you'll have a much better idea of what, if anything, you actually need.
that's what I would recommend for your budget probably