If your worry is that you won’t be able to “keep up” and you’ll be laid off, or fired, just wait for that to happen. Keep making a paycheck until then. Then you can start your barista job.
If the problem is that you hate the work, then fine. But why barista? Fine, if that’s what makes you happy. But there are a million jobs out there _if you are willing to relocate_.