At the end of the day, the beauty of one's own business is doing whatever one wants, so if micro-optimization of finances is something you like, ledger or beancount are awesome, you can write scripts and your own tools and processes. I personally would rather focus what I consider the interesting part of my business :)
Xero or Quikbooks are inexpensive and can be integrated with many different services, effectivly automating a good chunk of bookkeeping.
This is definitely overkill for expense recording alone, but A) I also use Quickbooks online to generate invoices, accept payments for those invoices for people who want to use that method (some prefer using their own ACH solution), and B) I like having in in place for when I get bigger.
I have introduced countless people who never though they would need to understand bookkeeping and accounting with this awesome tool.
If the business can’t afford a bookkeeper, it probably isn’t viable because bookkeepers are a cost of doing business.
Yes you can be your own bookkeeper and stagger along in zombie mode. Just realize that’s what you are doing.
Good luck.