I mean that's just "write the blog/activitypub in something that's not RoR or other just as slow stack". "Just" that.

With SQLite and maybe a tiny bit of caching you can also get "no external DB deps" easily