I'm glad that works for you but to me it sounds really expensive. At small scale you can do this any way you want but if you build an observability system with linear cost and a high coefficient it will become an issue if you run into some success.
Many kinds of systems can work great at this scale, which is non-trivial but ultimately not particularly large.
> It's really just 6 servers with 20tb each and another 40tb for backups.
Hopefully you can ingest and store and query O(10k) RPS with an order of magnitude less resources than this?