You should have a look at RxDB which does exactly what you have described. Also notice that neither firebase nor supabase is really offline-first.

https://github.com/pubkey/rxdb