Out of curiosity have you ever looked into Obsidian? Not that I think it's a replacement or superior but I feel that it's in the same space.
Sometimes I edit my markdown files in other editors like Bear (or web interfaces). Sometimes I draw handwritten notes on my ipad and insert them as images.
It all works pretty well.
Agreed on Google Docs (at least for design documents).