It's a pretty big shift from browsers like Chrome and Firefox, but I really like how Qutebrowser handles bookmarks (and "quickmarks"). It's very similar to what you're describing.
The reason I'm asking is that there are plans for some significant changes on how bookmarks/quickmarks are stored and handled: https://github.com/qutebrowser/qutebrowser/pull/3855