The underlying problem is that the way your brain works doesn't really map well into categories. Text searching sometimes works, but has the same problem.
Source: Nearly two decades ago we worked on this problem and read a bunch of research. We ended up making an app that let you input multiple facets to narrow things down, with the basic view being a calendar: https://nemo-docs.com/
We didn't have anyone marketing it, so it never really took off. The original plan was to build a serverless/P2P storage system underneath so sharing would be seamless and not require messing with servers, but never got that far.