ES is the C in CQRS though. If you're using it for the Q too, then it's no wonder you'll quickly get in a bad way. It's specifically not designed for that.
The only thing CQRS dictates is that a system's read models are separate from its write models.