I think this is awesome tool, but somehow using fish shell does most of what I need and rarely I reach for it. This is not a critique of Zoxide, but just the fact that this is not as big of a problem once it was.
abbr --add c cd
And then the "most used paths" are just present in the history filtered by the prefix I already typed.