I believe that focusing on individual pages will slow down the pace at which you can advance. Every user may have tens of pages which he/she visits every day. I reckon that supporting thousands of different pages would be a burden and it would be nearly impossible to please every user.

Instead, I would recommend aiming to develop a rock solid swiss knife for online keyboard shortcuts in the long term as an alternative to vimium with some fine tuning for the most visited 100 websites for instance.

I would probably not feel the need to have an extra layer on top of vimium otherwise.