Using a vector db that’s created as a post commithook is probably a reasonable improvement. With context lengths getting bigger natural language is getting easier to work with but your leaving a bunch of gains on the floor without them.
No shade on your project, this is an emerging space and we can all use novel approaches.
Keep it up!