I have a similar goal/desire as you. My current project is ingesting this type of data into Elasticsearch with vector embeddings and using a normal search+knn to generate some context when creating a prompt.

This works reasonably well with gpt4, but my context is almost always too large for self-hosted models so far.