If you have a newer-ish NVIDIA video card you can try ChatRTX. RTX30 or 40 and 8GB VRAM. Its not great but does allow you to point at a folder and is better than nothing. Does docs (txt, pdf, docx) and images (jpg, png, gif) but not at the same time.
https://www.nvidia.com/en-us/ai-on-rtx/chatrtx/