Re-reading your comment :)
Yes, my demo has just a simple loop when loading the embeddings.
I was replying more towards the latency you mentioned. Because duckdb runs on device, you save yourself the additional round trip network time when comparing similarities.