A recent paper [1] shows that what you're describing is possible to some degree - you can reproduce text from its embeddings. The paper provides the code implementing the reversal process, so you could quickly hack together a prototype :)

I also recommend a video by Yannic Kilcher [2], explaining the paper.

[1] https://arxiv.org/abs/2310.06816

[2] https://www.youtube.com/watch?v=FY5j3P9tCeA