Interesting, did you try also using PaCMAP or UMAP for dimensionality reduction? It might result in a more meaningful representation of their underlying semantic structure: see the 'mammoth' example in my article.
No! I only tried PCA, but I still have the embeddings.
I'll try later and post results.
Just a UI/UX comment: I cannot read the tiny text on your website's main graphic, on a 43" 4K display.