In case someone wondering, like me, what TSNE is. Which I still don't understand after reading
In case someone wondering, like me, what TSNE is. Which I still don't understand after reading
What you want to do is "visualise" those 20.000 points in 2D or 3D so you can get an idea of how the data is distributed. So you use t-SNE to "compress" those 200 columns to 2 or 3, and you display that.
Traditionally you would use Primary Component Analysis, but that only uses linear projection, and will not be able to project data that has non-linear relationships in the distributions.
Another algorithm, sometimes more powerfull and scalable is LargeViz.
Tool-wise, we do it in a few lines over tables with many rows/columns via end-to-end GPU acceleration using https://www.RAPIDS.ai (GPU dataframes + UMAP) + Graphistry (GPU viz, which we make).