Ask HN: Looking for a diagram that shows various data engineering solutions
The post was broadly about data engineering. The diagram listed various tools that were used for different stages in the data engineering process.
The diagram was shaped like a period. The wideness of the period was used to indicate the volume of data at various stages of the data-engineering process (i.e., at the wide base of the period, there were solutions suitable for handling terabytes of data, and at the narrow top of the period, there were solutions suitable for handling data volumes in the kilobytes to megabyte range).
Example solutions at the base of the period were distributed storage/compute solutions (like Apache Spark).
Example solutions at the middle of the period were things like a single SQL server instance.
Example solutions at the top of the period were highly interactive, low latency solutions (like excel).
If anyone recalls such a topic passing on HN, or knows of a similiar diagram, could you please share it with me?