> you don’t need Cassandra or other BigData database. If you did, you wouldn’t ask the question probably.
...and by the time you do, Postgres improvements will have rendered your Big Data medium-sized anyway :-)
...and by the time you do, Postgres improvements will have rendered your Big Data medium-sized anyway :-)
Of course, that's in a Spark cluster running massively parallel queries and not on a single (however large) node.
That’s no criticism at all. I wouldn’t use Spark for a transactional DB because it’s not the best tool for the job. Same for PostgreSQL when the dataset grows far beyond what a single instance can reasonably process.