This is a massive misconfiguration of an elastic search cluster. 50k indices? 500 documents per index?
500 records per index at 5shards/index is 100 records per shard.
Yeah, let's shard our data so much that we introduce tremendous amounts of disk i/o overhead!!!
Author should learn how to properly configure an ES cluster before posting ridiculous benchmarks like this.
What an utter pile of garbage benchmark this is.
To expand a little bit, the whole point of using multiple shards per index in an ES cluster is so that the shards spread across multiple nodes (servers) and distribute the load (disk i/o) and handle redundancy. ES automatically scales and reshuffles its shards across multiple nodes in the cluster to handle fault-tolerance as well. If one or more nodes go down, the cluster still has all of the data through replica shards etc...
Either way, in this particular case, the data is so small, having 5 shards per index with 50k indices results in 250k shards for 5GBs of data.
5GB / 250k shards = 20kb per shard.
You have shards of size ~ 20kb ... total cluster misconfiguration.
The specific test deployment was multitenant anyway-- you can't account or optimize for what tenants are going to index.
The impression I got was that they were trying to demonstrate for two specific workloads, how much more a single node of RS can do than a single node of ES, and that we should extrapolate the savings and performance if scaled out from there.
A properly deployed ES cluster versus a single RS node isn't a fair comparison either. It's a strained comparison in any case.
So in other words:
"If your specific use case is supporting 50,000 customers each having around 500 documents and only needing basic text search queries and relevance is not a major concern, RedisLabs Search might give you better performance than ElasticSearch!"
(This is assuming there isn't a different way to configure ElasticSearch to work for this scenario, that gives similar performance.)
When you point out the flawed methodology you come across like a luddite or sour grapes or whatever else.