Ask HN: Need centralized logs with a search interface. ELK or EFK or what else?
I run a SLURM(batch workload scheduler) cluster for research and need to aggregate logs from several compute nodes, a controller server and a few infrastructure servers(SSH server, web server, Git server etc).
What I'm looking to achieve is to have all logs sent to one place, and have a search interface on top of it.
Hard requirements:
Self-hosted/on-prem only.
Affordable for a small research group if not free and open source.
Choosing guidelines:
No clustering of any kind necessary. Single point of failure is okay. Our logs are not mission critical.
Low volume. Our entire clusters logs are probably less than 1 GB/day.
Prefer one fast server to deploy this solution in rather than the complexity of a distributed solution.
So, should I buckle up and work on Elasticsearch +[logstash or Fluentd] + Kibana?
Or
Are there better alternatives I can look at?
Appreciate your recommendations.
Cheers!