(Note I work on Mimir)
(Note I work on Mimir)
You can alternately use Prometheus Agent, to save storing the data and running a query engine at the leaf.
You can also use the OpenTelemetry suite to perform the same operation, though this is more appealing if you want some other OpenTelemetry features at the same time. Eg if you prefer the ‘pipeline’ style.
1: https://prometheus.io/docs/prometheus/latest/configuration/c...
The general takeaway is that you run a minimal prometheus/alertmanager setup that only scrapes the agents, then use a dead man switch-like system to ensure this pipeline keeps working.
Link: https://grafana.com/blog/2021/04/08/how-we-use-metamonitorin...
Mimir accepts the Prometheus remote-write api, which is protobuf-over-http; can be generated by anything really.