we had an on-prem splunk implementation and it was SOO SLOW.. it was built/managed by splunk and its consultants.
We finally got rid of it a few years later, but for the entire time we had it, it was a constant "round hole square peg" problems. Each time the consultants assured us Splunk could do what we needed, each time it could not.