HNHacker News
TopNewBestAskShowJobs

tiwarinitish86

156 karma · joined September 4, 2015

submissionscomments
tiwarinitish86··on Data Is Your Moat
When everyone has access to roughly equivalent models, the differentiator is what you feed your model. It is time to look at data retention
tiwarinitish86··on The Economics and Physics of 100 TB daily telemetry data
Infrastructure has become a key driver of observability cost. More than data volumes, this is because of approaches like replication, cross AZ data transfer and almost no compression.

In this post we explain the infra cost of running Parseable for 100TB telemetry data on a daily basis. This is based on extrapolating ingestion volumes for an hour.

Looking forward to your comments / feedback on this!

tiwarinitish86··on Our learnings with OTEL Traces in columnar files
Traces are one of most difficult observability signals to work with. You need a lot of work on the application and infrastructure instrumentation to get it right.

Once the hard work is done on the client side, you'd expect to extract max value from the this trace data (and not set small retention to save cost).

We worked hard to understand (and explain) how OTEL traces can be efficiently stored, queried and analysed on Parseable using the ubiquitous Parquet file format. Read on!

tiwarinitish86··on High cardinality meets columnar time series system
Columnar formats allow side stepping of some of the most critical issues that plague time series databases. Each label essentially becomes a column which is then efficient to parse through.
tiwarinitish86··on Alerts on unauthorised access to Kubernetes secrets
Secrets in Kubernetes as are only encoded, not encrypted by default. Due to this, there is always a concern around unauthorised access to secrets.

This posts explains a step by step guide to receive alerts in case of any unauthorised access to a secret.

tiwarinitish86··on I can't recommend serious use of an all-in-one local Grafana Loki setup
Will do soon!
tiwarinitish86··on I can't recommend serious use of an all-in-one local Grafana Loki setup
Not yet, but we have this on roadmap. We'll add this within a few months.
tiwarinitish86··on I can't recommend serious use of an all-in-one local Grafana Loki setup
Parseable is an open source Loki alternative.

- Single binary - Written in Rust (lightweight, fast and stable) - Use S3 bucket or Mount point - Visualize with Grafana

https://github.com/parseablehq/parseable

(founder here)

tiwarinitish86··on Private Helm repo for Kubernetes cluster
Minio is deliberately designed in this manner for scale. It is in our intention to make storage deployment to be simpler and scaling is achieved by deploying many smaller instances.

So each minio cluster is a deployment unit which scales with your orchestration software like kubernetes. In our view creating a gigantic cluster with single namespace is scary, where single server can take down the the entire data center.

With Minio's design the intention is to isolate such occurrences and safely operate/upgrade clusters without disturbing a single namespace.

tiwarinitish86··on What is your biggest pain point as you develop software?
I get your point. Here is the same survey in Typeform: https://devup1.typeform.com/to/QDiNFU

Hope to see your response soon. :)

tiwarinitish86··on What is your biggest pain point as you develop software?
It requires a Google login to prevent repeated responses. Could you try while logged in with Google?

We would love to hear you out!

tiwarinitish86··on Fleet re-routing applications if a node fails
Servers crash all the time. But it is important to make sure applications, and hence the business, doesn’t suffer. This is why service availability is one of biggest concerns for operational engineers deploying applications in the cloud.