Scaling Data Pipelines on Kubernetes

airbyte.com

3 pointsdavinchia2 comments

why didn't you use grpc?

Also, a standard kubernetes client (e.g. the go client), uses cache on the client side for queries, and does not hit the api server.

Since this is executed from Java code, we did not want to have to bundle kubectl (I'm assuming that's what you are referring to) with the Jar. We also did not want to run an exec command.

Are you asking why not GRPC between the various job pods?

Reply on news.ycombinator.com