57 karma · joined January 2, 2020
What? This is the first I've heard of this.
It seems much easier to follow when you can push everything to horizontally scaled single processes for languages like Python.
This sounds like an issue not with Airflow but with integration.
This was explored in a famous study of Air Force pilots and when measuring across 10 different dimensions, found that 0 pilots were "average" across all 10.
https://www.thestar.com/news/insight/2016/01/16/when-us-air-...
>There was no such thing as an average pilot. If you’ve designed a cockpit to fit the average pilot, you’ve actually designed it to fit no one.
edit: wrong link
* BigQuery
* Tighter k8s integration with GKE
* Single message service (PubSub)
Unless BigQuery is your first class citizen, I would avoid GCP.
A lot of "engineers" at Boeing are actually project / program / product managers and can pivot to similar roles at tech firms. The stress engineers have it a lot tougher.
Explainable models = statistical models (regression / multilevel models).
Black box models = machine learning (tree based models).
AI = black box models for computer vision / NLP.