140 karma · joined October 8, 2022
- Herman Wouk, The Caine Mutiny
This is completely true. 18-20-year-old kids launch and arrest aircraft on a carrier while simultaneously performing an underway replenishment, and it's just another day.
My ship was near the USS Iowa when turret two went up. A sobering experience when you think how much risk the turret crews are in just by doing their jobs.
Wow. Just wow. All mechanical computers calculating fire control solutions for the big 16 inch guns. The guys giving the tour were well beyond the age for regular military retirement. Come to find out, they were all reactivated because practical knowledge of the mechanical computers had since left the navy. That was a very cool day.
https://www.oreilly.com/library/view/managing-cloud-native/9...
Python for serving HTTP? This could get expensive—the why, what, and choices teams have in deploying AI applications.
Or just use Astra and not worry about scaling your own cluster.
I feel like we should be talking about the sad state of logging where we think it’s perfectly ok to dump millions of 10k stack trace dumps and think that should be cheap.
Meanwhile copilot is becoming a superpower to those who figure it out.
And it hasn’t even been a year! I’m going to need a lot more popcorn.
What we won't be doing is figuring out how to scale to petabytes of data distributed across multiple data centers in a massive active-active cluster. We've spent the last 14 years perfecting that, and still have work to do. With the benefit of hindsight, if you have a database that is less than 10 years old, all I have to say is good luck. You have some challenging days ahead.
1. https://cwiki.apache.org/confluence/display/CASSANDRA/CEP-30...
If you are using Spark in a bare metal cluster with spark-submit, the above advice applies. In Kubernetes, never use the default pod scheduler with analytic workloads. Great choices are Volcano(https://volcano.sh/en/) and Yunikorn(https://yunikorn.apache.org/). Also great and evolving projects to support and contribute if you can.