I guess I would counter with if I have friends there, I would like their lives to be better. If my exit interview is able to do that, then I would take that as a net positive.
640 karma · joined August 28, 2009
I guess I would counter with if I have friends there, I would like their lives to be better. If my exit interview is able to do that, then I would take that as a net positive.
* timelines of kinetic resource missions * conops including order of battle, etc.
Per normal ODNI bits, it's pretty clearly within bounds for classification.
Remember all it takes is 1 employee to put that claim up there (although I do like evidence.dev).
Or at least they did for some of my corners of the world.
Yup .. comfy with iceberg/delta/hudi
> RDBMS based data warehousing is obviously not economical at the petabyte scale.
I never said it was .. I'm simply responding to "I simply cannot understand how anyone chooses this over running your own Spark clusters with Jupyterlab". I'm trying to help you understand why folks would choose a SaaS over run your own.
> But storing all that data in S3 with Delta Lake/Iceberg format and querying with Spark changes things entirely. You only pay for object storage, and S3 read costs are trivial.
No. You don't just pay for object storage + minor S3 read costs.
You pay for operations You pay for someone setting up conventions You pay to not have to optimize data layouts for streaming writes You pay to not have to discover race conditions in s3 when running multiple spark clusters writing to same delta tables You pay to not have to discover that your partitions/clustering needs have changed based on new data or query patterns
But look .. I get it. You have chosen to optimize for cost structures in one way .. and I've chosen to optimize in a different way. In the past I've done exactly as you've said as well. I think being able to seeking to see _why_ folks may have chosen a different path may help you understand other areas to consider in operations.
Would that potentially be a situation which “running your own” doesn’t make sense?
What I’ve seen is igniting that spark and moving folks from not caring to caring (or realizing they can affect change) can be even more rewarding than the other mentoring being discussed
But what counts as a new logo? Does a pro serve engagement that doesn’t use the product count? What about a business using the SaaS but still in a trial period? Etc.
A semantic layer helps provide common agrees upon definitions to the business. So any one looking for common data entities can just look those things up… and can come to published definitions (which are backed by queries to databases, data lakes, etc).
Does that help? Another example of this would be dbt for example
(FTR, I use all of them, lightdash, streamlit, (as well as drop down to flask) etc.)
Still tons of folks out there using Hadoop (ew), Snowflake, etc. New technologies coming out include things like Trino, Apache Iceberg, etc. So it's there ... just no one cares about the moniker .. just getting things done.
We took our kiddo on a trip to Colorado to the Gifted Development Center which was a good helpful first step (and connected a lot of dots for us). More than happy to share experiences at matt at mindvault dot com.
Zingermans has a pretty decent virtual class to teach the Detroit style pizza :)
I guess I’m somewhat on the opposite side of the fence. I see it everywhere... although yes I think Big Bang things are probably a few years off
I've found well-written documentation to be a good way to avoid having folks bother me. I tend to treat it as a first class citizen artifact of my work (along with tests). Have it be as auto generated as possible. The above being said, I've also sometimes struggled to put myself in the user's shoes to understand what are the things I should emphasize in the documentation.
The majority of the protests were mostly peaceful.
https://acleddata.com/2020/09/03/demonstrations-political-vi...
Police brutality is real https://www.nature.com/articles/d41586-020-01846-z
Is the value prop “you don’t need all they grunt work” as opposed to above direction?