Founder of a data streaming startup (a PhD in database systems, ex-AWS Redshift/IBM researcher) explains why AI will fundamentally reshape data engineering within 24 months. Key insights:
How text-to-SQL is becoming a commodity (with Snowflake hitting 90% accuracy)
Why vector databases are a dead-end business model
When AI replaces feature engineering (and what that means for Spark/RisingWave)
The surprising way AI acts as "lossy compression" for storage
Why database vendors must now answer: "Do we even need databases anymore?"