Delta is nice, but a lot of features are missing from the FOSS version.
Hudi is nice, but they are in the middle of a big format change right now.
Iceberg is nice, but is the most conservative and slow format out of three.
Hudi is nice, but they are in the middle of a big format change right now.
Iceberg is nice, but is the most conservative and slow format out of three.
The Delta Rust implementation is missing more table features, but we're closing the gap fast. We just added support for constraints to Delta Rust and are working on change data feed right now.
Can't you just setup a cron job to vacuum periodically?
If that were true, Snowflake would not be as fast on Iceberg/Parquet as its native format. The engine makes something fast or slow, not the table format.
Disclaimer - am at Snowflake.
We tested all three of them using Spark batches that converted a stream of changes into SCD2.