Databricks launches LakeFlow to help its customers build their data pipelines

Their Unity Catalog covers lineage and governance. Logging is still pretty bad last time I used it. But that’s more of PySpark issue with only the driver logs being collected.