Apache Spark 3.4.0 has been released

It includes Python client for Spark Connect, more ANSI SQL compliance, very good improvements in Structured Streaming, new built-in functions, and much more.

There is a blog post on Databricks with more details for most notable features: https://www.databricks.com/blog/2023/04/14/introducing-apach...