What’s new in Databricks for July 2023



  • You can use the new Run Job task to add another job as a task in your Databricks job allowing you to decompose a large processing workflow into multiple component jobs. For more information https://docs.databricks.com/workflows/jobs/create-run-jobs.html
  • You can configure an expected duration for a Databricks Job or a job task and add notification if a job or a task exceeds the expected duration. For more information 
  • The maximum offset for the list all jobs and list job runs api requests is now unlimited



  • Starting on July 24 and rolling out gradually to all eligible workspaces, all users will be able to install free or previously purchased datasets using Databricks Marketplace. This is made possible by granting the USE MARKETPLACE ASSETS privilege to all users in all Unity Catalog metastores. This new privilege has no cost impact, since all Marketplace transactions take place outside of Databricks. 
  • Delta Sharing and Databricks Marketplace support view Sharing. For more information https://docs.databricks.com/data-sharing/create-share.html#views

Databricks SQL

  • Unity Catalog users can now view additional table insights in Data Explorer such as frequently joined tables, frequent users of a given table, and frequently used notebooks and dashboards.
  • Enhanced reliability for VACUUM with shallow clones in Unity Catalog.
  • Support for Python UDFs in SQL.
  • Delta Lake UniForm for Iceberg is in Public Preview.
  • Delta Lake liquid clustering is in Public Preview.
  • Archival support for Delta Lake.
  • IDENTIFIER clause support.
  • Unity Catalog support for Python and Pandas User-Defined Functions (UDFs).

Laisser un commentaire

Votre adresse e-mail ne sera pas publiée. Les champs obligatoires sont indiqués avec *