Étiquette : Databricks

What’s new in Databricks for September 2023

Platform  Workflows Governance Databricks SQL Machine learning Delta Lake Partner connect

What’s new in Databricks for June 2023

Platform  Delta Lake ( DBR 13.2 required) Governance Data Management Marketplace Databricks SQL

Introduction to Databricks Photon

What’s Photon ? Photon is a vectorized query engine written in C++ that leverages data and instruction-level parallelism available in CPUs. It’s 100% compatible with Apache Spark APIs which means you don’t have to rewrite your existing code ( SQL, Python, R, Scala)  to benefit from its advantages.  Photon is an ANSI compliant Engine, it […]

Azure Databricks — Setup SCIM in the Account Console

Requirements: Your Azure Databricks account must have the Azure Databricks Premium Plan. Your Azure Active Directory account must be a Premium edition account. You must be a global administrator for the Azure Active Directory account. Useful links: https://learn.microsoft.com/en-us/azure/databricks/administration-guide/users-groups/scim/

How to upgrade your Hive metastore tables to Unity Catalog Using Sync

Before you begin, you must have: A storage credential with an IAM role that authorizes Unity Catalog to access the table’s location path. An external location that references the storage credential you just created and the path to the data on your cloud tenant. CREATE EXTERNAL TABLE permission on the external location of the table […]

Step by step guide to setup Unity Catalog in Azure

You must be an Azure Databricks account admin. The first Azure Databricks account admin must be an Azure Active Directory Global Administrator at the time that they first log in to the Azure Databricks account console. Upon first login, that user becomes an Azure Databricks account admin and no longer needs the Azure Active Directory […]

What’s new in Databricks for March 2023

Platform  You can now work with non-notebook files in Databricks ( py, md,csv, txt, log files). For more information : https://docs.databricks.com/files/workspace.html Databricks runtime 12.2 standard and ML are GA The SQL admin console has been combined with the general Admin console to create a Unified Experience for admin users. Support for Jupyter notebooks is available […]