Databricks
Databricks is a unified data analytics platform for running SQL queries, managing jobs, and working with pipelines and file storage. With the Databricks app in Make, you can manage your Databricks jobs, pipelines, and Unity Catalog volumes in your Databricks account.
The Databricks app is only available on the Make Enterprise plan.
Requirements
To use the Databricks app in Make, you must have a Databricks account with a service principal. For subscription information, refer to the Databricks pricing page.
This connection uses a Databricks service principal. To access resources such as jobs, pipelines, catalogs, or Unity Catalog volumes, the service principal must be granted permissions on each resource. For more information, see the Databricks OAuth M2M documentation.
Connect Databricks and Make
To get started, you must first create a connection between Databricks and Make, allowing the two services to communicate.
To create the connection, you need to:
Obtain your credentials in Databricks
Before you create the connection in Make, you must obtain your Databricks workspace URL and service principal credentials.
To obtain your credentials:
Log in to your Databricks account.
Copy your workspace URL from the browser address bar and store it in a safe place.
The URL follows the following format:
https://dbc-a1234567-abcd.cloud.databricks.com
Go to Settings > Identity and access > Service principals.
Select your service principal.
Copy the Application ID value. This is your Client ID. Store it in a safe place.
In the Secrets tab, generate or copy your OAuth secret. This is your Client secret. Store it in a safe place.
You'll use these values in the Create a connection dialog in Make.
Create the connection in Make
Once you have your Databricks credentials, you're ready to create the connection in Make.
To create the connection:
Log in to your Make account, add a Databricks module to your scenario, and click Create a connection.
Optional: In the Connection name field, enter a name for the connection.
In the Workspace URL field, enter your Databricks workspace URL copied above.
For example, https://dbc-a1234567-abcd.cloud.databricks.com
In the Client ID field, enter the Application ID of your Databricks service principal.
In the Client secret field, enter the OAuth secret of your Databricks service principal.
Click Save.
If prompted, authenticate your account and confirm access.
You've successfully created the connection and can now use the Databricks app in your scenarios. If you want to make changes to your connection in the future, follow the steps here.
Databricks modules
After connecting to the Databricks app, you can use the following types of modules to build your scenarios.
Templates
You can look for Databricks templates in Make's template gallery, where you'll find thousands of pre-created scenarios.