Databricks Preview

Connect Codatum to Databricks to run SQL and manage data. Supported targets are serverless SQL warehouses. For an overview of connections in general, see Connection.

INFO

This feature is in preview. To request access, contact Codatum support.

Preparing Databricks

Account console

• Create a service principal for the integration under User management > Service principals.
• Generate an OAuth secret under Credentials & secrets, and note the client ID/secret.
• Leave all role settings for the service principal turned off.
• Add the service principal to the workspace you're connecting to.

Workspace admin console

• Grant the service principal Can Use on the SQL warehouse you're connecting to.
• Grant SELECT / USE CATALOG / USE SCHEMA on the catalog.

Configuring Codatum

1. Open global nav > Workspace settings > Data management > Connections, then select New connection.
2. Select Databricks.
3. Set a Connection name and Access level.
4. Enter the following.

Item	Description
Server hostname	The hostname from the SQL warehouse's connection details (for example, <your_instance_name>.cloud.databricks.com)
HTTP path	The HTTP path from the SQL warehouse's connection details (for example, /sql/1.0/warehouses/<your_warehouse_id>)
Warehouse ID	The ID from the SQL warehouse's overview
Client ID	The client ID of the service principal
Client secret	The client secret of the service principal

After entering these, run Test connect, then save the connection. On the sync targets screen shown after saving, select the databases/schemas to sync (Table metadata sync). You can also skip this step.