Partition connections store access to external systems for a single partition. Data Downloads use them as a destination, and Automated Data Uploads use them as a source.
You can access Partition Connections under:
Account > Partitions > {PartitionName} > Data Management > Connections tab
Prerequisites
-
The Connections tab appears when the
allow-data-downloadfeature flag is enabled, or when theuse-databricks-sourcefeature flag is enabled and you have thePartition Data Management – editpermission. -
Creating, editing, and deleting connections requires the
Partition Data Management – editpermission.
Connection Types
|
Type |
Used for |
Feature flag |
|---|---|---|
|
SFTP |
Destination of a Data Download (External Storage). |
|
|
Databricks |
Source of an Automated Data Upload. |
|
A connection can only be used for what its type supports. Databricks connections are not offered as a Data Download destination, and SFTP connections are not offered as an upload source.
Connections Table
|
Column |
Description |
|---|---|
|
Name |
Name of the connection. Unique within the partition. |
|
Type |
SFTP or Databricks. |
Row actions (three-dot menu): Edit and Delete. You cannot delete a connection that a Data Upload or Data Download still uses.
Databricks Connection Fields
|
Field |
Required |
Description |
|---|---|---|
|
Name |
Yes |
Name of the connection. |
|
Connection Type |
Yes |
Databricks. Cannot change after creation. |
|
Workspace host |
Yes |
Host name of the Databricks workspace, without |
|
Warehouse ID |
Yes |
ID of the SQL warehouse that runs the queries. Letters and digits only. |
|
OAuth client ID |
Yes |
Application ID of the Databricks service principal. |
|
OAuth client secret |
On create |
OAuth secret of the service principal. Leave blank on edit to keep the current secret. |
|
Default catalog |
No |
Catalog used by Test connection. |
|
Default schema |
No |
Schema used by Test connection. |
Test connection checks the credentials and the warehouse and runs SELECT 1. For the result messages, see How to Create Databricks Connection.
If the use-databricks-source feature flag is disabled, existing Databricks connections are shown read-only.