Azure Databricks

Required attributes

  • Workspace Url — the Databricks workspace URL (e.g., https://adb-1234567890123456.7.azuredatabricks.net).
  • Optional Cluster Id for jobs that require a specific cluster.

Authentication methods

  • Polysync Service Principal(recommended) — no extra attributes; add the Polysync Enterprise Application as a service principal in the Databricks workspace and grant it the required permissions.
  • Service PrincipalTenant Id, Client Id, Client Secret. Use when you need a dedicated SPN per workspace. Rotate the secret regularly.
  • Personal Access Token (PAT)Personal Access Token. Easy but tied to a user account; rotate manually.

Permissions checklist

  • Add the chosen identity to the workspace and grant it Can Manage on the relevant Jobs (or Can Use on the SQL Warehouse / Cluster).
  • For Service Principal / Managed Identity auth, ensure the workspace has the principal added under Workspace > Admin Console > Identity and access > Service principals.