Polysync Overview
Polysync is a multi-tenant data orchestration platform that lets you connect to
external cloud services, securely manage credentials, and schedule executions
of platform pipelines/notebooks/functions with rich dependency, parameter,
and contention controls.
Core concepts
- Secret Vault — Connection to a cloud secret manager (Azure Key Vault, AWS
Secrets Manager, Google Cloud Secret Manager, HashiCorp Vault). Stores the
credentials referenced by Platforms.
- Platform — Connection to an external execution platform (Azure Data
Factory, Databricks, Synapse, Functions, Logic Apps, Google Cloud Functions,
…). Authenticated via a Secret Vault entry, a Managed Identity, or the
Polysync Service Principal.
- Job — A reusable template describing what can be executed on a
Platform (a pipeline, notebook, function, etc.) plus its parameter schema.
A Job can be created manually or by importing pipelines from a Platform.
- Task — A configured instance of a Job: it pins parameter values,
schedules, dependencies, retry policy, and contention profiles. Tasks
are what actually run.
- Contention Profile — A reusable concurrency / rate-limit policy that
caps how many tasks may dispatch on a Platform at the same time, or how
often they may dispatch.
Typical setup flow
- Create a Secret Vault.
- Create a Platform that authenticates via that vault (or a Managed Identity).
- Import or define one or more Jobs.
- Create Tasks from those Jobs, assign schedules, and link contention profiles.
- Use Run Once to validate a Task before its schedule fires.
Where to learn more
Visit the in-app wiki under Documentation for the full guide. The AI
Copilot can also walk you through any of these topics — just ask.