Polysync Overview

Polysync is a multi-tenant data orchestration platform that lets you connect to external cloud services, securely manage credentials, and schedule executions of platform pipelines/notebooks/functions with rich dependency, parameter, and contention controls.

Core concepts

  • Secret Vault — Connection to a cloud secret manager (Azure Key Vault, AWS Secrets Manager, Google Cloud Secret Manager, HashiCorp Vault). Stores the credentials referenced by Platforms.
  • Platform — Connection to an external execution platform (Azure Data Factory, Databricks, Synapse, Functions, Logic Apps, Google Cloud Functions, …). Authenticated via a Secret Vault entry, a Managed Identity, or the Polysync Service Principal.
  • Job — A reusable template describing what can be executed on a Platform (a pipeline, notebook, function, etc.) plus its parameter schema. A Job can be created manually or by importing pipelines from a Platform.
  • Task — A configured instance of a Job: it pins parameter values, schedules, dependencies, retry policy, and contention profiles. Tasks are what actually run.
  • Contention Profile — A reusable concurrency / rate-limit policy that caps how many tasks may dispatch on a Platform at the same time, or how often they may dispatch.

Typical setup flow

  1. Create a Secret Vault.
  2. Create a Platform that authenticates via that vault (or a Managed Identity).
  3. Import or define one or more Jobs.
  4. Create Tasks from those Jobs, assign schedules, and link contention profiles.
  5. Use Run Once to validate a Task before its schedule fires.

Where to learn more

Visit the in-app wiki under Documentation for the full guide. The AI Copilot can also walk you through any of these topics — just ask.