Data pipeline orchestration topic guides
Guides to cross-cloud orchestration, Azure data platform orchestration, scheduling and reliability, AI workload orchestration, and security and governance.
- Topic guide
Cross-platform and multi-cloud data orchestration
Scheduling, dependencies and monitoring for jobs spread across Azure, Google Cloud and AWS.
Read - Topic guide
Orchestrating the Azure data platform
ADF, Databricks, Fabric, Synapse, Logic Apps and Power BI working as one workflow.
Read - Topic guide
Pipeline scheduling, dependencies and reliability
Schedules, DAG conditions, retries, timeouts, concurrency caps and rate limits.
Read - Topic guide
Orchestrating AI workloads and AI-assisted operations
AI jobs as part of the pipeline, and AI that helps operate it.
Read - Topic guide
Security, credentials and governance for orchestration
Vault-held credentials, least privilege, Entra ID sign-in, isolation and Australian hosting.
Read