Do I need Apache Airflow if I already use Azure Data Factory?
Usually not, if your pipelines already run well in Azure Data Factory and the only gap is sequencing them with other services. Airflow earns its place when your team wants workflows as Python code with version control and tests, or needs to run custom task code that does not belong in ADF. If you add Airflow only to call ADF pipelines in order, you take on a second platform to host and maintain for something a lighter dependency layer can do.
Reasons to add Airflow
- Code-first teams. Engineers who want DAGs in Git, code review and unit tests.
- Custom task logic. Python work that does not fit an ADF activity.
- Many non-Azure systems. Airflow's provider ecosystem covers tools ADF and other orchestrators do not.
- Existing Airflow skills. If you already run Airflow elsewhere, extending it may be cheaper than learning something new.
Reasons not to
- Hosting. Self-hosted Airflow is a scheduler, database, web server and workers to patch and scale. Managed options cost money: Astronomer, Amazon MWAA, Google Cloud Composer, or Apache Airflow jobs in Microsoft Fabric. ADF's own managed Airflow (Workflow Orchestration Manager) no longer accepts new instances as of 1 January 2026.
- Duplication. Calling ADF pipelines from Airflow means two places to look when something fails.
- Skills. Data platform teams who build in ADF's designer may not want to own Python DAGs.
Alternatives for the "sequence ADF with other things" problem
| Need | Option |
|---|---|
| ADF then Databricks, one team | ADF's Databricks activity in the same pipeline |
| ADF then a Power BI refresh | A Web activity calling the refresh API, or an orchestrator task |
| ADF, Databricks, Fabric and AWS jobs owned by different teams | A configuration-driven control plane such as Polysync, which imports existing ADF pipelines and links them to other services without code |
| Lots of custom Python as well | Airflow |
Frequently asked questions
Can Airflow trigger Azure Data Factory pipelines?
Yes. The Microsoft Azure provider for Airflow includes operators to run ADF pipelines and wait for them.
Is Fabric's Airflow job the same as ADF's managed Airflow?
They are different services. Microsoft recommends moving ADF Workflow Orchestration Manager workloads to Apache Airflow jobs in Microsoft Fabric.
Can Polysync and Airflow work together?
Yes, for DAGs in Google Cloud Composer: Polysync can trigger a Composer DAG as one task in a wider chain. See Polysync vs Apache Airflow.
Microsoft, Azure, Azure Data Factory, Microsoft Fabric, Power BI, Logic Apps and Microsoft Marketplace are trademarks of the Microsoft group of companies. Apache Airflow and Airflow are trademarks of the Apache Software Foundation. Databricks and Lakeflow are trademarks of Databricks, Inc. All other product names are the property of their respective owners and are used for identification only. No endorsement by their owners is implied.