It's a "Breeze" to develop Apache Airflow
A Principal Software Engineer's journey to developer productivity. Learn how Jarek and his team sped up and simplified Airflow development for the community.
Apache Airflow Blog
@apache-airflow-blog
Publisher
40
Posts
Posts by Apache Airflow Blog
Documenting using local development environment
The story behind documenting local development environment of Apache Airflow
ApacheCon Europe 2019 — Thoughts and Insights by Airflow Committers
Here come some thoughts by Airflow committers and contributors from the ApacheCon Europe 2019. Get to know the ASF community!
New Airflow website
We are thrilled about our new website!
Airflow Survey 2019
Receiving and adjusting to our users’ feedback is a must. Let’s see who Airflow users are, how they play with it, and what they miss.
Experience in Google Season of Docs 2019 with Apache Airflow
I came across Google Season of Docs (GSoD) almost by accident, thanks to my extensive HackerNews and Twitter addiction. I was familiar with the Google Summer of Code but not with this program. It turns out it was the inaugural phase. I read the details, and the process felt a lot like GSoC except...
Apache Airflow 1.10.8 & 1.10.9
We are happy to present the new 1.10.8 and 1.10.9 releases of Apache Airflow.
Implementing Stable API for Apache Airflow
An Outreachy intern's progress report on contributing to Apache Airflow REST API.
Apache Airflow For Newcomers
Apache Airflow is a platform to programmatically author, schedule, and monitor workflows. A workflow is a sequence of tasks that processes a set of data. You can think of workflow as the path that describes how tasks go from being undone to done. Scheduling, on the other hand, is the process of p...
Journey with Airflow as an Outreachy Intern
Outreachy is a program which organises three months paid internships with FOSS projects for people who are typically underrepresented in those projects. Contribution Period The first thing I had to do was choose a project under an organisation. After going through all the projects I chose “Extend...
Airflow Survey 2020
We observe steady growth in number of users as well as in an amount of active contributors. So listening and understanding our community is of high importance.
Airflow Summit 2021
We are thrilled about Airflow Summit 2021!
What's new in Apache Airflow 2.2.0
We're proud to announce that Apache Airflow 2.2.0 has been released.
Airflow Survey 2022
2021 saw rapid adoption of Airflow 2, and continued growth of the community. This annual survey helps us understand how people are using Airflow, and where we can best focus our efforts going forward.
Apache Airflow 2.4.0: That Data Aware Release
We're proud to announce that Apache Airflow 2.4.0 has been released with many exciting improvements.
Apache Airflow 2.5.0: Tick-Tock
We're proud to announce that Apache Airflow 2.5.0 has been released with many quality of life changes.
Introducing Setup and Teardown tasks
An introduction to Setup and Teardown tasks, which are new in Apache Airflow 2.7.0
Apache Airflow 2.7.0 is here
Apache Airflow 2.7.0 has been released!
Airflow Survey 2023
Airflow 2 has seen rapid adoption, accompanied by continuous community growth. This annual survey helps us understand how people use Airflow and where we can best focus our efforts as we advance.
Apache Airflow 2.8.0 is here
Introducing Apache Airflow 2.8.0: Enhanced with New Features and Significant Improvements
Vulnerability in long deprecated OpenID authentication method in Flask AppBuilder
Advising users who still use a long-deprecated OpenID authentication method in Flask AppBuilder to upgrade to Apache Airflow 2.8.2
Apache Airflow 2.9.0: Dataset and UI Improvements
Apache Airflow 2.9.0 is here! Lots of exciting new Dataset and UI features/improvements this time around.
Apache Airflow 2.10.0 is here
Apache Airflow 2.10.0 is a game-changer, with powerful Dataset improvements and the groundbreaking Hybrid Executor, set to redefine your workflow capabilities!
Airflow Survey 2024
With more than 5,250 responses from 116 countries, this is the largest data engineering survey to date. Conducted annually, it offers valuable insights into Airflow usage and helps guide our future efforts.
Apache Airflow® 3 is Generally Available!
We're proud to announce that Apache Airflow 3.0.0 has been released.
Apache Airflow 3.1.0: Human-Centered Workflows
Apache Airflow 3.1.0 introduces Human-in-the-Loop workflows, 17-language internationalization, deadline alerts, and React plugin system for data orchestration teams.
Apache Airflow CTL aka airflowctl 0.1.0
A new way of using API in Airflow. Apache Airflow CTL aka airflowctl 0.1.0 is released! Secure way to manage your Apache Airflow deployments with ease.
Airflow Survey 2025
With more than 5,818 responses from 122 countries, this is the largest data engineering survey to date. Conducted annually, the Apache Airflow Survey offers valuable insights into Airflow usage and helps guide our future efforts.
Introducing the Apache Airflow Registry
The Apache Airflow Registry is a searchable catalog of 98 providers and 1,600+ modules — operators, hooks, sensors, triggers, and more — now live on airflow.apache.org.
Apache Airflow 3.2.0: Data-Aware Workflows at Scale
Apache Airflow 3.2.0 introduces Asset partitioning for granular pipeline orchestration, multi-team deployments for enterprise scale, synchronous deadline alert callbacks, and continued progress toward full Task SDK separation.
Introducing the Common AI Provider: LLM and AI Agent Support for Apache Airflow
The Common AI Provider adds LLM and AI agent operators to Apache Airflow with 6 operators, 5 toolsets, and 20+ model providers in one package.
Ask Your Survey Anything: Building AI Analysis Pipelines with Airflow 3
A walkthrough of two natural language analysis pipelines over the 2025 Airflow Community Survey, covering an interactive human-in-the-loop version and a fully automated scheduled version, using operators from the common.ai and common.sql providers.
Agentic Workloads on Airflow: Observable, Retryable, and Auditable by Design
How Dynamic Task Mapping and the common.ai provider turn a multi-dimensional research question into a fan-out/fan-in pipeline where every LLM call is a named, logged, independently retryable task, not a hidden step inside a reasoning loop.
Apache Airflow 3.3.0: Stateful Tasks and Multi-Language Support
Apache Airflow 3.3.0 introduces a first-class state store for tasks and assets (AIP-103), a Language Task SDK for writing tasks in Java and Go (AIP-108), a major expansion of asset partitioning, and pluggable retry policies.