Apache Airflow version
2.2.0 (latest released)
Operating System
macOS 11.5.2 or Amazon Linux 2 on EKS
Versions of Apache Airflow Providers
No response
Deployment
Docker-Compose
Deployment details
No response
What happened
it looks like In Airflow 2.2.0 catchup=False is ignored. The simple_dag is scheduled to run in ever minute.
I did not experience this behivour in Airflow 2.1.3
Airflow 2.2.0
I have paused the DAG at 11:31

I have unpaused the DAG at 11:35 and it executed all the skipped run despite catchup=False

Airflow 2.1.2
I have paused the DAG at 11:45

I have unpaused the DAG at 11:50 and it did not executed all the skipped run

What you expected to happen
All the DAG run which was scheduled to run under the pause period will not run after I unpause a DAG.
How to reproduce
- Use the official docker-compose file - https://airflow.apache.org/docs/apache-airflow/stable/docker-compose.yaml
- Add simple_dag.py
"""Sample DAG."""
import time
from datetime import datetime, timedelta
from airflow import DAG
from airflow.operators.python import PythonOperator
default_args = {
"owner": "airflow",
"depends_on_past": False,
"start_date": datetime(2020, 1, 1),
"email": ["support@airflow.com"],
"email_on_failure": False,
"email_on_retry": False,
"retries": 1,
"retry_delay": timedelta(minutes=5),
}
def sleep() -> bool:
time.sleep(10)
return True
with DAG("simple_dag", default_args=default_args, schedule_interval="* * * * *", catchup=False) as dag:
t1 = PythonOperator(task_id="sleep", python_callable=sleep)
- Run simple_dag for few minutes
- Pause simple_dag
- Wait few minutes
- Unpause simple_dag
Anything else
No response
Are you willing to submit PR?
Code of Conduct
Apache Airflow version
2.2.0 (latest released)
Operating System
macOS 11.5.2 or Amazon Linux 2 on EKS
Versions of Apache Airflow Providers
No response
Deployment
Docker-Compose
Deployment details
No response
What happened
it looks like In Airflow 2.2.0
catchup=Falseis ignored. The simple_dag is scheduled to run in ever minute.I did not experience this behivour in Airflow 2.1.3
Airflow 2.2.0
I have paused the DAG at 11:31

I have unpaused the DAG at 11:35 and it executed all the skipped run despite

catchup=FalseAirflow 2.1.2
I have paused the DAG at 11:45

I have unpaused the DAG at 11:50 and it did not executed all the skipped run

What you expected to happen
All the DAG run which was scheduled to run under the pause period will not run after I unpause a DAG.
How to reproduce
Anything else
No response
Are you willing to submit PR?
Code of Conduct