This PR splits logs based on try number and add
tabs to display different task instance tries.
**Note this PR is a temporary change for
separating task attempts. The code in this PR will
be refactored in the future. Please refer to #2422
for Airflow logging abstractions redesign.**
Testing:
1. Added unit tests.
2. Tested on localhost.
3. Tested on production environment with S3 remote
storage, MySQL database, Redis, one Airflow
scheduler and two airflow workers.
Closes#2383 from AllisonWang/allison--add-task-
attempt
Avoid unnecessary backfills by having start dates
of
just a few days ago. Adds a utility function
airflow.utils.dates.days_ago().
Closes#2068 from jlowin/example-start-date
dags/test_dag.py tries to set START_DATE to 3
hours before using
datetime.replace, but it doesn't support minus
value as argument.
So we have to use timedelta instead of simple
numeric subtraction.
Closes#1852 from sekikn/AIRFLOW-586
Remove the current example in dags/testdruid.py. It requires the installation of an extraneous library (Hive) and executes a query against table that no one has. In its place, I am creating a simple DAG that only depends on DummyOperator and standard Python packages.
Dear Airflow Maintainers,
Please accept this PR that addresses the following issues:
- https://issues.apache.org/jira/browse/AIRFLOW-399
Testing Done:
Manual.
aoen criccomini artwr jlowin bolkedebruin
Closes#1709 from r39132/master
Fokko Driesprong
Bolke de Bruin
AllisonWang
Siddharth Anand
Jeremiah Lowin
Kengo Seki