f3bb4c31b8
There is a bug caused by scheduler_jobs refactor which leads to task failure and scheduler locking. Essentially when a there is an overflow of tasks going into the scheduler, the tasks are set back to scheduled, but are not removed from the executor's queued_tasks queue. This means that the executor will attempt to run tasks that are in the scheduled state, but those tasks will fail dependency checks. Eventually the queue is filled with scheduled tasks, and the scheduler can no longer run. Co-Authored-By: Kaxil Naik <kaxilnaik@gmail.com>, Kevin Yang <kevin.yang@airbnb.com> |
||
|---|---|---|
| .. | ||
| operators | ||
| README.md | ||
| __init__.py | ||
| config.py | ||
| db.py | ||
| fake_datetime.py | ||
| gcp_system_helpers.py | ||
| get_all_tests.py | ||
| hdfs_utils.py | ||
| mock_executor.py | ||
| mock_operators.py | ||
| mock_security_manager.py | ||
| print_tests.py | ||
| reset_warning_registry.py | ||
| system_tests_class.py | ||