There are cyclic imports detected seemingly randomly by pylint checks when some
of the PRs are run in CI
It was not deterministic because pylint usually uses as many processors as
many are available and it splits the list of .py files between the separate
pylint processors - depending on how the split is done, pylint check might
or might not detect it. The cycle is always detected when all files are used.
In order to make it more deterministic, all pylint and mypy errors were resolved
in all executors package and in dag_processor.
At the same time plugins_manager had also been moved out of the executors
and all of the operators/hooks/sensors/macros because it was also causing
cyclic dependencies and it's far easier to untangle those dependencies
in executor when we move the intialisation of all plugins to plugins_manager.
Additionally require_serial is set in pre-commit configuration to
make sure cycle detection is deterministic.
* Correct typo in pod_launcher
* Remove param `secrets` in docstring since it's not specified/used
* Always use triple double quotes around docstrings
https://www.python.org/dev/peps/pep-0257/
For consistency, always use """triple double quotes""" around docstrings
- `security_context` was missing from docs of `KubernetesPodOperator`
- `KubernetesPodOperator` kwarg `in_cluster` erroneously defaults to
False in comparison to `default_args.py`, also default `do_xcom_push`
was overwritten to False in contradiction to `BaseOperator`
- `KubernetesPodOperator` kwarg `resources` is erroneously passed to
`base_operator`, instead should only go to `PodGenerator`. The two
have different syntax. (both on `master` and `v1-10-test` branches)
- `kubernetes/pod.py`: classes do not have `__slots__`
so they would accept arbitrary values in `setattr`
- Reduce amount of times the pod object is copied before execution
* [AIRFLOW-4781] Added the ability to specify ports in kubernetesOperator
* [AIRFLOW-4781] Added the ability to specify ports in kubernetesOperator
* [AIRFLOW-4781] Added the ability to specify ports in kubernetesOperator
added docstring
* [AIRFLOW-4781] Added the ability to specify ports in kubernetesOperator
add typehints
Co-Authored-By: Fokko Driesprong <fokko@driesprong.frl>
* [AIRFLOW-4781] Added the ability to specify ports in kubernetesOperator
fixed docstrings and typehints
* Move k8s executor from contrib folder
Considering that the k8s executor is now fully supported by core
committers, we should move it from contrib to the primary executor
directory.
antonymayi
Kamil Breguła
Jarek Potiuk
Xiaodong
Kaxil Naik
david
Kevin Yang
davlum
Ron van Weverwijk
Daniel Imberman