This proposal corrects some comma placements in the providers documentation page. I also suggest renaming the Q&A section to FAQ, since that seems like it might be more fitting for describing the section. (This latter change is more an opinion so I don't mind if that's rejected 🙂 )
(cherry picked from commit d4c4492a10)
For image build the python version is passed via
PYTHON_MAJOR_MINOR_VERSION but there is a part of the build
(preparing airflow package) that uses python installed on host.
This is fine for Master/2.0 to use same version as the image
but it should be unified (and in 1.10 when trying to build 2.7
image it would fail).
(cherry picked from commit c2bedd580c)
While debugging one of issues with Celery, it would have helped if `queued_by_job_id` & `external_executor_id` were available to see in Webserver under Browse TaskInstances instead of running psql.
(cherry picked from commit 1b96149f12)
Without this fix, when using CeleryExecutor and default config (i.e. `AIRFLOW__CORE__EXECUTE_TASKS_NEW_PYTHON_INTERPRETER=False`), tasks are run in fork and the pooled connections are shared to a forked process. This causes Celery tasks to hang infinitely (tasks will stay in queued state) with the following error:
```
[2020-12-22 18:49:39,085: WARNING/ForkPoolWorker-2] Failed to log action with (psycopg2.DatabaseError) error with status PGRES_TUPLES_OK and no message from the libpq
```
>It’s critical that when using a connection pool, and by extension when using an Engine created via create_engine(), that the pooled connections are not shared to a forked process.
Sqlalchmey docs: https://docs.sqlalchemy.org/en/14/core/pooling.html#using-connection-pools-with-multiprocessing-or-os-fork
(cherry picked from commit 7f8be97da4)
Closes#13200.
Currently, if the PID file path provided is relative,
the process silently fails to launch.
This fix ensures the PID path specified to be
a normalized absolutized path eventually (expand with cwd),
no matter the given value is relative or absolute.
(cherry picked from commit 93e4787b70)
* Describe what Python versions are supported.
As the result of vote: https://s.apache.org/8epvx - we agreed to
the rules of supporting Python versions. This PR adds it to
both README and official documentation.
* Update README.md
Co-authored-by: Xiaodong DENG <xd.deng.r@gmail.com>
Co-authored-by: Xiaodong DENG <xd.deng.r@gmail.com>
(cherry picked from commit a48bc837f8)
PIP upgrades itself after eager update, and since we (for now)
stick with the 20.2.4 version we want to reset PIP to that
version after eager upgrade.
(cherry picked from commit c44092f8df)
Workflow templates of GCP can be regional or global. In case of
regional the GCP API endpoint rpc url should match to the same
region.
In case of global templates needed to pass 'global' as region.
It is not used for endpoint address but needed to as part of
template path.
closes: #12804
(cherry picked from commit f95b1c9c95)
If no on_*_callback are defined on DAG, Callbacks should not be registered
and sent to DAG Processor.
This will reduce the KeyError mentioned in https://github.com/apache/airflow/issues/13047
(cherry picked from commit 2c9c55781e)
Since TESTING.rst is not published on Apache Site, we don't run spell check on it and hence there were some typos introuduced without getting noticed.
Time to fix them
(cherry picked from commit 5cf2fbf124)
Replace deprecated path in `tests/dags/test_zip/test_zip.zip/test_zip.py`:
```
from airflow.operators.dummy_operator import DummyOperator
```
with
```
from airflow.operators.dummy import DummyOperator
```
(cherry picked from commit 8e99ed61ee)
This commit sync Airflow 2.0 Updating Guide with Master i.e. removes alpha / beta mentions since it is now released
(cherry picked from commit ff9fb36148)
dstandish
Madison Bowden
Jarek Potiuk
Kamil Breguła
Kaxil Naik
Xiaodong DENG
Quentin Fortier
John Bampton
QP Hou
R3da
Tisham Dhar
Ash Berlin-Taylor
Omid Tourzan
plorenzatto
dependabot[bot]
Rakhi Kumari
André Amaral
Flávio de Assis
Ryan Hamilton
Tomek Urbaszek
eladkal