Граф коммитов

11178 Коммитов

Автор SHA1 Сообщение Дата
Jarek Potiuk 7b48feecbb Describe which Python versions are supported. (#13259)
* Describe what Python versions are supported.

As the result of vote: https://s.apache.org/8epvx - we agreed to
the rules of supporting Python versions. This PR adds it to
both README and official documentation.

* Update README.md

Co-authored-by: Xiaodong DENG <xd.deng.r@gmail.com>

Co-authored-by: Xiaodong DENG <xd.deng.r@gmail.com>
(cherry picked from commit a48bc837f8)
2021-01-21 18:14:46 +00:00
John Bampton 8eafd62f0a Fix link to Airflow master branch documentation (#13179)
(cherry picked from commit eda399b5fa)
2021-01-21 18:14:26 +00:00
QP Hou bb34a3e66e skip entrypoint load if provider has already been loaded from local source (#13245)
(cherry picked from commit 18df31d5d4)
2021-01-21 18:12:07 +00:00
Kaxil Naik f1c138d852 Bump datatables JS to 1.10.23 (#13253)
This was partially done in https://github.com/apache/airflow/pull/13143 but it kept datatables.net@1.10.21 in yarn.lock which causes the scanners to still detect vulnerability

(cherry picked from commit 962fc97e29)
2021-01-21 18:11:40 +00:00
dstandish 9bdf44cf35 Flower should be enabled for CeleryKubernetesExecutor (#13248)
(cherry picked from commit d752d92a4d)
2021-01-21 18:11:29 +00:00
Jarek Potiuk f10fcb5134 Reset PIP version after eager upgrade (#13251)
PIP upgrades itself after eager update, and since we (for now)
stick with the 20.2.4 version we want to reset PIP to that
version after eager upgrade.

(cherry picked from commit c44092f8df)
2021-01-21 18:11:20 +00:00
R3da f51b9e3a6c specify constraint key type & drop auto fkey referred to users tables (#13239)
(cherry picked from commit 640985865a)
2021-01-21 18:09:01 +00:00
Tisham Dhar 2b550d43c5 Add note block to 2.x migration docs (#13094)
closes: #13081
(cherry picked from commit 872350bac5)
2021-01-21 18:07:13 +00:00
Ash Berlin-Taylor a7140792fb Update minimum cattrs version (#13223)
Fixes error on Python 3.9

(cherry picked from commit 9c0a5df222)
2021-01-21 18:05:20 +00:00
Omid Tourzan 41e214cbc3 Add regional support to dataproc workflow template operators (#12907)
Workflow templates of GCP can be regional or global. In case of
regional the GCP API endpoint rpc url should match to the same
region.

In case of global templates needed to pass 'global' as region.
It is not used for endpoint address but needed to as part of
template path.

closes: #12804
(cherry picked from commit f95b1c9c95)
2021-01-21 18:04:56 +00:00
Kamil Breguła 2f65a1080f Fix typos and minor simplification in TESTING.rst (#13194)
(cherry picked from commit 97eee350e4)
2021-01-21 18:04:21 +00:00
plorenzatto 4aa59691b0 Add Mutt Data to INTHEWILD.md (#13227)
(cherry picked from commit 925153f5a5)
2021-01-21 18:04:17 +00:00
dstandish b4ae7f2fff Update chart readme to remove astronomer references (#13210)
(cherry picked from commit a3cc78dc16)
2021-01-21 18:04:12 +00:00
dependabot[bot] 151c8a8283 Bump dompurify from 2.0.12 to 2.2.6 in /airflow/www (#13164)
Bumps [dompurify](https://github.com/cure53/DOMPurify) from 2.0.12 to 2.2.6.
- [Release notes](https://github.com/cure53/DOMPurify/releases)
- [Commits](https://github.com/cure53/DOMPurify/compare/2.0.12...2.2.6)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit cb6914509f)
2021-01-21 18:03:51 +00:00
Rakhi Kumari 979cb625b3 Make function purpose clearer in example_kubernetes_executor example dag (#13216)
(cherry picked from commit 883cd4d8e4)
2021-01-21 18:03:09 +00:00
dstandish bc333df47a Fix parenthesis preventing Keda ScaledObject creation (#13183)
(cherry picked from commit a9d562e1c3)
2021-01-21 18:02:42 +00:00
Kamil Breguła 9daddf2c57 Fix brokend master (#13201)
(cherry picked from commit 4aba9c5a8b)
2021-01-21 18:02:26 +00:00
Kamil Breguła e6fefc6fcc Remove unused libraries - flask-swagger, funcsigs (#13178)
(cherry picked from commit 49f104b894)
2021-01-21 18:01:56 +00:00
Kamil Breguła b63ab7f044 Update pylint to 2.6.0 (#13174)
(cherry picked from commit 0ec4998954)
2021-01-21 18:01:40 +00:00
André Amaral 768bbbfa52 Add documentation about webserver_config.py (#13155)
Co-authored-by: Andre Amaral <aamaral@bionexo.com>
(cherry picked from commit 81fed8072d)
2021-01-21 18:00:55 +00:00
Flávio de Assis 377c1acf35 Use new logging options on values.yaml (#13173)
(cherry picked from commit 23a47879ab)
2021-01-21 18:00:40 +00:00
Ryan Hamilton ec8e0eeb8e Display alternative tooltip when a Task has yet to run (no TI) (#13162)
(cherry picked from commit 4ad1accd3f)
2021-01-21 18:00:02 +00:00
Ash Berlin-Taylor 5ca86e232f User werkzeug's own type conversion for request args (#13184)
Werkzeug handles this exact behaviour for us, we don't need to do it
ourselves.

https://github.com/pallets/werkzeug/blob/daeb2d0/src/werkzeug/datastructures.py#L259-L302
(cherry picked from commit 4fe9304c4f)
2021-01-21 17:58:45 +00:00
Kaxil Naik 42496f759e Stop sending Callback Requests if no callbacks are defined on DAG (#13163)
If no on_*_callback are defined on DAG, Callbacks should not be registered
and sent to DAG Processor.

This will reduce the KeyError mentioned in https://github.com/apache/airflow/issues/13047

(cherry picked from commit 2c9c55781e)
2021-01-21 17:57:52 +00:00
Kaxil Naik 1d0047feac Filter DagRuns with Task Instances in removed State while Scheduling (#13165)
closes https://github.com/apache/airflow/issues/13151

(cherry picked from commit ef8f414c20)
2021-01-21 17:57:34 +00:00
Kaxil Naik 7c866a2262 Fix typos in TESTING.rst (#13169)
Since TESTING.rst is not published on Apache Site, we don't run spell check on it and hence there were some typos introuduced without getting noticed.

Time to fix them

(cherry picked from commit 5cf2fbf124)
2021-01-21 17:57:11 +00:00
Kaxil Naik 88f78090c7 Replace deprecated dummy operator path in test_zip.zip (#13172)
Replace deprecated path in `tests/dags/test_zip/test_zip.zip/test_zip.py`:

```
from airflow.operators.dummy_operator import DummyOperator
```

with

```
from airflow.operators.dummy import DummyOperator
```

(cherry picked from commit 8e99ed61ee)
2021-01-21 17:57:06 +00:00
Kaxil Naik edc52e7ff5 Sync Updating Guide with 2.0.0 (#13168)
This commit sync Airflow 2.0 Updating Guide with Master i.e. removes alpha / beta mentions since it is now released

(cherry picked from commit ff9fb36148)
2021-01-21 17:56:46 +00:00
John Bampton 0b83c73065 Remove duplicate pre-commit checks (#13167)
- Sort INTHEWILD.md alphabetically
- Lint Helm Chart

(cherry picked from commit 2e28ab6324)
2021-01-21 17:56:40 +00:00
Kaxil Naik 40e511cb29 Add missing version information to recently added configs (#13161)
These configs were added in 1.10.14 / 2.0.0

(cherry picked from commit 419111696d)
2021-01-21 17:56:19 +00:00
Xiaodong DENG d741a50a3d Minor style fix in docs/extra-packages-ref (#13159)
(cherry picked from commit d2b60cae54)
2021-01-21 17:55:55 +00:00
Kamil Breguła d1bd896ce8 Fix invalid provider name - Apache Kylin (#13157)
(cherry picked from commit 101d561cec)
2021-01-21 17:52:34 +00:00
dependabot[bot] 3cecd14f2d Bump datatables.net from 1.10.21 to 1.10.22 in /airflow/www (#13143)
Bumps [datatables.net](https://github.com/DataTables/Dist-DataTables) from 1.10.21 to 1.10.22.
- [Release notes](https://github.com/DataTables/Dist-DataTables/releases)
- [Commits](https://github.com/DataTables/Dist-DataTables/compare/1.10.21...1.10.22)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit 1be20c614f)
2021-01-21 17:52:10 +00:00
Tomek Urbaszek fac4b760f5 Use generic information in UpdateMask component (#13146)
The UpdateMask is used in connection, pools, variables and dag.
So the docs should be more generic.

(cherry picked from commit c26366ef28)
2021-01-21 17:51:47 +00:00
Kaxil Naik fa98a50043 Fix Headings in CONTRIBUTING.rst (#13120)
(cherry picked from commit 7dc7f85619)
2021-01-21 17:51:30 +00:00
eladkal bc04e96674 Add Airflow 2.0.0 to requirements table (#13140)
(cherry picked from commit d3ddfd1d79)
2021-01-21 17:51:14 +00:00
John Bampton a3271f1252 Fix spelling (#13135)
(cherry picked from commit 625576a3af)
2021-01-21 17:50:43 +00:00
Jarek Potiuk 8f2c58dfaa The default value in chart should be 2.0.0 (#13125)
(cherry picked from commit f5c4b2442d)
2021-01-21 17:50:35 +00:00
Jarek Potiuk a3e5e3fce9 Fix typo in pip upgrade command :( (#13148)
(cherry picked from commit 6cf76d7ac0)
2021-01-21 17:50:29 +00:00
Kamil Breguła ce52abbd14 Fix typo in provider name - Oracle (#13147)
(cherry picked from commit 33e0a70cff)
2021-01-21 17:50:23 +00:00
Kamil Breguła 102b86e546 Add system tests for CloudKMSHook (#13122)
(cherry picked from commit 23f27c1b1c)
2021-01-21 17:50:12 +00:00
Manuel B 2d945f2b0a Fix Google BigQueryHook method get_schema() (#13136)
Co-authored-by: Manuel Bordes <manuel.bordes@gamesys.co.uk>
(cherry picked from commit cddbf81b12)
2021-01-21 17:49:48 +00:00
John Bampton ca20ba079b Fix spelling (#13130)
(cherry picked from commit 8529cb1c7d)
2021-01-21 17:45:49 +00:00
Kaxil Naik 4e37b78691 Remove Kaxil's old record in INTHEWILD.md (#13123)
I don't work at Data Reply anymore

(cherry picked from commit 8d5b4349f5)
2021-01-21 17:45:45 +00:00
Jarek Potiuk 811d54a139 Cleans all DBs on ./breeze stop (#13119)
When ./breeze stop is run, we run docker-compose down under the
hood - by default with --volumes flag which also removes the
volumes. But the volumes were only defined when you
selected the database.

We want to clean up all the volumes on breeze stop
in order to avoid surprizes when you switch the DB and find
the DB is there.

Otherwise when you switch databases while they are running
stop will delete volumes for only the most recently used
database.

The fix makes sure that all the db
volumes are defined always so they are always all deleted on stop

(cherry picked from commit a983273413)
2021-01-21 17:45:41 +00:00
Kaxil Naik 087c2fdaf9 Add guidelines for promoting Committers to PMC (#13090)
This is based on the discussion on the mailing list and proposal from various PMC Members

(cherry picked from commit f5dbc3bdda)
2021-01-21 17:45:36 +00:00
Jarek Potiuk 883473bbaa For v2 target branches python 2.7 and 3.5 images are skipped (#13118)
Previously we skipped building 2.7 and 3.5 for master branch but
now we have also v2-0-test, so it is better to skip the
versions when branch is != v1-10-test (this is the only
DEFAULT_BRANCH - even in v1-10-stable builds v1-10-test is used
as DEFAULT_BRANCH is v1-10-test.

(cherry picked from commit 0f01faa486)
2021-01-21 17:45:28 +00:00
Xiaodong DENG b780f879b5 Avoid confusion in doc for CeleryKubernetesExecutor (#13116)
Make the doc around CeleryKubernetesExecutor clearer.

(cherry picked from commit 2491a9360c)
2021-01-21 17:44:58 +00:00
Felix Uellendall 659f8ef6ff Add Trade Republic to list of Airflow users (#13111)
I changed the company. I am now working for Trade Republic.

(cherry picked from commit 84b4e6e80b)
2021-01-21 17:44:21 +00:00
Marty Jackson 02aa5c5d4d Add The Dyrt to INTHEWILD.md (#13098)
* Add The Dyrt to INTHEWILD.md

(cherry picked from commit 741292ef66)
2021-01-21 17:44:17 +00:00