9070531981
[AIRFLOW-5336] Add ability to make updating FAB perms on webserver in… ( #5940 )
...
Co-Authored-By: Kaxil Naik <kaxilnaik@gmail.com>
2019-10-28 19:21:31 +00:00
1f2573aa7c
[AIRFLOW-5772] Use mock.patch.dict for manipulation of env vars ( #6444 )
2019-10-28 18:03:04 +00:00
8136675c55
[AIRFLOW-5673] Rename GcfHook to CloudFunctionsHook ( #6414 )
2019-10-28 17:10:49 +01:00
286a68a244
[AIRFLOW-5678] Rename GCPTextToSpeechHook to CloudTextToSpeechHook ( #6411 )
2019-10-28 17:05:28 +01:00
c61ef4a6f6
[AIRFLOW-5676] Rename CloudSpannerHook to SpannerHook ( #6409 )
2019-10-28 17:03:57 +01:00
a9fc1a2814
[AIRFLOW-5671] rename DataProcHook to DataprocHook ( #6404 )
2019-10-28 17:01:46 +01:00
ffe7ba9819
[AIRFLOW-5631] Change way of running GCP system tests ( #6299 )
...
* [AIRFLOW-5631] Change way of running GCP system tests
This commit proposes a new way of running GCP related system tests.
It uses SystemTests base class and authentication is provided by a
context manager thus it's easier to understand what's going on.
2019-10-28 14:26:37 +01:00
3fb9d4935f
[AIRFLOW-5798] Set default ExternalTaskSensor.external_task_id ( #6431 )
...
- fix type annotation for ExternalTaskSensor
2019-10-28 13:31:16 +01:00
376f954c04
[AIRFLOW-5766] Use httpbin.org in http_default ( #6438 )
...
- the url for the http_default changes from google.com to httpbin.org
- adjust example_http_operator
2019-10-28 13:03:23 +01:00
37a342d0e9
[AIRFLOW-5793] add test to detect multiple alembic revision heads ( #6449 )
2019-10-28 09:52:10 +01:00
b66fbe4657
[AIRFLOW-5770] Add example for PythonVirtualenvOperator ( #6441 )
2019-10-28 08:44:38 +01:00
171e1bb3d5
[AIRFLOW-5771] Make Alembic migrations lineair ( #6442 )
...
Remove branchpoints to make it lineair again.
2019-10-27 23:17:29 +01:00
f2caa451fc
[AIRFLOW-5742] Move Google Cloud Vision to providers package ( #6424 )
2019-10-27 13:04:06 +01:00
4132f3bc70
Revert "AIRFLOW-5701: Don't clear xcom explicitly before execution ( #6370 )"
...
This reverts commit 74d2a0d9e7
2019-10-27 09:26:50 +01:00
4440d5e56d
[AIRFLOW-5764][depends on #6434 ] Avoid loading corrupted DAGs in a breeze environment ( #6436 )
2019-10-26 22:54:00 +02:00
3cc816d260
[AIRFLOW-5749][AIRFLOW-4162] Support the "blocks" component for the Slack operators ( #6418 )
...
Co-authored-by: bskim45 <bskim45@gmail.com>
2019-10-26 20:11:21 +02:00
2f8c9dacc1
[AIRFLOW-5759] Don't allow additional arguments in BaseOperator ( #6435 )
2019-10-26 15:11:56 +02:00
5dd1dbc322
[AIRFLOW-5663] Switch to real-time logging in PythonVirtualenvOperator ( #6389 )
...
Co-Authored-By: Kamil Breguła <mik-laj@users.noreply.github.com>
2019-10-26 14:39:39 +02:00
4cf4a34f0e
[AIRFLOW-5717] Add get_tree_map method to SFTPHook ( #6387 )
2019-10-26 13:43:52 +02:00
a80707fdd2
[AIRFLOW-XXX] Updates to Breeze documentation from GSOD ( #6285 )
...
Co-authored-by: Elena Fedotova <lavel@mail.ru>
Co-authored-by: Felix Uellendall <feluelle@users.noreply.github.com>
2019-10-26 13:31:51 +02:00
4649563b56
[AIRFLOW-5727] SqoopHook: Build --connect parameter only if port/schema are defined ( #6397 )
2019-10-26 00:32:44 +01:00
93933eb34d
[AIRFLOW-5757] Improve test_on_kill test ( #6430 )
2019-10-26 00:26:50 +01:00
52c2be5a6c
[AIRFLOW-XXX] Clarify daylight savings time behavior ( #6324 )
2019-10-26 00:21:16 +01:00
c04ee1375b
[AIRFLOW-XXX] GSoD: Adding 'Create a custom operator' doc ( #6348 )
2019-10-26 00:20:19 +01:00
dc8b13fe21
[AIRFLOW-XXX] Improve GCP documentation ( #6433 )
2019-10-25 16:31:55 +02:00
7e440dab11
[AIRFLOW-5754] Improved RAT checking ( #6429 )
...
All files are mounted in CI now and checked using the RAT tool.
As opposed to only the runtime-needed files. This is enabled for CI
build only as mounting all local files to Docker (especially on Mac)
has big performance penalty when running the checks (slow osxfs
volume and thousands of small node_modules files generated make the
check runs for a number of minutes). The RAT checks will by default
use the selective volumes but on CI they will mount the whole
source directory.
Also latest version of RAT tool is used now and the output - list
of checked files - is additionally printed as output of the RAT
check so that we are sure the files we expect to be there, are
actually verified.
2019-10-25 09:34:39 +01:00
351ae4e541
[AIRFLOW-5748] Remove python auto-detection ( #6423 )
...
The detection of python version is complex because we need to handle
several cases - including determining the version from image name
on DockerHub, detecting python version from python in the environment,
finally forced from python version. This caused multiple problems
with Travis where we run tests with different version (auto-detected
from current python - especially when python3 became present in
Travis' python 2.7 images. Now all the jobs in Travis have
PYTHON_VERSION forced and the code responsible for detecting current
python version has been removed as it is not needed in this case.
2019-10-25 09:56:08 +02:00
ba01ed538f
[AIRFLOW-5750] Licence check is done also for non-executable .sh ( #6425 )
2019-10-25 09:54:36 +02:00
3b0da2f1ce
[AIRFLOW-5723] Simplify illegal arguments test ( #6394 )
2019-10-25 09:48:51 +02:00
7b6da531c2
[AIRFLOW-5690] Change log level local_task_job.py ( #6422 )
2019-10-24 23:11:43 +02:00
c7ed169740
[AIRFLOW-5746] Fix problems with static checks ( #6420 )
2019-10-24 21:22:07 +02:00
d5dc1e2632
[AIRFLOW-5747] `real_prefix misses the virtual env created with pyenv and venv ( #6417 )
2019-10-24 20:05:15 +02:00
63344f2e0d
[AIRFLOW-5745] Breeze complete has now licence ( #6415 )
2019-10-24 19:58:30 +02:00
adfcf67d65
[AIRFLOW-5746] move FakeDateTime into the only place it is used ( #6416 )
...
Co-authored-by: Jarek Potiuk <jarek.potiuk@polidea.com>
2019-10-24 19:49:47 +02:00
401003e8e3
[AIRFLOW-5740] Fix Transient failure in Slack test ( #6407 )
...
* [AIRFLOW-5740] Fix Transient failure in Slack test
The transient failure is caused by Dict Ordering
* We were comparing string
We were comparing strings
2019-10-24 19:35:42 +02:00
8d87077e26
[AIRFLOW-XXX] Add Automattic to Airflow users ( #6413 )
2019-10-24 13:36:36 +01:00
66b2a47d9e
[AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability ( #5743 )
...
Co-Authored-By: Kaxil Naik <kaxilnaik@gmail.com>
Co-Authored-By: Ash Berlin-Taylor <ash_github@firemirror.com>
2019-10-24 13:23:13 +01:00
859e1cc79b
[AIRFLOW-XXX] Add resources & links to CONTRIBUTING.rst ( #6405 )
2019-10-24 11:57:55 +02:00
6ba5442222
[AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking ( #6336 )
2019-10-24 10:53:57 +01:00
62675b30c8
[AIRFLOW-5474] Add Basic auth to Druid hook ( #6095 )
2019-10-24 11:44:52 +02:00
47eac794cd
[AIRFLOW-5732] Add unit test for the version command ( #6401 )
...
There's no unit test for the `airflow version` command for now. This PR
adds a unit test for that command so as to avoid an accidental
regression.
2019-10-23 22:25:10 -07:00
f3c3812908
[AIRFLOW-5644] Simplify TriggerDagRunOperator usage ( #6317 )
...
* [AIRFLOW-5644] Simplify TriggerDagRunOperator usage
* Call timezone.parse in execute() to allow for templating
2019-10-23 21:48:10 +02:00
74d2a0d9e7
AIRFLOW-5701: Don't clear xcom explicitly before execution ( #6370 )
2019-10-23 07:37:48 +02:00
e9d65e3d21
[AIRFLOW-5710] Optionally raise exception on unused operator arguments. ( #6332 )
2019-10-22 19:47:50 -07:00
6c7c58c5d3
[AIRFLOW-XXX] Improve wording ( #6391 )
2019-10-22 18:21:55 -07:00
641b8aaf04
[AIRFLOW-5715] Make email, owner context available ( #6385 )
2019-10-22 12:24:32 -07:00
bc53412234
[AIRFLOW-5714] Collect SLA miss emails only from tasks missed SLA ( #6384 )
...
Currently when a task in the DAG missed the SLA,
Airflow would traverse through all the tasks in the DAG
and collect all the task-level emails. Then Airflow would
send an SLA miss email to all those collected emails,
which can add unnecessary noise to task owners that
does not contribute to the SLA miss.
Thus, changing the code to only collect emails
from the tasks that missed the SLA.
2019-10-22 11:37:22 -07:00
3cfe4a1c9d
[AIRFLOW-5632] Rename ComputeEngine operators ( #6306 )
2019-10-22 15:20:24 +02:00
4311c1f074
[AIRFLOW-5696] Add GoogleCloudStorageToSFTPOperator ( #6366 )
2019-10-22 12:00:02 +02:00
16d7accb22
[AIRFLOW-4971] Add Google Display & Video 360 integration ( #6170 )
2019-10-22 11:51:40 +02:00
Nathaniel Ritholtz
Kamil Breguła
mislo
Tomek
Vladimir Gavrilenko
MinJae Kwon
dstandish
Fokko Driesprong
Louis Guitton
wjiangqc
TobKed
Jarek Potiuk
Mindaugas
Joshua Carp
Kartik Khare
Francisco Chiang
mucio
Michael R. Crusoe
Kaxil Naik
Igor Khrol
Zhou Fang
Anton Zayniev
awelsh93
Kengo Seki
Bas Harenslak
Steve Taggart
Tao Feng
Chao-Han Tsai