d5dc1e2632
[AIRFLOW-5747] `real_prefix misses the virtual env created with pyenv and venv ( #6417 )
2019-10-24 20:05:15 +02:00
63344f2e0d
[AIRFLOW-5745] Breeze complete has now licence ( #6415 )
2019-10-24 19:58:30 +02:00
adfcf67d65
[AIRFLOW-5746] move FakeDateTime into the only place it is used ( #6416 )
...
Co-authored-by: Jarek Potiuk <jarek.potiuk@polidea.com>
2019-10-24 19:49:47 +02:00
401003e8e3
[AIRFLOW-5740] Fix Transient failure in Slack test ( #6407 )
...
* [AIRFLOW-5740] Fix Transient failure in Slack test
The transient failure is caused by Dict Ordering
* We were comparing string
We were comparing strings
2019-10-24 19:35:42 +02:00
8d87077e26
[AIRFLOW-XXX] Add Automattic to Airflow users ( #6413 )
2019-10-24 13:36:36 +01:00
66b2a47d9e
[AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability ( #5743 )
...
Co-Authored-By: Kaxil Naik <kaxilnaik@gmail.com>
Co-Authored-By: Ash Berlin-Taylor <ash_github@firemirror.com>
2019-10-24 13:23:13 +01:00
859e1cc79b
[AIRFLOW-XXX] Add resources & links to CONTRIBUTING.rst ( #6405 )
2019-10-24 11:57:55 +02:00
6ba5442222
[AIRFLOW-5073] Change SQLSensor to optionally treat NULL as keep poking ( #6336 )
2019-10-24 10:53:57 +01:00
62675b30c8
[AIRFLOW-5474] Add Basic auth to Druid hook ( #6095 )
2019-10-24 11:44:52 +02:00
47eac794cd
[AIRFLOW-5732] Add unit test for the version command ( #6401 )
...
There's no unit test for the `airflow version` command for now. This PR
adds a unit test for that command so as to avoid an accidental
regression.
2019-10-23 22:25:10 -07:00
f3c3812908
[AIRFLOW-5644] Simplify TriggerDagRunOperator usage ( #6317 )
...
* [AIRFLOW-5644] Simplify TriggerDagRunOperator usage
* Call timezone.parse in execute() to allow for templating
2019-10-23 21:48:10 +02:00
74d2a0d9e7
AIRFLOW-5701: Don't clear xcom explicitly before execution ( #6370 )
2019-10-23 07:37:48 +02:00
e9d65e3d21
[AIRFLOW-5710] Optionally raise exception on unused operator arguments. ( #6332 )
2019-10-22 19:47:50 -07:00
6c7c58c5d3
[AIRFLOW-XXX] Improve wording ( #6391 )
2019-10-22 18:21:55 -07:00
641b8aaf04
[AIRFLOW-5715] Make email, owner context available ( #6385 )
2019-10-22 12:24:32 -07:00
bc53412234
[AIRFLOW-5714] Collect SLA miss emails only from tasks missed SLA ( #6384 )
...
Currently when a task in the DAG missed the SLA,
Airflow would traverse through all the tasks in the DAG
and collect all the task-level emails. Then Airflow would
send an SLA miss email to all those collected emails,
which can add unnecessary noise to task owners that
does not contribute to the SLA miss.
Thus, changing the code to only collect emails
from the tasks that missed the SLA.
2019-10-22 11:37:22 -07:00
3cfe4a1c9d
[AIRFLOW-5632] Rename ComputeEngine operators ( #6306 )
2019-10-22 15:20:24 +02:00
4311c1f074
[AIRFLOW-5696] Add GoogleCloudStorageToSFTPOperator ( #6366 )
2019-10-22 12:00:02 +02:00
16d7accb22
[AIRFLOW-4971] Add Google Display & Video 360 integration ( #6170 )
2019-10-22 11:51:40 +02:00
4e661f535d
[AIRFLOW-5379] Add Google Search Ads 360 operators ( #6228 )
2019-10-22 10:27:57 +02:00
b43922161a
[AIRFLOW-5713] Remove dead code ( #6382 )
2019-10-22 08:31:19 +02:00
417754a14a
[AIRFLOW-4965] Handle quote exceptions in GCP operators ( #6305 )
2019-10-22 08:29:33 +02:00
b08f86290e
[AIRFLOW-5712] Rename internal Dataflow classes ( #6381 )
2019-10-22 08:23:02 +02:00
3d3cc41678
[AIRFLOW-5695] use RUNNING_DEPS to check run from UI ( #6367 )
2019-10-21 16:44:36 -07:00
e344f61f67
[AIRFLOW-5661] Fix create_cluster method of GKEClusterHook ( #6339 )
2019-10-21 22:28:19 +02:00
fc4aa041b0
[AIRFLOW-5667] Improve type annotations in GCP ( #6345 )
2019-10-21 18:31:33 +02:00
44b6a271fb
[AIRFLOW-5665] Add path_exists method to SFTPHook ( #6344 )
...
Co-Authored-By: Kamil Breguła <mik-laj@users.noreply.github.com>
2019-10-21 18:28:58 +02:00
03eede00c9
[AIRFLOW-5707] Add type annotations to SFTPHook ( #6378 )
2019-10-21 17:14:17 +02:00
e7b790ded8
[AIRFLOW-5699] Add more tests for Dataflow integration ( #6369 )
2019-10-21 10:03:49 +02:00
ca77c01a53
[AIRFLOW-5698] Organize Dataflow tests ( #6368 )
2019-10-21 10:00:33 +02:00
636aeb010a
[AIRFLOW-5693] Support the "blocks" component for the Slack messages ( #6364 )
...
- fix doc string issues
2019-10-20 13:46:14 +02:00
4903c9730c
[AIRFLOW-5702] Fix common docstring issues ( #6372 )
2019-10-20 07:28:29 +02:00
c72c427302
[AIRFLOW-5694] Check for blinker in Sentry setup ( #6365 )
2019-10-20 04:16:26 +02:00
c19a60c23d
[AIRFLOW-5680] Fixes Kubernetes hangs ( #6347 )
2019-10-19 21:40:59 +02:00
b8c0263213
Add logo info to readme ( #6349 )
2019-10-18 21:18:44 +02:00
9c57dd8d4a
[AIRFLOW-5688] Merge multiple heads in alembic migrations ( #6362 )
2019-10-18 17:23:01 +01:00
9ec562f88e
[AIRFLOW-5640] Document and test `email` parameters of BaseOperator ( #6315 )
...
* Refactored get_email_address_list to have a better
separation between string handling and other iterables.
* Explicitely casting get_email_address_list argument
to a list in case the argument was an iterable. This
enables direct support for tuples, sets or the like.
* Fixed type annotation of email parameter of
BaseOperator to show that iterables are directly
supported.
* Added docstring entries for email, email_on_retry,
email_on_failure and queue in BaseOperator.
2019-10-18 14:35:15 +01:00
19e32b4e2c
[AIRFLOW-5656] Rename provider to providers module ( #6333 )
2019-10-18 14:54:30 +02:00
7bdc063fa3
[AIRFLOW-5415] Enable authentication for Druid hook ( #5967 )
2019-10-18 13:52:20 +02:00
0790ede702
[AIRFLOW-4574] SSHHook private_key may only be supplied in extras ( #6163 )
...
* discussion on original PR suggested removing private_key option as init param
* with this PR, can still provide through extras, but not as init param
* also add support for private_key in tunnel -- missing in original PR for this issue
* remove test related to private_key init param
* use context manager to auto-close socket listener so tests can be re-run
2019-10-18 10:34:08 +01:00
10c3f7f0ed
[AIRFLOW-5649] Skips tests when relevant .py files are not changed ( #6321 )
2019-10-18 10:49:58 +02:00
489e7fe9a7
[AIRFLOW-5687] Fix Upgrade pip to 19.0.2 in CI build pipeline ( #6361 )
2019-10-18 09:45:12 +01:00
a8babec808
[AIRFLOW-5339] Fix infinite wait for Spark subprocess
2019-10-18 00:46:57 -07:00
dde65a609a
[AIRFLOW-XXXX] Include code tags for sample file names ( #6360 )
2019-10-18 00:49:11 +02:00
f2b7f5a85a
[AIRFLOW-5687] Upgrade pip to 19.0.2 ( #6358 )
2019-10-17 21:37:51 +01:00
e35829e472
Revert "AIRFLOW-5608: Gracefully stop executor when SIGTERM is received by SchedulerJib ( #6274 )" ( #6357 )
...
This reverts commit 7c9b44dbfc
2019-10-17 15:45:39 +01:00
f8794d888f
[AIRFLOW-5684] docker-compose-kubernetes still used ( #6353 )
2019-10-17 14:54:19 +02:00
ac42428bf5
[AIRFLOW-5643] Reduce duplicated logic in S3Hook ( #6313 )
...
S3Hook.load_bytes is duplicating the logic of S3Hook.load_file_obj.
Instead, we should stay consistent : S3Hook.load_string is already
delegating the logic to S3Hook.load_bytes, so we can use the same
approach to delegate to S3Hook.load_file_obj
2019-10-16 18:49:59 +02:00
d4e282d9b2
[AIRFLOW-5126] Read aws_session_token in extra_config of the aws hook ( #6303 )
2019-10-16 16:22:07 +01:00
8b0c9cbb55
[AIRFLOW-5224] Add encoding parameter to GoogleCloudStorageToBigQuery… ( #6297 )
2019-10-15 20:15:11 -07:00
mucio
Jarek Potiuk
Michael R. Crusoe
Kaxil Naik
Igor Khrol
Zhou Fang
Tomek
Anton Zayniev
awelsh93
Kengo Seki
Bas Harenslak
Fokko Driesprong
Joshua Carp
Steve Taggart
Tao Feng
Chao-Han Tsai
mislo
TobKed
Kamil Breguła
Ping Zhang
MinJae Kwon
Marcus Levine
Leah E. Cole
Martin Winkel
scrawfor
dstandish
toughrogrammer
Frank Cash
Ash Berlin-Taylor
Louis Guitton
JohannesGuenther