891a90665c
[AIRFLOW-XXX] Add information about default pool to docs ( #6019 )
2019-09-05 16:54:14 +01:00
4ab6982f0b
[AIRFLOW-5072] gcs_hook should download once ( #5685 )
...
When a user supplied a filename the expected behaviour is that airflow
downloads the file and does not return it's content as a string.
2019-09-05 17:54:07 +02:00
756069766d
[AIRFLOW-3804] Extend MySQL to GCS operator tests ( #5993 )
...
This commit adds additional test related to problem mentioned in initial
issue https://issues.apache.org/jira/browse/AIRFLOW-3804\#
2019-09-05 17:49:19 +02:00
0948bcf868
[AIRFLOW-5319] Add system tests for Dataproc ( #5924 )
...
* [AIRFLOW-5319] Add system tests for Dataproc
2019-09-05 17:44:32 +02:00
7018f47460
[AIRFLOW-5361] Add system tests for BigQuery ( #5968 )
2019-09-05 17:43:04 +02:00
ad61f3272a
[AIRFLOW-5332] Add system tests for Datastore ( #5937 )
2019-09-05 17:35:31 +02:00
0f548b8cf2
[AIRFLOW-5403] Fix input check in GKE Operator ( #6004 )
2019-09-05 16:48:14 +02:00
c4cc83971d
Passed **kwargs to push_by_returning ( #5810 )
...
Without **kwargs push_by_returning was giving error, so added that parameter.
2019-09-05 15:50:53 +02:00
9165739e90
[AIRFLOW-5409] Fix BigQuery hook tests ( #6017 )
2019-09-05 15:37:07 +02:00
ebffd39c99
[AIRFLOW-XXX] Use full command in examples ( #5973 )
2019-09-05 12:09:20 +01:00
57f77e0c09
[AIRFLOW-5308] Pass credentials object to pandas_gbq ( #5911 )
2019-09-05 12:55:06 +02:00
a4ebd9d2eb
[AIRFLOW-5358] Improved mocking of the project ID ( #5964 )
...
* [AIRFLOW-5358] Improved mocking of the project ID
2019-09-05 12:49:45 +02:00
9278f794c3
[AIRFLOW-XXX] Make Breeze The default integration test environment ( #6001 )
...
* [AIRFLOW-XXX] Make Breeze The default integration test environment
Co-Authored-By: Chao-Han Tsai <milton0825@gmail.com>
2019-09-05 10:28:48 +02:00
55d7e70932
Fix webserver link in breeze.rst ( #6013 )
...
- change webserver link to RST syntax
- link resulted in a `about:blank#blocked` .
2019-09-04 17:09:29 -07:00
51d2e1bbb2
[AIRFLOW-5404] Switch back to using Lucas-C pre-commit-hooks
...
The fuzzy licence matching implemented by Jarek Potiuk
was accepted and merged by Lucas-C in his pre-commit
hooks implementation (released today ver. 1.1.7)
so we can switch back to it.
2019-09-05 01:12:12 +02:00
17d4179db2
[AIRFLOW-4851] Refactor K8S codebase with k8s API models ( #5481 )
...
* [AIRLFOW-4851] refactor Airflow kubernetes
* [AIRFLOW-4851] refactor Airflow k8s models
* [AIRFLOW-4851] Fix linting and tests
* Refactor and add some tests
* [AIRLFOW-4851] Add assertions to PodOperator tests
2019-09-04 16:24:31 -05:00
6f6112e262
[AIRFLOW-5405] Fixed Unbound variable in force build
2019-09-04 23:07:35 +02:00
9143893c99
[AIRFLOW-5347] Add system tests for GoogleCloudStorage ( #5951 )
2019-09-04 22:21:15 +02:00
6fb821713f
[AIRFLOW-XXX] Add Chagelog for 1.10.5
2019-09-04 15:35:01 +01:00
9f16c68a5f
[AIRFLOW-4391] Fix tooltip for None-State Tasks in 'Recent Tasks' ( #5909 )
2019-09-04 15:12:23 +01:00
c9e2d04fde
[AIRFLOW-4085] FileSensor now takes glob patterns for `filepath` ( #5358 )
2019-09-04 11:02:28 +01:00
ba9e521e71
[AIRFLOW-5344] Add --proxy-user parameter to SparkSubmitOperator ( #5948 )
...
`spark2-submit` supports `--proxy-user` parameter which should be handled by SparkSubmitOperator.
```
$ spark2-submit --help 2>&1 | grep proxy
--proxy-user NAME User to impersonate when submitting the application.
```
2019-09-04 10:47:09 +01:00
54fa1cf75e
[AIRFLOW-XXX] Remove flake8 from PR template
...
Since we have pre-commit and flake8 on CI there seems to be no
reason to keep this bullet point in PR template.
2019-09-04 10:48:13 +02:00
13843151fb
[Airflow-4668] Make airflow/contrib/utils Pylint compatible ( #5916 )
2019-09-04 09:23:57 +01:00
6e53281af6
[AIRFLOW-5399] Add invoke operator for GCP Functions ( #5995 )
2019-09-04 09:07:45 +02:00
fa9e91227b
[AIRFLOW-5386] Move Google Dataproc to core ( #5986 )
...
For more information check AIP-21.
2019-09-03 23:00:38 +02:00
4af841c925
[Airflow-XXXX] Fix a typo
2019-09-03 20:58:59 +02:00
f497d1d5aa
[AIRFLOW-4858] Deprecate "Historical convenience functions" in airflow.configuration ( #5495 )
...
1. Issue old conf method deprecation warnings properly and remove current old conf method usages.
2. Unify the way to use conf as `from airflow.configuration import conf`
2019-09-03 17:08:55 +01:00
c5c6448ff9
[AIRFLOW-5367] Remove hook initialization in ctor from BigtableTableWaitForReplicationSensor ( #5974 )
2019-09-03 15:38:26 +01:00
9d6b58d871
[AIRFLOW-5389] better organized scripts for building CI docker deps
2019-09-03 16:13:41 +02:00
16dad6a203
[AIRFLOW-XXX] Adds BlueKiri and Logitrabel to companies using Airflow ( #5991 )
...
[ci skip]
2019-09-03 13:57:47 +01:00
a9ba915799
[AIRFLOW-5129] Add typehint to GCP DLP hook ( #5980 )
2019-09-03 13:39:37 +02:00
319b80437c
[AIRFLOW-5365] No need to do image rebuild when switching master/v1-10-test ( #5972 )
2019-09-03 11:20:25 +01:00
f46b54a10e
[AIRFLOW-5360] Type annotations for BaseSensorOperator ( #5966 )
2019-09-03 11:36:26 +02:00
6060c2aca0
[AIRFLOW-XXX] Added Bexs Bank to list of Airflow Users ( #5988 )
2019-09-02 20:35:24 +01:00
2ae5256df6
[AIRFLOW-5388] Add airflow version label to newly created buckets ( #5987 )
...
To tag and track GCP resources spawned from Airflow, we have
been adding airflow specific label(s) to GCP API service calls
whenever possible and applicable.
2019-09-02 20:54:55 +02:00
7d74a13194
[AIRFLOW-XXX] Added AMPATH Kenya to list of Airflow Users ( #5983 )
2019-09-02 18:53:52 +01:00
bcd8390fbb
[AIRFLOW-XXX] Add Kroton as official user ( #5984 )
2019-09-02 18:51:53 +01:00
c35b93218e
[AIRFLOW-5384] Improve dst param info in FileToGCSOperator ( #5985 )
...
This commit add more info about dst parameter to indicate that the path
must include file name.
2019-09-02 18:50:47 +01:00
a8dc50db4b
[AIRFLOW-5371] Remove yamllint as prerequisite to run pre-commit
2019-09-02 11:37:32 -04:00
4d7bf965cc
[AIRFLOW-5372] Apache license check runs locally on LICENCE changes
...
Licence check for RAT runs too often (every time pre-commit is modified) and it
should only be run (locally) when any of *LICEN[S|C]E* files change. We anyhow
run full check on CI so this is local optimisation (it runs too long while you
play with .pre-commit-config.yaml - and we will probably be able to detect some
problems locally as well when new modules are added.
2019-09-02 11:08:48 -04:00
1158f57375
[AIRFLOW-XXXX] Update BigQuery View section URL to ViewDefinition ( #5981 )
2019-09-02 09:17:10 +02:00
7ee2b99229
[AIRFLOW-5314] Create test for new import paths ( #5920 )
2019-09-01 02:51:28 +02:00
593dfb9134
[AIRFLOW-5364] Fix missing port numbers for local ci scripts
2019-08-31 09:49:26 -04:00
572465e020
[AIRFLOW-5363] Fixed building docs in breeze
2019-08-31 07:47:10 -04:00
7a59358ffd
[AIRFLOW-5356] Fix GCP Datastore unit tests ( #5961 )
...
This commit adds additional mocking for Datastore tests which
tests fallback_to_default_project_id decorator.
2019-08-30 18:17:28 +02:00
6138208749
[AIRFLOW-5335] Simplify GCSHook test ( #5958 )
2019-08-30 16:50:54 +01:00
dc0018b2f2
[AIRFLOW-5357] Fix Content-Type for exported variables.json file ( #5962 )
2019-08-30 15:20:48 +01:00
bc5c8f32a1
[AIRFLOW-5320] Add system tests for PubSub ( #5925 )
2019-08-30 15:28:12 +02:00
1b69a0b120
[AIRFLOW-5353] Simplify GKEClusterHook ( #5960 )
2019-08-30 14:26:48 +02:00
Matthew Bowden
Tobias Kaymak
Tomek
Kamil Breguła
TobKed
Gaurav Prachchhak
Jarek Potiuk
Temo Ojeda
Jarek Potiuk
davlum
kaxil
Felix Uellendall
Zacharya
Igor Khrol
Omkar Desai
Hao Liang
Sergio Soto
Ryan Yuan
TobKed
Felipe F. Barral
Fatma Ali
João A Silva
Tomek
Kaxil Naik