github
/
incubator-airflow
зеркало из https://github.com/github/incubator-airflow.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
6 982 коммитов 59 Ветки 111 Теги 246 MiB
Граф коммитов

50 Коммитов

Автор SHA1 Сообщение Дата
TobKed 75484bc37e [AIRFLOW-5446] Rewrite Google KMS Hook to Google Cloud Python (#6065) 2019-09-10 14:12:01 +02:00
Jacob Ferriero 6db9f86925 [AIRFLOW-4983] Add ability for DataflowPythonOperator to submit jobs w/ python3 (#5602) 2019-09-09 08:02:38 +02:00
Tomek Urbaszek ae0d03eba7 [AIRFLOW-5401] Add support for project_id from connection in GKE 
This change adds support for reading project_id value from
connection configuration GKE operators.
 2019-09-07 17:14:36 +02:00
Kamil Breguła 004f353342 [AIRFLOW-3511][AIRFLOW-3512] Add Cloud Memorystore integration 2019-09-07 17:12:52 +02:00
Tomek 1b1d79c0a6 [AIRFLOW-4964] Add BigQuery Data Transfer Hook and Operator (#5769) 
* [AIRFLOW-4964] Add BigQuery Data Transfer Hook and Operator
 2019-09-06 12:48:42 +02:00
TobKed f4b64b3557 [AIRFLOW-5412] Add get_conn/get_client to hooks tests (#6018) 
* [AIRFLOW-5412] Add get_conn/get_client to hooks tests
 2019-09-06 12:20:38 +02:00
Tomek 0948bcf868 [AIRFLOW-5319] Add system tests for Dataproc (#5924) 
* [AIRFLOW-5319] Add system tests for Dataproc
 2019-09-05 17:44:32 +02:00
Tomek ad61f3272a [AIRFLOW-5332] Add system tests for Datastore (#5937) 2019-09-05 17:35:31 +02:00
TobKed 0f548b8cf2 [AIRFLOW-5403] Fix input check in GKE Operator (#6004) 2019-09-05 16:48:14 +02:00
Kamil Breguła a4ebd9d2eb [AIRFLOW-5358] Improved mocking of the project ID (#5964) 
* [AIRFLOW-5358] Improved mocking of the project ID
 2019-09-05 12:49:45 +02:00
Tomek 6e53281af6 [AIRFLOW-5399] Add invoke operator for GCP Functions (#5995) 2019-09-04 09:07:45 +02:00
Tomek fa9e91227b [AIRFLOW-5386] Move Google Dataproc to core (#5986) 
For more information check AIP-21.
 2019-09-03 23:00:38 +02:00
Tomek 7a59358ffd [AIRFLOW-5356] Fix GCP Datastore unit tests (#5961) 
This commit adds additional mocking for Datastore tests which
tests fallback_to_default_project_id decorator.
 2019-08-30 18:17:28 +02:00
Tomek bc5c8f32a1 [AIRFLOW-5320] Add system tests for PubSub (#5925) 2019-08-30 15:28:12 +02:00
Kamil Breguła 1b69a0b120
[AIRFLOW-5353] Simplify GKEClusterHook (#5960) 2019-08-30 14:26:48 +02:00
Kamil Breguła 7c0d9b46ce
[AIRFLOW-5303] Use project_id from GCP credentials (#5907) 2019-08-30 01:11:34 +02:00
Kaxil Naik b420ada05b
[AIRFLOW-5351] Move all GCP Cloud SQL tests in 1 file (#5956) 2019-08-29 23:04:00 +01:00
Tomek 5fb9972672 [AIRFLOW-5330] Add project_id to Datastore hook and operators (#5935) 2019-08-29 23:04:39 +02:00
Tomek 8eeedf538c [AIRFLOW-5346] Add system tests for GKECluster (#5947) 2019-08-29 22:54:30 +02:00
Tomek 88a94cb1bb [AIRFLOW-5341] Use more precise mock of time.sleep (#5950) 
Some tests were mocking 'time.sleep' instead of using more precise
'airflow.module.path.time.sleep' mock.
 2019-08-29 22:52:10 +02:00
Tomek 382b21e234 [AIRFLOW-5322] Fix flaky test - GCP Transfer Service hook (#5931) 2019-08-28 15:56:38 +02:00
Tomek 747a8f1706 [AIRFLOW-5317] Remove invalid arguments in tests for GCPTransferServiceWaitForJobStatusSensor (#5921) 
This commit removes unused  in tests for GCPTransferServiceWaitForJobStatusSensor.
 2019-08-27 20:03:04 +01:00
Omar A df3397cd6c [AIRFLOW-5158] Add Google Sheets hook (#5845) 2019-08-27 09:17:06 +02:00
Tomek c921812261 [AIRFLOW-5099] Add Google Cloud AutoML operators (#5720) 2019-08-26 09:50:12 +02:00
Tomek 23d104203e [AIRFLOW-5309] Use assert_called_once or has_calls in tests (#5912) 
Using mock.assert_call_with method can result in flaky tests
(ex. iterating through dict in python 3.5 which does not
store order of elements). That's why it's better to
use assert_called_once_with or has_calls methods.
 2019-08-26 07:03:43 +02:00
Tomek ac652744ad [AIRFLOW-4771] Improve initialization of hook in the GCP operators (#5893) 
Hook should be initialized in execute method not in operator's constructor.
 2019-08-24 22:23:31 +02:00
Tomek 7f6f2f008e [AIRFLOW-5294] Make GCP MLEngine pylint compatible (#5892) 
This commit make MLEngine operators and tests pylint compatible
 2019-08-23 20:37:32 -07:00
Qingping Hou 3bb4b34f29 [AIRFLOW-5251] add missing typing-extensions dep for py37 (#5857) 2019-08-23 11:51:13 +01:00
Tomek 2d46d5ff4e [AIRFLOW-4768] Add timeout parameter to Cloud Video Intelligence operators (#5862) 2019-08-22 22:23:02 +02:00
Bas Harenslak 5196db38f2 [AIRFLOW-5241] Make all test class names consistent (#5847) 
Make all test class names consistent by starting with Test
 2019-08-22 14:14:25 +02:00
Tomek b7cdedc5dc [AIRFLOW-5193] Move GCP Cloud Build to core (#5798) 
This commit moves GCP Cloud Build from contrib to core.
For more information check AIP-21.
 2019-08-21 11:00:55 +02:00
Tomek 6837af99d3 [AIRFLOW-5197] Move GCP Datastore to core (#5801) 
This commit moves GCP Datastore from contrib to core.
For more information check AIP-21.
 2019-08-21 10:58:34 +02:00
Tomek cfaf90175a [AIRFLOW-5202] Move GCP MLEngine to core (#5805) 
This commit moves GCP MLEngine from contrib to core.
For more information check AIP-21.
 2019-08-21 10:58:19 +02:00
Tomek 08a56979d0 [AIRFLOW-5203] Move GCP BigTable to core (#5806) 
This commit moves GCP BigTable from contrib to core.
For more information check AIP-21.
 2019-08-21 10:58:07 +02:00
Tomek dfecb609c4 [AIRFLOW-5255] Move GCP SQL to core (#5861) 
This commit moves GCP SQL from contrib to core.
For more information check AIP-21.
 2019-08-21 10:57:54 +02:00
Tomek fb02f026ab [AIRFLOW-5190] Move GCP Compute to core (#5797) 2019-08-21 10:50:37 +02:00
Tomek d98e7c4b0a [AIRFLOW-5254] Move GCP Tasks to core (#5860) 
This commit moves GCP Tasks from contrib to core.
For more information check AIP-21.
 2019-08-20 13:38:00 +01:00
Tomek 56670acfdd [AIRFLOW-5253] Move GCP KMS to core (#5859) 
This commit moves GCP KMS from contrib to core.
For more information check AIP-21.
 2019-08-20 13:36:40 +01:00
Tomek da582d5c56 [AIRFLOW-5252] Move GCP Transfer to core (#5858) 
This commit moves GCP Transfer from contrib to core.
For more information check AIP-21.
 2019-08-19 19:53:44 -07:00
Tomek 4dc358d654 [AIRFLOW-5201] Move GCP Functions to core (#5804) 
This commit moves GCP Functions from contrib to core.
For more information check AIP-21.
 2019-08-17 20:34:57 +01:00
Tomek b1abd83b42 [AIRFLOW-5189] Move GCP Vision to core (#5796) 
This commit moves GCP Vision from contrib to core.
For more information check AIP-21.
 2019-08-17 20:30:44 +01:00
Tomek b3acb3df8c [AIRFLOW-5195] Move GCP Dataflow to core (#5799) 
This commit moves GCP Dataflow from contrib to core.
For more information check AIP-21.
 2019-08-17 20:29:28 +01:00
Tomek e071bd7268 [AIRFLOW-5196] Move Google DLP to core (#5800) 
This commit moves GCP DLP from contrib to core.
For more information check AIP-21.
 2019-08-17 20:28:36 +01:00
Tomek d8163167aa [AIRFLOW-5199] Move GCP Spanner to core (#5802) 
This commit moves GCP Spanner from contrib to core.
For more information check AIP-21.
 2019-08-17 20:27:06 +01:00
Tomek 01995c0dcb [AIRFLOW-5200] Move GCP PubSub to core (#5803) 
This commit moves GCP PubSub from contrib to core.
For more information check AIP-21.
 2019-08-17 20:26:26 +01:00
Tomek 74d0305835 [AIRFLOW-5186] Move GCP Translate to core (#5795) 
This commit moves GCP Translate from contrib to core.
For more information check AIP-21.
 2019-08-17 20:22:14 +01:00
Tomek ee3fdacdd9 [AIRFLOW-5185] Move GCP Video Intelligence to core (#5794) 
This commit moves GCP Video Intelligence from contrib to core.
For more information check AIP-21.
 2019-08-17 19:26:38 +01:00
Tomek f5204cd1e4 [AIRFLOW-5187] Move GCP Container to core (#5793) 
This commit moves GCP Container from contrib to core.
For more information check AIP-21.
 2019-08-17 19:23:55 +01:00
Tomek e2d76b9215 [AIRFLOW-5184] Move GCP Natural Language to core (#5792) 2019-08-16 11:21:18 +01:00
Tomek 40745aa225 [AIRFLOW-5183] Preprare documentation for new GCP import paths (#5791) 2019-08-14 19:07:43 +02:00