github
/
incubator-airflow
зеркало из https://github.com/github/incubator-airflow.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
5 748 коммитов 59 Ветки 111 Теги 246 MiB
Граф коммитов

5748 Коммитов

Автор SHA1 Сообщение Дата
Xiaodong 0222a36ab1 [AIRFLOW-3627] Refine performance of /task_stats (#4433) 2019-01-09 00:24:52 +00:00
Kevin P. Fleming 9972c4fa98 [AIRFLOW-XXX] Add Bloomberg to list of Airflow users (#4462) 
* Add Bloomberg to list of Airflow users

* Indicate that Daniel Imberman is Bloomberg's Airflow PoC
 2019-01-08 13:57:21 -08:00
Joshua Carp 167f2cd6cd [AIRFLOW-3631] Update flake8 and fix lint. (#4436) 2019-01-08 09:12:08 -08:00
Fokko Driesprong 5d75028d28 [AIRFLOW-3478] Make sure that the session is closed (#4298) 2019-01-08 10:45:40 +00:00
Fokko Driesprong 327860fe4f [AIRFLOW-3515] Remove the run_duration option (#4320) 2019-01-08 10:40:10 +00:00
Felix 76d755d777 [AIRFLOW-3519] Fix example http operator (#4455) 2019-01-08 09:36:52 +00:00
Tao Feng 8a45a3fdd0 [AIRFLOW-3650] Skip running on mysql for the flaky test (#4457) 2019-01-08 09:23:32 +01:00
Tao Feng b450065dc2
[AIRFLOW-XXX] Fix a flake8 error to unblock CI (#4453) 2019-01-06 20:45:49 -08:00
Arnau Villoro 621b69e2bc [AIRFLOW-XXX] Add BaseTIS as Airflow User (#4442) 2019-01-06 22:02:21 +00:00
Raja Gangopadhya 76e9fd746d [AIRFLOW-2082] Resolve a bug in adding password_auth to api as auth method (#4343) 2019-01-06 21:59:55 +00:00
Dana Ma 3d5160fc80 [AIRFLOW-3610] Add region param for EMR jobflow creation (#4418) 2019-01-06 21:51:01 +00:00
Kaxil Naik 0bea2d6e8e
[AIRFLOW-3531] Fix test for GCS to GCS Transfer Hook (#4452) 2019-01-06 21:40:54 +00:00
Joshua Carp e5c4f6cadc [AIRFLOW-3531] Add gcs to gcs transfer operator. (#4331) 2019-01-06 19:35:31 +00:00
K.K. POON 67d8ab760b [AIRFLOW-3624] Add masterType parameter to MLEngineTrainingOperator (#4428) 2019-01-06 10:36:00 -08:00
Ping Zhang 9021b427c5 [AIRFLOW-3636] Fix a test introduced in #4425 (#4446) 2019-01-05 22:17:11 -08:00
Tao Feng 0a5d8cb536
[AIRFLOW-3637] Fix test for HiveToMySqlTransfer Operator (#4447) 2019-01-05 22:13:05 -08:00
Xiaodong 7da9bb68ce [AIRFLOW-3635] Fix incorrect logic in detele_dag (introduced in PR#4406) (#4445) 
Incorrect logic was introduced in PR #4406
(https://github.com/apache/airflow/pull/4406)

This was not found out because the Travis CI was not working as expected.
 2019-01-05 21:56:21 -08:00
Kaxil Naik 94bfeef7cb
[AIRFLOW-3612] Remove remaining incubator mention & Fix CI Behaviour (#4441) 2019-01-05 16:32:12 +00:00
Tao Feng d151f75d9d [AIRFLOW-XXX] Update committer list based on latest TLP discussion (#4427) 2019-01-05 14:10:31 +00:00
Tao Feng 67572025cc [AIRFLOW-3612] Remove incubation/incubator mention (#4419) 2019-01-05 14:05:25 +00:00
Kaxil Naik c5e26d4bee
[AIRFLOW-3634] Fix GCP Spanner Test (#4440) 2019-01-05 13:15:56 +00:00
Jarek Potiuk c31c2bde25 [AIRFLOW-3480] Add GCP Spanner Database Operators (#4353) 2019-01-05 12:06:56 +00:00
Kaxil Naik cfcb4dac23 [AIRFLOW-3150] Make execution_date templated in TriggerDagRunOperator (#4359) 2019-01-04 18:17:45 -08:00
aliceabe 089fa65419 [AIRFLOW-3622] Add ability to pass hive_conf to HiveToMysqlTransfer (#4432) 2019-01-04 15:35:07 -08:00
Sumit Maheshwari 25b7cd185f [AIRFLOW-3340] Placeholder support in connections form (#4185) 2019-01-04 13:55:56 +00:00
Jarek Potiuk f806fa13fe [AIRFLOW-3527] Update Cloud SQL Proxy to have shorter path for UNIX socket (#4350) 2019-01-04 13:54:33 +00:00
Dariusz Aniszewski d0233ba643 [AIRFLOW-3446] Add Google Cloud BigTable operators (#4354) 2019-01-04 13:50:15 +00:00
Ping Zhang 6f616f0dd9 [AIRFLOW-3623] Support download logs by attempts from UI (#4425) 2019-01-03 20:40:58 -08:00
Conrad Lee 8d5ffef599 [AIRFLOW-3316] For gcs_to_bq: add missing init of schema_fields var (#4430) 2019-01-03 23:18:05 +00:00
Chinh Nguyen 11a36d17f2 [AIRFLOW-3583] Fix AirflowException import (#4389) 
Looks like the class path changed and broke wasb_hook
 2019-01-03 14:42:42 -08:00
OmerJog 658b7c477e [AIRFLOW-2641] Fix MySqlToHiveTransfer to handle MySQL DECIMAL correctly 2019-01-03 20:25:57 +00:00
Tao Feng 02106e77ca
[AIRFLOW-XXX] Add a doc on how to add a new role in RBAC UI (#4426) 2019-01-03 11:34:49 -08:00
Kaxil Naik 97c761ddab
[AIRFLOW-XXX] Fix WeekDay Sensor Example (#4431) 2019-01-03 10:51:46 +00:00
Kaxil Naik 55ec82439e [AIRFLOW-3560] Add DayOfWeek Sensor (#4363) 
* [AIRFLOW-3560] Add WeekEnd & DayOfWeek Sensors

* Change to using Enum

* Fix Docstring

* Refactor into a Single Sensor
 2019-01-03 10:35:35 +01:00
raman dd1bf84938 [AIRFLOW-3613] Updated ReadMe to add Adobe as an airflow user (#4420) 
* [AIRFLOW-3613] Updated ReadMe to add Adobe as an airflow user

* [AIRFLOW-3613] Corrected Adobe as an Airflow User entry in README file
 2019-01-02 20:08:26 -08:00
Kevin Pullin 8bdf6c4ab9 [AIRFLOW-3402] Support global k8s affinity and toleration configs (#4247) 
* Support setting global k8s affinity and toleration configuration in the airflow config file.

* Copy annotations as dict, not list

* Update airflow/contrib/kubernetes/pod.py

Co-Authored-By: kppullin <kevin.pullin@gmail.com>
 2019-01-02 21:40:14 +01:00
Fokko Driesprong 51d0aca83b [AIRFLOW-XXX] Fix Flake8 error 2019-01-02 14:24:39 +01:00
Jimmy Cao 9266c0fb60 [AIRFLOW-2548] Output plugin import errors to web UI (#3930) 2019-01-02 14:11:15 +01:00
Kaxil Naik aa2dc603ab [AIRFLOW-3578] Fix Type Error for BigQueryOperator (#4384) 
* Fix Type Error for BigQueryOperator and support the unicode object.
* Add tests
 2019-01-02 13:36:23 +01:00
Xiaodong ecc77c2bf7 [AIRFLOW-XXX] Fix Flake8 error (#4422) 2019-01-02 12:22:08 +00:00
Steve Jacobs 671769ce8d [AIRFLOW-1921] Add support for https and user auth (#2879) 2019-01-02 08:57:08 +01:00
Felix 0a0c88ae07 [AIRFLOW-3580] Adds tests for HiveToMySqlTransfer (#4387) 
- adds tests for hive_to_mysql operator
- refactoring
 2019-01-01 23:50:12 -08:00
ianbillett c5c0705de8 [AIRFLOW-XXX] Adds image code comment (#4413) 2019-01-01 23:45:47 -08:00
Daniel Imberman 6bb88fab1e [AIRFLOW-360] Launch custom images to Airflow CI tests (#4416) 
To help move away from Minikube, we need to remove the dependency on
a local docker registry and move towards a solution that can be used
in any kubernetes cluster. Custom image names allow users to use
systems like docker, artifactory and gcr
 2019-01-02 08:40:22 +01:00
eladkal 4b99adf136 [Airflow-XXX] - fix missing type in docstring (#4403) 
Add missing type of delegate_to
 2019-01-01 23:17:25 -08:00
Xiaodong ba47ca60c4 [AIRFLOW-3587] Remove unnecessary condition checks in dag_stats & task_stats (#4395) 
These condition checks will always be pass no matter
whether "all_dags" is in filter_dag_ids.

They're not necessary.
 2019-01-01 23:13:58 -08:00
Xiaodong 0d5c127d72 [AIRFLOW-3606] Fix Flake8 test & fix the Flake8 errors introduced since Flake8 test was broken (#4415) 
The flake8 test in the Travis CI was broken since https://github.com/apache/incubator-airflow/pull/4361
(7a6acbf5b3 )

And some Flake8 errors (code style/quality issues. found in 10 files) were introduce since flake8 test was broken.
 2019-01-01 22:49:38 -08:00
Xiaodong 7ee926618a [AIRFLOW-3576] Remove unnecessray arg 'root' for /delete in dag.html (#4380) 
'root' is not used anywhere in `delete` method in either
www/views.py or www_rbac/views.py.

Having it in url_for("airflow.delete", dag_id=dag.dag_id, root=root)
in dag.html is meaningless.
 2019-01-01 21:56:32 -08:00
Daniel Imberman f4f55fdc2c [AIRFLOW-3609] Fix bug in volumes readWriteMany (#4417) 
When running integration tests on a k8s cluster vs. Minikube
I discovered that we were actually using an invalid permission
structure for our persistent volume. This commit fixes that.
 2019-01-01 21:55:43 -08:00
Felix 8938d2c727 [AIRFLOW-XXX] Reorder Airflow Users (#4410) 2018-12-31 17:18:49 +05:30