github
/
incubator-airflow
зеркало из https://github.com/github/incubator-airflow.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
5 759 коммитов 59 Ветки 111 Теги 246 MiB
Граф коммитов

5759 Коммитов

Автор SHA1 Сообщение Дата
Dane Laban 1c3e20a14e [AIRFLOW-XXX] Update README.md (#4482) 
We are using Airflow at Nine.
 2019-01-10 22:31:59 -08:00
Drew J. Sonne d108d8d2aa [AIRFLOW-3605] Load plugins from entry_points (#4412) 
* [AIRFLOW-3605] Add entrypoint plugin docs

This documentation came from https://github.com/apache/incubator-airflow/pull/730 which had already started work on a PR for this functionality.

* [AIRFLOW-3605] Extend plugin loading functionality

Added business logic to import AirflowPlugin classes through entry_points.
This means we don’t have to interact with the file system directly to install plugins, and can manage them via `pip`.
 2019-01-10 15:03:59 -08:00
Tobias Kaymak 2836ec0a75 [AIRFLOW-3657] Fix zendesk integration (#4466) 2019-01-10 09:57:15 -08:00
Xiaodong 24bc74bc5f [AIRFLOW-3504] Refine the functionality of "/health" endpoint (#4309) 
Extend the functionality of "/health" endpoint by:
1. Checking if database backend can be connected;
2. Checking the latest scheduler heartbeat

The response will be in format:
  {
    "metadatabase":{
      "status":"healthy"
    },
    "scheduler":{
      "status":"healthy",
      "latest_scheduler_heartbeat":"2018-12-26 17:15:11+00:00"
    }
  }

This is done for both /www and /www_rbac.

No authentication is required to access this endpoint (no
sensitive information will be exposed through it).

Tests & documentation are added accordingly.

(Deleted an unnecessary line in airflow/www/views.py as well)
 2019-01-09 22:58:29 -08:00
Kaxil Naik 0e112d35c7
[AIRFLOW-3662] Add dependency for Enum (#4468) 2019-01-09 23:09:48 +00:00
Ash Berlin-Taylor 2f0d021cb3 [AIRFLOW-3655] Escape links generated in model views (#4463) 2019-01-09 23:06:42 +00:00
Daniel Marcous c15b1f305b [AIRFLOW-3661] Add Waze as an Airflow user (#4469) 2019-01-09 23:04:18 +00:00
Joshua Carp c49de67e0d [AIRFLOW-3596] Clean up undefined template variables. (#4401) 2019-01-09 14:16:41 -08:00
Jarek Potiuk 3bfc304ce4 [AIRFLOW-3630] Cleanup of GCP Cloud SQL Connection (#4451) 2019-01-09 20:36:39 +00:00
Felix 59eb9cfeac [AIRFLOW-3582] Adds tests for HiveStatsCollectionOperator (#4398) 2019-01-09 20:27:04 +00:00
Tao Feng 94b977e8ef [AIRFLOW-3646] Rename plugins_manager.py to test_xx to trigger tests (#4464) 2019-01-09 20:23:03 +00:00
Xiaodong 0222a36ab1 [AIRFLOW-3627] Refine performance of /task_stats (#4433) 2019-01-09 00:24:52 +00:00
Kevin P. Fleming 9972c4fa98 [AIRFLOW-XXX] Add Bloomberg to list of Airflow users (#4462) 
* Add Bloomberg to list of Airflow users

* Indicate that Daniel Imberman is Bloomberg's Airflow PoC
 2019-01-08 13:57:21 -08:00
Joshua Carp 167f2cd6cd [AIRFLOW-3631] Update flake8 and fix lint. (#4436) 2019-01-08 09:12:08 -08:00
Fokko Driesprong 5d75028d28 [AIRFLOW-3478] Make sure that the session is closed (#4298) 2019-01-08 10:45:40 +00:00
Fokko Driesprong 327860fe4f [AIRFLOW-3515] Remove the run_duration option (#4320) 2019-01-08 10:40:10 +00:00
Felix 76d755d777 [AIRFLOW-3519] Fix example http operator (#4455) 2019-01-08 09:36:52 +00:00
Tao Feng 8a45a3fdd0 [AIRFLOW-3650] Skip running on mysql for the flaky test (#4457) 2019-01-08 09:23:32 +01:00
Tao Feng b450065dc2
[AIRFLOW-XXX] Fix a flake8 error to unblock CI (#4453) 2019-01-06 20:45:49 -08:00
Arnau Villoro 621b69e2bc [AIRFLOW-XXX] Add BaseTIS as Airflow User (#4442) 2019-01-06 22:02:21 +00:00
Raja Gangopadhya 76e9fd746d [AIRFLOW-2082] Resolve a bug in adding password_auth to api as auth method (#4343) 2019-01-06 21:59:55 +00:00
Dana Ma 3d5160fc80 [AIRFLOW-3610] Add region param for EMR jobflow creation (#4418) 2019-01-06 21:51:01 +00:00
Kaxil Naik 0bea2d6e8e
[AIRFLOW-3531] Fix test for GCS to GCS Transfer Hook (#4452) 2019-01-06 21:40:54 +00:00
Joshua Carp e5c4f6cadc [AIRFLOW-3531] Add gcs to gcs transfer operator. (#4331) 2019-01-06 19:35:31 +00:00
K.K. POON 67d8ab760b [AIRFLOW-3624] Add masterType parameter to MLEngineTrainingOperator (#4428) 2019-01-06 10:36:00 -08:00
Ping Zhang 9021b427c5 [AIRFLOW-3636] Fix a test introduced in #4425 (#4446) 2019-01-05 22:17:11 -08:00
Tao Feng 0a5d8cb536
[AIRFLOW-3637] Fix test for HiveToMySqlTransfer Operator (#4447) 2019-01-05 22:13:05 -08:00
Xiaodong 7da9bb68ce [AIRFLOW-3635] Fix incorrect logic in detele_dag (introduced in PR#4406) (#4445) 
Incorrect logic was introduced in PR #4406
(https://github.com/apache/airflow/pull/4406)

This was not found out because the Travis CI was not working as expected.
 2019-01-05 21:56:21 -08:00
Kaxil Naik 94bfeef7cb
[AIRFLOW-3612] Remove remaining incubator mention & Fix CI Behaviour (#4441) 2019-01-05 16:32:12 +00:00
Tao Feng d151f75d9d [AIRFLOW-XXX] Update committer list based on latest TLP discussion (#4427) 2019-01-05 14:10:31 +00:00
Tao Feng 67572025cc [AIRFLOW-3612] Remove incubation/incubator mention (#4419) 2019-01-05 14:05:25 +00:00
Kaxil Naik c5e26d4bee
[AIRFLOW-3634] Fix GCP Spanner Test (#4440) 2019-01-05 13:15:56 +00:00
Jarek Potiuk c31c2bde25 [AIRFLOW-3480] Add GCP Spanner Database Operators (#4353) 2019-01-05 12:06:56 +00:00
Kaxil Naik cfcb4dac23 [AIRFLOW-3150] Make execution_date templated in TriggerDagRunOperator (#4359) 2019-01-04 18:17:45 -08:00
aliceabe 089fa65419 [AIRFLOW-3622] Add ability to pass hive_conf to HiveToMysqlTransfer (#4432) 2019-01-04 15:35:07 -08:00
Sumit Maheshwari 25b7cd185f [AIRFLOW-3340] Placeholder support in connections form (#4185) 2019-01-04 13:55:56 +00:00
Jarek Potiuk f806fa13fe [AIRFLOW-3527] Update Cloud SQL Proxy to have shorter path for UNIX socket (#4350) 2019-01-04 13:54:33 +00:00
Dariusz Aniszewski d0233ba643 [AIRFLOW-3446] Add Google Cloud BigTable operators (#4354) 2019-01-04 13:50:15 +00:00
Ping Zhang 6f616f0dd9 [AIRFLOW-3623] Support download logs by attempts from UI (#4425) 2019-01-03 20:40:58 -08:00
Conrad Lee 8d5ffef599 [AIRFLOW-3316] For gcs_to_bq: add missing init of schema_fields var (#4430) 2019-01-03 23:18:05 +00:00
Chinh Nguyen 11a36d17f2 [AIRFLOW-3583] Fix AirflowException import (#4389) 
Looks like the class path changed and broke wasb_hook
 2019-01-03 14:42:42 -08:00
OmerJog 658b7c477e [AIRFLOW-2641] Fix MySqlToHiveTransfer to handle MySQL DECIMAL correctly 2019-01-03 20:25:57 +00:00
Tao Feng 02106e77ca
[AIRFLOW-XXX] Add a doc on how to add a new role in RBAC UI (#4426) 2019-01-03 11:34:49 -08:00
Kaxil Naik 97c761ddab
[AIRFLOW-XXX] Fix WeekDay Sensor Example (#4431) 2019-01-03 10:51:46 +00:00
Kaxil Naik 55ec82439e [AIRFLOW-3560] Add DayOfWeek Sensor (#4363) 
* [AIRFLOW-3560] Add WeekEnd & DayOfWeek Sensors

* Change to using Enum

* Fix Docstring

* Refactor into a Single Sensor
 2019-01-03 10:35:35 +01:00
raman dd1bf84938 [AIRFLOW-3613] Updated ReadMe to add Adobe as an airflow user (#4420) 
* [AIRFLOW-3613] Updated ReadMe to add Adobe as an airflow user

* [AIRFLOW-3613] Corrected Adobe as an Airflow User entry in README file
 2019-01-02 20:08:26 -08:00
Kevin Pullin 8bdf6c4ab9 [AIRFLOW-3402] Support global k8s affinity and toleration configs (#4247) 
* Support setting global k8s affinity and toleration configuration in the airflow config file.

* Copy annotations as dict, not list

* Update airflow/contrib/kubernetes/pod.py

Co-Authored-By: kppullin <kevin.pullin@gmail.com>
 2019-01-02 21:40:14 +01:00
Fokko Driesprong 51d0aca83b [AIRFLOW-XXX] Fix Flake8 error 2019-01-02 14:24:39 +01:00
Jimmy Cao 9266c0fb60 [AIRFLOW-2548] Output plugin import errors to web UI (#3930) 2019-01-02 14:11:15 +01:00
Kaxil Naik aa2dc603ab [AIRFLOW-3578] Fix Type Error for BigQueryOperator (#4384) 
* Fix Type Error for BigQueryOperator and support the unicode object.
* Add tests
 2019-01-02 13:36:23 +01:00