github
/
incubator-airflow
зеркало из https://github.com/github/incubator-airflow.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
6 662 коммитов 59 Ветки 111 Теги 246 MiB
Граф коммитов

421 Коммитов

Автор SHA1 Сообщение Дата
Ryan Yuan 6ef0e37a63 [AIRFLOW-4811] Implement GCP DLP' Hook and Operators (#5539) 
Implement GCP DLP' Hook and Operators
 2019-07-30 14:37:37 +02:00
Qingping Hou 32847180b6 [AIRFLOW-5021] move gitpython into setup_requires (#5640) 
Since this dependency is only used in setup.py
 2019-07-24 13:19:20 +01:00
Jarek Potiuk f03dc61268
[AIRFLOW-5031] Added limit on tzlocal release (#5649) 2019-07-23 23:06:38 +02:00
Jarek Potiuk 2d086d77f1
[AIRFLOW-4117] Travis CI uses multi-stage images to run tests (#4938) 2019-07-17 22:42:43 +02:00
Nathaniel Ritholtz 2c32435667 [AIRFLOW-4934] Bump Flask to resolve Werkzeug ProxyFix (#5571) 2019-07-12 16:22:12 +01:00
Jarek Potiuk 8f41eb75ad [AIRFLOW-4905] Add colours to flake8 output (#5541) 2019-07-11 14:06:44 +01:00
Luqman Abdul Mushawwir 2b366934cd [AIRFLOW-4900] Resolve incompatible version of Werkzeug (#5535) 
* [AIRFLOW-4900] Resolve incompatible version of Werkzeug

Pin Werkzeug version to >= 0.15 as flask requirement needs it.

* Update setup.py
 2019-07-05 20:16:57 +02:00
Jarek Potiuk 7448d3c0cd
[AIRFLOW-4885] Add virtualenv dependency (#5518) 2019-07-03 05:12:52 +02:00
Asgeir Berland 722379adc7 [AIRFLOW-4564] ACI bugfixes and improvements (#5319) 2019-07-01 17:23:02 +01:00
Jarek Potiuk b71f36bc92 [AIRFLOW-4841] Pin Sphinx AutoApi to 1.0.0 (#5468) 
Co-authored-by: kaxil <kaxilnaik@gmail.com>
 2019-06-24 14:23:01 +05:30
Fokko Driesprong 8644a6f94c
[AIRFLOW-4777] Simplify python_requires in setup (#5405) 
From Airflow 2.0 we support Python 3.5+, but not yet Python 4.0
 2019-06-17 16:23:36 +02:00
Joshua Carp 9cfeb31fc1 [AIRFLOW-4795] Upgrade alembic to latest release. (#5411) 2019-06-17 09:56:37 +02:00
Gordon Ball 201e67100c [AIRFLOW-4731] Fix GCS hook with google-storage-client 1.16 (#5368) 
google-storage-client 1.16 introduced a breaking change where the
signature of client.get_bucket changed from (bucket_name) to
(bucket_or_name). Calls with named arguments to this method now fail.
This commit makes all calls positional to work around this.
 2019-06-10 11:44:31 +01:00
Jarek Potiuk 54d41dff6e [AIRFLOW-4754] Fixed failure when no .git repo is found (#5396) 2019-06-09 21:24:04 +02:00
Bas Harenslak 6dd3f31a04 [AIRFLOW-4689] Make setup.py Pylint compatible (#5395) 2019-06-09 08:35:22 -07:00
Bas Harenslak 18b27387f5 [AIRFLOW-4725] Fix setup.py PEP440 & Sphinx-PyPI-upload dependency (#5363) 2019-06-08 22:41:56 -07:00
Bas Harenslak 669b026c0b [AIRFLOW-4364] Add Pylint to CI (#5238) 2019-05-30 22:02:09 +02:00
Ash Berlin-Taylor 3dcfe2801c
[AIRFLOW-4343] Show warning in UI if scheduler is not running (#5127) 
Now that the webserver is more stateless, if the scheduler is not
running the list of dags won't populate, making it harder for new
starters to work out what is going on.

New dep is BSD-2 which is Cat-A under ASF
 2019-05-29 10:50:07 +01:00
Bas Harenslak 3322782aa6 [AIRFLOW-4570] Remove future library (#5324) 
Remove all usage of the future library because we're dropping Python 2 support.
 2019-05-25 18:58:33 +02:00
Joshua Carp 05bfeec6ea [AIRFLOW-4546] Upgrade google-cloud-bigtable. (#5307) 
Resolves conflicts among `gcp_api` dependency versions.
 2019-05-20 21:43:58 +02:00
Chao-Han Tsai 577f893672 [AIRFLOW-4215] Replace mock with unittest.mock (#5292) 2019-05-17 15:40:03 +02:00
bolkedebruin 786aeaedd4
[AIRFLOW-4473] Add papermill operator (#5254) 
Add papermill operator to productize python notebooks.
 2019-05-09 23:01:16 +02:00
Junda Yang 945f45b463 [AIRFLOW-4146] Fix CgroupTaskRunner errors (#5224) 
* fix cgrouptaskrunner

* add comment

* call super.on_finish() to delete temp cfg files

* flake 8

* update docstring

* add unittests

* add header

* refactor cgrouptaskrunner test

* refactor cgrouptaskrunner test

* empty commit to trigger tesgt

* nit

* add cgroups to setup.py devel_all
 2019-05-03 09:24:37 -07:00
Tao Feng 406882f5e5 [AIRFLOW-4452] Webserver and Scheduler keep crashing because of slackclient update (#5225) 2019-05-01 21:48:36 -07:00
Antoni Smoliński df18b02d2a [AIRFLOW-4168] Create Google Cloud Video Intelligence Operators (#4985) 2019-04-27 20:48:37 +02:00
Kaxil Naik e43626d622 [AIRFLOW-4380] Remove enum dependency from setup.py (#5146) 2019-04-21 20:05:36 -07:00
Ash Berlin-Taylor da024dded4
[AIRFLOW-4342] Use @cached_property instead of re-implementing it each time (#5126) 
It's not many lines, but I just find this much clearer
 2019-04-18 10:00:30 +01:00
Kaxil Naik cb4e39a1ab [AIRFLOW-4299] Upgrade to Celery 4.3.0 to fix crashing workers (#5116) 2019-04-17 10:25:50 +08:00
Kaxil Naik 7f36c36d1e [AIRFLOW-4332] Upgrade sqlalchemy to remove security Vulnerability (#5113) 2019-04-16 18:16:29 +01:00
John Cheng ac464be88e [AIRFLOW-3672] Add support for Mongo DB DNS Seedlist Connection Format (#4481) 
* [AIRFLOW-3672] Add support for Mongo DB DNS Seedlist Connection Format

https://docs.mongodb.com/manual/reference/connection-string/index.html#dns-seedlist-connection-format
http://api.mongodb.com/python/current/api/pymongo/mongo_client.html#pymongo.mongo_client.MongoClient

* [AIRFLOW-3672] Add unit test for srv uri

* [AIRFLOW-3672] Fix unit test for Mongo srv uri

* [AIRFLOW-3672] Construct MongoDB URI when hook init
 2019-04-14 22:18:52 +02:00
Felix Uellendall 3eb2f547ac [AIRFLOW-3993] Add tests for salesforce hook (#4829) 
- refactor code
- update docs
- change sign_in to get_conn
- add salesforce to devel_all packages
- add note to UPDATING.md

Co-Authored-By: mik-laj <mik-laj@users.noreply.github.com>
 2019-04-14 21:07:43 +02:00
Felix Uellendall c41b878691 [AIRFLOW-4266] Add mypy to setup.py dependencies (#5069) 
- remove old comment regarding to cloudant upgrade
 2019-04-14 21:04:58 +02:00
Jarek Potiuk 5b53d9987f [AIRFLOW-4115] Multi-staging Aiflow Docker image (#4936) 2019-04-13 15:03:02 +02:00
Xiaodong ee4815d05c [AIRFLOW-XXX] Change allowed version of Jinja2 to fix CVE-2019-10906 (#5075) 2019-04-10 17:15:13 +01:00
Kaxil Naik ec7c67ff95
[AIRFLOW-4255] Replace Discovery based api with client based for GCS (#5054) 2019-04-09 19:46:00 +01:00
Felix Uellendall b93f2649ae [AIRFLOW-4220] Change CloudantHook to a new major version and add tests (#5023) 
- upgrade cloudant version from `>=0.5.9,<2.0` to `>=2.0`
- remove the use of the `schema` attribute in the connection
- remove `db` function since the database object can also be retrieved by calling `cloudant_session['database_name']`
- update docs
- refactor code
 2019-04-05 23:12:13 +01:00
Kamil Breguła 99c8a6f125 [AIRFLOW-3971] Add Google Cloud Natural Language operators (#4980) 2019-04-05 22:36:50 +01:00
Paul Bramhall 04ce1551a0 [AIRFLOW-4246] Flask-Oauthlib needs downstream dependencies pinning due to breaking changes (#5045) 2019-04-05 17:11:50 +01:00
Xiaodong 6ed112201e [AIRFLOW-XXX] Pin psycopg2 due to breaking change (#5036) 2019-04-04 15:44:05 +01:00
Ash Berlin-Taylor 2fcb761067 [AIRFLOW-XXX] Pin Sendgrid dep. (#5031) 
Sendgrid just released 6.0 with breaking changes, and I don't have the
time to define how to change our code or tests - as they haven't
published a migration guide :(
 2019-04-03 15:38:25 +02:00
Antoni Smoliński 5c17948184 [AIRFLOW-3960] Adds Google Cloud Speech operators (#4780) 2019-04-01 20:42:52 +01:00
Joshua Carp 0e30793849 [AIRFLOW-4177] Check types in tests (#4994) 2019-03-29 23:03:34 +01:00
Kamil Breguła e27950a75c [AIRFLOW-3811] automatic generation of API Reference in docs (#4788) 
Co-authored-by: Jarek Potiuk <jarek.potiuk@polidea.com>
 2019-03-26 18:06:14 +00:00
Tao Feng f211f3acc3 [AIRFLOW-XXX] Upgrade FAB to latest version (#4955) 2019-03-21 15:58:18 -07:00
Ash Berlin-Taylor 66104151d9
[AIRFLOW-3768] Escape search parameter in pagination controls (#4911) 
The "minidom" we were using from lxml didn't cope with the &gt; etc
entities (because it is an XML parser, not an HTML parser): rather than
special casing each one I have instead swapped out lxml-based parser for
BeautifulSoup which 1) handles these, and 2) is pure-python so is easier
to install :)
 2019-03-15 17:46:53 +00:00
Joshua Carp 2c255e9e0c [AIRFLOW-3862] Check types with mypy. (#4685) 2019-03-15 11:28:52 +00:00
Ash Berlin-Taylor 25f5a5b14a [AIRFLOW-4083] Add tests for link generation utils (#4912) 
We were making use of the "bleach" module or jinja.escape function to
clean parameters when it wasn't needed - we could simply call .format on
the Markup object and it will handle escaping for us. (format the
object, not format the string passed to the constructor)

This removes the (direct?) dependency on bleach - one less thing to
depend on is a good thing too.
 2019-03-14 22:50:41 +08:00
Jarek Potiuk 93e15b5fc5 [AIRFLOW-3939] Add Google Cloud Translate operator (#4755) 2019-03-14 10:13:44 +00:00
morgendave 8d5d46022b [AIRFLOW-3272] Add base grpc hook (#4101) 
* [AIRFLOW-3272] add base grpc hook

* [AIRFLOW-3272] fix based on comments and add more docs

* [AIRFLOW-3272] add extra fields to www_rabc view in connection model

* [AIRFLOW-3272] change url for grpc, fix some bugs

* [AIRFLOW-3272] Add mcck for grpc

* [AIRFLOW-3272] add unit tests for grpc hook

* [AIRFLOW-3272] add gRPC connection howto doc
 2019-03-12 18:54:47 -07:00
OmerJog f19538a319 [AIRFLOW-4012] - Upgrade tabulate to 0.8.3 (#4838) 
Pin upper version bound to 0.9 too, so we don't have to update this again
until 0.9 is out (when we can check for compatability)
 2019-03-05 21:27:25 +00:00