Граф коммитов

432 Коммитов

Автор SHA1 Сообщение Дата
Jarek Potiuk e1cb8ce99b
[AIRFLOW-5180] Added static checks (yamllint) + auto-licences for yaml file (#5790) 2019-08-22 10:13:56 -04:00
Qingping Hou e6a20acb13 [AIRFLOW-5140] fix all missing type annotation errors from dmypy (#5664) 2019-08-16 18:49:32 +01:00
Jarek Potiuk 70e937a8d8
[AIRFLOW-5161] Static checks are run automatically in pre-commit hooks (#5777) 2019-08-14 20:53:28 -04:00
Kaxil Naik 34fbd029f7
[AIRFLOW-5209] Bump Sphinx version to fix doc build (#5814) 2019-08-14 10:39:40 +01:00
Kaxil Naik 44eb89d672
[AIRFLOW-4222] Add cli autocomplete for bash & zsh (#5789) 2019-08-13 22:34:33 +01:00
Bas Harenslak 9f14bd8e43 [AIRFLOW-4992] Replace backports configparser by Python native configparser (#5617) 2019-08-07 07:52:24 +02:00
Ryan Yuan 7cdf99a437 [AIRFLOW-4746] Implement GCP Cloud Tasks' Hook and Operators (#5402)
Implement GCP Cloud Tasks' Hook and Operators
2019-08-07 07:41:27 +02:00
Jarek Potiuk 8b41c3f129
[AIRFLOW-5051] Better coverage integration (#5732) 2019-08-06 15:03:18 +02:00
Kamil Breguła 8dcb976377 [AIRFLOW-4813] Add the client_info parameter during GCP's client library initialization (#5728) 2019-08-06 07:47:15 +02:00
Jarek Potiuk bfff185edb
[AIRFLOW-5089] Spanner compatibility bug causes missing imports (#5703) 2019-08-01 13:57:16 +02:00
Tomek f76d9daca5 [AIRFLOW-5065] Add colors to console log (#5681)
This commit adds custom formatter for Airflow console log to display colours
when connected to a TTY
2019-07-30 17:03:34 +01:00
Ryan Yuan 6ef0e37a63 [AIRFLOW-4811] Implement GCP DLP' Hook and Operators (#5539)
Implement GCP DLP' Hook and Operators
2019-07-30 14:37:37 +02:00
Qingping Hou 32847180b6 [AIRFLOW-5021] move gitpython into setup_requires (#5640)
Since this dependency is only used in setup.py
2019-07-24 13:19:20 +01:00
Jarek Potiuk f03dc61268
[AIRFLOW-5031] Added limit on tzlocal release (#5649) 2019-07-23 23:06:38 +02:00
Jarek Potiuk 2d086d77f1
[AIRFLOW-4117] Travis CI uses multi-stage images to run tests (#4938) 2019-07-17 22:42:43 +02:00
Nathaniel Ritholtz 2c32435667 [AIRFLOW-4934] Bump Flask to resolve Werkzeug ProxyFix (#5571) 2019-07-12 16:22:12 +01:00
Jarek Potiuk 8f41eb75ad [AIRFLOW-4905] Add colours to flake8 output (#5541) 2019-07-11 14:06:44 +01:00
Luqman Abdul Mushawwir 2b366934cd [AIRFLOW-4900] Resolve incompatible version of Werkzeug (#5535)
* [AIRFLOW-4900] Resolve incompatible version of Werkzeug

Pin Werkzeug version to >= 0.15 as flask requirement needs it.

* Update setup.py
2019-07-05 20:16:57 +02:00
Jarek Potiuk 7448d3c0cd
[AIRFLOW-4885] Add virtualenv dependency (#5518) 2019-07-03 05:12:52 +02:00
Asgeir Berland 722379adc7 [AIRFLOW-4564] ACI bugfixes and improvements (#5319) 2019-07-01 17:23:02 +01:00
Jarek Potiuk b71f36bc92 [AIRFLOW-4841] Pin Sphinx AutoApi to 1.0.0 (#5468)
Co-authored-by: kaxil <kaxilnaik@gmail.com>
2019-06-24 14:23:01 +05:30
Fokko Driesprong 8644a6f94c
[AIRFLOW-4777] Simplify python_requires in setup (#5405)
From Airflow 2.0 we support Python 3.5+, but not yet Python 4.0
2019-06-17 16:23:36 +02:00
Joshua Carp 9cfeb31fc1 [AIRFLOW-4795] Upgrade alembic to latest release. (#5411) 2019-06-17 09:56:37 +02:00
Gordon Ball 201e67100c [AIRFLOW-4731] Fix GCS hook with google-storage-client 1.16 (#5368)
google-storage-client 1.16 introduced a breaking change where the
signature of client.get_bucket changed from (bucket_name) to
(bucket_or_name). Calls with named arguments to this method now fail.
This commit makes all calls positional to work around this.
2019-06-10 11:44:31 +01:00
Jarek Potiuk 54d41dff6e [AIRFLOW-4754] Fixed failure when no .git repo is found (#5396) 2019-06-09 21:24:04 +02:00
Bas Harenslak 6dd3f31a04 [AIRFLOW-4689] Make setup.py Pylint compatible (#5395) 2019-06-09 08:35:22 -07:00
Bas Harenslak 18b27387f5 [AIRFLOW-4725] Fix setup.py PEP440 & Sphinx-PyPI-upload dependency (#5363) 2019-06-08 22:41:56 -07:00
Bas Harenslak 669b026c0b [AIRFLOW-4364] Add Pylint to CI (#5238) 2019-05-30 22:02:09 +02:00
Ash Berlin-Taylor 3dcfe2801c
[AIRFLOW-4343] Show warning in UI if scheduler is not running (#5127)
Now that the webserver is more stateless, if the scheduler is not
running the list of dags won't populate, making it harder for new
starters to work out what is going on.

New dep is BSD-2 which is Cat-A under ASF
2019-05-29 10:50:07 +01:00
Bas Harenslak 3322782aa6 [AIRFLOW-4570] Remove future library (#5324)
Remove all usage of the future library because we're dropping Python 2 support.
2019-05-25 18:58:33 +02:00
Joshua Carp 05bfeec6ea [AIRFLOW-4546] Upgrade google-cloud-bigtable. (#5307)
Resolves conflicts among `gcp_api` dependency versions.
2019-05-20 21:43:58 +02:00
Chao-Han Tsai 577f893672 [AIRFLOW-4215] Replace mock with unittest.mock (#5292) 2019-05-17 15:40:03 +02:00
bolkedebruin 786aeaedd4
[AIRFLOW-4473] Add papermill operator (#5254)
Add papermill operator to productize python notebooks.
2019-05-09 23:01:16 +02:00
Junda Yang 945f45b463 [AIRFLOW-4146] Fix CgroupTaskRunner errors (#5224)
* fix cgrouptaskrunner

* add comment

* call super.on_finish() to delete temp cfg files

* flake 8

* update docstring

* add unittests

* add header

* refactor cgrouptaskrunner test

* refactor cgrouptaskrunner test

* empty commit to trigger tesgt

* nit

* add cgroups to setup.py devel_all
2019-05-03 09:24:37 -07:00
Tao Feng 406882f5e5 [AIRFLOW-4452] Webserver and Scheduler keep crashing because of slackclient update (#5225) 2019-05-01 21:48:36 -07:00
Antoni Smoliński df18b02d2a [AIRFLOW-4168] Create Google Cloud Video Intelligence Operators (#4985) 2019-04-27 20:48:37 +02:00
Kaxil Naik e43626d622 [AIRFLOW-4380] Remove enum dependency from setup.py (#5146) 2019-04-21 20:05:36 -07:00
Ash Berlin-Taylor da024dded4
[AIRFLOW-4342] Use @cached_property instead of re-implementing it each time (#5126)
It's not many lines, but I just find this much clearer
2019-04-18 10:00:30 +01:00
Kaxil Naik cb4e39a1ab [AIRFLOW-4299] Upgrade to Celery 4.3.0 to fix crashing workers (#5116) 2019-04-17 10:25:50 +08:00
Kaxil Naik 7f36c36d1e [AIRFLOW-4332] Upgrade sqlalchemy to remove security Vulnerability (#5113) 2019-04-16 18:16:29 +01:00
John Cheng ac464be88e [AIRFLOW-3672] Add support for Mongo DB DNS Seedlist Connection Format (#4481)
* [AIRFLOW-3672] Add support for Mongo DB DNS Seedlist Connection Format

https://docs.mongodb.com/manual/reference/connection-string/index.html#dns-seedlist-connection-format
http://api.mongodb.com/python/current/api/pymongo/mongo_client.html#pymongo.mongo_client.MongoClient

* [AIRFLOW-3672] Add unit test for srv uri

* [AIRFLOW-3672] Fix unit test for Mongo srv uri

* [AIRFLOW-3672] Construct MongoDB URI when hook init
2019-04-14 22:18:52 +02:00
Felix Uellendall 3eb2f547ac [AIRFLOW-3993] Add tests for salesforce hook (#4829)
- refactor code
- update docs
- change sign_in to get_conn
- add salesforce to devel_all packages
- add note to UPDATING.md

Co-Authored-By: mik-laj <mik-laj@users.noreply.github.com>
2019-04-14 21:07:43 +02:00
Felix Uellendall c41b878691 [AIRFLOW-4266] Add mypy to setup.py dependencies (#5069)
- remove old comment regarding to cloudant upgrade
2019-04-14 21:04:58 +02:00
Jarek Potiuk 5b53d9987f [AIRFLOW-4115] Multi-staging Aiflow Docker image (#4936) 2019-04-13 15:03:02 +02:00
Xiaodong ee4815d05c [AIRFLOW-XXX] Change allowed version of Jinja2 to fix CVE-2019-10906 (#5075) 2019-04-10 17:15:13 +01:00
Kaxil Naik ec7c67ff95
[AIRFLOW-4255] Replace Discovery based api with client based for GCS (#5054) 2019-04-09 19:46:00 +01:00
Felix Uellendall b93f2649ae [AIRFLOW-4220] Change CloudantHook to a new major version and add tests (#5023)
- upgrade cloudant version from `>=0.5.9,<2.0` to `>=2.0`
- remove the use of the `schema` attribute in the connection
- remove `db` function since the database object can also be retrieved by calling `cloudant_session['database_name']`
- update docs
- refactor code
2019-04-05 23:12:13 +01:00
Kamil Breguła 99c8a6f125 [AIRFLOW-3971] Add Google Cloud Natural Language operators (#4980) 2019-04-05 22:36:50 +01:00
Paul Bramhall 04ce1551a0 [AIRFLOW-4246] Flask-Oauthlib needs downstream dependencies pinning due to breaking changes (#5045) 2019-04-05 17:11:50 +01:00
Xiaodong 6ed112201e [AIRFLOW-XXX] Pin psycopg2 due to breaking change (#5036) 2019-04-04 15:44:05 +01:00