Kaxil Naik
d3d918cc2f
Fix typo in api_connexion/openapi/v1.yaml ( #9986 )
...
`startd_ate_lte` -> `start_date_lte`
2020-07-25 18:16:10 +01:00
Tobiasz Kędzierski
81b65bed23
Remove unnecessary environment variable from CI workflow ( #9998 )
2020-07-25 17:38:36 +01:00
Jarek Potiuk
2f73974402
Revert "Bump mysqlclient to 2.0.1 ( #9987 )" ( #9997 )
...
This reverts commit c4388127f1
.
2020-07-25 12:19:19 +02:00
Kaxil Naik
c4388127f1
Bump mysqlclient to 2.0.1 ( #9987 )
...
mysqlclient was pinned as the functionality of Connection object of MySQL had changed and that it dropped python2.
mysqlclient has added context manager interface to Connection which closes the connection on `__exit__` in 2.0.0 and Airflow Master no longer uses Python 2
2020-07-25 09:40:11 +02:00
Kaxil Naik
926aa1ba3a
Relax requirement to allow latest version of tenacity ( #9992 )
2020-07-25 09:37:53 +02:00
Kaxil Naik
76c60afc81
Relax requirement to allow latest version of jinja2 ( #9991 )
...
The latest available version of jinja2 is 2.11.2
Fixes in 2.11.2: https://github.com/pallets/jinja/blob/master/CHANGES.rst#version-2112
2020-07-25 09:37:12 +02:00
Kaxil Naik
7cafa59927
Relax requirement to allow latest version of flask-caching ( #9989 )
...
Current available version is 1.9.0
2020-07-25 09:35:15 +02:00
Kaxil Naik
47cab5fbeb
Bump tableauserverclient to 0.12 ( #9988 )
2020-07-25 09:34:15 +02:00
Kaxil Naik
2719fcf700
Bump actions/setup-python version to 2 ( #9984 )
...
v2 was released on 21 March
2020-07-25 09:28:54 +02:00
Kaxil Naik
8b10a4b35e
Stop using start_date in default_args in example_dags ( #9982 )
2020-07-25 00:16:25 +01:00
Kaxil Naik
fc033048f7
Fix various typos in airflow/cli/commands ( #9983 )
2020-07-24 23:04:10 +01:00
Kaxil Naik
c839705bf6
Fix typo in airflow/cli/cli_parser.py ( #9980 )
...
`action_subcommnads` -> `action_subcommands`
`group_subcommnands` -> `group_subcommands`
2020-07-24 22:47:25 +01:00
Kaxil Naik
42543c58dc
Add Badges for Airflow Docker ( #9979 )
2020-07-24 21:31:36 +02:00
Kaxil Naik
6d7739b315
Fix OpenShift Guidelines link in IMAGES.rst ( #9978 )
2020-07-24 21:25:17 +02:00
jayrumi
0bf330ba86
Add get_blobs_list method to WasbHook ( #9950 )
2020-07-24 14:39:23 +02:00
zikun
458d7d4cb0
Fix CI: Fetch target only when source repo != target repo ( #9962 )
2020-07-24 10:09:18 +02:00
Kaxil Naik
4112723f80
Fix CI: Don't add & fetch remote if source branch == target branch ( #9961 )
2020-07-24 01:22:25 +02:00
zikun
243b704f47
Add DateTimeSensor ( #9697 )
...
* Add DateTimeSensor
2020-07-23 18:53:10 +02:00
Tomek Urbaszek
ef98edf4da
Add more information about using GoogleAdsHook ( #9951 )
...
This hook requires two connections and it's not obvious how
to use it and what is the purpose of each connection.
2020-07-23 17:03:42 +02:00
Kamil Breguła
3a1dd0b181
Improve signature for core operaotrs ( #9944 )
2020-07-23 13:56:51 +02:00
Jarek Potiuk
e90271e81a
Fix link to CI.rst document ( #9953 )
2020-07-23 13:44:33 +02:00
Roi Teveth
5cfacfc6bc
Add Nielsen to Airflow users list ( #9954 )
2020-07-23 13:39:52 +02:00
Johan Eklund
867bc44aca
Add type annotations to providers/vertica ( #9936 )
...
Co-authored-by: Johan Eklund <jeklund@zynga.com>
2020-07-23 03:00:24 +02:00
Kamil Breguła
33f0cd2657
apply_default keeps the function signature for mypy ( #9784 )
2020-07-22 22:36:27 +02:00
Kamil Breguła
39a0288a47
Add Google Authentication for experimental API ( #9848 )
2020-07-22 22:33:55 +02:00
Kamil Breguła
708197bf50
Improve command examples in docs ( #9934 )
2020-07-22 22:32:06 +02:00
Jarek Potiuk
e86d753b4b
Pin github checkout action to v2 ( #9938 )
2020-07-22 21:18:17 +02:00
Jarek Potiuk
a9c871b47c
Clean up tmp directory when exiting from breeze shell ( #9930 )
...
Since we are mountign tmp dir now to inside container, some
of the remnants of what's going on inside remains after exit.
This is particularly bad if you are using tmux (some of the
directories remaining there prevent tmux from re-run)
This change cleans up /tmp directory on exit from Breeze command.
It does it from inside container so that we clean up all
root-owned files without sudo.
2020-07-22 19:54:35 +02:00
Jarek Potiuk
7b9e8e0950
Python base image version is retrieved in the right place ( #9931 )
...
When quick-fixing Python 3.8.4 error #9820 PYTHON_BASE_IMAGE_VERSION
variable was added but it was initialized too early in Breeze and
it took the default version of Python rather than the one chosen
by --python switch. This caused the generated requirements
(locally by Breeze only) to generate wrong set of requirements
and images built locally for different python versions were
based on default Python version, not the one chosen by --python
switch.
2020-07-22 15:58:39 +02:00
Dani Hodovic
ac93419d1d
Add response_filter parameter to SimpleHttpOperator ( #9885 )
2020-07-22 14:03:23 +02:00
retornam
c2db0dfeb1
More strict rules in mypy ( #9705 ) ( #9906 )
...
Signed-off-by: Raymond Etornam <retornam@users.noreply.github.com>
2020-07-22 13:56:02 +02:00
Beni Ben zikry
24a951e8ed
Breeze / KinD - support earlier k8s versions, fix recreate and kubectl versioning ( #9905 )
2020-07-22 12:24:46 +02:00
Jarek Potiuk
cd160b9957
Shorter/more meaningful header for official images ( #9925 )
2020-07-22 11:39:59 +02:00
Stijn De Haes
1427e4acb4
Update Spark submit operator for Spark 3 support ( #8730 )
...
In spark 3 they log the exit code with a lowercase
e, in spark 2 they used an uppercase E.
Also made the exception a bit clearer when running
on kubernetes.
2020-07-22 10:12:43 +01:00
QP Hou
040fb1db02
point go client mod path to new repo ( #9922 )
...
* point go client mod path to new repo
2020-07-22 09:56:55 +02:00
Kamil Breguła
6d612efc7e
Allows to configure logging for third-party libraries ( #9657 )
2020-07-22 08:52:00 +02:00
chipmyersjr
f60940d3ec
Add unit test for test_sql_to_gcs ( #9920 )
2020-07-22 08:48:31 +02:00
Jarek Potiuk
ddeea33b88
Nightly tag was not pushed on scheduled run ( #9924 )
2020-07-22 08:35:33 +02:00
Nathan Hadfield
c4244e18bb
Fix calling `get_client` in BigQueryHook.table_exists ( #9916 )
...
Adding `project_id` argument to `get_client` method
otherwise this call always falls back to the default connection id.
2020-07-22 08:10:56 +02:00
Jarek Potiuk
c460529d93
Postgres tests were skipped by mistake ( #9923 )
2020-07-22 08:08:47 +02:00
Jarek Potiuk
508d7d202a
Tests are cancelled if any of faster checks fail ( #9917 )
2020-07-22 08:05:36 +02:00
Karthikeyan Singaravelan
46e34ab4fb
Import ABC from collections.abc ( #9649 )
2020-07-22 02:41:30 +02:00
Kamil Breguła
719ae2bf62
Dump Pod as YAML in logs for KubernetesPodOperator ( #9895 )
2020-07-22 02:29:55 +02:00
BaoshanGu
8a405d25fa
[AIRFLOW-6931] Fixed migrations to find all dependencies for MSSQL ( #9891 )
2020-07-22 01:11:39 +02:00
Kamil Olszewski
5eacc16420
Add support for impersonation in GCP hooks ( #9915 )
...
Co-authored-by: Kamil Olszewski <kamil.olszewski@polidea.com>
2020-07-22 01:02:32 +02:00
chipmyersjr
4eddce22a3
Add typing for grpc provider ( #9884 )
2020-07-21 19:13:14 +02:00
Tomek Urbaszek
b823f8a2e8
Use pipe pylint result to sort -u for error deduplication ( #9893 )
...
Due to an pylint issue https://github.com/PyCQA/pylint/issues/3584
single error/warning is printed multiple times when using
pylint in multiprocessing mode
2020-07-21 18:46:36 +02:00
Tomek Urbaszek
bff713750f
Add function to get current context ( #9631 )
...
Support for getting current context at any code location that runs
under the scope of BaseOperator.execute function. This functionality
is part of AIP-31.
Co-authored-by: Jonathan Shir <jonathan.shir@databand.ai>
2020-07-21 18:45:09 +02:00
zikun
d5d119babc
Increase typing coverage for Elasticsearch ( #9911 )
2020-07-21 15:54:20 +02:00
Shekhar Singh
eb1aedd2df
Add unit tests for CassandraTableSensor, CassandraRecordSensor and WebHdfsSensor ( #9874 )
2020-07-21 14:14:29 +02:00