968a3f98b4
[AIRFLOW-XXXX] Add label for Secrets for matching filepaths ( #7746 )
2020-03-17 12:26:59 +00:00
4ff9d63db8
[AIRFLOW-5705] Fix bug in Secrets Backend ( #7742 )
2020-03-17 01:19:28 +00:00
a8b5fc74d0
[AIRFLOW-4175] S3Hook load_file should support ACL policy paramete ( #7733 )
...
- Added acl_policy parameter to all the S3Hook.load_*() and S3Hook.copy_object() function
- Added unittest to test the response permissions when the policy is passed
- Updated the docstring of the function
Co-authored-by: retornam <retornam@users.noreply.github.com>
2020-03-16 16:18:31 +01:00
ae035cdb69
[AIRFLOW-6987] Avoid creating default connections ( #7629 )
2020-03-16 11:09:29 +01:00
51161dbd9d
[AIRFLOW-5664] Store timestamps with microseconds precision ( #6354 )
...
Microseconds value is lost in the conversion to timestamp
using time.mktime.
Timestamp is now computed to be precise up to microseconds.
2020-03-16 10:11:35 +01:00
8f417e5d64
[AIRFLOW-XXXX] Updated supported versions of backends ( #7727 )
2020-03-16 08:32:07 +01:00
8bf6a9093d
[AIRFLOW-6530] Allow Custom Statsd Client ( #7227 )
...
Co-authored-by: Usman Arshad <usman.arshad@skyscanner.net>
Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
Co-authored-by: Craig Rosie <craigrosie7@gmail.com>
2020-03-15 20:28:26 +00:00
0740dafa0a
[AIRFLOW-7066] Use sphinx syntax in concepts.rst ( #7729 )
2020-03-15 13:08:32 +01:00
271ee6477b
[AIRFLOW-7058] Add support for different DB versions ( #7717 )
2020-03-14 23:57:47 +01:00
dced43bee9
[AIRFLOW-6946] Switch to MySQL 5.7 in 2.0 as base ( #7570 )
...
Switch to MySQL 5.7 in tests.
Fixes the utf8mb4 encoding issue where utf8mb4 encoding
produces too long keys for mysql to handle in XCom table.
You can optionally specify a separate option to set
encoding differently for the columns that are part of the
index - dag_id, task_id and key.
2020-03-14 22:24:03 +01:00
6fc5148bf1
[AIRFLOW-7063] Fix dag.clear() slowness caused by count ( #7723 )
2020-03-14 17:44:05 +01:00
35eff0a15b
[AIRFLOW-7051] Implement Vertica Hook Tests ( #7707 )
2020-03-14 14:19:46 +01:00
e31e9ddd23
[AIRFLOW-5705] Add secrets backend and support for AWS SSM ( #6376 )
2020-03-14 11:48:10 +00:00
5f784ae5c0
[AIRFLOW-7061] Rename openfass to openfaas ( #7721 )
2020-03-14 10:47:50 +01:00
31d15bd88f
[AIRFLOW-7062] Fix pydruid release breaking the build ( #7720 )
2020-03-14 08:51:12 +01:00
2bc020c431
[AIRFLOW-7055] Verbose logging option for google provider ( #7711 )
2020-03-14 08:10:59 +01:00
d4661485a2
[AIRFLOW-7019] Show un/pause errors in dags view. ( #7669 )
...
Pausing and unpausing dags in the dags view is asynchronous, and there
is currently no indication to the user if the operation fails. This
patch updates the paused input and highlights it in red when pausing or
unpausing fails.
2020-03-14 00:10:12 -04:00
8badb3d06f
[AIRFLOW-XXXX] Add Rakuten in Airflow Users list ( #7686 )
2020-03-13 21:14:45 +00:00
4e49f00538
[AIRFLOW-7001] Further fix for the MySQL 5.7 UtcDateTime ( #7655 )
...
The original fix from the commit
b4215f634c0dd60f101b79d3d5bf493603bc6cbc
was wrong. It converted to utc initially but then make_naive
had used TIMEZONE and converted it to the lcoal timezone rather
than UTC.
2020-03-13 21:00:44 +01:00
ef71ac6a22
[AIRFLOW-7029] Use separate docker image for running license check ( #7678 )
...
Each stage of the CI tests needs to pull our `ci` image. By removing
java from it we can save 1-2minutes from each test stage. This is part
of that work.
2020-03-13 18:54:22 +00:00
5192756dd0
[AIRFLOW-XXXX] Remove the defunct limitation of Dag Serialization ( #7716 )
2020-03-13 18:30:14 +00:00
7e1523684c
[AIRFLOW-XXXX] Update temp link to a fixed link ( #7715 )
2020-03-13 16:24:07 +00:00
0be7654fd2
[AIRFLOW-7003] Lazy load all plguins ( #7644 )
2020-03-13 17:15:48 +01:00
e1465182ac
[AIRFLOW-5946] DAG Serialization: Store source code in db ( #7217 )
...
* DAG serialization improvement: the DAG's source code is now stored in the dag_code table and is queried from here when the Code view is opened for the DAG. The webserver no longer needs access to the dags folder in the shared filesystem.
2020-03-13 16:10:59 +00:00
a86924f0e0
[AIRFLOW-7054] Breeze has an option now to reset db at entry ( #7710 )
2020-03-13 16:08:16 +01:00
c997cab42d
[AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator ( #7630 )
...
Co-authored-by: michalslowikowski00 <michal.slowikowski@polidea.com>
2020-03-13 13:04:42 +01:00
289bc80cbc
[AIRFLOW-7056] Selective backport packages build ( #7712 )
2020-03-13 12:37:48 +01:00
ccbaf578ae
[AIRFLOW-6989] Display Rendered template_fields without accessing Dagfiles ( #7633 )
2020-03-13 11:22:15 +00:00
3bb60afc7b
[AIRFLOW-6975] Base AWSHook AssumeRoleWithSAML ( #7619 )
...
* [AIRFLOW-6975] Base AWSHook AssumeRoleWithSAML
* [AIRFLOW-6975] Base AWSHook AssumeRoleWithSAML CODE REVIEW
* [AIRFLOW-6975] Base AWSHook AssumeRoleWithSAML CODE REVIEW 2
Co-authored-by: Bjorn Olsen <BjornOlsen@capitecbank.co.za>
2020-03-13 10:10:45 +01:00
7f6e6b974f
[AIRFLOW-7022] Simplify DagFileProcessor.process_file method ( #7674 )
2020-03-12 20:51:54 +01:00
c0c5f11ad1
[AIRFLOW-6884] Make SageMakerTrainingOperator idempotent ( #7598 )
2020-03-12 16:17:22 +00:00
2327aa5a26
[AIRFLOW-7025] Fix SparkSqlHook.run_query to handle its parameter properly ( #7677 )
2020-03-12 16:13:33 +00:00
421e7a26dd
[AIRFLOW-7047] Fixe build providers dependencies pre-commit on Mac ( #7705 )
2020-03-12 15:40:27 +01:00
3e2323561f
[AIRFLOW-6954] Use DagRunType instead of ID_PREFIX in run_id ( #7583 )
...
fixup! [AIRFLOW-6954] Use DagRunType instead of ID_PREFIX in run_id
2020-03-12 13:48:07 +01:00
78e48ba46a
[AIRFLOW-5944] Rendering templated_fields without accessing DAG files ( #6788 )
2020-03-12 11:09:47 +00:00
6cc9d817fa
[AIRFLOW-7013] Automated check if Breeze image needs to be pulled ( #7656 )
2020-03-12 09:48:24 +01:00
137896f326
[AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op ( #7685 )
...
* [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Operator
* fixup! [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Operator
* fixup! fixup! [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Operator
* fixup! fixup! fixup! [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Operator
2020-03-12 08:26:04 +01:00
6140356b80
[AIRFLOW-6481] Fix bug in SalesforceHook ( #7703 )
...
Explicitly cast the columns that are deemed as possibly string to str
type because accessing .str on Python dict raises an error.
Update the corresponding test and re-formatted the code.
Co-authored-by: Teddy Hartanto <teddy.hartanto@ninjavan.co>
2020-03-12 08:23:08 +01:00
6539af34ed
[AIRFLOW-XXXX] Wrap line under 90 characters ( #7701 )
2020-03-12 08:19:25 +01:00
41d66fe780
[AIRFLOW-XXXX] Fix broken link in backport_packages/README.md ( #7700 )
2020-03-12 08:11:55 +01:00
a251ae9a7e
[AIRFLOW-XXXX] Change CONTRIBUTING.md to CONTRIBUTING.rst ( #7695 )
2020-03-12 08:11:07 +01:00
63cf3036e4
[AIRFLOW-XXXX] Update to the latest version of pre-commit-hooks ( #7702 )
2020-03-12 05:31:57 +00:00
25c3abfa0f
[AIRFLOW-XXXX] Replace conversion from list to set ( #7696 )
2020-03-12 01:52:28 +00:00
facd59b406
[AIRFLOW-XXXX] Remove already solved items from pylint_todo.txt ( #7697 )
2020-03-12 01:52:06 +00:00
8f11af9dbf
[AIRFLOW-XXXX] Fix docstring in TestSchedulerJob ( #7699 )
2020-03-12 01:51:45 +00:00
81f50a9f2e
[AIRFLOW-XXXX] Fix typo in tests/jobs/test_base_job.py ( #7698 )
2020-03-12 01:51:16 +00:00
bdb2eba7cf
[AIRFLOW-7017] Respect default dag view in trigger dag origin. ( #7667 )
2020-03-12 01:14:28 +00:00
462225a054
[AIRFLOW-7041] make bowler dependency local ( #7691 )
2020-03-11 13:25:31 +01:00
3aff65319e
[AIRFLOW-7040] Move tests/utils/contrib packages to tests/utils ( #7690 )
2020-03-11 12:13:27 +01:00
2536b517e6
[AIRFLOW-7037] Fix Incorrect Type Annotation for Multiprocessing Connection ( #7687 )
2020-03-10 21:24:44 +01:00
Kaxil Naik
Omair Khan
Noël Bardelot
Oluwafemi Sule
Jarek Potiuk
Usman Arshad
Jiajie Zhong
yuqian90
Hossein Torabi
dstandish
Bas Harenslak
Joshua Carp
Better-Boy
Ash Berlin-Taylor
Kamil Breguła
Anita Fronczak
Michał Słowikowski
Bjorn Olsen
Kengo Seki
Tomek Urbaszek
Teddy Hartanto