8f6b8378aa
The group of embedded DAGs should be root to be OpenShift compatible ( #9794 )
2020-07-13 20:47:55 +02:00
d31e8a3250
Add DAG Source endpoint ( #9322 )
2020-07-13 19:50:03 +02:00
7f64f2d00b
Backfill reset_dagruns set DagRun to NONE state ( #9756 )
2020-07-13 10:33:15 -07:00
56f7a2b6e6
Fix small errors in image building documentation ( #9792 )
2020-07-13 19:23:55 +02:00
1ea7316ffa
Refactor Google operators guides ( #9766 )
...
* Refactor Google guides
* fixup! Refactor Google guides
* fixup! fixup! Refactor Google guides
2020-07-13 18:35:00 +02:00
514eb6d1e3
provide_session keep return type ( #9787 )
2020-07-13 14:46:52 +02:00
9850bae318
Enable pretty output in mypy ( #9785 )
2020-07-13 12:09:02 +01:00
2b12c304f6
Improve typing coverage in scheduler_job.py ( #9783 )
2020-07-13 11:11:33 +02:00
5ddbbf1f59
Add API Endpoint - DagRuns Batch ( #9556 )
...
Co-authored-by: Ephraim Anierobi <splendidzigy24@gmail.com>
2020-07-13 10:54:10 +02:00
d34404809f
Upgrade to latest isort (5.0.8) ( #9782 )
2020-07-12 20:15:33 +02:00
43cb059e96
Fixes failing formatting of DAG file containing {} in docstring ( #9779 )
2020-07-12 18:42:36 +02:00
815a4697dc
Unit tests jenkins hook ( #9767 )
2020-07-12 18:41:19 +02:00
d3c76da952
Improve type hinting to provider microsoft ( #9774 )
2020-07-12 18:25:49 +02:00
1de78e8f97
Add Google Stackdriver link ( #9765 )
2020-07-12 14:32:00 +02:00
7d20059664
Fix typo in the word "Airflow" ( #9772 )
2020-07-12 10:12:56 +02:00
a518801f8d
Add type hinting for discord provider ( #9773 )
2020-07-12 10:03:42 +02:00
861e5e70f1
Fix is_terminal_support_colors functtion ( #9734 )
2020-07-11 21:35:48 +02:00
74036a8401
Links Breeze documentation to new Breeze video ( #9768 )
2020-07-11 21:21:19 +02:00
619ab69657
Add 1.10.11 Changelog & Update UPDATING.md ( #9757 )
2020-07-11 19:15:02 +01:00
c328871a04
Add ME-Br to who uses Airflow list ( #9770 )
2020-07-11 19:38:06 +02:00
5bb228d841
improve type hinting for celery provider ( #9762 )
2020-07-11 19:31:49 +02:00
a6b04d7b9a
Add tests for yandex hook ( #9665 )
2020-07-11 17:47:07 +02:00
aee000c0eb
Check project structure in sensors/transfers directories ( #9764 )
2020-07-11 16:14:22 +02:00
092d33f298
Fix StackdriverTaskHandler + add system tests ( #9761 )
...
Co-authored-by: Tomek Urbaszek <tomasz.urbaszek@polidea.com>
Co-authored-by: Tomek Urbaszek <tomasz.urbaszek@polidea.com>
2020-07-11 16:11:15 +02:00
bade1d3b4a
Use absolute paths in howto guides ( #9758 )
2020-07-11 13:11:21 +02:00
0873070e08
Mask other forms of password arguments in SparkSubmitOperator ( #9615 )
...
This is a follow-up to #6917 before modifying the masking code.
Related: #9595 .
2020-07-11 12:49:15 +02:00
3cc5756d04
Add unit tests for mlengine_operator_utils ( #9702 )
2020-07-11 00:26:00 +02:00
0faa06ed9b
Add TargetQueryValue to KEDA Autoscaler ( #9748 )
...
Co-authored-by: Daniel Imberman <daniel@astronomer.io>
2020-07-10 07:48:17 -07:00
ecf2f8499b
Use namedtuple for TaskInstanceKeyType ( #9712 )
...
* Use namedtuple for TaskInstanceKeyType
2020-07-10 15:05:51 +02:00
ac3bd8a577
Support extra config options for Sentry ( #8911 )
...
For now only dsn can be configured through the airflow.cfg. Need support 'http_proxy' option for example (it can't be configured through the environment variables). This change implements solution for supporting all existed (and maybe future) options for sentry configuration.
2020-07-10 00:34:56 +02:00
dcdc7c1fa9
Pre-create Celery db result tables before running Celery worker ( #9719 )
...
Otherwise at large scale this can end up with some tasks failing as they
try to create the result table at the same time.
This was always possible before, just exceedingly rare, but in large
scale performance testing where I create a lot of tasks quickly
(especially in my HA testing) I hit this a few times.
This is also only a problem for fresh installs/clean DBs, as once these
tables exist the possible race goes away.
This is the same fix from #8909 , just for runtime, not test time.
2020-07-09 19:40:17 +01:00
070e3c3364
Tests are working for newly added backport providers ( #9739 )
...
* Tests are working for newly added backport providers
2020-07-09 20:13:58 +02:00
66c8af1f00
Update local_task_job.py ( #9746 )
...
Removing the suicide joke.
2020-07-09 18:27:13 +02:00
8517af696f
Fix warning about incompatible plugins ( #9704 )
...
One condition was bad and warns when the plugin is for admin and FAB flask.
2020-07-09 17:57:08 +02:00
b2305660f0
Update example DAG for AI Platform operators ( #9727 )
2020-07-09 17:11:37 +02:00
13a827d80f
Ensure Kerberos token is valid in SparkSubmitOperator before running `yarn kill` ( #9044 )
...
do a kinit before yarn kill if keytab and principal is provided
2020-07-09 10:39:16 +01:00
8b94ace597
Add read-only endpoints for DAG Model ( #9045 )
...
Co-authored-by: Tomek Urbaszek <turbaszek@gmail.com>
Co-authored-by: Tomek Urbaszek <tomasz.urbaszek@polidea.com>
2020-07-09 07:28:34 +02:00
0aea648b4b
Skip one version of Python for each test.
...
Skip one version of Python for each test.
2020-07-08 22:26:07 +02:00
9db1fa3698
Error in description after deployment ( #9723 )
...
* Error in description after deployment
Co-authored-by: Daniel Debny <daniel.debny@polidea.com>
2020-07-08 22:24:12 +02:00
47c9f75d55
Add new fantastic team member of Polidea. ( #9724 )
2020-07-08 22:22:32 +02:00
576100b58e
Add Qingping Hou to committers list ( #9725 )
2020-07-08 22:22:08 +02:00
b26017d84b
Add The Climate Corporation to user list ( #9726 )
2020-07-08 21:18:55 +01:00
38a0b1dc76
fix grammar in prereq tasks gcp operator docs ( #9728 )
2020-07-08 21:58:20 +02:00
dfe8337ca2
YAML file supports extra json parameters ( #9549 )
...
Co-authored-by: Kamil Breguła <mik-laj@users.noreply.github.com>
Co-authored-by: Vinay <vinay@synctactic.ai>
Co-authored-by: Kamil Breguła <mik-laj@users.noreply.github.com>
2020-07-08 17:29:49 +02:00
2f31b3060e
Get Airflow configs with sensitive data from Secret Backends ( #9645 )
2020-07-08 13:29:54 +01:00
c353fed81a
Make airflow/migrations/env.py Pylint Compatible ( #9670 )
2020-07-08 12:14:51 +01:00
7a4988a3c7
Add Dag Runs CRUD endpoints ( #9473 )
2020-07-08 13:12:26 +02:00
07b81029eb
Allow AWSAthenaHook to get more than 1000/first page of results ( #6075 )
...
Co-authored-by: Dylan Joss <dylanjoss@gmail.com>
2020-07-08 11:41:52 +01:00
23f80f34ad
Move gcs & wasb task handlers to their respective provider packages ( #9714 )
2020-07-08 11:30:16 +02:00
564192c162
Add AWS StepFunctions integrations to the aws provider ( #8749 )
2020-07-08 11:25:16 +02:00
Jarek Potiuk
Tobiasz Kędzierski
Chao-Han Tsai
Kamil Breguła
takunnithan
Kanthi
Guilherme Da Silva Gonçalves
Mauricio De Diana
Kaxil Naik
Rafferty Chen
Nitai Bezerra da Silva
morrme
Jacek Kołodziej
chipmyersjr
Daniel Imberman
Tomek Urbaszek
Bolgov Andrey
Ash Berlin-Taylor
Morgan Racine
Vismita Uppalli
Aneesh Joseph
James Timmins
Daniel Debny
Jeff Melching
Vinay G B
Omair Khan
lindsable
Ephraim Anierobi
chamcca