Fixes PendingDeprecationWarning on HipChatAPISendRoomNotificationOperator
Using `HipChatAPISendRoomNotificationOperator` on Airflow master branch (2.0) gives:
airflow/models.py:2390: PendingDeprecationWarning:
Invalid arguments were passed to HipChatAPISendRoomNotificationOperator.
Support for passing such arguments will be dropped in Airflow 2.0.
Invalid arguments were:
*args: ()
**kwargs: {'color': 'green'}
category=PendingDeprecationWarning
Because upper/lower case was not considered
in the file extension check, S3ToHiveTransfer
operator may mistakenly think a GZIP file with
uppercase ext ".GZ" is not a GZIP file and
raise exception.
It's recommended by Falsk community to use random
SECRET_KEY for security reason.
However, in Airflow there is a default value for
secret_key and most users will ignore to change
it.
This may cause security concern.
Closes#3651 from XD-DENG/patch-2
value of min_file_process_interval in config
template is 0
However it's supposed to be 180 according to
airflow/jobs.py line 592
Closes#3659 from XD-DENG/patch-3
Currently the role assumption method works only if
the granting account
does not specify an External ID. The external ID
is used to solved the
confused deputy problem. When using the AWS hook
to export data to
multiple customers, it's good security practice to
use the external ID.
There is no backwards compatibility break, the ID
will be `None` in
existing cases. Moto doesn't provide any
convenient way to verify the
value was passed in the credential response in
tests, so existing
test cases are kept.
Documentation: https://docs.aws.amazon.com/IAM/lat
est/UserGuide/id_roles_create_for-
user_externalid.html
Closes#3647 from vvondra/support_sts_external_id
The tree view generates JSON that can be massive
for bigger DAGs,
up to 10s of MBs. The JSON is currently
prettified, which both
takes up more CPU time during serialization, and
slows down
everything else that uses it. Considering the JSON
is only
meant to be used programmatically, this is an easy
win
Closes#3620 from abdul-stripe/smaller-tree-view-
json
previous version created the subdag by copying
over all the tasks, and
then filtering them down. it's a lot faster if we
only copy over the
tasks we need
Closes#3621 from abdul-stripe/faster-subdag
If `email_on_failure` or `email_on_failure` set to
TRUE and email available, there will be email sent
out on event of retry or failure.
In the implementation, there is a argument
`is_retry` passed to method `self.email_alert`.
However, inside this method, this argument is not
used at all. I believer the initial author of this
method was planning to differentiate the email to
be sent out, but for whatever reason this was not
implemented.
Given in the email to be sent out, there will be a
line "Try {try_number} out of {max_tries}<br>", it
would be fine not to differentiate **retry email**
and **failure email**.
Closes#3640 from XD-DENG/patch-1
retornam
Deevankshu Garg
Dan Fowler
Cameron Moberg
Marcus Rehm
Fokko Driesprong
Leo Gallucci
Andy Cooper
Ash Berlin-Taylor
XD-DENG
Jacob Hayes
Kaxil Naik
Vojtech Vondra
Bolke de Bruin
Jasper Kahn
Tom Chapin
Andy Wilcox
Verdan Mahmood
Abdul Nimeri
Jeffrey Scott Keone Payne
Taylor D. Edmiston
arihantsurana
Bagus Nurtomo
Xiaodong
Juhwi Lee
niels
Fokko Driesprong
Tom Kunc
Kaxil Naik
Felix
Kevin Yuen
George Leslie-Waksman