S3FileTransformOperator doen't work for now since
it uses a function
which is no longer supported by boto3. This PR
replaces it with a
valid function and adds an unit test for this
operator.
Closes#3200 from sekikn/AIRFLOW-2293
This commit adds three extra optional parameters
to the
`MLEngineTrainingOperator` as well as a new unit
test for the
`MLEngineVersionOperator`
Closes#3202 from dlebech/ml-engine-python-version
Fix a minor typo and a wrong non-default
assignment
Fix one more typo
Adapt tests to new error messages and fix another
typo
Fix exception type in utils operator test class
Improve cleansing of non-valid training and
prediciton job names
Closes#2746 from wileeam/ml-engine-prediction-
job-normalization
Many operators and hooks are not listed in the
config, and therefore
not picked up by the docks generator.
Closes#3201 from Fokko/airflow-2302-add-missing-
docs
# JIRA
[x] My PR addresses the following Airflow JIRA
issues and references them in the PR title.
*
https://issues.apache.org/jira/browse/AIRFLOW-2312
# Description
[x] Here are some details about my PR
Minor typo fix in the docs. `correpsonding` to
`corresponding`
# Tests
[x] My PR adds the following unit tests OR does
not need testing for this extremely good reason:
I assume I don't need testing for docs
# Commits
[x] My commits all reference JIRA issues in their
subject lines, and I have squashed multiple
commits if they address the same issue. In
addition, my commits follow the guidelines from
"How to write a good git commit message":
1. Subject is separated from body by a blank line
2. Subject is limited to 50 characters
3. Subject does not end with a period
4. Subject uses the imperative mood ("add", not
"adding")
5. Body wraps at 72 characters
6. Body explains "what" and "why", not "how"
Closes#3211 from tamsanh/patch-1
on_kill methods were not triggered, due to
processes
not being properly terminated. This was due to the
fact
the runners use a shell which is then replaced by
the
child pid, which is unknown to Airflow.
Closes#3204 from bolkedebruin/AIRFLOW-1623
Currently RedshiftToS3Transfer (UNLOAD) exists but
the opposite doesn't.
This PR adds COPY operation as
S3ToRedshiftTransfer.
Closes#3161 from sekikn/AIRFLOW-1340
Because the api doesn't return the job, because it
isn't known yet
or because it cannot be found, it could be that
the log lines arent
available yet. Also use the locations based api
call, which returns
the jobs immediately. This call seems to work for
us-central, but
doesn't return any jobs for other regions.
Closes#3165 from Fokko/AIRFLOW-2259
Add the Slack webhook hook/operator pair. This
allows posting
messages to Slack in an easy, light-weight manner.
Closes#3129 from danielvdende/AIRFLOW-2217-add-
slack-webhook-operator
Guillermo Rodriguez Cano
Kengo Seki
Sergio Díaz Bautista
David Volquartz Lebech
Guillermo Rodríguez Cano
Fokko Driesprong
Tamu
Bolke de Bruin
Joy Gao
John Arnold (AZURE)
Tao feng
Unknown
Marcin Szymanski
Dan Davydov
milanvdm
niels
r39132
charlesverdad
Thomas Buida
Taylor D. Edmiston
devinXL8
David Klosowski
Hongyi Wang
Jin Hyuk Chang
Michael Peteuil
Daniel van der Ende