Remove Backport Providers (#14886)
We are removing support for Backport Providers now.
The last release was sent yesterday- as planned, on 17 March 2021 - the
last release of the Backport Providers.
As agreed before, and documented here:
https://github.com/apache/airflow/blob/master/dev/PROJECT_GUIDELINES.md#support-for-backport-providers
> Backport providers within 1.10.x, will be supported for critical fixes
for three months (March 17, 2021) from Airflow 2.0.0 release date (Dec
17, 2020).
For the future reference, if anyone would like to build backport
providers with cherry-picking any fixes, the branch to start from is
`legacy-backport-cutoff-point`. The documentation and tools to build the
backports are there, but there will be no more community releases for
backports.
Good Bye Backport Providers.
(cherry picked from commit 68e4c4dcb0
)
This commit is contained in:
Родитель
55bc60231a
Коммит
12ad529a3a
|
@ -120,7 +120,7 @@ jobs:
|
|||
sourceRunId: ${{ github.event.workflow_run.id }}
|
||||
notifyPRCancel: true
|
||||
jobNameRegexps: >
|
||||
["^Pylint$", "^Static checks", "^Build docs$", "^Spell check docs$", "^Backport packages$",
|
||||
["^Pylint$", "^Static checks", "^Build docs$", "^Spell check docs$",
|
||||
"^Provider packages", "^Checks: Helm tests$", "^Test OpenAPI*"]
|
||||
- name: "Extract canceled failed runs"
|
||||
# We use this step to build regexp that will be used to match the Source Run id in
|
||||
|
|
|
@ -486,62 +486,6 @@ ${{ hashFiles('.pre-commit-config.yaml') }}"
|
|||
github.event_name == 'push'
|
||||
run: aws s3 sync --delete ./files/documentation s3://apache-airflow-docs
|
||||
|
||||
prepare-backport-provider-packages:
|
||||
timeout-minutes: 40
|
||||
name: "Backport packages: ${{ matrix.package-format }}"
|
||||
runs-on: ${{ fromJson(needs.build-info.outputs.runsOn) }}
|
||||
needs: [build-info, ci-images]
|
||||
strategy:
|
||||
matrix:
|
||||
package-format: ['wheel', 'sdist']
|
||||
env:
|
||||
# In this case we want to install airflow from the latest released 1.10 version
|
||||
# all provider packages are installed from wheels or .tar.gz files
|
||||
INSTALL_AIRFLOW_VERSION: "1.10.14"
|
||||
AIRFLOW_EXTRAS: "all"
|
||||
PYTHON_MAJOR_MINOR_VERSION: ${{needs.build-info.outputs.defaultPythonVersion}}
|
||||
BACKPORT_PACKAGES: "true"
|
||||
VERSION_SUFFIX_FOR_PYPI: "dev"
|
||||
VERSION_SUFFIX_FOR_SVN: "dev"
|
||||
PACKAGE_FORMAT: ${{ matrix.package-format }}
|
||||
GITHUB_REGISTRY: ${{ needs.ci-images.outputs.githubRegistry }}
|
||||
if: needs.build-info.outputs.image-build == 'true'
|
||||
steps:
|
||||
- name: "Checkout ${{ github.ref }} ( ${{ github.sha }} )"
|
||||
uses: actions/checkout@v2
|
||||
with:
|
||||
persist-credentials: false
|
||||
- name: "Setup python"
|
||||
uses: actions/setup-python@v2
|
||||
with:
|
||||
python-version: ${{ env.PYTHON_MAJOR_MINOR_VERSION }}
|
||||
- name: "Free space"
|
||||
run: ./scripts/ci/tools/ci_free_space_on_ci.sh
|
||||
- name: "Prepare CI image ${{env.PYTHON_MAJOR_MINOR_VERSION}}:${{ env.GITHUB_REGISTRY_PULL_IMAGE_TAG }}"
|
||||
run: ./scripts/ci/images/ci_prepare_ci_image_on_ci.sh
|
||||
- name: "Prepare provider documentation"
|
||||
run: ./scripts/ci/provider_packages/ci_prepare_provider_documentation.sh
|
||||
- name: "Prepare provider packages: ${{ matrix.package-format }}"
|
||||
run: ./scripts/ci/provider_packages/ci_prepare_provider_packages.sh
|
||||
- name: "Install and test provider packages and airflow via ${{ matrix.package-format }} files"
|
||||
run: ./scripts/ci/provider_packages/ci_install_and_test_provider_packages.sh
|
||||
env:
|
||||
INSTALL_PROVIDERS_FROM_SOURCES: "false"
|
||||
- name: "Upload package artifacts"
|
||||
uses: actions/upload-artifact@v2
|
||||
if: always()
|
||||
with:
|
||||
name: airflow-backport-packages
|
||||
path: "./dist/apache*"
|
||||
retention-days: 7
|
||||
- name: "Upload documentation artifacts"
|
||||
uses: actions/upload-artifact@v2
|
||||
if: always() && matrix.package-format == 'wheel'
|
||||
with:
|
||||
name: airflow-backport-readmes
|
||||
path: "./files/airflow-readme-*"
|
||||
retention-days: 7
|
||||
|
||||
prepare-provider-packages:
|
||||
timeout-minutes: 40
|
||||
name: "Provider packages ${{ matrix.package-format }}"
|
||||
|
@ -1112,7 +1056,6 @@ ${{ hashFiles('.pre-commit-config.yaml') }}"
|
|||
- tests-postgres
|
||||
- tests-mysql
|
||||
- tests-kubernetes
|
||||
- prepare-backport-provider-packages
|
||||
- prepare-provider-packages
|
||||
- test-provider-packages-released-airflow
|
||||
- prod-images
|
||||
|
@ -1162,7 +1105,6 @@ ${{ hashFiles('.pre-commit-config.yaml') }}"
|
|||
- tests-postgres
|
||||
- tests-mysql
|
||||
- tests-kubernetes
|
||||
- prepare-backport-provider-packages
|
||||
- ci-images
|
||||
- verify-ci-images
|
||||
- docs
|
||||
|
|
|
@ -78,7 +78,6 @@ rat-results.txt
|
|||
apache-airflow-.*\+source.tar.gz.*
|
||||
apache-airflow-.*\+bin.tar.gz.*
|
||||
PULL_REQUEST_TEMPLATE.md
|
||||
BACKPORT_PROVIDER_CHANGES*.md
|
||||
PROVIDER_CHANGES*.md
|
||||
manifests/*
|
||||
redirects.txt
|
||||
|
|
52
BREEZE.rst
52
BREEZE.rst
|
@ -545,9 +545,6 @@ There are several commands that you can run in Breeze to manage and build packag
|
|||
Preparing provider readme files is part of the release procedure by the release managers
|
||||
and it is described in detail in `dev <dev/README.md>`_ .
|
||||
|
||||
You can prepare provider packages - by default regular provider packages are prepared, but with
|
||||
``--backport`` flag you can prepare backport packages.
|
||||
|
||||
The packages are prepared in ``dist`` folder. Note, that this command cleans up the ``dist`` folder
|
||||
before running, so you should run it before generating airflow package below as it will be removed.
|
||||
|
||||
|
@ -565,13 +562,6 @@ providers that you would like to build. By default ``both`` types of packages ar
|
|||
|
||||
./breeze prepare-provider-packages google amazon
|
||||
|
||||
You can also prepare backport provider packages, if you specify ``--backport`` flag. You can read more
|
||||
about backport packages in `dev <dev/README.md>`_
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
./breeze prepare-provider-packages --backports google amazon
|
||||
|
||||
You can see all providers available by running this command:
|
||||
|
||||
.. code-block:: bash
|
||||
|
@ -1772,10 +1762,6 @@ This is the current syntax for `./breeze <./breeze>`_:
|
|||
|
||||
Default: both
|
||||
|
||||
--backports
|
||||
|
||||
Prepares backport providers rather than regular ones.
|
||||
|
||||
-v, --verbose
|
||||
Show verbose information about executed docker, kind, kubectl, helm commands. Useful for
|
||||
debugging - when you run breeze with --verbose flags you will be able to see the commands
|
||||
|
@ -2132,7 +2118,7 @@ This is the current syntax for `./breeze <./breeze>`_:
|
|||
Detailed usage for command: prepare-provider-documentation
|
||||
|
||||
|
||||
breeze prepare-provider-documentation [FLAGS] [YYYY.MM.DD] [PACKAGE_ID ...]
|
||||
breeze prepare-provider-documentation [FLAGS] [PACKAGE_ID ...]
|
||||
|
||||
Prepares documentation files for provider packages.
|
||||
|
||||
|
@ -2141,23 +2127,14 @@ This is the current syntax for `./breeze <./breeze>`_:
|
|||
If no packages are specified, readme for all packages are generated.
|
||||
If no date is specified, current date + 3 days is used (allowing for PMC votes to pass).
|
||||
|
||||
You can also specify --backport flag to prepare backport providers documentation and in this
|
||||
case you can also optionally specify CALVER version as first parameter.
|
||||
|
||||
Examples:
|
||||
|
||||
'breeze prepare-provider-documentation' or
|
||||
'breeze prepare-provider-documentation --version-suffix-for-pypi rc1' or
|
||||
'breeze prepare-provider-documentation --backports 2020.05.10' or
|
||||
'breeze prepare-provider-documentation --backports 2020.05.10 https google amazon'
|
||||
'breeze prepare-provider-documentation --version-suffix-for-pypi rc1'
|
||||
|
||||
General form:
|
||||
|
||||
'breeze prepare-provider-documentation YYYY.MM.DD <PACKAGE_ID> ...'
|
||||
|
||||
* YYYY.MM.DD - is the CALVER version of the package to prepare. Note that this date
|
||||
cannot be earlier than the already released version (the script will fail if it
|
||||
will be). It can be set in the future anticipating the future release date.
|
||||
'breeze prepare-provider-documentation <PACKAGE_ID> ...'
|
||||
|
||||
* <PACKAGE_ID> is usually directory in the airflow/providers folder (for example
|
||||
'google' but in several cases, it might be one level deeper separated with
|
||||
|
@ -2166,7 +2143,7 @@ This is the current syntax for `./breeze <./breeze>`_:
|
|||
Flags:
|
||||
|
||||
-S, --version-suffix-for-pypi SUFFIX
|
||||
Adds optional suffix to the version in the generated backport package. It can be used
|
||||
Adds optional suffix to the version in the generated provider package. It can be used
|
||||
to generate rc1/rc2 ... versions of the packages to be uploaded to PyPI.
|
||||
|
||||
-N, --version-suffix-for-svn SUFFIX
|
||||
|
@ -2183,10 +2160,6 @@ This is the current syntax for `./breeze <./breeze>`_:
|
|||
|
||||
Default: both
|
||||
|
||||
--backports
|
||||
|
||||
Prepares backport providers rather than regular ones.
|
||||
|
||||
-v, --verbose
|
||||
Show verbose information about executed docker, kind, kubectl, helm commands. Useful for
|
||||
debugging - when you run breeze with --verbose flags you will be able to see the commands
|
||||
|
@ -2208,7 +2181,7 @@ This is the current syntax for `./breeze <./breeze>`_:
|
|||
|
||||
breeze prepare-provider-packages [FLAGS] [PACKAGE_ID ...]
|
||||
|
||||
Prepares backport packages. You can provide (after --) optional list of packages to prepare.
|
||||
Prepares provider packages. You can provide (after --) optional list of packages to prepare.
|
||||
If no packages are specified, readme for all packages are generated. You can specify optional
|
||||
--version-suffix-for-svn flag to generate rc candidate packages to upload to SVN or
|
||||
--version-suffix-for-pypi flag to generate rc candidates for PyPI packages. You can also
|
||||
|
@ -2218,9 +2191,6 @@ This is the current syntax for `./breeze <./breeze>`_:
|
|||
prepared there so make sure you run prepare-provider-packages first,
|
||||
and prepare-airflow-packages second.
|
||||
|
||||
You can also specify --backport flag to prepare backport providers or --package-format to
|
||||
prepare one or both types of supported formats.
|
||||
|
||||
Examples:
|
||||
|
||||
'breeze prepare-provider-packages' or
|
||||
|
@ -2233,7 +2203,7 @@ This is the current syntax for `./breeze <./breeze>`_:
|
|||
|
||||
General form:
|
||||
|
||||
'breeze prepare-provider-packages [--backports] [--package-format PACKAGE_FORMAT] \
|
||||
'breeze prepare-provider-packages [--package-format PACKAGE_FORMAT] \
|
||||
[--version-suffix-for-svn|--version-suffix-for-pypi] <PACKAGE_ID> ...'
|
||||
|
||||
* <PACKAGE_ID> is usually directory in the airflow/providers folder (for example
|
||||
|
@ -2252,12 +2222,8 @@ This is the current syntax for `./breeze <./breeze>`_:
|
|||
|
||||
Default: both
|
||||
|
||||
--backports
|
||||
|
||||
Prepares backport providers rather than regular ones.
|
||||
|
||||
-S, --version-suffix-for-pypi SUFFIX
|
||||
Adds optional suffix to the version in the generated backport package. It can be used
|
||||
Adds optional suffix to the version in the generated provider package. It can be used
|
||||
to generate rc1/rc2 ... versions of the packages to be uploaded to PyPI.
|
||||
|
||||
-N, --version-suffix-for-svn SUFFIX
|
||||
|
@ -2773,10 +2739,10 @@ This is the current syntax for `./breeze <./breeze>`_:
|
|||
Default: All
|
||||
|
||||
****************************************************************************************************
|
||||
Flags for generation of the backport packages
|
||||
Flags for generation of the provider packages
|
||||
|
||||
-S, --version-suffix-for-pypi SUFFIX
|
||||
Adds optional suffix to the version in the generated backport package. It can be used
|
||||
Adds optional suffix to the version in the generated provider package. It can be used
|
||||
to generate rc1/rc2 ... versions of the packages to be uploaded to PyPI.
|
||||
|
||||
-N, --version-suffix-for-svn SUFFIX
|
||||
|
|
6
CI.rst
6
CI.rst
|
@ -265,10 +265,10 @@ You can use those variables when you try to reproduce the build locally.
|
|||
+-----------------------------------------+-------------+-------------+------------+-------------------------------------------------+
|
||||
| Version suffix variables |
|
||||
+-----------------------------------------+-------------+-------------+------------+-------------------------------------------------+
|
||||
| ``VERSION_SUFFIX_FOR_PYPI`` | | | | Version suffix used during backport |
|
||||
| ``VERSION_SUFFIX_FOR_PYPI`` | | | | Version suffix used during provider |
|
||||
| | | | | package preparation for PyPI builds. |
|
||||
+-----------------------------------------+-------------+-------------+------------+-------------------------------------------------+
|
||||
| ``VERSION_SUFFIX_FOR_SVN`` | | | | Version suffix used during backport |
|
||||
| ``VERSION_SUFFIX_FOR_SVN`` | | | | Version suffix used during provider |
|
||||
| | | | | package preparation for SVN builds. |
|
||||
+-----------------------------------------+-------------+-------------+------------+-------------------------------------------------+
|
||||
| Git variables |
|
||||
|
@ -706,8 +706,6 @@ This workflow is a regular workflow that performs all checks of Airflow code.
|
|||
+---------------------------+----------------------------------------------+-------+-------+------+
|
||||
| Spell check docs | Spell check for documentation | Yes | Yes | Yes |
|
||||
+---------------------------+----------------------------------------------+-------+-------+------+
|
||||
| Backport packages | Prepares Backport Packages for 1.10 Airflow | Yes | Yes | Yes |
|
||||
+---------------------------+----------------------------------------------+-------+-------+------+
|
||||
| Trigger tests | Checks if tests should be triggered | Yes | Yes | Yes |
|
||||
+---------------------------+----------------------------------------------+-------+-------+------+
|
||||
| Tests [Pg/Msql/Sqlite] | Run all the Pytest tests for Python code | Yes(2)| Yes | Yes |
|
||||
|
|
|
@ -616,8 +616,8 @@ The dependency list is automatically used during PyPI packages generation.
|
|||
|
||||
Cross-dependencies between provider packages are converted into extras - if you need functionality from
|
||||
the other provider package you can install it adding [extra] after the
|
||||
``apache-airflow-backport-providers-PROVIDER`` for example:
|
||||
``pip install apache-airflow-backport-providers-google[amazon]`` in case you want to use GCP
|
||||
``apache-airflow-providers-PROVIDER`` for example:
|
||||
``pip install apache-airflow-providers-google[amazon]`` in case you want to use GCP
|
||||
transfer operators from Amazon ECS.
|
||||
|
||||
If you add a new dependency between different providers packages, it will be detected automatically during
|
||||
|
@ -750,19 +750,6 @@ providers.
|
|||
You can read more about out approach for tests in `TESTING.rst <TESTING.rst>`_ but here
|
||||
are some highlights.
|
||||
|
||||
|
||||
Backport providers
|
||||
------------------
|
||||
|
||||
You can also build backport provider packages for Airflow 1.10. They aim to provide a bridge when users
|
||||
of Airflow 1.10 want to migrate to Airflow 2.0. The backport packages are named similarly to the
|
||||
provider packages, but with "backport" added:
|
||||
|
||||
* ``apache-airflow-backport-provider-*``
|
||||
|
||||
Those backport providers are automatically refactored to work with Airflow 1.10.* and have a few
|
||||
limitations described in those packages.
|
||||
|
||||
Dependency management
|
||||
=====================
|
||||
|
||||
|
|
|
@ -493,7 +493,7 @@ based on example in `this comment <https://github.com/apache/airflow/issues/8605
|
|||
--build-arg AIRFLOW_SOURCES_FROM="empty" \
|
||||
--build-arg AIRFLOW_SOURCES_TO="/empty" \
|
||||
--build-arg ADDITIONAL_AIRFLOW_EXTRAS="slack" \
|
||||
--build-arg ADDITIONAL_PYTHON_DEPS="apache-airflow-backport-providers-odbc \
|
||||
--build-arg ADDITIONAL_PYTHON_DEPS="apache-airflow-providers-odbc \
|
||||
azure-storage-blob \
|
||||
sshtunnel \
|
||||
google-api-python-client \
|
||||
|
|
|
@ -174,7 +174,8 @@ pip install apache-airflow[postgres,google]==2.0.1 \
|
|||
--constraint "https://raw.githubusercontent.com/apache/airflow/constraints-2.0.1/constraints-3.7.txt"
|
||||
```
|
||||
|
||||
For information on installing backport providers check [backport-providers.rst](docs/apache-airflow/backport-providers.rst).
|
||||
For information on installing provider packages check
|
||||
[providers](http://airflow.apache.org/docs/apache-airflow-providers/index.html).
|
||||
|
||||
## Official source code
|
||||
|
||||
|
|
109
TESTING.rst
109
TESTING.rst
|
@ -870,10 +870,6 @@ run Google Cloud system tests.
|
|||
|
||||
RANDOM_POSTFIX=$(cat "${RANDOM_FILE}")
|
||||
|
||||
# install any packages from dist folder if they are available
|
||||
if [[ ${RUN_AIRFLOW_1_10:=} == "true" ]]; then
|
||||
pip install /dist/apache_airflow_backport_providers_{google,postgres,mysql}*.whl || true
|
||||
fi
|
||||
|
||||
To execute system tests, specify the ``--system SYSTEM``
|
||||
flag where ``SYSTEM`` is a system to run the system tests for. It can be repeated.
|
||||
|
@ -948,75 +944,19 @@ example, the below command will build google postgres and mysql wheel packages:
|
|||
Those packages will be prepared in ./dist folder. This folder is mapped to /dist folder
|
||||
when you enter Breeze, so it is easy to automate installing those packages for testing.
|
||||
|
||||
|
||||
Installing backported for Airflow 1.10.* series
|
||||
-----------------------------------------------
|
||||
|
||||
The tests can be executed against the master version of Airflow, but they also work
|
||||
with older versions. This is especially useful to test back-ported operators
|
||||
from Airflow 2.0 to 1.10.* versions.
|
||||
|
||||
To run the tests for Airflow 1.10.* series, you need to run Breeze with
|
||||
``--install-airflow-version=<VERSION>`` to install a different version of Airflow.
|
||||
If ``current`` is specified (default), then the current version of Airflow is used.
|
||||
Otherwise, the released version of Airflow is installed.
|
||||
|
||||
The ``-install-airflow-version=<VERSION>`` command make sure that the current (from sources) version of
|
||||
Airflow is removed and the released version of Airflow from ``PyPI`` is installed. Note that tests sources
|
||||
are not removed and they can be used to run tests (unit tests and system tests) against the
|
||||
freshly installed version.
|
||||
|
||||
You should automate installing of the provider packages in your own
|
||||
``./files/airflow-breeze-config/variables.env`` file. You should make it depend on
|
||||
``RUN_AIRFLOW_1_10`` variable value equals to "true" so that
|
||||
the installation of provider packages is only performed when you install airflow 1.10.*.
|
||||
The provider packages are available in ``/dist`` directory if they were prepared as described
|
||||
in the previous chapter.
|
||||
|
||||
Typically the command in you variables.env file will be similar to:
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
# install any packages from dist folder if they are available
|
||||
if [[ ${RUN_AIRFLOW_1_10:=} == "true" ]]; then
|
||||
pip install /dist/apache_airflow_backport_providers_{google,postgres,mysql}*.whl || true
|
||||
fi
|
||||
|
||||
The command above will automatically install backported google, postgres, and mysql packages if they
|
||||
were prepared before entering the breeze.
|
||||
|
||||
|
||||
Running system tests for backported packages in Airflow 1.10.* series
|
||||
---------------------------------------------------------------------
|
||||
|
||||
Once you installed 1.10.* Airflow version with ``--install-airflow-version`` and prepared and
|
||||
installed the required packages via ``variables.env`` it should be as easy as running
|
||||
``pytest --system=<SYSTEM_NAME> TEST_NAME``. Note that we have default timeout for running
|
||||
system tests set to 8 minutes and some system tests might take much longer to run and you might
|
||||
want to add ``-o faulthandler_timeout=2400`` (2400s = 40 minutes for example) to your
|
||||
pytest command.
|
||||
|
||||
The typical system test session
|
||||
-------------------------------
|
||||
|
||||
Here is the typical session that you need to do to run system tests:
|
||||
|
||||
1. Prepare provider packages
|
||||
1. Enter breeze
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
./breeze prepare-provider-packages -- google postgres mysql
|
||||
|
||||
2. Enter breeze with installing Airflow 1.10.*, forwarding credentials and installing
|
||||
backported packages (you need an appropriate line in ``./files/airflow-breeze-config/variables.env``)
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
./breeze --install-airflow-version 1.10.9 --python 3.6 --db-reset --forward-credentials restart
|
||||
./breeze --python 3.6 --db-reset --forward-credentials restart
|
||||
|
||||
This will:
|
||||
|
||||
* install Airflow 1.10.9
|
||||
* restarts the whole environment (i.e. recreates metadata database from the scratch)
|
||||
* run Breeze with python 3.6 version
|
||||
* reset the Airflow database
|
||||
|
@ -1064,61 +1004,26 @@ Breeze session. They are usually expensive to run.
|
|||
|
||||
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Important !!!!!!!!!!!!!!!!!!!!!!!!!!!!
|
||||
|
||||
Note that in case you have to update your backported operators or system tests (they are part of
|
||||
the provider packageS) you need to rebuild the packages outside of breeze and
|
||||
``pip remove/pip install`` those packages to get them installed. This is not needed
|
||||
if you run system tests with ``current`` Airflow version, so it is better to iterate with the
|
||||
system tests with the ``current`` version and fix all problems there and only afterwards run
|
||||
the tests with Airflow 1.10.*
|
||||
|
||||
The typical session then looks as follows:
|
||||
|
||||
1. Prepare provider packages
|
||||
1. Enter breeze
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
./breeze prepare-provider-packages -- google postgres mysql
|
||||
./breeze --python 3.6 --db-reset --forward-credentials restart
|
||||
|
||||
2. Enter breeze with installing Airflow 1.10.*, forwarding credentials and installing
|
||||
backported packages (you need an appropriate line in ``./files/airflow-breeze-config/variables.env``)
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
./breeze --install-airflow-version 1.10.9 --python 3.6 --db-reset --forward-credentials restart
|
||||
|
||||
3. Run create action in helper (to create slowly created resources):
|
||||
2. Run create action in helper (to create slowly created resources):
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
python tests/providers/google/cloud/operators/test_cloud_sql_system_helper.py --action create
|
||||
|
||||
4. Run the tests:
|
||||
3. Run the tests:
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
pytest -o faulthandler_timeout=2400 \
|
||||
--system=google tests/providers/google/cloud/operators/test_compute_system.py
|
||||
|
||||
5. In case you are running provider packages tests you need to rebuild and reinstall a package
|
||||
every time you change the operators/hooks or example_dags. The example below shows reinstallation
|
||||
of the google package:
|
||||
|
||||
In the host:
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
./breeze prepare-provider-packages -- google
|
||||
|
||||
In the container:
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
pip uninstall apache-airflow-backport-providers-google
|
||||
pip install /dist/apache_airflow_backport_providers_google-*.whl
|
||||
|
||||
The points 4. and 5. can be repeated multiple times without leaving the container
|
||||
|
||||
6. Run delete action in helper:
|
||||
4. Run delete action in helper:
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
|
|
|
@ -0,0 +1 @@
|
|||
get_provider_info.py
|
|
@ -1,26 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
## Change in import paths
|
||||
|
||||
If you are upgrading from 2020.10.5 note the following changes in import paths
|
||||
|
||||
| Old path | New path |
|
||||
| --------------------------------------------------------------- | ----------------------------------------------------------- |
|
||||
| airflow.providers.amazon.aws.hooks.aws_dynamodb.AwsDynamoDBHook | airflow.providers.amazon.aws.hooks.dynamodb.AwsDynamoDBHook |
|
|
@ -1,106 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [992a18c84](https://github.com/apache/airflow/commit/992a18c84a355d13e821c703e7364f12233c37dc) | 2020-06-19 | Move MySqlToS3Operator to transfers (#9400) |
|
||||
| [a60f589aa](https://github.com/apache/airflow/commit/a60f589aa251cc3df6bec5b306ad4a7f736f539f) | 2020-06-19 | Add MySqlToS3Operator (#9054) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [40bf8f28f](https://github.com/apache/airflow/commit/40bf8f28f97f17f40d993d207ea740eba54593ee) | 2020-06-18 | Detect automatically the lack of reference to the guide in the operator descriptions (#9290) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [58a8ec0e4](https://github.com/apache/airflow/commit/58a8ec0e46f624ee0369dd156dd8fb4f81884a21) | 2020-06-16 | AWSBatchOperator <> ClientHook relation changed to composition (#9306) |
|
||||
| [a80cd25e8](https://github.com/apache/airflow/commit/a80cd25e8eb7f8b5d89af26cdcd62a5bbe44d65c) | 2020-06-15 | Close/Flush byte stream in s3 hook load_string and load_bytes (#9211) |
|
||||
| [ffb857403](https://github.com/apache/airflow/commit/ffb85740373f7adb70d28ec7d5a8886380170e5e) | 2020-06-14 | Decrypt secrets from SystemsManagerParameterStoreBackend (#9214) |
|
||||
| [a69b031f2](https://github.com/apache/airflow/commit/a69b031f20c5a1cd032f9873394374f661811e8f) | 2020-06-10 | Add S3ToRedshift example dag and system test (#8877) |
|
||||
| [17adcea83](https://github.com/apache/airflow/commit/17adcea835cb7b0cf2d8da0ac7dda5549cfa3e45) | 2020-06-02 | Fix handling of subprocess error handling in s3_file_transform and gcs (#9106) |
|
||||
| [357e11e0c](https://github.com/apache/airflow/commit/357e11e0cfb4c02833018e073bc4f5e5b52fae4f) | 2020-05-29 | Add Delete/Create S3 bucket operators (#8895) |
|
||||
| [1ed171bfb](https://github.com/apache/airflow/commit/1ed171bfb265ded8674058bdc425640d25f1f4fc) | 2020-05-28 | Add script_args for S3FileTransformOperator (#9019) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [1d36b0303](https://github.com/apache/airflow/commit/1d36b0303b8632fce6de78ca4e782ae26ee06fea) | 2020-05-23 | Fix references in docs (#8984) |
|
||||
| [f946f96da](https://github.com/apache/airflow/commit/f946f96da45d8e6101805450d8cab7ccb2774ad0) | 2020-05-23 | Old json boto compat removed from dynamodb_to_s3 operator (#8987) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [f4edd90a9](https://github.com/apache/airflow/commit/f4edd90a94b8f91bbefbbbfba367372399559596) | 2020-05-16 | Speed up TestAwsLambdaHook by not actually running a function (#8882) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [85bbab27d](https://github.com/apache/airflow/commit/85bbab27dbb4f55f6f322b894fe3d54797076c15) | 2020-05-15 | Add EMR operators howto docs (#8863) |
|
||||
| [e61b9bb9b](https://github.com/apache/airflow/commit/e61b9bb9bbe6d8a0621310f3583483b9135c6770) | 2020-05-13 | Add AWS EMR System tests (#8618) |
|
||||
| [ed3f5131a](https://github.com/apache/airflow/commit/ed3f5131a27e2ef0422f2495a4532630a6204f82) | 2020-05-13 | Correctly pass sleep time from AWSAthenaOperator down to the hook. (#8845) |
|
||||
| [7236862a1](https://github.com/apache/airflow/commit/7236862a1f5361b5e99c03dd63dae9b966efcd24) | 2020-05-12 | [AIRFLOW-2310] Enable AWS Glue Job Integration (#6007) |
|
||||
| [d590e5e76](https://github.com/apache/airflow/commit/d590e5e7679322bebb1472fa8c7ec6d183e4154a) | 2020-05-11 | Add option to propagate tags in ECSOperator (#8811) |
|
||||
| [0c3db84c3](https://github.com/apache/airflow/commit/0c3db84c3ce5107f53ed5ecc48edfdfe1b97feff) | 2020-05-11 | [AIRFLOW-7068] Create EC2 Hook, Operator and Sensor (#7731) |
|
||||
| [cbebed2b4](https://github.com/apache/airflow/commit/cbebed2b4d0bd1e0984c331c0270e83bf8df8540) | 2020-05-10 | Allow passing backend_kwargs to AWS SSM client (#8802) |
|
||||
| [c7788a689](https://github.com/apache/airflow/commit/c7788a6894cb79c22153434dd9b977393b8236be) | 2020-05-10 | Add imap_attachment_to_s3 example dag and system test (#8669) |
|
||||
| [ff5b70149](https://github.com/apache/airflow/commit/ff5b70149bf51012156378c8fc8b072c7c280d9d) | 2020-05-07 | Add google_api_to_s3_transfer example dags and system tests (#8581) |
|
||||
| [4421f011e](https://github.com/apache/airflow/commit/4421f011eeec2d1022a39933e27f530fb9f9c1b1) | 2020-05-01 | Improve template capabilities of EMR job and step operators (#8572) |
|
||||
| [379a884d6](https://github.com/apache/airflow/commit/379a884d645a4d73db1c81e3450adc82571989ea) | 2020-04-28 | fix: aws hook should work without conn id (#8534) |
|
||||
| [74bc316c5](https://github.com/apache/airflow/commit/74bc316c56192f14677e9406d3878887a836062b) | 2020-04-27 | [AIRFLOW-4438] Add Gzip compression to S3_hook (#8571) |
|
||||
| [7ea66a1a9](https://github.com/apache/airflow/commit/7ea66a1a9594704869e82513d3a06fe35b6109b2) | 2020-04-26 | Add example DAG for ECSOperator (#8452) |
|
||||
| [b6434dedf](https://github.com/apache/airflow/commit/b6434dedf974085e5f8891446fa63104836c8fdf) | 2020-04-24 | [AIRFLOW-7111] Add generate_presigned_url method to S3Hook (#8441) |
|
||||
| [becedd5af](https://github.com/apache/airflow/commit/becedd5af8df01a0210e0a3fa78e619785f39908) | 2020-04-19 | Remove unrelated EC2 references in ECSOperator (#8451) |
|
||||
| [ab1290cb0](https://github.com/apache/airflow/commit/ab1290cb0c5856fa85c8596bfdf780fcdfd99c31) | 2020-04-13 | Make launch_type parameter optional (#8248) |
|
||||
| [87969a350](https://github.com/apache/airflow/commit/87969a350ddd41e9e77776af6d780b31e363eaca) | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
|
||||
| [b46d6c060](https://github.com/apache/airflow/commit/b46d6c060280da59193a28cf67e791eb825cb51c) | 2020-04-08 | Add support for AWS Secrets Manager as Secrets Backend (#8186) |
|
||||
| [68d1714f2](https://github.com/apache/airflow/commit/68d1714f296989b7aad1a04b75dc033e76afb747) | 2020-04-04 | [AIRFLOW-6822] AWS hooks should cache boto3 client (#7541) |
|
||||
| [8a0240257](https://github.com/apache/airflow/commit/8a02402576f83869d5134b4bddef5d73c15a8320) | 2020-03-31 | Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011) |
|
||||
| [7239d9a82](https://github.com/apache/airflow/commit/7239d9a82dbb3b9bdf27b531daa70338af9dd796) | 2020-03-28 | Get Airflow Variables from AWS Systems Manager Parameter Store (#7945) |
|
||||
| [eb4af4f94](https://github.com/apache/airflow/commit/eb4af4f944c77e67e167bbb6b0a2aaf075a95b50) | 2020-03-28 | Make BaseSecretsBackend.build_path generic (#7948) |
|
||||
| [438da7241](https://github.com/apache/airflow/commit/438da7241eb537e3ef5ae711629446155bf738a3) | 2020-03-28 | [AIRFLOW-5825] SageMakerEndpointOperator is not idempotent (#7891) |
|
||||
| [686d7d50b](https://github.com/apache/airflow/commit/686d7d50bd21622724d6818021355bc6885fd3de) | 2020-03-25 | Standardize SecretBackend class names (#7846) |
|
||||
| [eef87b995](https://github.com/apache/airflow/commit/eef87b9953347a65421f315a07dbef37ded9df66) | 2020-03-23 | [AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830) |
|
||||
| [5648dfbc3](https://github.com/apache/airflow/commit/5648dfbc300337b10567ef4e07045ea29d33ec06) | 2020-03-23 | Add missing call to Super class in 'amazon', 'cloudant & 'databricks' providers (#7827) |
|
||||
| [a36002412](https://github.com/apache/airflow/commit/a36002412334c445e4eab41fdbb85ef31b6fd384) | 2020-03-19 | [AIRFLOW-5705] Make AwsSsmSecretsBackend consistent with VaultBackend (#7753) |
|
||||
| [2a54512d7](https://github.com/apache/airflow/commit/2a54512d785ba603ba71381dc3dfa049e9f74063) | 2020-03-17 | [AIRFLOW-5705] Fix bugs in AWS SSM Secrets Backend (#7745) |
|
||||
| [a8b5fc74d](https://github.com/apache/airflow/commit/a8b5fc74d07e50c91bb64cb66ca1a450aa5ce6e1) | 2020-03-16 | [AIRFLOW-4175] S3Hook load_file should support ACL policy paramete (#7733) |
|
||||
| [e31e9ddd2](https://github.com/apache/airflow/commit/e31e9ddd2332e5d92422baf668acee441646ad68) | 2020-03-14 | [AIRFLOW-5705] Add secrets backend and support for AWS SSM (#6376) |
|
||||
| [3bb60afc7](https://github.com/apache/airflow/commit/3bb60afc7b8319996385d681faac342afe2b3bd2) | 2020-03-13 | [AIRFLOW-6975] Base AWSHook AssumeRoleWithSAML (#7619) |
|
||||
| [c0c5f11ad](https://github.com/apache/airflow/commit/c0c5f11ad11a5a38e0553c1a36aa75eb83efae51) | 2020-03-12 | [AIRFLOW-6884] Make SageMakerTrainingOperator idempotent (#7598) |
|
||||
| [b7cdda1c6](https://github.com/apache/airflow/commit/b7cdda1c64595bc7f85519337029de259e573fce) | 2020-03-10 | [AIRFLOW-4438] Add Gzip compression to S3_hook (#7680) |
|
||||
| [42eef3821](https://github.com/apache/airflow/commit/42eef38217e709bc7a7f71bf0286e9e61293a43e) | 2020-03-07 | [AIRFLOW-6877] Add cross-provider dependencies as extras (#7506) |
|
||||
| [9a94ab246](https://github.com/apache/airflow/commit/9a94ab246db8c09aa83bb6a6d245b1ca9563bcd9) | 2020-03-01 | [AIRFLOW-6962] Fix compeleted to completed (#7600) |
|
||||
| [1b38f6d9b](https://github.com/apache/airflow/commit/1b38f6d9b6710bd5e25fc16883599f1842ab7cb9) | 2020-02-29 | [AIRFLOW-5908] Add download_file to S3 Hook (#6577) |
|
||||
| [3ea3e1a2b](https://github.com/apache/airflow/commit/3ea3e1a2b580b7ed10efe668de0cc37b03673500) | 2020-02-26 | [AIRFLOW-6824] EMRAddStepsOperator problem with multi-step XCom (#7443) |
|
||||
| [6eaa7e3b1](https://github.com/apache/airflow/commit/6eaa7e3b1845644d5ec65a00a997f4029bec9628) | 2020-02-25 | [AIRFLOW-5924] Automatically unify bucket name and key in S3Hook (#6574) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [7d0e7122d](https://github.com/apache/airflow/commit/7d0e7122dd14576d834c6f66fe919a72b100b7f8) | 2020-02-24 | [AIRFLOW-6830] Add Subject/MessageAttributes to SNS hook and operator (#7451) |
|
||||
| [4d03e33c1](https://github.com/apache/airflow/commit/4d03e33c115018e30fa413c42b16212481ad25cc) | 2020-02-22 | [AIRFLOW-6817] remove imports from `airflow/__init__.py`, replaced implicit imports with explicit imports, added entry to `UPDATING.MD` - squashed/rebased (#7456) |
|
||||
| [47a922b86](https://github.com/apache/airflow/commit/47a922b86426968bfa07cc7892d2eeeca761d884) | 2020-02-21 | [AIRFLOW-6854] Fix missing typing_extensions on python 3.8 (#7474) |
|
||||
| [9cbd7de6d](https://github.com/apache/airflow/commit/9cbd7de6d115795aba8bfb8addb060bfdfbdf87b) | 2020-02-18 | [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412) |
|
||||
| [58c3542ed](https://github.com/apache/airflow/commit/58c3542ed25061320ce61dbe0adf451a44c738dd) | 2020-02-12 | [AIRFLOW-5231] Fix S3Hook.delete_objects method (#7375) |
|
||||
| [b7aa778b3](https://github.com/apache/airflow/commit/b7aa778b38df2f116a1c20031e72fea8b97315bf) | 2020-02-10 | [AIRFLOW-6767] Correct name for default Athena workgroup (#7394) |
|
||||
| [9282185e6](https://github.com/apache/airflow/commit/9282185e6624e64bb7f17447f81c1b2d1bb4d56d) | 2020-02-09 | [AIRFLOW-6761] Fix WorkGroup param in AWSAthenaHook (#7386) |
|
||||
| [94fccca97](https://github.com/apache/airflow/commit/94fccca97030ee59d89f302a98137b17e7b01a33) | 2020-02-04 | [AIRFLOW-XXXX] Add pre-commit check for utf-8 file encoding (#7347) |
|
||||
| [f3ad5cf61](https://github.com/apache/airflow/commit/f3ad5cf6185b9d406d0fb0a4ecc0b5536f79217a) | 2020-02-03 | [AIRFLOW-4681] Make sensors module pylint compatible (#7309) |
|
||||
| [88e40c714](https://github.com/apache/airflow/commit/88e40c714d2853aa8966796945b2907c263fed08) | 2020-02-03 | [AIRFLOW-6716] Fix AWS Datasync Example DAG (#7339) |
|
||||
| [a311d3d82](https://github.com/apache/airflow/commit/a311d3d82e0c2e32bcb56e29f33c95ed0a2a2ddc) | 2020-02-03 | [AIRFLOW-6718] Fix more occurrences of utils.dates.days_ago (#7341) |
|
||||
| [cb766b05b](https://github.com/apache/airflow/commit/cb766b05b17b80fd54a5ce6ac3ee35a631115000) | 2020-02-03 | [AIRFLOW-XXXX] Fix Static Checks on CI (#7342) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [7527eddc5](https://github.com/apache/airflow/commit/7527eddc5e9729aa7e732209a07d57985f6c73e4) | 2020-02-02 | [AIRFLOW-4364] Make all code in airflow/providers/amazon pylint compatible (#7336) |
|
||||
| [cf141506a](https://github.com/apache/airflow/commit/cf141506a25dbba279b85500d781f7e056540721) | 2020-02-02 | [AIRFLOW-6708] Set unique logger names (#7330) |
|
||||
| [63aa3db88](https://github.com/apache/airflow/commit/63aa3db88f8824efe79622301efd9f8ba75b991c) | 2020-02-02 | [AIRFLOW-6258] Add CloudFormation operators to AWS providers (#6824) |
|
||||
| [af4157fde](https://github.com/apache/airflow/commit/af4157fdeffc0c18492b518708c0db44815067ab) | 2020-02-02 | [AIRFLOW-6672] AWS DataSync - better logging of error message (#7288) |
|
||||
| [373c6aa4a](https://github.com/apache/airflow/commit/373c6aa4a208284b5ff72987e4bd8f4e2ada1a1b) | 2020-01-30 | [AIRFLOW-6682] Move GCP classes to providers package (#7295) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [1988a97e8](https://github.com/apache/airflow/commit/1988a97e8f687e28a5a39b29677fb514e097753c) | 2020-01-28 | [AIRFLOW-6659] Move AWS Transfer operators to providers package (#7274) |
|
||||
| [ab10443e9](https://github.com/apache/airflow/commit/ab10443e965269efe9c1efaf5fa33bcdbe609f13) | 2020-01-28 | [AIRFLOW-6424] Added a operator to modify EMR cluster (#7213) |
|
||||
| [40246132a](https://github.com/apache/airflow/commit/40246132a7ef3b07fe3173c6e7646ed6b53aad6e) | 2020-01-28 | [AIRFLOW-6654] AWS DataSync - bugfix when creating locations (#7270) |
|
||||
| [82c0e5aff](https://github.com/apache/airflow/commit/82c0e5aff6004f636b98e207c3caec40b403fbbe) | 2020-01-28 | [AIRFLOW-6655] Move AWS classes to providers (#7271) |
|
||||
| [599e4791c](https://github.com/apache/airflow/commit/599e4791c91cff411b1bf1c45555db5094c2b420) | 2020-01-18 | [AIRFLOW-6541] Use EmrJobFlowSensor for other states (#7146) |
|
||||
| [c319e81ca](https://github.com/apache/airflow/commit/c319e81cae1de31ad1373903252d8608ffce1fba) | 2020-01-17 | [AIRFLOW-6572] Move AWS classes to providers.amazon.aws package (#7178) |
|
||||
| [941a07057](https://github.com/apache/airflow/commit/941a070578bc7d9410715b89658548167352cc4d) | 2020-01-15 | [AIRFLOW-6570] Add dag tag for all example dag (#7176) |
|
||||
| [78d8fe694](https://github.com/apache/airflow/commit/78d8fe6944b689b9b0af99255286e34e06eedec3) | 2020-01-08 | [AIRFLOW-6245] Add custom waiters for AWS batch jobs (#6811) |
|
||||
| [e0b022725](https://github.com/apache/airflow/commit/e0b022725749181bd4e30933e4a0ffefb993eede) | 2019-12-28 | [AIRFLOW-6319] Add support for AWS Athena workgroups (#6871) |
|
||||
| [57da45685](https://github.com/apache/airflow/commit/57da45685457520d51a0967e2aeb5e5ff162dfa7) | 2019-12-24 | [AIRFLOW-6333] Bump Pylint to 2.4.4 & fix/disable new checks (#6888) |
|
||||
| [cf647c27e](https://github.com/apache/airflow/commit/cf647c27e0f35bbd1183bfcf87a106cbdb69d3fa) | 2019-12-18 | [AIRFLOW-6038] AWS DataSync reworked (#6773) |
|
||||
| [7502cad28](https://github.com/apache/airflow/commit/7502cad2844139d57e4276d971c0706a361d9dbe) | 2019-12-17 | [AIRFLOW-6206] Move and rename AWS batch operator [AIP-21] (#6764) |
|
||||
| [c4c635df6](https://github.com/apache/airflow/commit/c4c635df6906f56e01724573923e19763bb0da62) | 2019-12-17 | [AIRFLOW-6083] Adding ability to pass custom configuration to lambda client. (#6678) |
|
||||
| [4fb498f87](https://github.com/apache/airflow/commit/4fb498f87ef89acc30f2576ebc5090ab0653159e) | 2019-12-09 | [AIRFLOW-6072] aws_hook: Outbound http proxy setting and other enhancements (#6686) |
|
||||
| [a1e2f8635](https://github.com/apache/airflow/commit/a1e2f863526973b17892ec31caf09eded95c1cd2) | 2019-11-20 | [AIRFLOW-6021] Replace list literal with list constructor (#6617) |
|
||||
| [baae14084](https://github.com/apache/airflow/commit/baae140847cdf9d84e905fb6d1f119d6950eecf9) | 2019-11-19 | [AIRFLOW-5781] AIP-21 Migrate AWS Kinesis to /providers/amazon/aws (#6588) |
|
||||
| [504cfbac1](https://github.com/apache/airflow/commit/504cfbac1a4ec2e2fd169523ed357808f63881bb) | 2019-11-18 | [AIRFLOW-5783] AIP-21 Move aws redshift into providers structure (#6539) |
|
||||
| [992f0e3ac](https://github.com/apache/airflow/commit/992f0e3acf11163294508858515a5f79116e3ad8) | 2019-11-12 | AIRFLOW-5824: AWS DataSync Hook and Operators added (#6512) |
|
||||
| [c015eb2f6](https://github.com/apache/airflow/commit/c015eb2f6496b9721afda9e85d5d4af3bbe0696b) | 2019-11-10 | [AIRFLOW-5786] Migrate AWS SNS to /providers/amazon/aws (#6502) |
|
||||
| [3d76fb4bf](https://github.com/apache/airflow/commit/3d76fb4bf25e5b7d3d30e0d64867b5999b77f0b0) | 2019-11-09 | [AIRFLOW-5782] Migrate AWS Lambda to /providers/amazon/aws [AIP-21] (#6518) |
|
|
@ -1,65 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:------------------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [00ffedb8c](https://github.com/apache/airflow/commit/00ffedb8c402eb5638782628eb706a5f28215eac) | 2020-09-30 | Add amazon glacier to GCS transfer operator (#10947) |
|
||||
| [e3f96ce7a](https://github.com/apache/airflow/commit/e3f96ce7a8ac098aeef5e9930e6de6c428274d57) | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [b61225a88](https://github.com/apache/airflow/commit/b61225a8850b20be17842c2428b91d873584c4da) | 2020-09-21 | Add D204 pydocstyle check (#11031) |
|
||||
| [2410f592a](https://github.com/apache/airflow/commit/2410f592a4ab160b377f1a9e5de3b7262b9851cc) | 2020-09-19 | Get Airflow configs with sensitive data from AWS Systems Manager (#11023) |
|
||||
| [2bf7b7cac](https://github.com/apache/airflow/commit/2bf7b7cac7858f5a6a495f1a9eb4780ec84f95b4) | 2020-09-19 | Add typing to amazon provider EMR (#10910) |
|
||||
| [9edfcb7ac](https://github.com/apache/airflow/commit/9edfcb7ac46917836ec956264da8876e58d92392) | 2020-09-19 | Support extra_args in S3Hook and GCSToS3Operator (#11001) |
|
||||
| [4e1f3a69d](https://github.com/apache/airflow/commit/4e1f3a69db8614c302e4916332555034053b935c) | 2020-09-14 | [AIRFLOW-10645] Add AWS Secrets Manager Hook (#10655) |
|
||||
| [e9add7916](https://github.com/apache/airflow/commit/e9add79160e3a16bb348e30f4e83386a371dbc1e) | 2020-09-14 | Fix Failing static tests on Master (#10927) |
|
||||
| [383a118d2](https://github.com/apache/airflow/commit/383a118d2df618e46d81c520cd2c4a31d81b33dd) | 2020-09-14 | Add more type annotations to AWS hooks (#10671) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [2934220dc](https://github.com/apache/airflow/commit/2934220dc98e295764f7791d33e121629ed2fbbb) | 2020-09-08 | Always return a list from S3Hook list methods (#10774) |
|
||||
| [f40ac9b15](https://github.com/apache/airflow/commit/f40ac9b151124dbcd87197d6ae38c85191d41f38) | 2020-09-01 | Add placement_strategy option (#9444) |
|
||||
| [e4878e677](https://github.com/apache/airflow/commit/e4878e6775bbe5cb2a1d786e57e009271b78bba0) | 2020-08-31 | fix type hints for s3 hook read_key method (#10653) |
|
||||
| [2ca615cff](https://github.com/apache/airflow/commit/2ca615cffefe97dfa38e1b7f60d9ed33c6628992) | 2020-08-29 | Update Google Cloud branding (#10642) |
|
||||
| [8969b7185](https://github.com/apache/airflow/commit/8969b7185ebc3c90168ce9a2fb97dfbc74d2bed9) | 2020-08-28 | Removed bad characters from AWS operator (#10590) |
|
||||
| [8349061f9](https://github.com/apache/airflow/commit/8349061f9cb01a92c87edd349cc844c4053851e8) | 2020-08-26 | Improve Docstring for AWS Athena Hook/Operator (#10580) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [3734876d9](https://github.com/apache/airflow/commit/3734876d9898067ee933b84af522d53df6160d7f) | 2020-08-24 | Implement impersonation in google operators (#10052) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [c6358045f](https://github.com/apache/airflow/commit/c6358045f9d61af63c96833cb6682d6f382a6408) | 2020-08-22 | Fixes S3ToRedshift COPY query (#10436) |
|
||||
| [7c206a82a](https://github.com/apache/airflow/commit/7c206a82a6f074abcc4898a005ecd2c84a920054) | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
|
||||
| [27d08b76a](https://github.com/apache/airflow/commit/27d08b76a2d171d716a1599157a8a60a121dbec6) | 2020-08-21 | Amazon SES Hook (#10391) |
|
||||
| [dea345b05](https://github.com/apache/airflow/commit/dea345b05c2cd226e70f97a3934d7456aa1cc754) | 2020-08-17 | Fix AwsGlueJobSensor to stop running after the Glue job finished (#9022) |
|
||||
| [f6734b3b8](https://github.com/apache/airflow/commit/f6734b3b850d33d3712763f93c114e80f5af9ffb) | 2020-08-12 | Enable Sphinx spellcheck for doc generation (#10280) |
|
||||
| [82f744b87](https://github.com/apache/airflow/commit/82f744b871bb2c5e9a2d628e1c45ae16c1244240) | 2020-08-11 | Add type annotations to AwsGlueJobHook, RedshiftHook modules (#10286) |
|
||||
| [19bc97d0c](https://github.com/apache/airflow/commit/19bc97d0ce436a6ec9d8e9a5adcd48c0a769d01f) | 2020-08-10 | Revert "Add Amazon SES hook (#10004)" (#10276) |
|
||||
| [f06fe616e](https://github.com/apache/airflow/commit/f06fe616e66256bdc53710de505c2c6b1bd21528) | 2020-08-10 | Add Amazon SES hook (#10004) |
|
||||
| [0c77ea8a3](https://github.com/apache/airflow/commit/0c77ea8a3c417805f66d10f0c757ca218bf8dee0) | 2020-08-06 | Add type annotations to S3 hook module (#10164) |
|
||||
| [24c8e4c2d](https://github.com/apache/airflow/commit/24c8e4c2d6e359ecc2c7d6275dccc68de4a82832) | 2020-08-06 | Changes to all the constructors to remove the args argument (#10163) |
|
||||
| [9667314b2](https://github.com/apache/airflow/commit/9667314b2fb879edc451793a8350123507e1cfd6) | 2020-08-05 | Add correct signatures for operators in amazon provider package (#10167) |
|
||||
| [000287753](https://github.com/apache/airflow/commit/000287753b478f29e6c25442ac253e3a6c8e8c87) | 2020-08-03 | Improve Typing coverage of amazon/aws/athena (#10025) |
|
||||
| [53ada6e79](https://github.com/apache/airflow/commit/53ada6e7911f411e80ebb00be9f07a7cc0788d01) | 2020-08-03 | Add S3KeysUnchangedSensor (#9817) |
|
||||
| [aeea71274](https://github.com/apache/airflow/commit/aeea71274d4527ff2351102e94aa38bda6099e7f) | 2020-08-02 | Remove `args` parameter from provider operator constructors (#10097) |
|
||||
| [2b8dea64e](https://github.com/apache/airflow/commit/2b8dea64e9e8716fba8c38a1b439f7835bbd2918) | 2020-08-01 | Fix typo in Athena sensor retries (#10079) |
|
||||
| [1508c43ec](https://github.com/apache/airflow/commit/1508c43ec9594e801b415dd82472fa017791b759) | 2020-07-29 | Adding new SageMaker operator for ProcessingJobs (#9594) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [8b10a4b35](https://github.com/apache/airflow/commit/8b10a4b35e45d536a6475bfe1491ee75fad50186) | 2020-07-25 | Stop using start_date in default_args in example_dags (#9982) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [e7c87fe45](https://github.com/apache/airflow/commit/e7c87fe453c6a70ed087c7ffbccaacbf0d2831b9) | 2020-07-20 | Refactor AwsBaseHook._get_credentials (#9878) |
|
||||
| [2577f9334](https://github.com/apache/airflow/commit/2577f9334a5cb71cccd97e62b0ae2d097cb99e1a) | 2020-07-16 | Fix S3FileTransformOperator to support S3 Select transformation only (#8936) |
|
||||
| [52b6efe1e](https://github.com/apache/airflow/commit/52b6efe1ecaae74b9c2497f565e116305d575a76) | 2020-07-15 | Add option to delete by prefix to S3DeleteObjectsOperator (#9350) |
|
||||
| [553bb7af7](https://github.com/apache/airflow/commit/553bb7af7cb7a50f7141b5b89297713cee6d19f6) | 2020-07-13 | Keep functions signatures in decorators (#9786) |
|
||||
| [2f31b3060](https://github.com/apache/airflow/commit/2f31b3060ed8274d5d1b1db7349ce607640b9199) | 2020-07-08 | Get Airflow configs with sensitive data from Secret Backends (#9645) |
|
||||
| [07b81029e](https://github.com/apache/airflow/commit/07b81029ebc2a296fb54181f2cec11fcc7704d9d) | 2020-07-08 | Allow AWSAthenaHook to get more than 1000/first page of results (#6075) |
|
||||
| [564192c16](https://github.com/apache/airflow/commit/564192c1625a552456cebb3751978c08eebdb2a1) | 2020-07-08 | Add AWS StepFunctions integrations to the aws provider (#8749) |
|
||||
| [ecce1ace7](https://github.com/apache/airflow/commit/ecce1ace7a277c948c61d7d4cbfc8632cc216559) | 2020-07-08 | [AIRFLOW-XXXX] Remove unnecessary docstring in AWSAthenaOperator |
|
||||
| [a79e2d4c4](https://github.com/apache/airflow/commit/a79e2d4c4aa105f3fac5ae6a28e29af9cd572407) | 2020-07-06 | Move provider's log task handlers to the provider package (#9604) |
|
||||
| [ee20086b8](https://github.com/apache/airflow/commit/ee20086b8c499fa40dcaac71652f21b466e7f80f) | 2020-07-02 | Move S3TaskHandler to the AWS provider package (#9602) |
|
||||
| [40add26d4](https://github.com/apache/airflow/commit/40add26d459c2511a6d9d305ae7300f0d6104211) | 2020-06-29 | Remove almost all references to airflow.contrib (#9559) |
|
||||
| [c858babdd](https://github.com/apache/airflow/commit/c858babddf8b18b417993b5bfefec1c5635510da) | 2020-06-26 | Remove kwargs from Super calls in AWS Secrets Backends (#9523) |
|
||||
| [87fdbd070](https://github.com/apache/airflow/commit/87fdbd0708d942af98d35604fe5962962e25d246) | 2020-06-25 | Use literal syntax instead of function calls to create data structure (#9516) |
|
||||
| [c7a454aa3](https://github.com/apache/airflow/commit/c7a454aa32bf33133d042e8438ac259b32144b21) | 2020-06-22 | Add AWS ECS system test (#8888) |
|
||||
| [df8efd04f](https://github.com/apache/airflow/commit/df8efd04f394afc4b5affb677bc78d8b7bd5275a) | 2020-06-21 | Enable & Fix "Docstring Content Issues" PyDocStyle Check (#9460) |
|
||||
| [e13a14c87](https://github.com/apache/airflow/commit/e13a14c8730f4f633d996dd7d3468fe827136a84) | 2020-06-21 | Enable & Fix Whitespace related PyDocStyle Checks (#9458) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,26 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [6ce855af1](https://github.com/apache/airflow/commit/6ce855af118daeaa4c249669079ab9d9aad23945) | 2020-10-24 | Fix spelling (#11821) |
|
||||
| [3934ef224](https://github.com/apache/airflow/commit/3934ef22494db6d9613c229aaa82ea6a366b7c2f) | 2020-10-24 | Remove redundant builtins imports (#11809) |
|
||||
| [4c8e033c0](https://github.com/apache/airflow/commit/4c8e033c0ee7d28963d504a9216205155f20f58f) | 2020-10-24 | Fix spelling and grammar (#11814) |
|
||||
| [483068745](https://github.com/apache/airflow/commit/48306874538eea7cfd42358d5ebb59705204bfc4) | 2020-10-24 | Use Python 3 style super classes (#11806) |
|
||||
| [0df60b773](https://github.com/apache/airflow/commit/0df60b773671ecf8d4e5f582ac2be200cf2a2edd) | 2020-10-23 | Add reattach flag to ECSOperator (#10643) |
|
||||
| [b9d677cdd](https://github.com/apache/airflow/commit/b9d677cdd660e0be8278a64658e73359276a9682) | 2020-10-22 | Add type hints to aws provider (#11531) |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [674368f66](https://github.com/apache/airflow/commit/674368f66cf61b2a105f326f23868ac3aee08807) | 2020-10-19 | Fixes MySQLToS3 float to int conversion (#10437) |
|
||||
| [0823d46a7](https://github.com/apache/airflow/commit/0823d46a7f267f2e45195a175021825367938add) | 2020-10-16 | Add type annotations for AWS operators and hooks (#11434) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [d38a0a781](https://github.com/apache/airflow/commit/d38a0a781e123c8c50313efdb23f767d6678afe0) | 2020-10-12 | added type hints for aws cloud formation (#11470) |
|
||||
| [d305876be](https://github.com/apache/airflow/commit/d305876bee328287ff391a29cc1cd632468cc731) | 2020-10-12 | Remove redundant None provided as default to dict.get() (#11448) |
|
||||
| [c3e340584](https://github.com/apache/airflow/commit/c3e340584bf1892c4f73aa9e7495b5823dab0c40) | 2020-10-11 | Change prefix of AwsDynamoDB hook module (#11209) |
|
||||
| [42a23d16f](https://github.com/apache/airflow/commit/42a23d16fe9b2f165b0805fb767ecbb825c93657) | 2020-10-11 | Update MySQLToS3Operator's s3_bucket to template_fields (#10778) |
|
||||
| [422b61a9d](https://github.com/apache/airflow/commit/422b61a9dd95ab9d00b239daa14d87d7cae5ae73) | 2020-10-09 | Adding ElastiCache Hook for creating, describing and deleting replication groups (#8701) |
|
||||
| [dd98b2149](https://github.com/apache/airflow/commit/dd98b21494ff6036242b63268140abe1294b3657) | 2020-10-06 | Add acl_policy parameter to GCSToS3Operator (#10804) (#10829) |
|
||||
| [32b3cfbcf](https://github.com/apache/airflow/commit/32b3cfbcf0209cb062dd641c1232ab25d02d4d6d) | 2020-10-06 | Strict type check for all hooks in amazon (#11250) |
|
||||
| [6d573e8ab](https://github.com/apache/airflow/commit/6d573e8abbf87e3c7281347e03d428a6e5baccd4) | 2020-10-03 | Add s3 key to template fields for s3/redshift transfer operators (#10890) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,26 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.11.23
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [4873d9759](https://github.com/apache/airflow/commit/4873d9759dfdec1dd3663074f9e64ad69fa881cc) | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) |
|
||||
| [ae7cb4a1e](https://github.com/apache/airflow/commit/ae7cb4a1e2a96351f1976cf5832615e24863e05d) | 2020-11-17 | Update wrong commit hash in backport provider changes (#12390) |
|
||||
| [6889a333c](https://github.com/apache/airflow/commit/6889a333cff001727eb0a66e375544a28c9a5f03) | 2020-11-15 | Improvements for operators and hooks ref docs (#12366) |
|
||||
| [c94b1241a](https://github.com/apache/airflow/commit/c94b1241a144294f5f1c5f461d5e3b92e4a8fc38) | 2020-11-13 | Add extra error handling to S3 remote logging (#9908) |
|
||||
| [7825e8f59](https://github.com/apache/airflow/commit/7825e8f59034645ab3247229be83a3aa90baece1) | 2020-11-13 | Docs installation improvements (#12304) |
|
||||
| [250436d96](https://github.com/apache/airflow/commit/250436d962c8c950d38c1eb5e54a998891648cc9) | 2020-11-10 | Fix spelling in Python files (#12230) |
|
||||
| [85a18e13d](https://github.com/apache/airflow/commit/85a18e13d9dec84275283ff69e34704b60d54a75) | 2020-11-09 | Point at pypi project pages for cross-dependency of provider packages (#12212) |
|
||||
| [59eb5de78](https://github.com/apache/airflow/commit/59eb5de78c70ee9c7ae6e4cba5c7a2babb8103ca) | 2020-11-09 | Update provider READMEs for up-coming 1.0.0beta1 releases (#12206) |
|
||||
| [b2a28d159](https://github.com/apache/airflow/commit/b2a28d1590410630d66966aa1f2b2a049a8c3b32) | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
|
||||
| [fcb6b00ef](https://github.com/apache/airflow/commit/fcb6b00efef80c81272a30cfc618202a29e0c6a9) | 2020-11-08 | Add authentication to AWS with Google credentials (#12079) |
|
||||
| [fb6bddba0](https://github.com/apache/airflow/commit/fb6bddba0c9e3e7ef2610b4fb3f73622e48d7ea0) | 2020-11-07 | In AWS Secrets backend, a lookup is optional (#12143) |
|
||||
| [cf9437d79](https://github.com/apache/airflow/commit/cf9437d79f9658d1309e4bfe847fe63d52ec7b99) | 2020-11-06 | Simplify string expressions (#12123) |
|
||||
| [41bf172c1](https://github.com/apache/airflow/commit/41bf172c1dc75099f4f9d8b3f3350b4b1f523ef9) | 2020-11-04 | Simplify string expressions (#12093) |
|
||||
| [4e8f9cc8d](https://github.com/apache/airflow/commit/4e8f9cc8d02b29c325b8a5a76b4837671bdf5f68) | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
|
||||
| [8c42cf1b0](https://github.com/apache/airflow/commit/8c42cf1b00c90f0d7f11b8a3a455381de8e003c5) | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
|
||||
| [5e77a6154](https://github.com/apache/airflow/commit/5e77a61543d26e5466d885d639247aa5189c011d) | 2020-11-02 | Docstring fix for S3DeleteBucketOperator (#12049) |
|
||||
| [822285134](https://github.com/apache/airflow/commit/8222851348aa81424c9bdcea994e25e0d6692709) | 2020-10-29 | Add Template Fields to RedshiftToS3Operator & S3ToRedshiftOperator (#11844) |
|
||||
| [db121f726](https://github.com/apache/airflow/commit/db121f726b3c7a37aca1ea05eb4714f884456005) | 2020-10-28 | Add truncate table (before copy) option to S3ToRedshiftOperator (#9246) |
|
||||
| [5a439e84e](https://github.com/apache/airflow/commit/5a439e84eb6c0544dc6c3d6a9f4ceeb2172cd5d0) | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
|
||||
| [8afdb6ac6](https://github.com/apache/airflow/commit/8afdb6ac6a7997cb14806bc2734c81c00ed8da97) | 2020-10-26 | Fix spellings (#11825) |
|
|
@ -1,41 +0,0 @@
|
|||
|
||||
|
||||
### Release 2021.2.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:----------------------------------------------------------------------------------------|
|
||||
| [66e82969d](https://github.com/apache/airflow/commit/66e82969dd0ad656618bda4719a545bbaeed5d10) | 2021-01-31 | `Implement provider versioning tools` |
|
||||
| [ecfdc60bb](https://github.com/apache/airflow/commit/ecfdc60bb607fe0d13fa7e315476c607813abab6) | 2021-01-29 | `Add bucket_name to template fileds in S3 operators (#13973)` |
|
||||
| [d0ab7f6d3](https://github.com/apache/airflow/commit/d0ab7f6d3a2976167f9c4fb309c502a4f866f983) | 2021-01-25 | `Add ExasolToS3Operator (#13847)` |
|
||||
| [6d55f329f](https://github.com/apache/airflow/commit/6d55f329f93c5cd1e94973194c0cd7caa65309e1) | 2021-01-25 | `AWS Glue Crawler Integration (#13072)` |
|
||||
| [f473ca713](https://github.com/apache/airflow/commit/f473ca7130f844bc59477674e641b42b80698bb7) | 2021-01-24 | `Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851)` |
|
||||
| [a9ac2b040](https://github.com/apache/airflow/commit/a9ac2b040b64de1aa5d9c2b9def33334e36a8d22) | 2021-01-23 | `Switch to f-strings using flynt. (#13732)` |
|
||||
| [3fd5ef355](https://github.com/apache/airflow/commit/3fd5ef355556cf0ad7896bb570bbe4b2eabbf46e) | 2021-01-21 | `Add missing logos for integrations (#13717)` |
|
||||
| [29730d720](https://github.com/apache/airflow/commit/29730d720066a4c16d524e905de8cdf07e8cd129) | 2021-01-20 | `Add acl_policy to S3CopyObjectOperator (#13773)` |
|
||||
| [c065d3218](https://github.com/apache/airflow/commit/c065d32189bfee80ab938d96ad74f6492e9c9b24) | 2021-01-19 | `AllowDiskUse parameter and docs in MongotoS3Operator (#12033)` |
|
||||
| [ab5fe56ac](https://github.com/apache/airflow/commit/ab5fe56ac4bda0d3fcdcbf58ed2632255b7ac713) | 2021-01-16 | `Fix bug in GCSToS3Operator (#13718)` |
|
||||
| [04d278f93](https://github.com/apache/airflow/commit/04d278f93ffafb40fb6e95b41ecfa5f5cba5ef98) | 2021-01-13 | `Add S3ToFTPOperator (#11747)` |
|
||||
| [8d42d9ed6](https://github.com/apache/airflow/commit/8d42d9ed69b03b372c6bc01309ef22e01b8db55f) | 2021-01-11 | `add xcom push for ECSOperator (#12096)` |
|
||||
| [308f1d066](https://github.com/apache/airflow/commit/308f1d06668ad427fd2483077d8e60f55ee617e6) | 2021-01-07 | `[AIRFLOW-3723] Add Gzip capability to mongo_to_S3 operator (#13187)` |
|
||||
| [f69405fb0](https://github.com/apache/airflow/commit/f69405fb0b7c236968c730e1ad31a60eea2338c4) | 2021-01-07 | `Fix S3KeysUnchangedSensor so that template_fields work (#13490)` |
|
||||
| [4e479e1e1](https://github.com/apache/airflow/commit/4e479e1e1b8eea71df48f5cc08a7dd15929ba177) | 2021-01-06 | `Add S3KeySizeSensor (#13049)` |
|
||||
| [f7a1334ab](https://github.com/apache/airflow/commit/f7a1334abe4417409498daad52c97d3f0eb95137) | 2021-01-02 | `Add 'mongo_collection' to template_fields in MongoToS3Operator (#13361)` |
|
||||
| [bd74eb0ca](https://github.com/apache/airflow/commit/bd74eb0ca0bb5f81cd98e2c151257a404d4a55a5) | 2020-12-31 | `Allow Tags on AWS Batch Job Submission (#13396)` |
|
||||
| [295d66f91](https://github.com/apache/airflow/commit/295d66f91446a69610576d040ba687b38f1c5d0a) | 2020-12-30 | `Fix Grammar in PIP warning (#13380)` |
|
||||
| [625576a3a](https://github.com/apache/airflow/commit/625576a3af470cddad250735b74ba11e4880de0a) | 2020-12-18 | `Fix spelling (#13135)` |
|
||||
| [6cf76d7ac](https://github.com/apache/airflow/commit/6cf76d7ac01270930de7f105fb26428763ee1d4e) | 2020-12-18 | `Fix typo in pip upgrade command :( (#13148)` |
|
||||
| [5090fb0c8](https://github.com/apache/airflow/commit/5090fb0c8967d2d8719c6f4a468f2151395b5444) | 2020-12-15 | `Add script to generate integrations.json (#13073)` |
|
||||
| [32971a1a2](https://github.com/apache/airflow/commit/32971a1a2de1db0b4f7442ed26facdf8d3b7a36f) | 2020-12-09 | `Updates providers versions to 1.0.0 (#12955)` |
|
||||
| [d5589673a](https://github.com/apache/airflow/commit/d5589673a95aaced0b851ea0a4061a010a924a82) | 2020-12-08 | `Move dummy_operator.py to dummy.py (#11178) (#11293)` |
|
||||
| [b40dffa08](https://github.com/apache/airflow/commit/b40dffa08547b610162f8cacfa75847f3c4ca364) | 2020-12-08 | `Rename remaing modules to match AIP-21 (#12917)` |
|
||||
| [9b39f2478](https://github.com/apache/airflow/commit/9b39f24780e85f859236672e9060b2fbeee81b36) | 2020-12-08 | `Add support for dynamic connection form fields per provider (#12558)` |
|
||||
| [bd90136aa](https://github.com/apache/airflow/commit/bd90136aaf5035e3234fe545b79a3e4aad21efe2) | 2020-11-30 | `Move operator guides to provider documentation packages (#12681)` |
|
||||
| [02d94349b](https://github.com/apache/airflow/commit/02d94349be3d201ce9d37d7358573c937fd010df) | 2020-11-29 | `Don't use time.time() or timezone.utcnow() for duration calculations (#12353)` |
|
||||
| [de3b1e687](https://github.com/apache/airflow/commit/de3b1e687b26c524c6909b7b4dfbb60d25019751) | 2020-11-28 | `Move connection guides to provider documentation packages (#12653)` |
|
||||
| [663259d4b](https://github.com/apache/airflow/commit/663259d4b541ab10ce55fec4d2460e23917062c2) | 2020-11-25 | `Fix AWS DataSync tests failing (#11020)` |
|
||||
| [3fa51f94d](https://github.com/apache/airflow/commit/3fa51f94d7a17f170ddc31908d36c91f4456a20b) | 2020-11-24 | `Add check for duplicates in provider.yaml files (#12578)` |
|
||||
| [ed09915a0](https://github.com/apache/airflow/commit/ed09915a02b9b99e60689e647452addaab1688fc) | 2020-11-23 | `[AIRFLOW-5115] Bugfix for S3KeySensor failing to accept template_fields (#12389)` |
|
||||
| [370e7d07d](https://github.com/apache/airflow/commit/370e7d07d1ed1a53b73fe878425fdcd4c71a7ed1) | 2020-11-21 | `Fix Python Docstring parameters (#12513)` |
|
||||
| [c34ef853c](https://github.com/apache/airflow/commit/c34ef853c890e08f5468183c03dc8f3f3ce84af2) | 2020-11-20 | `Separate out documentation building per provider (#12444)` |
|
||||
| [008035450](https://github.com/apache/airflow/commit/00803545023b096b8db4fbd6eb473843096d7ce4) | 2020-11-18 | `Update provider READMEs for 1.0.0b2 batch release (#12449)` |
|
||||
| [7ca0b6f12](https://github.com/apache/airflow/commit/7ca0b6f121c9cec6e25de130f86a56d7c7fbe38c) | 2020-11-18 | `Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)` |
|
|
@ -1,505 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-amazon
|
||||
|
||||
Release: 2021.2.5
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Cross provider package dependencies](#cross-provider-package-dependencies)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [New operators](#new-operators)
|
||||
- [Moved operators](#moved-operators)
|
||||
- [Transfer operators](#transfer-operators)
|
||||
- [New transfer operators](#new-transfer-operators)
|
||||
- [Moved transfer operators](#moved-transfer-operators)
|
||||
- [Sensors](#sensors)
|
||||
- [New sensors](#new-sensors)
|
||||
- [Moved sensors](#moved-sensors)
|
||||
- [Hooks](#hooks)
|
||||
- [New hooks](#new-hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Secrets](#secrets)
|
||||
- [Moved secrets](#moved-secrets)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.11.23](#release-20201123)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `amazon` provider. All classes for this provider package
|
||||
are in `airflow.providers.amazon` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
## Change in import paths
|
||||
|
||||
If you are upgrading from 2020.10.5 note the following changes in import paths
|
||||
|
||||
| Old path | New path |
|
||||
| --------------------------------------------------------------- | ----------------------------------------------------------- |
|
||||
| airflow.providers.amazon.aws.hooks.aws_dynamodb.AwsDynamoDBHook | airflow.providers.amazon.aws.hooks.dynamodb.AwsDynamoDBHook |
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-amazon`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:--------------|:-------------------|
|
||||
| `boto3` | `>=1.15.0,<1.16.0` |
|
||||
| `botocore` | `>=1.18.0,<1.19.0` |
|
||||
| `watchtower` | `~=0.7.3` |
|
||||
|
||||
## Cross provider package dependencies
|
||||
|
||||
Those are dependencies that might be needed in order to use all the features of the package.
|
||||
You need to install the specified backport providers package in order to use them.
|
||||
|
||||
You can install such cross-provider dependencies when installing from PyPI. For example:
|
||||
|
||||
```bash
|
||||
pip install apache-airflow-backport-providers-amazon[apache.hive]
|
||||
```
|
||||
|
||||
| Dependent package | Extra |
|
||||
|:-----------------------------------------------------------------------------------------------------------------------------|:--------------|
|
||||
| [apache-airflow-backport-providers-apache-hive](https://github.com/apache/airflow/tree/master/airflow/providers/apache/hive) | `apache.hive` |
|
||||
| [apache-airflow-backport-providers-exasol](https://github.com/apache/airflow/tree/master/airflow/providers/exasol) | `exasol` |
|
||||
| [apache-airflow-backport-providers-ftp](https://github.com/apache/airflow/tree/master/airflow/providers/ftp) | `ftp` |
|
||||
| [apache-airflow-backport-providers-google](https://github.com/apache/airflow/tree/master/airflow/providers/google) | `google` |
|
||||
| [apache-airflow-backport-providers-imap](https://github.com/apache/airflow/tree/master/airflow/providers/imap) | `imap` |
|
||||
| [apache-airflow-backport-providers-mongo](https://github.com/apache/airflow/tree/master/airflow/providers/mongo) | `mongo` |
|
||||
| [apache-airflow-backport-providers-mysql](https://github.com/apache/airflow/tree/master/airflow/providers/mysql) | `mysql` |
|
||||
| [apache-airflow-backport-providers-postgres](https://github.com/apache/airflow/tree/master/airflow/providers/postgres) | `postgres` |
|
||||
| [apache-airflow-backport-providers-ssh](https://github.com/apache/airflow/tree/master/airflow/providers/ssh) | `ssh` |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `amazon` provider
|
||||
are in the `airflow.providers.amazon` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
|
||||
### New operators
|
||||
|
||||
| New Airflow 2.0 operators: `airflow.providers.amazon` package |
|
||||
|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [aws.operators.cloud_formation.CloudFormationCreateStackOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/cloud_formation.py) |
|
||||
| [aws.operators.cloud_formation.CloudFormationDeleteStackOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/cloud_formation.py) |
|
||||
| [aws.operators.datasync.AWSDataSyncOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/datasync.py) |
|
||||
| [aws.operators.ec2_start_instance.EC2StartInstanceOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/ec2_start_instance.py) |
|
||||
| [aws.operators.ec2_stop_instance.EC2StopInstanceOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/ec2_stop_instance.py) |
|
||||
| [aws.operators.emr_modify_cluster.EmrModifyClusterOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/emr_modify_cluster.py) |
|
||||
| [aws.operators.glacier.GlacierCreateJobOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/glacier.py) |
|
||||
| [aws.operators.glue.AwsGlueJobOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/glue.py) |
|
||||
| [aws.operators.glue_crawler.AwsGlueCrawlerOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/glue_crawler.py) |
|
||||
| [aws.operators.s3_bucket.S3CreateBucketOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/s3_bucket.py) |
|
||||
| [aws.operators.s3_bucket.S3DeleteBucketOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/s3_bucket.py) |
|
||||
| [aws.operators.s3_file_transform.S3FileTransformOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/s3_file_transform.py) |
|
||||
| [aws.operators.sagemaker_processing.SageMakerProcessingOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/sagemaker_processing.py) |
|
||||
| [aws.operators.step_function_get_execution_output.StepFunctionGetExecutionOutputOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/step_function_get_execution_output.py) |
|
||||
| [aws.operators.step_function_start_execution.StepFunctionStartExecutionOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/step_function_start_execution.py) |
|
||||
|
||||
|
||||
### Moved operators
|
||||
|
||||
| Airflow 2.0 operators: `airflow.providers.amazon` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [aws.operators.athena.AWSAthenaOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/athena.py) | [contrib.operators.aws_athena_operator.AWSAthenaOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/aws_athena_operator.py) |
|
||||
| [aws.operators.batch.AwsBatchOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/batch.py) | [contrib.operators.awsbatch_operator.AWSBatchOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/awsbatch_operator.py) |
|
||||
| [aws.operators.ecs.ECSOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/ecs.py) | [contrib.operators.ecs_operator.ECSOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/ecs_operator.py) |
|
||||
| [aws.operators.emr_add_steps.EmrAddStepsOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/emr_add_steps.py) | [contrib.operators.emr_add_steps_operator.EmrAddStepsOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/emr_add_steps_operator.py) |
|
||||
| [aws.operators.emr_create_job_flow.EmrCreateJobFlowOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/emr_create_job_flow.py) | [contrib.operators.emr_create_job_flow_operator.EmrCreateJobFlowOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/emr_create_job_flow_operator.py) |
|
||||
| [aws.operators.emr_terminate_job_flow.EmrTerminateJobFlowOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/emr_terminate_job_flow.py) | [contrib.operators.emr_terminate_job_flow_operator.EmrTerminateJobFlowOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/emr_terminate_job_flow_operator.py) |
|
||||
| [aws.operators.s3_copy_object.S3CopyObjectOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/s3_copy_object.py) | [contrib.operators.s3_copy_object_operator.S3CopyObjectOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/s3_copy_object_operator.py) |
|
||||
| [aws.operators.s3_delete_objects.S3DeleteObjectsOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/s3_delete_objects.py) | [contrib.operators.s3_delete_objects_operator.S3DeleteObjectsOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/s3_delete_objects_operator.py) |
|
||||
| [aws.operators.s3_list.S3ListOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/s3_list.py) | [contrib.operators.s3_list_operator.S3ListOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/s3_list_operator.py) |
|
||||
| [aws.operators.sagemaker_base.SageMakerBaseOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/sagemaker_base.py) | [contrib.operators.sagemaker_base_operator.SageMakerBaseOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/sagemaker_base_operator.py) |
|
||||
| [aws.operators.sagemaker_endpoint.SageMakerEndpointOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/sagemaker_endpoint.py) | [contrib.operators.sagemaker_endpoint_operator.SageMakerEndpointOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/sagemaker_endpoint_operator.py) |
|
||||
| [aws.operators.sagemaker_endpoint_config.SageMakerEndpointConfigOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/sagemaker_endpoint_config.py) | [contrib.operators.sagemaker_endpoint_config_operator.SageMakerEndpointConfigOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/sagemaker_endpoint_config_operator.py) |
|
||||
| [aws.operators.sagemaker_model.SageMakerModelOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/sagemaker_model.py) | [contrib.operators.sagemaker_model_operator.SageMakerModelOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/sagemaker_model_operator.py) |
|
||||
| [aws.operators.sagemaker_training.SageMakerTrainingOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/sagemaker_training.py) | [contrib.operators.sagemaker_training_operator.SageMakerTrainingOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/sagemaker_training_operator.py) |
|
||||
| [aws.operators.sagemaker_transform.SageMakerTransformOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/sagemaker_transform.py) | [contrib.operators.sagemaker_transform_operator.SageMakerTransformOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/sagemaker_transform_operator.py) |
|
||||
| [aws.operators.sagemaker_tuning.SageMakerTuningOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/sagemaker_tuning.py) | [contrib.operators.sagemaker_tuning_operator.SageMakerTuningOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/sagemaker_tuning_operator.py) |
|
||||
| [aws.operators.sns.SnsPublishOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/sns.py) | [contrib.operators.sns_publish_operator.SnsPublishOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/sns_publish_operator.py) |
|
||||
| [aws.operators.sqs.SQSPublishOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/operators/sqs.py) | [contrib.operators.aws_sqs_publish_operator.SQSPublishOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/aws_sqs_publish_operator.py) |
|
||||
|
||||
|
||||
## Transfer operators
|
||||
|
||||
|
||||
### New transfer operators
|
||||
|
||||
| New Airflow 2.0 transfers: `airflow.providers.amazon` package |
|
||||
|:------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [aws.transfers.exasol_to_s3.ExasolToS3Operator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/exasol_to_s3.py) |
|
||||
| [aws.transfers.glacier_to_gcs.GlacierToGCSOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/glacier_to_gcs.py) |
|
||||
| [aws.transfers.mysql_to_s3.MySQLToS3Operator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/mysql_to_s3.py) |
|
||||
| [aws.transfers.s3_to_ftp.S3ToFTPOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/s3_to_ftp.py) |
|
||||
|
||||
|
||||
### Moved transfer operators
|
||||
|
||||
| Airflow 2.0 transfers: `airflow.providers.amazon` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [aws.transfers.dynamodb_to_s3.DynamoDBToS3Operator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/dynamodb_to_s3.py) | [contrib.operators.dynamodb_to_s3.DynamoDBToS3Operator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/dynamodb_to_s3.py) |
|
||||
| [aws.transfers.gcs_to_s3.GCSToS3Operator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/gcs_to_s3.py) | [operators.gcs_to_s3.GCSToS3Operator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/gcs_to_s3.py) |
|
||||
| [aws.transfers.google_api_to_s3.GoogleApiToS3Operator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/google_api_to_s3.py) | [operators.google_api_to_s3_transfer.GoogleApiToS3Transfer](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/google_api_to_s3_transfer.py) |
|
||||
| [aws.transfers.hive_to_dynamodb.HiveToDynamoDBOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/hive_to_dynamodb.py) | [contrib.operators.hive_to_dynamodb.HiveToDynamoDBOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/hive_to_dynamodb.py) |
|
||||
| [aws.transfers.imap_attachment_to_s3.ImapAttachmentToS3Operator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/imap_attachment_to_s3.py) | [contrib.operators.imap_attachment_to_s3_operator.ImapAttachmentToS3Operator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/imap_attachment_to_s3_operator.py) |
|
||||
| [aws.transfers.mongo_to_s3.MongoToS3Operator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/mongo_to_s3.py) | [contrib.operators.mongo_to_s3.MongoToS3Operator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/mongo_to_s3.py) |
|
||||
| [aws.transfers.redshift_to_s3.RedshiftToS3Operator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/redshift_to_s3.py) | [operators.redshift_to_s3_operator.RedshiftToS3Transfer](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/redshift_to_s3_operator.py) |
|
||||
| [aws.transfers.s3_to_redshift.S3ToRedshiftOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/s3_to_redshift.py) | [operators.s3_to_redshift_operator.S3ToRedshiftTransfer](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/s3_to_redshift_operator.py) |
|
||||
| [aws.transfers.s3_to_sftp.S3ToSFTPOperator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/s3_to_sftp.py) | [contrib.operators.s3_to_sftp_operator.S3ToSFTPOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/s3_to_sftp_operator.py) |
|
||||
| [aws.transfers.sftp_to_s3.SFTPToS3Operator](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/transfers/sftp_to_s3.py) | [contrib.operators.sftp_to_s3_operator.SFTPToS3Operator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/sftp_to_s3_operator.py) |
|
||||
|
||||
|
||||
## Sensors
|
||||
|
||||
|
||||
### New sensors
|
||||
|
||||
| New Airflow 2.0 sensors: `airflow.providers.amazon` package |
|
||||
|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [aws.sensors.cloud_formation.CloudFormationCreateStackSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/cloud_formation.py) |
|
||||
| [aws.sensors.cloud_formation.CloudFormationDeleteStackSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/cloud_formation.py) |
|
||||
| [aws.sensors.ec2_instance_state.EC2InstanceStateSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/ec2_instance_state.py) |
|
||||
| [aws.sensors.glacier.GlacierJobOperationSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/glacier.py) |
|
||||
| [aws.sensors.glue.AwsGlueJobSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/glue.py) |
|
||||
| [aws.sensors.glue_crawler.AwsGlueCrawlerSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/glue_crawler.py) |
|
||||
| [aws.sensors.redshift.AwsRedshiftClusterSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/redshift.py) |
|
||||
| [aws.sensors.s3_key.S3KeySizeSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/s3_key.py) |
|
||||
| [aws.sensors.s3_keys_unchanged.S3KeysUnchangedSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/s3_keys_unchanged.py) |
|
||||
| [aws.sensors.sagemaker_training.SageMakerTrainingSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/sagemaker_training.py) |
|
||||
| [aws.sensors.step_function_execution.StepFunctionExecutionSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/step_function_execution.py) |
|
||||
|
||||
|
||||
### Moved sensors
|
||||
|
||||
| Airflow 2.0 sensors: `airflow.providers.amazon` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [aws.sensors.athena.AthenaSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/athena.py) | [contrib.sensors.aws_athena_sensor.AthenaSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/aws_athena_sensor.py) |
|
||||
| [aws.sensors.emr_base.EmrBaseSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/emr_base.py) | [contrib.sensors.emr_base_sensor.EmrBaseSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/emr_base_sensor.py) |
|
||||
| [aws.sensors.emr_job_flow.EmrJobFlowSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/emr_job_flow.py) | [contrib.sensors.emr_job_flow_sensor.EmrJobFlowSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/emr_job_flow_sensor.py) |
|
||||
| [aws.sensors.emr_step.EmrStepSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/emr_step.py) | [contrib.sensors.emr_step_sensor.EmrStepSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/emr_step_sensor.py) |
|
||||
| [aws.sensors.glue_catalog_partition.AwsGlueCatalogPartitionSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/glue_catalog_partition.py) | [contrib.sensors.aws_glue_catalog_partition_sensor.AwsGlueCatalogPartitionSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/aws_glue_catalog_partition_sensor.py) |
|
||||
| [aws.sensors.s3_key.S3KeySensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/s3_key.py) | [sensors.s3_key_sensor.S3KeySensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/sensors/s3_key_sensor.py) |
|
||||
| [aws.sensors.s3_prefix.S3PrefixSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/s3_prefix.py) | [sensors.s3_prefix_sensor.S3PrefixSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/sensors/s3_prefix_sensor.py) |
|
||||
| [aws.sensors.sagemaker_base.SageMakerBaseSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/sagemaker_base.py) | [contrib.sensors.sagemaker_base_sensor.SageMakerBaseSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/sagemaker_base_sensor.py) |
|
||||
| [aws.sensors.sagemaker_endpoint.SageMakerEndpointSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/sagemaker_endpoint.py) | [contrib.sensors.sagemaker_endpoint_sensor.SageMakerEndpointSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/sagemaker_endpoint_sensor.py) |
|
||||
| [aws.sensors.sagemaker_transform.SageMakerTransformSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/sagemaker_transform.py) | [contrib.sensors.sagemaker_transform_sensor.SageMakerTransformSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/sagemaker_transform_sensor.py) |
|
||||
| [aws.sensors.sagemaker_tuning.SageMakerTuningSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/sagemaker_tuning.py) | [contrib.sensors.sagemaker_tuning_sensor.SageMakerTuningSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/sagemaker_tuning_sensor.py) |
|
||||
| [aws.sensors.sqs.SQSSensor](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/sensors/sqs.py) | [contrib.sensors.aws_sqs_sensor.SQSSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/aws_sqs_sensor.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
### New hooks
|
||||
|
||||
| New Airflow 2.0 hooks: `airflow.providers.amazon` package |
|
||||
|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [aws.hooks.batch_client.AwsBatchClientHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/batch_client.py) |
|
||||
| [aws.hooks.batch_waiters.AwsBatchWaitersHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/batch_waiters.py) |
|
||||
| [aws.hooks.cloud_formation.AWSCloudFormationHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/cloud_formation.py) |
|
||||
| [aws.hooks.ec2.EC2Hook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/ec2.py) |
|
||||
| [aws.hooks.elasticache_replication_group.ElastiCacheReplicationGroupHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/elasticache_replication_group.py) |
|
||||
| [aws.hooks.glacier.GlacierHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/glacier.py) |
|
||||
| [aws.hooks.glue.AwsGlueJobHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/glue.py) |
|
||||
| [aws.hooks.glue_crawler.AwsGlueCrawlerHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/glue_crawler.py) |
|
||||
| [aws.hooks.kinesis.AwsFirehoseHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/kinesis.py) |
|
||||
| [aws.hooks.redshift.RedshiftHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/redshift.py) |
|
||||
| [aws.hooks.secrets_manager.SecretsManagerHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/secrets_manager.py) |
|
||||
| [aws.hooks.ses.SESHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/ses.py) |
|
||||
| [aws.hooks.step_function.StepFunctionHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/step_function.py) |
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.amazon` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:-----------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [aws.hooks.athena.AWSAthenaHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/athena.py) | [contrib.hooks.aws_athena_hook.AWSAthenaHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/aws_athena_hook.py) |
|
||||
| [aws.hooks.base_aws.AwsBaseHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/base_aws.py) | [contrib.hooks.aws_hook.AwsHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/aws_hook.py) |
|
||||
| [aws.hooks.datasync.AWSDataSyncHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/datasync.py) | [contrib.hooks.aws_datasync_hook.AWSDataSyncHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/aws_datasync_hook.py) |
|
||||
| [aws.hooks.dynamodb.AwsDynamoDBHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/dynamodb.py) | [contrib.hooks.aws_dynamodb_hook.AwsDynamoDBHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/aws_dynamodb_hook.py) |
|
||||
| [aws.hooks.emr.EmrHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/emr.py) | [contrib.hooks.emr_hook.EmrHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/emr_hook.py) |
|
||||
| [aws.hooks.glue_catalog.AwsGlueCatalogHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/glue_catalog.py) | [contrib.hooks.aws_glue_catalog_hook.AwsGlueCatalogHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/aws_glue_catalog_hook.py) |
|
||||
| [aws.hooks.lambda_function.AwsLambdaHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/lambda_function.py) | [contrib.hooks.aws_lambda_hook.AwsLambdaHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/aws_lambda_hook.py) |
|
||||
| [aws.hooks.logs.AwsLogsHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/logs.py) | [contrib.hooks.aws_logs_hook.AwsLogsHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/aws_logs_hook.py) |
|
||||
| [aws.hooks.s3.S3Hook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/s3.py) | [hooks.S3_hook.S3Hook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/hooks/S3_hook.py) |
|
||||
| [aws.hooks.sagemaker.SageMakerHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/sagemaker.py) | [contrib.hooks.sagemaker_hook.SageMakerHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/sagemaker_hook.py) |
|
||||
| [aws.hooks.sns.AwsSnsHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/sns.py) | [contrib.hooks.aws_sns_hook.AwsSnsHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/aws_sns_hook.py) |
|
||||
| [aws.hooks.sqs.SQSHook](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/hooks/sqs.py) | [contrib.hooks.aws_sqs_hook.SQSHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/aws_sqs_hook.py) |
|
||||
|
||||
|
||||
## Secrets
|
||||
|
||||
|
||||
|
||||
### Moved secrets
|
||||
|
||||
| Airflow 2.0 secrets: `airflow.providers.amazon` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [aws.secrets.secrets_manager.SecretsManagerBackend](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/secrets/secrets_manager.py) | [contrib.secrets.aws_secrets_manager.SecretsManagerBackend](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/secrets/aws_secrets_manager.py) |
|
||||
| [aws.secrets.systems_manager.SystemsManagerParameterStoreBackend](https://github.com/apache/airflow/blob/master/airflow/providers/amazon/aws/secrets/systems_manager.py) | [contrib.secrets.aws_systems_manager.SystemsManagerParameterStoreBackend](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/secrets/aws_systems_manager.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.11.23
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [4873d9759](https://github.com/apache/airflow/commit/4873d9759dfdec1dd3663074f9e64ad69fa881cc) | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) |
|
||||
| [ae7cb4a1e](https://github.com/apache/airflow/commit/ae7cb4a1e2a96351f1976cf5832615e24863e05d) | 2020-11-17 | Update wrong commit hash in backport provider changes (#12390) |
|
||||
| [6889a333c](https://github.com/apache/airflow/commit/6889a333cff001727eb0a66e375544a28c9a5f03) | 2020-11-15 | Improvements for operators and hooks ref docs (#12366) |
|
||||
| [c94b1241a](https://github.com/apache/airflow/commit/c94b1241a144294f5f1c5f461d5e3b92e4a8fc38) | 2020-11-13 | Add extra error handling to S3 remote logging (#9908) |
|
||||
| [7825e8f59](https://github.com/apache/airflow/commit/7825e8f59034645ab3247229be83a3aa90baece1) | 2020-11-13 | Docs installation improvements (#12304) |
|
||||
| [250436d96](https://github.com/apache/airflow/commit/250436d962c8c950d38c1eb5e54a998891648cc9) | 2020-11-10 | Fix spelling in Python files (#12230) |
|
||||
| [85a18e13d](https://github.com/apache/airflow/commit/85a18e13d9dec84275283ff69e34704b60d54a75) | 2020-11-09 | Point at pypi project pages for cross-dependency of provider packages (#12212) |
|
||||
| [59eb5de78](https://github.com/apache/airflow/commit/59eb5de78c70ee9c7ae6e4cba5c7a2babb8103ca) | 2020-11-09 | Update provider READMEs for up-coming 1.0.0beta1 releases (#12206) |
|
||||
| [b2a28d159](https://github.com/apache/airflow/commit/b2a28d1590410630d66966aa1f2b2a049a8c3b32) | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
|
||||
| [fcb6b00ef](https://github.com/apache/airflow/commit/fcb6b00efef80c81272a30cfc618202a29e0c6a9) | 2020-11-08 | Add authentication to AWS with Google credentials (#12079) |
|
||||
| [fb6bddba0](https://github.com/apache/airflow/commit/fb6bddba0c9e3e7ef2610b4fb3f73622e48d7ea0) | 2020-11-07 | In AWS Secrets backend, a lookup is optional (#12143) |
|
||||
| [cf9437d79](https://github.com/apache/airflow/commit/cf9437d79f9658d1309e4bfe847fe63d52ec7b99) | 2020-11-06 | Simplify string expressions (#12123) |
|
||||
| [41bf172c1](https://github.com/apache/airflow/commit/41bf172c1dc75099f4f9d8b3f3350b4b1f523ef9) | 2020-11-04 | Simplify string expressions (#12093) |
|
||||
| [4e8f9cc8d](https://github.com/apache/airflow/commit/4e8f9cc8d02b29c325b8a5a76b4837671bdf5f68) | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
|
||||
| [8c42cf1b0](https://github.com/apache/airflow/commit/8c42cf1b00c90f0d7f11b8a3a455381de8e003c5) | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
|
||||
| [5e77a6154](https://github.com/apache/airflow/commit/5e77a61543d26e5466d885d639247aa5189c011d) | 2020-11-02 | Docstring fix for S3DeleteBucketOperator (#12049) |
|
||||
| [822285134](https://github.com/apache/airflow/commit/8222851348aa81424c9bdcea994e25e0d6692709) | 2020-10-29 | Add Template Fields to RedshiftToS3Operator & S3ToRedshiftOperator (#11844) |
|
||||
| [db121f726](https://github.com/apache/airflow/commit/db121f726b3c7a37aca1ea05eb4714f884456005) | 2020-10-28 | Add truncate table (before copy) option to S3ToRedshiftOperator (#9246) |
|
||||
| [5a439e84e](https://github.com/apache/airflow/commit/5a439e84eb6c0544dc6c3d6a9f4ceeb2172cd5d0) | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
|
||||
| [8afdb6ac6](https://github.com/apache/airflow/commit/8afdb6ac6a7997cb14806bc2734c81c00ed8da97) | 2020-10-26 | Fix spellings (#11825) |
|
||||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [6ce855af1](https://github.com/apache/airflow/commit/6ce855af118daeaa4c249669079ab9d9aad23945) | 2020-10-24 | Fix spelling (#11821) |
|
||||
| [3934ef224](https://github.com/apache/airflow/commit/3934ef22494db6d9613c229aaa82ea6a366b7c2f) | 2020-10-24 | Remove redundant builtins imports (#11809) |
|
||||
| [4c8e033c0](https://github.com/apache/airflow/commit/4c8e033c0ee7d28963d504a9216205155f20f58f) | 2020-10-24 | Fix spelling and grammar (#11814) |
|
||||
| [483068745](https://github.com/apache/airflow/commit/48306874538eea7cfd42358d5ebb59705204bfc4) | 2020-10-24 | Use Python 3 style super classes (#11806) |
|
||||
| [0df60b773](https://github.com/apache/airflow/commit/0df60b773671ecf8d4e5f582ac2be200cf2a2edd) | 2020-10-23 | Add reattach flag to ECSOperator (#10643) |
|
||||
| [b9d677cdd](https://github.com/apache/airflow/commit/b9d677cdd660e0be8278a64658e73359276a9682) | 2020-10-22 | Add type hints to aws provider (#11531) |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [674368f66](https://github.com/apache/airflow/commit/674368f66cf61b2a105f326f23868ac3aee08807) | 2020-10-19 | Fixes MySQLToS3 float to int conversion (#10437) |
|
||||
| [0823d46a7](https://github.com/apache/airflow/commit/0823d46a7f267f2e45195a175021825367938add) | 2020-10-16 | Add type annotations for AWS operators and hooks (#11434) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [d38a0a781](https://github.com/apache/airflow/commit/d38a0a781e123c8c50313efdb23f767d6678afe0) | 2020-10-12 | added type hints for aws cloud formation (#11470) |
|
||||
| [d305876be](https://github.com/apache/airflow/commit/d305876bee328287ff391a29cc1cd632468cc731) | 2020-10-12 | Remove redundant None provided as default to dict.get() (#11448) |
|
||||
| [c3e340584](https://github.com/apache/airflow/commit/c3e340584bf1892c4f73aa9e7495b5823dab0c40) | 2020-10-11 | Change prefix of AwsDynamoDB hook module (#11209) |
|
||||
| [42a23d16f](https://github.com/apache/airflow/commit/42a23d16fe9b2f165b0805fb767ecbb825c93657) | 2020-10-11 | Update MySQLToS3Operator's s3_bucket to template_fields (#10778) |
|
||||
| [422b61a9d](https://github.com/apache/airflow/commit/422b61a9dd95ab9d00b239daa14d87d7cae5ae73) | 2020-10-09 | Adding ElastiCache Hook for creating, describing and deleting replication groups (#8701) |
|
||||
| [dd98b2149](https://github.com/apache/airflow/commit/dd98b21494ff6036242b63268140abe1294b3657) | 2020-10-06 | Add acl_policy parameter to GCSToS3Operator (#10804) (#10829) |
|
||||
| [32b3cfbcf](https://github.com/apache/airflow/commit/32b3cfbcf0209cb062dd641c1232ab25d02d4d6d) | 2020-10-06 | Strict type check for all hooks in amazon (#11250) |
|
||||
| [6d573e8ab](https://github.com/apache/airflow/commit/6d573e8abbf87e3c7281347e03d428a6e5baccd4) | 2020-10-03 | Add s3 key to template fields for s3/redshift transfer operators (#10890) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:------------------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [00ffedb8c](https://github.com/apache/airflow/commit/00ffedb8c402eb5638782628eb706a5f28215eac) | 2020-09-30 | Add amazon glacier to GCS transfer operator (#10947) |
|
||||
| [e3f96ce7a](https://github.com/apache/airflow/commit/e3f96ce7a8ac098aeef5e9930e6de6c428274d57) | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [b61225a88](https://github.com/apache/airflow/commit/b61225a8850b20be17842c2428b91d873584c4da) | 2020-09-21 | Add D204 pydocstyle check (#11031) |
|
||||
| [2410f592a](https://github.com/apache/airflow/commit/2410f592a4ab160b377f1a9e5de3b7262b9851cc) | 2020-09-19 | Get Airflow configs with sensitive data from AWS Systems Manager (#11023) |
|
||||
| [2bf7b7cac](https://github.com/apache/airflow/commit/2bf7b7cac7858f5a6a495f1a9eb4780ec84f95b4) | 2020-09-19 | Add typing to amazon provider EMR (#10910) |
|
||||
| [9edfcb7ac](https://github.com/apache/airflow/commit/9edfcb7ac46917836ec956264da8876e58d92392) | 2020-09-19 | Support extra_args in S3Hook and GCSToS3Operator (#11001) |
|
||||
| [4e1f3a69d](https://github.com/apache/airflow/commit/4e1f3a69db8614c302e4916332555034053b935c) | 2020-09-14 | [AIRFLOW-10645] Add AWS Secrets Manager Hook (#10655) |
|
||||
| [e9add7916](https://github.com/apache/airflow/commit/e9add79160e3a16bb348e30f4e83386a371dbc1e) | 2020-09-14 | Fix Failing static tests on Master (#10927) |
|
||||
| [383a118d2](https://github.com/apache/airflow/commit/383a118d2df618e46d81c520cd2c4a31d81b33dd) | 2020-09-14 | Add more type annotations to AWS hooks (#10671) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [2934220dc](https://github.com/apache/airflow/commit/2934220dc98e295764f7791d33e121629ed2fbbb) | 2020-09-08 | Always return a list from S3Hook list methods (#10774) |
|
||||
| [f40ac9b15](https://github.com/apache/airflow/commit/f40ac9b151124dbcd87197d6ae38c85191d41f38) | 2020-09-01 | Add placement_strategy option (#9444) |
|
||||
| [e4878e677](https://github.com/apache/airflow/commit/e4878e6775bbe5cb2a1d786e57e009271b78bba0) | 2020-08-31 | fix type hints for s3 hook read_key method (#10653) |
|
||||
| [2ca615cff](https://github.com/apache/airflow/commit/2ca615cffefe97dfa38e1b7f60d9ed33c6628992) | 2020-08-29 | Update Google Cloud branding (#10642) |
|
||||
| [8969b7185](https://github.com/apache/airflow/commit/8969b7185ebc3c90168ce9a2fb97dfbc74d2bed9) | 2020-08-28 | Removed bad characters from AWS operator (#10590) |
|
||||
| [8349061f9](https://github.com/apache/airflow/commit/8349061f9cb01a92c87edd349cc844c4053851e8) | 2020-08-26 | Improve Docstring for AWS Athena Hook/Operator (#10580) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [3734876d9](https://github.com/apache/airflow/commit/3734876d9898067ee933b84af522d53df6160d7f) | 2020-08-24 | Implement impersonation in google operators (#10052) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [c6358045f](https://github.com/apache/airflow/commit/c6358045f9d61af63c96833cb6682d6f382a6408) | 2020-08-22 | Fixes S3ToRedshift COPY query (#10436) |
|
||||
| [7c206a82a](https://github.com/apache/airflow/commit/7c206a82a6f074abcc4898a005ecd2c84a920054) | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
|
||||
| [27d08b76a](https://github.com/apache/airflow/commit/27d08b76a2d171d716a1599157a8a60a121dbec6) | 2020-08-21 | Amazon SES Hook (#10391) |
|
||||
| [dea345b05](https://github.com/apache/airflow/commit/dea345b05c2cd226e70f97a3934d7456aa1cc754) | 2020-08-17 | Fix AwsGlueJobSensor to stop running after the Glue job finished (#9022) |
|
||||
| [f6734b3b8](https://github.com/apache/airflow/commit/f6734b3b850d33d3712763f93c114e80f5af9ffb) | 2020-08-12 | Enable Sphinx spellcheck for doc generation (#10280) |
|
||||
| [82f744b87](https://github.com/apache/airflow/commit/82f744b871bb2c5e9a2d628e1c45ae16c1244240) | 2020-08-11 | Add type annotations to AwsGlueJobHook, RedshiftHook modules (#10286) |
|
||||
| [19bc97d0c](https://github.com/apache/airflow/commit/19bc97d0ce436a6ec9d8e9a5adcd48c0a769d01f) | 2020-08-10 | Revert "Add Amazon SES hook (#10004)" (#10276) |
|
||||
| [f06fe616e](https://github.com/apache/airflow/commit/f06fe616e66256bdc53710de505c2c6b1bd21528) | 2020-08-10 | Add Amazon SES hook (#10004) |
|
||||
| [0c77ea8a3](https://github.com/apache/airflow/commit/0c77ea8a3c417805f66d10f0c757ca218bf8dee0) | 2020-08-06 | Add type annotations to S3 hook module (#10164) |
|
||||
| [24c8e4c2d](https://github.com/apache/airflow/commit/24c8e4c2d6e359ecc2c7d6275dccc68de4a82832) | 2020-08-06 | Changes to all the constructors to remove the args argument (#10163) |
|
||||
| [9667314b2](https://github.com/apache/airflow/commit/9667314b2fb879edc451793a8350123507e1cfd6) | 2020-08-05 | Add correct signatures for operators in amazon provider package (#10167) |
|
||||
| [000287753](https://github.com/apache/airflow/commit/000287753b478f29e6c25442ac253e3a6c8e8c87) | 2020-08-03 | Improve Typing coverage of amazon/aws/athena (#10025) |
|
||||
| [53ada6e79](https://github.com/apache/airflow/commit/53ada6e7911f411e80ebb00be9f07a7cc0788d01) | 2020-08-03 | Add S3KeysUnchangedSensor (#9817) |
|
||||
| [aeea71274](https://github.com/apache/airflow/commit/aeea71274d4527ff2351102e94aa38bda6099e7f) | 2020-08-02 | Remove `args` parameter from provider operator constructors (#10097) |
|
||||
| [2b8dea64e](https://github.com/apache/airflow/commit/2b8dea64e9e8716fba8c38a1b439f7835bbd2918) | 2020-08-01 | Fix typo in Athena sensor retries (#10079) |
|
||||
| [1508c43ec](https://github.com/apache/airflow/commit/1508c43ec9594e801b415dd82472fa017791b759) | 2020-07-29 | Adding new SageMaker operator for ProcessingJobs (#9594) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [8b10a4b35](https://github.com/apache/airflow/commit/8b10a4b35e45d536a6475bfe1491ee75fad50186) | 2020-07-25 | Stop using start_date in default_args in example_dags (#9982) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [e7c87fe45](https://github.com/apache/airflow/commit/e7c87fe453c6a70ed087c7ffbccaacbf0d2831b9) | 2020-07-20 | Refactor AwsBaseHook._get_credentials (#9878) |
|
||||
| [2577f9334](https://github.com/apache/airflow/commit/2577f9334a5cb71cccd97e62b0ae2d097cb99e1a) | 2020-07-16 | Fix S3FileTransformOperator to support S3 Select transformation only (#8936) |
|
||||
| [52b6efe1e](https://github.com/apache/airflow/commit/52b6efe1ecaae74b9c2497f565e116305d575a76) | 2020-07-15 | Add option to delete by prefix to S3DeleteObjectsOperator (#9350) |
|
||||
| [553bb7af7](https://github.com/apache/airflow/commit/553bb7af7cb7a50f7141b5b89297713cee6d19f6) | 2020-07-13 | Keep functions signatures in decorators (#9786) |
|
||||
| [2f31b3060](https://github.com/apache/airflow/commit/2f31b3060ed8274d5d1b1db7349ce607640b9199) | 2020-07-08 | Get Airflow configs with sensitive data from Secret Backends (#9645) |
|
||||
| [07b81029e](https://github.com/apache/airflow/commit/07b81029ebc2a296fb54181f2cec11fcc7704d9d) | 2020-07-08 | Allow AWSAthenaHook to get more than 1000/first page of results (#6075) |
|
||||
| [564192c16](https://github.com/apache/airflow/commit/564192c1625a552456cebb3751978c08eebdb2a1) | 2020-07-08 | Add AWS StepFunctions integrations to the aws provider (#8749) |
|
||||
| [ecce1ace7](https://github.com/apache/airflow/commit/ecce1ace7a277c948c61d7d4cbfc8632cc216559) | 2020-07-08 | [AIRFLOW-XXXX] Remove unnecessary docstring in AWSAthenaOperator |
|
||||
| [a79e2d4c4](https://github.com/apache/airflow/commit/a79e2d4c4aa105f3fac5ae6a28e29af9cd572407) | 2020-07-06 | Move provider's log task handlers to the provider package (#9604) |
|
||||
| [ee20086b8](https://github.com/apache/airflow/commit/ee20086b8c499fa40dcaac71652f21b466e7f80f) | 2020-07-02 | Move S3TaskHandler to the AWS provider package (#9602) |
|
||||
| [40add26d4](https://github.com/apache/airflow/commit/40add26d459c2511a6d9d305ae7300f0d6104211) | 2020-06-29 | Remove almost all references to airflow.contrib (#9559) |
|
||||
| [c858babdd](https://github.com/apache/airflow/commit/c858babddf8b18b417993b5bfefec1c5635510da) | 2020-06-26 | Remove kwargs from Super calls in AWS Secrets Backends (#9523) |
|
||||
| [87fdbd070](https://github.com/apache/airflow/commit/87fdbd0708d942af98d35604fe5962962e25d246) | 2020-06-25 | Use literal syntax instead of function calls to create data structure (#9516) |
|
||||
| [c7a454aa3](https://github.com/apache/airflow/commit/c7a454aa32bf33133d042e8438ac259b32144b21) | 2020-06-22 | Add AWS ECS system test (#8888) |
|
||||
| [df8efd04f](https://github.com/apache/airflow/commit/df8efd04f394afc4b5affb677bc78d8b7bd5275a) | 2020-06-21 | Enable & Fix "Docstring Content Issues" PyDocStyle Check (#9460) |
|
||||
| [e13a14c87](https://github.com/apache/airflow/commit/e13a14c8730f4f633d996dd7d3468fe827136a84) | 2020-06-21 | Enable & Fix Whitespace related PyDocStyle Checks (#9458) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [992a18c84](https://github.com/apache/airflow/commit/992a18c84a355d13e821c703e7364f12233c37dc) | 2020-06-19 | Move MySqlToS3Operator to transfers (#9400) |
|
||||
| [a60f589aa](https://github.com/apache/airflow/commit/a60f589aa251cc3df6bec5b306ad4a7f736f539f) | 2020-06-19 | Add MySqlToS3Operator (#9054) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [40bf8f28f](https://github.com/apache/airflow/commit/40bf8f28f97f17f40d993d207ea740eba54593ee) | 2020-06-18 | Detect automatically the lack of reference to the guide in the operator descriptions (#9290) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [58a8ec0e4](https://github.com/apache/airflow/commit/58a8ec0e46f624ee0369dd156dd8fb4f81884a21) | 2020-06-16 | AWSBatchOperator <> ClientHook relation changed to composition (#9306) |
|
||||
| [a80cd25e8](https://github.com/apache/airflow/commit/a80cd25e8eb7f8b5d89af26cdcd62a5bbe44d65c) | 2020-06-15 | Close/Flush byte stream in s3 hook load_string and load_bytes (#9211) |
|
||||
| [ffb857403](https://github.com/apache/airflow/commit/ffb85740373f7adb70d28ec7d5a8886380170e5e) | 2020-06-14 | Decrypt secrets from SystemsManagerParameterStoreBackend (#9214) |
|
||||
| [a69b031f2](https://github.com/apache/airflow/commit/a69b031f20c5a1cd032f9873394374f661811e8f) | 2020-06-10 | Add S3ToRedshift example dag and system test (#8877) |
|
||||
| [17adcea83](https://github.com/apache/airflow/commit/17adcea835cb7b0cf2d8da0ac7dda5549cfa3e45) | 2020-06-02 | Fix handling of subprocess error handling in s3_file_transform and gcs (#9106) |
|
||||
| [357e11e0c](https://github.com/apache/airflow/commit/357e11e0cfb4c02833018e073bc4f5e5b52fae4f) | 2020-05-29 | Add Delete/Create S3 bucket operators (#8895) |
|
||||
| [1ed171bfb](https://github.com/apache/airflow/commit/1ed171bfb265ded8674058bdc425640d25f1f4fc) | 2020-05-28 | Add script_args for S3FileTransformOperator (#9019) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [1d36b0303](https://github.com/apache/airflow/commit/1d36b0303b8632fce6de78ca4e782ae26ee06fea) | 2020-05-23 | Fix references in docs (#8984) |
|
||||
| [f946f96da](https://github.com/apache/airflow/commit/f946f96da45d8e6101805450d8cab7ccb2774ad0) | 2020-05-23 | Old json boto compat removed from dynamodb_to_s3 operator (#8987) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [f4edd90a9](https://github.com/apache/airflow/commit/f4edd90a94b8f91bbefbbbfba367372399559596) | 2020-05-16 | Speed up TestAwsLambdaHook by not actually running a function (#8882) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [85bbab27d](https://github.com/apache/airflow/commit/85bbab27dbb4f55f6f322b894fe3d54797076c15) | 2020-05-15 | Add EMR operators howto docs (#8863) |
|
||||
| [e61b9bb9b](https://github.com/apache/airflow/commit/e61b9bb9bbe6d8a0621310f3583483b9135c6770) | 2020-05-13 | Add AWS EMR System tests (#8618) |
|
||||
| [ed3f5131a](https://github.com/apache/airflow/commit/ed3f5131a27e2ef0422f2495a4532630a6204f82) | 2020-05-13 | Correctly pass sleep time from AWSAthenaOperator down to the hook. (#8845) |
|
||||
| [7236862a1](https://github.com/apache/airflow/commit/7236862a1f5361b5e99c03dd63dae9b966efcd24) | 2020-05-12 | [AIRFLOW-2310] Enable AWS Glue Job Integration (#6007) |
|
||||
| [d590e5e76](https://github.com/apache/airflow/commit/d590e5e7679322bebb1472fa8c7ec6d183e4154a) | 2020-05-11 | Add option to propagate tags in ECSOperator (#8811) |
|
||||
| [0c3db84c3](https://github.com/apache/airflow/commit/0c3db84c3ce5107f53ed5ecc48edfdfe1b97feff) | 2020-05-11 | [AIRFLOW-7068] Create EC2 Hook, Operator and Sensor (#7731) |
|
||||
| [cbebed2b4](https://github.com/apache/airflow/commit/cbebed2b4d0bd1e0984c331c0270e83bf8df8540) | 2020-05-10 | Allow passing backend_kwargs to AWS SSM client (#8802) |
|
||||
| [c7788a689](https://github.com/apache/airflow/commit/c7788a6894cb79c22153434dd9b977393b8236be) | 2020-05-10 | Add imap_attachment_to_s3 example dag and system test (#8669) |
|
||||
| [ff5b70149](https://github.com/apache/airflow/commit/ff5b70149bf51012156378c8fc8b072c7c280d9d) | 2020-05-07 | Add google_api_to_s3_transfer example dags and system tests (#8581) |
|
||||
| [4421f011e](https://github.com/apache/airflow/commit/4421f011eeec2d1022a39933e27f530fb9f9c1b1) | 2020-05-01 | Improve template capabilities of EMR job and step operators (#8572) |
|
||||
| [379a884d6](https://github.com/apache/airflow/commit/379a884d645a4d73db1c81e3450adc82571989ea) | 2020-04-28 | fix: aws hook should work without conn id (#8534) |
|
||||
| [74bc316c5](https://github.com/apache/airflow/commit/74bc316c56192f14677e9406d3878887a836062b) | 2020-04-27 | [AIRFLOW-4438] Add Gzip compression to S3_hook (#8571) |
|
||||
| [7ea66a1a9](https://github.com/apache/airflow/commit/7ea66a1a9594704869e82513d3a06fe35b6109b2) | 2020-04-26 | Add example DAG for ECSOperator (#8452) |
|
||||
| [b6434dedf](https://github.com/apache/airflow/commit/b6434dedf974085e5f8891446fa63104836c8fdf) | 2020-04-24 | [AIRFLOW-7111] Add generate_presigned_url method to S3Hook (#8441) |
|
||||
| [becedd5af](https://github.com/apache/airflow/commit/becedd5af8df01a0210e0a3fa78e619785f39908) | 2020-04-19 | Remove unrelated EC2 references in ECSOperator (#8451) |
|
||||
| [ab1290cb0](https://github.com/apache/airflow/commit/ab1290cb0c5856fa85c8596bfdf780fcdfd99c31) | 2020-04-13 | Make launch_type parameter optional (#8248) |
|
||||
| [87969a350](https://github.com/apache/airflow/commit/87969a350ddd41e9e77776af6d780b31e363eaca) | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
|
||||
| [b46d6c060](https://github.com/apache/airflow/commit/b46d6c060280da59193a28cf67e791eb825cb51c) | 2020-04-08 | Add support for AWS Secrets Manager as Secrets Backend (#8186) |
|
||||
| [68d1714f2](https://github.com/apache/airflow/commit/68d1714f296989b7aad1a04b75dc033e76afb747) | 2020-04-04 | [AIRFLOW-6822] AWS hooks should cache boto3 client (#7541) |
|
||||
| [8a0240257](https://github.com/apache/airflow/commit/8a02402576f83869d5134b4bddef5d73c15a8320) | 2020-03-31 | Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011) |
|
||||
| [7239d9a82](https://github.com/apache/airflow/commit/7239d9a82dbb3b9bdf27b531daa70338af9dd796) | 2020-03-28 | Get Airflow Variables from AWS Systems Manager Parameter Store (#7945) |
|
||||
| [eb4af4f94](https://github.com/apache/airflow/commit/eb4af4f944c77e67e167bbb6b0a2aaf075a95b50) | 2020-03-28 | Make BaseSecretsBackend.build_path generic (#7948) |
|
||||
| [438da7241](https://github.com/apache/airflow/commit/438da7241eb537e3ef5ae711629446155bf738a3) | 2020-03-28 | [AIRFLOW-5825] SageMakerEndpointOperator is not idempotent (#7891) |
|
||||
| [686d7d50b](https://github.com/apache/airflow/commit/686d7d50bd21622724d6818021355bc6885fd3de) | 2020-03-25 | Standardize SecretBackend class names (#7846) |
|
||||
| [eef87b995](https://github.com/apache/airflow/commit/eef87b9953347a65421f315a07dbef37ded9df66) | 2020-03-23 | [AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830) |
|
||||
| [5648dfbc3](https://github.com/apache/airflow/commit/5648dfbc300337b10567ef4e07045ea29d33ec06) | 2020-03-23 | Add missing call to Super class in 'amazon', 'cloudant & 'databricks' providers (#7827) |
|
||||
| [a36002412](https://github.com/apache/airflow/commit/a36002412334c445e4eab41fdbb85ef31b6fd384) | 2020-03-19 | [AIRFLOW-5705] Make AwsSsmSecretsBackend consistent with VaultBackend (#7753) |
|
||||
| [2a54512d7](https://github.com/apache/airflow/commit/2a54512d785ba603ba71381dc3dfa049e9f74063) | 2020-03-17 | [AIRFLOW-5705] Fix bugs in AWS SSM Secrets Backend (#7745) |
|
||||
| [a8b5fc74d](https://github.com/apache/airflow/commit/a8b5fc74d07e50c91bb64cb66ca1a450aa5ce6e1) | 2020-03-16 | [AIRFLOW-4175] S3Hook load_file should support ACL policy paramete (#7733) |
|
||||
| [e31e9ddd2](https://github.com/apache/airflow/commit/e31e9ddd2332e5d92422baf668acee441646ad68) | 2020-03-14 | [AIRFLOW-5705] Add secrets backend and support for AWS SSM (#6376) |
|
||||
| [3bb60afc7](https://github.com/apache/airflow/commit/3bb60afc7b8319996385d681faac342afe2b3bd2) | 2020-03-13 | [AIRFLOW-6975] Base AWSHook AssumeRoleWithSAML (#7619) |
|
||||
| [c0c5f11ad](https://github.com/apache/airflow/commit/c0c5f11ad11a5a38e0553c1a36aa75eb83efae51) | 2020-03-12 | [AIRFLOW-6884] Make SageMakerTrainingOperator idempotent (#7598) |
|
||||
| [b7cdda1c6](https://github.com/apache/airflow/commit/b7cdda1c64595bc7f85519337029de259e573fce) | 2020-03-10 | [AIRFLOW-4438] Add Gzip compression to S3_hook (#7680) |
|
||||
| [42eef3821](https://github.com/apache/airflow/commit/42eef38217e709bc7a7f71bf0286e9e61293a43e) | 2020-03-07 | [AIRFLOW-6877] Add cross-provider dependencies as extras (#7506) |
|
||||
| [9a94ab246](https://github.com/apache/airflow/commit/9a94ab246db8c09aa83bb6a6d245b1ca9563bcd9) | 2020-03-01 | [AIRFLOW-6962] Fix compeleted to completed (#7600) |
|
||||
| [1b38f6d9b](https://github.com/apache/airflow/commit/1b38f6d9b6710bd5e25fc16883599f1842ab7cb9) | 2020-02-29 | [AIRFLOW-5908] Add download_file to S3 Hook (#6577) |
|
||||
| [3ea3e1a2b](https://github.com/apache/airflow/commit/3ea3e1a2b580b7ed10efe668de0cc37b03673500) | 2020-02-26 | [AIRFLOW-6824] EMRAddStepsOperator problem with multi-step XCom (#7443) |
|
||||
| [6eaa7e3b1](https://github.com/apache/airflow/commit/6eaa7e3b1845644d5ec65a00a997f4029bec9628) | 2020-02-25 | [AIRFLOW-5924] Automatically unify bucket name and key in S3Hook (#6574) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [7d0e7122d](https://github.com/apache/airflow/commit/7d0e7122dd14576d834c6f66fe919a72b100b7f8) | 2020-02-24 | [AIRFLOW-6830] Add Subject/MessageAttributes to SNS hook and operator (#7451) |
|
||||
| [4d03e33c1](https://github.com/apache/airflow/commit/4d03e33c115018e30fa413c42b16212481ad25cc) | 2020-02-22 | [AIRFLOW-6817] remove imports from `airflow/__init__.py`, replaced implicit imports with explicit imports, added entry to `UPDATING.MD` - squashed/rebased (#7456) |
|
||||
| [47a922b86](https://github.com/apache/airflow/commit/47a922b86426968bfa07cc7892d2eeeca761d884) | 2020-02-21 | [AIRFLOW-6854] Fix missing typing_extensions on python 3.8 (#7474) |
|
||||
| [9cbd7de6d](https://github.com/apache/airflow/commit/9cbd7de6d115795aba8bfb8addb060bfdfbdf87b) | 2020-02-18 | [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412) |
|
||||
| [58c3542ed](https://github.com/apache/airflow/commit/58c3542ed25061320ce61dbe0adf451a44c738dd) | 2020-02-12 | [AIRFLOW-5231] Fix S3Hook.delete_objects method (#7375) |
|
||||
| [b7aa778b3](https://github.com/apache/airflow/commit/b7aa778b38df2f116a1c20031e72fea8b97315bf) | 2020-02-10 | [AIRFLOW-6767] Correct name for default Athena workgroup (#7394) |
|
||||
| [9282185e6](https://github.com/apache/airflow/commit/9282185e6624e64bb7f17447f81c1b2d1bb4d56d) | 2020-02-09 | [AIRFLOW-6761] Fix WorkGroup param in AWSAthenaHook (#7386) |
|
||||
| [94fccca97](https://github.com/apache/airflow/commit/94fccca97030ee59d89f302a98137b17e7b01a33) | 2020-02-04 | [AIRFLOW-XXXX] Add pre-commit check for utf-8 file encoding (#7347) |
|
||||
| [f3ad5cf61](https://github.com/apache/airflow/commit/f3ad5cf6185b9d406d0fb0a4ecc0b5536f79217a) | 2020-02-03 | [AIRFLOW-4681] Make sensors module pylint compatible (#7309) |
|
||||
| [88e40c714](https://github.com/apache/airflow/commit/88e40c714d2853aa8966796945b2907c263fed08) | 2020-02-03 | [AIRFLOW-6716] Fix AWS Datasync Example DAG (#7339) |
|
||||
| [a311d3d82](https://github.com/apache/airflow/commit/a311d3d82e0c2e32bcb56e29f33c95ed0a2a2ddc) | 2020-02-03 | [AIRFLOW-6718] Fix more occurrences of utils.dates.days_ago (#7341) |
|
||||
| [cb766b05b](https://github.com/apache/airflow/commit/cb766b05b17b80fd54a5ce6ac3ee35a631115000) | 2020-02-03 | [AIRFLOW-XXXX] Fix Static Checks on CI (#7342) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [7527eddc5](https://github.com/apache/airflow/commit/7527eddc5e9729aa7e732209a07d57985f6c73e4) | 2020-02-02 | [AIRFLOW-4364] Make all code in airflow/providers/amazon pylint compatible (#7336) |
|
||||
| [cf141506a](https://github.com/apache/airflow/commit/cf141506a25dbba279b85500d781f7e056540721) | 2020-02-02 | [AIRFLOW-6708] Set unique logger names (#7330) |
|
||||
| [63aa3db88](https://github.com/apache/airflow/commit/63aa3db88f8824efe79622301efd9f8ba75b991c) | 2020-02-02 | [AIRFLOW-6258] Add CloudFormation operators to AWS providers (#6824) |
|
||||
| [af4157fde](https://github.com/apache/airflow/commit/af4157fdeffc0c18492b518708c0db44815067ab) | 2020-02-02 | [AIRFLOW-6672] AWS DataSync - better logging of error message (#7288) |
|
||||
| [373c6aa4a](https://github.com/apache/airflow/commit/373c6aa4a208284b5ff72987e4bd8f4e2ada1a1b) | 2020-01-30 | [AIRFLOW-6682] Move GCP classes to providers package (#7295) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [1988a97e8](https://github.com/apache/airflow/commit/1988a97e8f687e28a5a39b29677fb514e097753c) | 2020-01-28 | [AIRFLOW-6659] Move AWS Transfer operators to providers package (#7274) |
|
||||
| [ab10443e9](https://github.com/apache/airflow/commit/ab10443e965269efe9c1efaf5fa33bcdbe609f13) | 2020-01-28 | [AIRFLOW-6424] Added a operator to modify EMR cluster (#7213) |
|
||||
| [40246132a](https://github.com/apache/airflow/commit/40246132a7ef3b07fe3173c6e7646ed6b53aad6e) | 2020-01-28 | [AIRFLOW-6654] AWS DataSync - bugfix when creating locations (#7270) |
|
||||
| [82c0e5aff](https://github.com/apache/airflow/commit/82c0e5aff6004f636b98e207c3caec40b403fbbe) | 2020-01-28 | [AIRFLOW-6655] Move AWS classes to providers (#7271) |
|
||||
| [599e4791c](https://github.com/apache/airflow/commit/599e4791c91cff411b1bf1c45555db5094c2b420) | 2020-01-18 | [AIRFLOW-6541] Use EmrJobFlowSensor for other states (#7146) |
|
||||
| [c319e81ca](https://github.com/apache/airflow/commit/c319e81cae1de31ad1373903252d8608ffce1fba) | 2020-01-17 | [AIRFLOW-6572] Move AWS classes to providers.amazon.aws package (#7178) |
|
||||
| [941a07057](https://github.com/apache/airflow/commit/941a070578bc7d9410715b89658548167352cc4d) | 2020-01-15 | [AIRFLOW-6570] Add dag tag for all example dag (#7176) |
|
||||
| [78d8fe694](https://github.com/apache/airflow/commit/78d8fe6944b689b9b0af99255286e34e06eedec3) | 2020-01-08 | [AIRFLOW-6245] Add custom waiters for AWS batch jobs (#6811) |
|
||||
| [e0b022725](https://github.com/apache/airflow/commit/e0b022725749181bd4e30933e4a0ffefb993eede) | 2019-12-28 | [AIRFLOW-6319] Add support for AWS Athena workgroups (#6871) |
|
||||
| [57da45685](https://github.com/apache/airflow/commit/57da45685457520d51a0967e2aeb5e5ff162dfa7) | 2019-12-24 | [AIRFLOW-6333] Bump Pylint to 2.4.4 & fix/disable new checks (#6888) |
|
||||
| [cf647c27e](https://github.com/apache/airflow/commit/cf647c27e0f35bbd1183bfcf87a106cbdb69d3fa) | 2019-12-18 | [AIRFLOW-6038] AWS DataSync reworked (#6773) |
|
||||
| [7502cad28](https://github.com/apache/airflow/commit/7502cad2844139d57e4276d971c0706a361d9dbe) | 2019-12-17 | [AIRFLOW-6206] Move and rename AWS batch operator [AIP-21] (#6764) |
|
||||
| [c4c635df6](https://github.com/apache/airflow/commit/c4c635df6906f56e01724573923e19763bb0da62) | 2019-12-17 | [AIRFLOW-6083] Adding ability to pass custom configuration to lambda client. (#6678) |
|
||||
| [4fb498f87](https://github.com/apache/airflow/commit/4fb498f87ef89acc30f2576ebc5090ab0653159e) | 2019-12-09 | [AIRFLOW-6072] aws_hook: Outbound http proxy setting and other enhancements (#6686) |
|
||||
| [a1e2f8635](https://github.com/apache/airflow/commit/a1e2f863526973b17892ec31caf09eded95c1cd2) | 2019-11-20 | [AIRFLOW-6021] Replace list literal with list constructor (#6617) |
|
||||
| [baae14084](https://github.com/apache/airflow/commit/baae140847cdf9d84e905fb6d1f119d6950eecf9) | 2019-11-19 | [AIRFLOW-5781] AIP-21 Migrate AWS Kinesis to /providers/amazon/aws (#6588) |
|
||||
| [504cfbac1](https://github.com/apache/airflow/commit/504cfbac1a4ec2e2fd169523ed357808f63881bb) | 2019-11-18 | [AIRFLOW-5783] AIP-21 Move aws redshift into providers structure (#6539) |
|
||||
| [992f0e3ac](https://github.com/apache/airflow/commit/992f0e3acf11163294508858515a5f79116e3ad8) | 2019-11-12 | AIRFLOW-5824: AWS DataSync Hook and Operators added (#6512) |
|
||||
| [c015eb2f6](https://github.com/apache/airflow/commit/c015eb2f6496b9721afda9e85d5d4af3bbe0696b) | 2019-11-10 | [AIRFLOW-5786] Migrate AWS SNS to /providers/amazon/aws (#6502) |
|
||||
| [3d76fb4bf](https://github.com/apache/airflow/commit/3d76fb4bf25e5b7d3d30e0d64867b5999b77f0b0) | 2019-11-09 | [AIRFLOW-5782] Migrate AWS Lambda to /providers/amazon/aws [AIP-21] (#6518) |
|
|
@ -1,99 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-apache-beam
|
||||
|
||||
Release:
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Cross provider package dependencies](#cross-provider-package-dependencies)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [Moved operators](#moved-operators)
|
||||
- [Transfer operators](#transfer-operators)
|
||||
- [Moved transfer operators](#moved-transfer-operators)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release](#release)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `apache.beam` provider. All classes for this provider package
|
||||
are in `airflow.providers.apache.beam` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-apache-beam`
|
||||
|
||||
## Cross provider package dependencies
|
||||
|
||||
Those are dependencies that might be needed in order to use all the features of the package.
|
||||
You need to install the specified backport providers package in order to use them.
|
||||
|
||||
You can install such cross-provider dependencies when installing from PyPI. For example:
|
||||
|
||||
```bash
|
||||
pip install apache-airflow-beckport-providers-apache-beam[google]
|
||||
```
|
||||
|
||||
| Dependent package | Extra |
|
||||
|:----------------------------------------------------------------------------------------------------------|:------------|
|
||||
| [apache-airflow-providers-apache-google](https://pypi.org/project/apache-airflow-providers-apache-google) | google |
|
||||
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `apache.beam` provider
|
||||
are in the `airflow.providers.apache.beam` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
### New operators
|
||||
|
||||
| New Airflow 2.0 operators: `airflow.providers.apache.beam` package |
|
||||
|:-----------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.beam.BeamRunJavaPipelineOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/beam/operators/beam.py) |
|
||||
| [operators.beam.BeamRunPythonPipelineOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/beam/operators/beam.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
### New hooks
|
||||
|
||||
| New Airflow 2.0 hooks: `airflow.providers.apache.beam` package |
|
||||
|:-----------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.beam.BeamHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/beam/hooks/beam.py) |
|
||||
|
||||
|
||||
## Releases
|
|
@ -55,7 +55,7 @@ You can install this package on top of an existing airflow 2.* installation via
|
|||
## Cross provider package dependencies
|
||||
|
||||
Those are dependencies that might be needed in order to use all the features of the package.
|
||||
You need to install the specified backport providers package in order to use them.
|
||||
You need to install the specified provider packages in order to use them.
|
||||
|
||||
You can install such cross-provider dependencies when installing from PyPI. For example:
|
||||
|
||||
|
|
|
@ -1,20 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [2f2f89c14](https://github.com/apache/airflow/commit/2f2f89c148e2b694aee9402707f68065ee7320f8) | 2019-12-01 | [AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701) |
|
||||
| [f88f06c86](https://github.com/apache/airflow/commit/f88f06c862b6096e974871decd14b86811cc4bc6) | 2019-11-30 | [AIRFLOW-6131] Make Cassandra hooks/sensors pylint compatible (#6693) |
|
||||
| [f987646d7](https://github.com/apache/airflow/commit/f987646d7d85683cdc73ae9438a2a8c4a2992c7f) | 2019-11-22 | [AIRFLOW-5950] AIP-21 Change import paths for "apache/cassandra" modules (#6609) |
|
|
@ -1,17 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [750555f26](https://github.com/apache/airflow/commit/750555f261616d809d24b8550b9482a713ba3171) | 2020-07-19 | Add guide for Cassandra Operators (#9877) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,11 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [0646849e3](https://github.com/apache/airflow/commit/0646849e3dacdc2bc62705ae136f3ad3b16232e9) | 2020-10-14 | Add protocol_version to conn_config for Cassandrahook (#11036) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,141 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-apache-cassandra
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Sensors](#sensors)
|
||||
- [Moved sensors](#moved-sensors)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `apache.cassandra` provider. All classes for this provider package
|
||||
are in `airflow.providers.apache.cassandra` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-apache-cassandra`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:-----------------|:-------------------|
|
||||
| cassandra-driver | >=3.13.0,<3.21.0 |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `apache.cassandra` provider
|
||||
are in the `airflow.providers.apache.cassandra` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Sensors
|
||||
|
||||
|
||||
|
||||
### Moved sensors
|
||||
|
||||
| Airflow 2.0 sensors: `airflow.providers.apache.cassandra` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:-------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [sensors.record.CassandraRecordSensor](https://github.com/apache/airflow/blob/master/airflow/providers/apache/cassandra/sensors/record.py) | [contrib.sensors.cassandra_record_sensor.CassandraRecordSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/cassandra_record_sensor.py) |
|
||||
| [sensors.table.CassandraTableSensor](https://github.com/apache/airflow/blob/master/airflow/providers/apache/cassandra/sensors/table.py) | [contrib.sensors.cassandra_table_sensor.CassandraTableSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/cassandra_table_sensor.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.apache.cassandra` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:-------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.cassandra.CassandraHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/cassandra/hooks/cassandra.py) | [contrib.hooks.cassandra_hook.CassandraHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/cassandra_hook.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [0646849e3](https://github.com/apache/airflow/commit/0646849e3dacdc2bc62705ae136f3ad3b16232e9) | 2020-10-14 | Add protocol_version to conn_config for Cassandrahook (#11036) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [750555f26](https://github.com/apache/airflow/commit/750555f261616d809d24b8550b9482a713ba3171) | 2020-07-19 | Add guide for Cassandra Operators (#9877) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [2f2f89c14](https://github.com/apache/airflow/commit/2f2f89c148e2b694aee9402707f68065ee7320f8) | 2019-12-01 | [AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701) |
|
||||
| [f88f06c86](https://github.com/apache/airflow/commit/f88f06c862b6096e974871decd14b86811cc4bc6) | 2019-11-30 | [AIRFLOW-6131] Make Cassandra hooks/sensors pylint compatible (#6693) |
|
||||
| [f987646d7](https://github.com/apache/airflow/commit/f987646d7d85683cdc73ae9438a2a8c4a2992c7f) | 2019-11-22 | [AIRFLOW-5950] AIP-21 Change import paths for "apache/cassandra" modules (#6609) |
|
|
@ -1,21 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:--------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [057f3ae3a](https://github.com/apache/airflow/commit/057f3ae3a4afedf6d462ecf58b01dd6304d3e135) | 2020-01-29 | [AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286) |
|
||||
| [086d731ce](https://github.com/apache/airflow/commit/086d731ce0066b3037d96df2a05cea1101ed3c17) | 2020-01-14 | [AIRFLOW-6510] Fix druid operator templating (#7127) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,18 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [7c206a82a](https://github.com/apache/airflow/commit/7c206a82a6f074abcc4898a005ecd2c84a920054) | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,10 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,172 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-apache-druid
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Cross provider package dependencies](#cross-provider-package-dependencies)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [Moved operators](#moved-operators)
|
||||
- [Transfer operators](#transfer-operators)
|
||||
- [Moved transfer operators](#moved-transfer-operators)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `apache.druid` provider. All classes for this provider package
|
||||
are in `airflow.providers.apache.druid` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-apache-druid`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:--------------|:-------------------|
|
||||
| pydruid | >=0.4.1 |
|
||||
|
||||
## Cross provider package dependencies
|
||||
|
||||
Those are dependencies that might be needed in order to use all the features of the package.
|
||||
You need to install the specified backport providers package in order to use them.
|
||||
|
||||
You can install such cross-provider dependencies when installing from PyPI. For example:
|
||||
|
||||
```bash
|
||||
pip install apache-airflow-backport-providers-apache-druid[apache.hive]
|
||||
```
|
||||
|
||||
| Dependent package | Extra |
|
||||
|:-----------------------------------------------------------------------------------------------------------------------------|:------------|
|
||||
| [apache-airflow-backport-providers-apache-hive](https://github.com/apache/airflow/tree/master/airflow/providers/apache/hive) | apache.hive |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `apache.druid` provider
|
||||
are in the `airflow.providers.apache.druid` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
|
||||
|
||||
### Moved operators
|
||||
|
||||
| Airflow 2.0 operators: `airflow.providers.apache.druid` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:--------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.druid.DruidOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/druid/operators/druid.py) | [contrib.operators.druid_operator.DruidOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/druid_operator.py) |
|
||||
| [operators.druid_check.DruidCheckOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/druid/operators/druid_check.py) | [operators.druid_check_operator.DruidCheckOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/druid_check_operator.py) |
|
||||
|
||||
|
||||
## Transfer operators
|
||||
|
||||
|
||||
|
||||
### Moved transfer operators
|
||||
|
||||
| Airflow 2.0 transfers: `airflow.providers.apache.druid` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:-------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [transfers.hive_to_druid.HiveToDruidOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/druid/transfers/hive_to_druid.py) | [operators.hive_to_druid.HiveToDruidTransfer](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/hive_to_druid.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.apache.druid` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:--------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.druid.DruidDbApiHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/druid/hooks/druid.py) | [hooks.druid_hook.DruidDbApiHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/hooks/druid_hook.py) |
|
||||
| [hooks.druid.DruidHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/druid/hooks/druid.py) | [hooks.druid_hook.DruidHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/hooks/druid_hook.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [7c206a82a](https://github.com/apache/airflow/commit/7c206a82a6f074abcc4898a005ecd2c84a920054) | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:--------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [057f3ae3a](https://github.com/apache/airflow/commit/057f3ae3a4afedf6d462ecf58b01dd6304d3e135) | 2020-01-29 | [AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286) |
|
||||
| [086d731ce](https://github.com/apache/airflow/commit/086d731ce0066b3037d96df2a05cea1101ed3c17) | 2020-01-14 | [AIRFLOW-6510] Fix druid operator templating (#7127) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,22 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [87969a350](https://github.com/apache/airflow/commit/87969a350ddd41e9e77776af6d780b31e363eaca) | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
|
||||
| [6c670870a](https://github.com/apache/airflow/commit/6c670870aa6ea5d82a86f912bb6de8b88e711ca5) | 2020-03-25 | [AIRFLOW-6833] HA for webhdfs connection (#7454) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [f3ad5cf61](https://github.com/apache/airflow/commit/f3ad5cf6185b9d406d0fb0a4ecc0b5536f79217a) | 2020-02-03 | [AIRFLOW-4681] Make sensors module pylint compatible (#7309) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [cf141506a](https://github.com/apache/airflow/commit/cf141506a25dbba279b85500d781f7e056540721) | 2020-02-02 | [AIRFLOW-6708] Set unique logger names (#7330) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,18 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:----------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [d1bce91bb](https://github.com/apache/airflow/commit/d1bce91bb21d5a468fa6a0207156c28fe1ca6513) | 2020-08-25 | PyDocStyle: Enable D403: Capitalized first word of docstring (#10530) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [2f2d8dbfa](https://github.com/apache/airflow/commit/2f2d8dbfafefb4be3dd80f22f31c649c8498f148) | 2020-08-25 | Remove all "noinspection" comments native to IntelliJ (#10525) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [44d4ae809](https://github.com/apache/airflow/commit/44d4ae809c1e3784ff95b6a5e95113c3412e56b3) | 2020-07-06 | Upgrade to latest pre-commit checks (#9686) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,10 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,146 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-apache-hdfs
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Sensors](#sensors)
|
||||
- [Moved sensors](#moved-sensors)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `apache.hdfs` provider. All classes for this provider package
|
||||
are in `airflow.providers.apache.hdfs` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-apache-hdfs`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:--------------|:-------------------|
|
||||
| snakebite-py3 | |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `apache.hdfs` provider
|
||||
are in the `airflow.providers.apache.hdfs` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Sensors
|
||||
|
||||
|
||||
|
||||
### Moved sensors
|
||||
|
||||
| Airflow 2.0 sensors: `airflow.providers.apache.hdfs` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:----------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [sensors.hdfs.HdfsFolderSensor](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hdfs/sensors/hdfs.py) | [contrib.sensors.hdfs_sensor.HdfsSensorFolder](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/hdfs_sensor.py) |
|
||||
| [sensors.hdfs.HdfsRegexSensor](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hdfs/sensors/hdfs.py) | [contrib.sensors.hdfs_sensor.HdfsSensorRegex](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/hdfs_sensor.py) |
|
||||
| [sensors.hdfs.HdfsSensor](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hdfs/sensors/hdfs.py) | [sensors.hdfs_sensor.HdfsSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/sensors/hdfs_sensor.py) |
|
||||
| [sensors.web_hdfs.WebHdfsSensor](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hdfs/sensors/web_hdfs.py) | [sensors.web_hdfs_sensor.WebHdfsSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/sensors/web_hdfs_sensor.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.apache.hdfs` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:--------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.hdfs.HDFSHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hdfs/hooks/hdfs.py) | [hooks.hdfs_hook.HDFSHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/hooks/hdfs_hook.py) |
|
||||
| [hooks.webhdfs.WebHDFSHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hdfs/hooks/webhdfs.py) | [hooks.webhdfs_hook.WebHDFSHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/hooks/webhdfs_hook.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:----------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [d1bce91bb](https://github.com/apache/airflow/commit/d1bce91bb21d5a468fa6a0207156c28fe1ca6513) | 2020-08-25 | PyDocStyle: Enable D403: Capitalized first word of docstring (#10530) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [2f2d8dbfa](https://github.com/apache/airflow/commit/2f2d8dbfafefb4be3dd80f22f31c649c8498f148) | 2020-08-25 | Remove all "noinspection" comments native to IntelliJ (#10525) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [44d4ae809](https://github.com/apache/airflow/commit/44d4ae809c1e3784ff95b6a5e95113c3412e56b3) | 2020-07-06 | Upgrade to latest pre-commit checks (#9686) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [87969a350](https://github.com/apache/airflow/commit/87969a350ddd41e9e77776af6d780b31e363eaca) | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
|
||||
| [6c670870a](https://github.com/apache/airflow/commit/6c670870aa6ea5d82a86f912bb6de8b88e711ca5) | 2020-03-25 | [AIRFLOW-6833] HA for webhdfs connection (#7454) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [f3ad5cf61](https://github.com/apache/airflow/commit/f3ad5cf6185b9d406d0fb0a4ecc0b5536f79217a) | 2020-02-03 | [AIRFLOW-4681] Make sensors module pylint compatible (#7309) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [cf141506a](https://github.com/apache/airflow/commit/cf141506a25dbba279b85500d781f7e056540721) | 2020-02-02 | [AIRFLOW-6708] Set unique logger names (#7330) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,32 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [c78e2a5fe](https://github.com/apache/airflow/commit/c78e2a5feae15e84b05430cfc5935f0e289fb6b4) | 2020-06-16 | Make hive macros py3 compatible (#8598) |
|
||||
| [6350fd6eb](https://github.com/apache/airflow/commit/6350fd6ebb9958982cb3fa1d466168fc31708035) | 2020-06-08 | Don't use the term "whitelist" - language matters (#9174) |
|
||||
| [10796cb7c](https://github.com/apache/airflow/commit/10796cb7ce52c8ac2f68024e531fdda779547bdf) | 2020-06-03 | Remove Hive/Hadoop/Java dependency from unit tests (#9029) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [cdb3f2545](https://github.com/apache/airflow/commit/cdb3f25456e49d0199cd7ccd680626dac01c9be6) | 2020-05-26 | All classes in backport providers are now importable in Airflow 1.10 (#8991) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [93ea05880](https://github.com/apache/airflow/commit/93ea05880283a56e3d42ab07db7453977a3de8ec) | 2020-04-21 | [AIRFLOW-7059] pass hive_conf to get_pandas_df in HiveServer2Hook (#8380) |
|
||||
| [87969a350](https://github.com/apache/airflow/commit/87969a350ddd41e9e77776af6d780b31e363eaca) | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
|
||||
| [cb0bf4a14](https://github.com/apache/airflow/commit/cb0bf4a142656ee40b43a01660b6f6b08a9840fa) | 2020-03-30 | Remove sql like function in base_hook (#7901) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [4d03e33c1](https://github.com/apache/airflow/commit/4d03e33c115018e30fa413c42b16212481ad25cc) | 2020-02-22 | [AIRFLOW-6817] remove imports from `airflow/__init__.py`, replaced implicit imports with explicit imports, added entry to `UPDATING.MD` - squashed/rebased (#7456) |
|
||||
| [f3ad5cf61](https://github.com/apache/airflow/commit/f3ad5cf6185b9d406d0fb0a4ecc0b5536f79217a) | 2020-02-03 | [AIRFLOW-4681] Make sensors module pylint compatible (#7309) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [057f3ae3a](https://github.com/apache/airflow/commit/057f3ae3a4afedf6d462ecf58b01dd6304d3e135) | 2020-01-29 | [AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286) |
|
||||
| [059eda05f](https://github.com/apache/airflow/commit/059eda05f82fefce4410f44f761f945a27d83daf) | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,29 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:--------------------------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [e3f96ce7a](https://github.com/apache/airflow/commit/e3f96ce7a8ac098aeef5e9930e6de6c428274d57) | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [ac943c9e1](https://github.com/apache/airflow/commit/ac943c9e18f75259d531dbda8c51e650f57faa4c) | 2020-09-08 | [AIRFLOW-3964][AIP-17] Consolidate and de-dup sensor tasks using Smart Sensor (#5499) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [d76026545](https://github.com/apache/airflow/commit/d7602654526fdd2876466371404784bd17cfe0d2) | 2020-08-25 | PyDocStyle: No whitespaces allowed surrounding docstring text (#10533) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [27339a5a0](https://github.com/apache/airflow/commit/27339a5a0f9e382dbc7d32a128f0831a48ef9a12) | 2020-08-22 | Remove mentions of Airflow Gitter (#10460) |
|
||||
| [7c206a82a](https://github.com/apache/airflow/commit/7c206a82a6f074abcc4898a005ecd2c84a920054) | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
|
||||
| [8f8db8959](https://github.com/apache/airflow/commit/8f8db8959e526be54d700845d36ee9f315bae2ea) | 2020-08-12 | DbApiHook: Support kwargs in get_pandas_df (#9730) |
|
||||
| [b43f90abf](https://github.com/apache/airflow/commit/b43f90abf4c7219d5d59cccb0514256bd3f2fdc7) | 2020-08-09 | Fix various typos in the repo (#10263) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [c2db0dfeb](https://github.com/apache/airflow/commit/c2db0dfeb13ee679bf4d7b57874f0fcb39c0f0ed) | 2020-07-22 | More strict rules in mypy (#9705) (#9906) |
|
||||
| [5013fda8f](https://github.com/apache/airflow/commit/5013fda8f072e633c114fb39fb59a22f60200b40) | 2020-07-20 | Add drop_partition functionality for HiveMetastoreHook (#9472) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [44d4ae809](https://github.com/apache/airflow/commit/44d4ae809c1e3784ff95b6a5e95113c3412e56b3) | 2020-07-06 | Upgrade to latest pre-commit checks (#9686) |
|
||||
| [e13a14c87](https://github.com/apache/airflow/commit/e13a14c8730f4f633d996dd7d3468fe827136a84) | 2020-06-21 | Enable & Fix Whitespace related PyDocStyle Checks (#9458) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,10 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,221 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-apache-hive
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Cross provider package dependencies](#cross-provider-package-dependencies)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [Moved operators](#moved-operators)
|
||||
- [Transfer operators](#transfer-operators)
|
||||
- [Moved transfer operators](#moved-transfer-operators)
|
||||
- [Sensors](#sensors)
|
||||
- [Moved sensors](#moved-sensors)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `apache.hive` provider. All classes for this provider package
|
||||
are in `airflow.providers.apache.hive` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-apache-hive`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:--------------|:-------------------|
|
||||
| hmsclient | >=0.1.0 |
|
||||
| pyhive[hive] | >=0.6.0 |
|
||||
|
||||
## Cross provider package dependencies
|
||||
|
||||
Those are dependencies that might be needed in order to use all the features of the package.
|
||||
You need to install the specified backport providers package in order to use them.
|
||||
|
||||
You can install such cross-provider dependencies when installing from PyPI. For example:
|
||||
|
||||
```bash
|
||||
pip install apache-airflow-backport-providers-apache-hive[amazon]
|
||||
```
|
||||
|
||||
| Dependent package | Extra |
|
||||
|:-------------------------------------------------------------------------------------------------------------------------------------|:----------------|
|
||||
| [apache-airflow-backport-providers-amazon](https://github.com/apache/airflow/tree/master/airflow/providers/amazon) | amazon |
|
||||
| [apache-airflow-backport-providers-microsoft-mssql](https://github.com/apache/airflow/tree/master/airflow/providers/microsoft/mssql) | microsoft.mssql |
|
||||
| [apache-airflow-backport-providers-mysql](https://github.com/apache/airflow/tree/master/airflow/providers/mysql) | mysql |
|
||||
| [apache-airflow-backport-providers-presto](https://github.com/apache/airflow/tree/master/airflow/providers/presto) | presto |
|
||||
| [apache-airflow-backport-providers-samba](https://github.com/apache/airflow/tree/master/airflow/providers/samba) | samba |
|
||||
| [apache-airflow-backport-providers-vertica](https://github.com/apache/airflow/tree/master/airflow/providers/vertica) | vertica |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `apache.hive` provider
|
||||
are in the `airflow.providers.apache.hive` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
|
||||
|
||||
### Moved operators
|
||||
|
||||
| Airflow 2.0 operators: `airflow.providers.apache.hive` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:--------------------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.hive.HiveOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/operators/hive.py) | [operators.hive_operator.HiveOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/hive_operator.py) |
|
||||
| [operators.hive_stats.HiveStatsCollectionOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/operators/hive_stats.py) | [operators.hive_stats_operator.HiveStatsCollectionOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/hive_stats_operator.py) |
|
||||
|
||||
|
||||
## Transfer operators
|
||||
|
||||
|
||||
|
||||
### Moved transfer operators
|
||||
|
||||
| Airflow 2.0 transfers: `airflow.providers.apache.hive` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [transfers.hive_to_mysql.HiveToMySqlOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/transfers/hive_to_mysql.py) | [operators.hive_to_mysql.HiveToMySqlTransfer](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/hive_to_mysql.py) |
|
||||
| [transfers.hive_to_samba.HiveToSambaOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/transfers/hive_to_samba.py) | [operators.hive_to_samba_operator.HiveToSambaOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/hive_to_samba_operator.py) |
|
||||
| [transfers.mssql_to_hive.MsSqlToHiveOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/transfers/mssql_to_hive.py) | [operators.mssql_to_hive.MsSqlToHiveTransfer](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/mssql_to_hive.py) |
|
||||
| [transfers.mysql_to_hive.MySqlToHiveOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/transfers/mysql_to_hive.py) | [operators.mysql_to_hive.MySqlToHiveTransfer](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/mysql_to_hive.py) |
|
||||
| [transfers.s3_to_hive.S3ToHiveOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/transfers/s3_to_hive.py) | [operators.s3_to_hive_operator.S3ToHiveTransfer](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/s3_to_hive_operator.py) |
|
||||
| [transfers.vertica_to_hive.VerticaToHiveOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/transfers/vertica_to_hive.py) | [contrib.operators.vertica_to_hive.VerticaToHiveTransfer](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/vertica_to_hive.py) |
|
||||
|
||||
|
||||
## Sensors
|
||||
|
||||
|
||||
|
||||
### Moved sensors
|
||||
|
||||
| Airflow 2.0 sensors: `airflow.providers.apache.hive` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [sensors.hive_partition.HivePartitionSensor](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/sensors/hive_partition.py) | [sensors.hive_partition_sensor.HivePartitionSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/sensors/hive_partition_sensor.py) |
|
||||
| [sensors.metastore_partition.MetastorePartitionSensor](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/sensors/metastore_partition.py) | [sensors.metastore_partition_sensor.MetastorePartitionSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/sensors/metastore_partition_sensor.py) |
|
||||
| [sensors.named_hive_partition.NamedHivePartitionSensor](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/sensors/named_hive_partition.py) | [sensors.named_hive_partition_sensor.NamedHivePartitionSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/sensors/named_hive_partition_sensor.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.apache.hive` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:--------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.hive.HiveCliHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/hooks/hive.py) | [hooks.hive_hooks.HiveCliHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/hooks/hive_hooks.py) |
|
||||
| [hooks.hive.HiveMetastoreHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/hooks/hive.py) | [hooks.hive_hooks.HiveMetastoreHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/hooks/hive_hooks.py) |
|
||||
| [hooks.hive.HiveServer2Hook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/hive/hooks/hive.py) | [hooks.hive_hooks.HiveServer2Hook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/hooks/hive_hooks.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:--------------------------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [e3f96ce7a](https://github.com/apache/airflow/commit/e3f96ce7a8ac098aeef5e9930e6de6c428274d57) | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [ac943c9e1](https://github.com/apache/airflow/commit/ac943c9e18f75259d531dbda8c51e650f57faa4c) | 2020-09-08 | [AIRFLOW-3964][AIP-17] Consolidate and de-dup sensor tasks using Smart Sensor (#5499) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [d76026545](https://github.com/apache/airflow/commit/d7602654526fdd2876466371404784bd17cfe0d2) | 2020-08-25 | PyDocStyle: No whitespaces allowed surrounding docstring text (#10533) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [27339a5a0](https://github.com/apache/airflow/commit/27339a5a0f9e382dbc7d32a128f0831a48ef9a12) | 2020-08-22 | Remove mentions of Airflow Gitter (#10460) |
|
||||
| [7c206a82a](https://github.com/apache/airflow/commit/7c206a82a6f074abcc4898a005ecd2c84a920054) | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
|
||||
| [8f8db8959](https://github.com/apache/airflow/commit/8f8db8959e526be54d700845d36ee9f315bae2ea) | 2020-08-12 | DbApiHook: Support kwargs in get_pandas_df (#9730) |
|
||||
| [b43f90abf](https://github.com/apache/airflow/commit/b43f90abf4c7219d5d59cccb0514256bd3f2fdc7) | 2020-08-09 | Fix various typos in the repo (#10263) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [c2db0dfeb](https://github.com/apache/airflow/commit/c2db0dfeb13ee679bf4d7b57874f0fcb39c0f0ed) | 2020-07-22 | More strict rules in mypy (#9705) (#9906) |
|
||||
| [5013fda8f](https://github.com/apache/airflow/commit/5013fda8f072e633c114fb39fb59a22f60200b40) | 2020-07-20 | Add drop_partition functionality for HiveMetastoreHook (#9472) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [44d4ae809](https://github.com/apache/airflow/commit/44d4ae809c1e3784ff95b6a5e95113c3412e56b3) | 2020-07-06 | Upgrade to latest pre-commit checks (#9686) |
|
||||
| [e13a14c87](https://github.com/apache/airflow/commit/e13a14c8730f4f633d996dd7d3468fe827136a84) | 2020-06-21 | Enable & Fix Whitespace related PyDocStyle Checks (#9458) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [c78e2a5fe](https://github.com/apache/airflow/commit/c78e2a5feae15e84b05430cfc5935f0e289fb6b4) | 2020-06-16 | Make hive macros py3 compatible (#8598) |
|
||||
| [6350fd6eb](https://github.com/apache/airflow/commit/6350fd6ebb9958982cb3fa1d466168fc31708035) | 2020-06-08 | Don't use the term "whitelist" - language matters (#9174) |
|
||||
| [10796cb7c](https://github.com/apache/airflow/commit/10796cb7ce52c8ac2f68024e531fdda779547bdf) | 2020-06-03 | Remove Hive/Hadoop/Java dependency from unit tests (#9029) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [cdb3f2545](https://github.com/apache/airflow/commit/cdb3f25456e49d0199cd7ccd680626dac01c9be6) | 2020-05-26 | All classes in backport providers are now importable in Airflow 1.10 (#8991) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [93ea05880](https://github.com/apache/airflow/commit/93ea05880283a56e3d42ab07db7453977a3de8ec) | 2020-04-21 | [AIRFLOW-7059] pass hive_conf to get_pandas_df in HiveServer2Hook (#8380) |
|
||||
| [87969a350](https://github.com/apache/airflow/commit/87969a350ddd41e9e77776af6d780b31e363eaca) | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
|
||||
| [cb0bf4a14](https://github.com/apache/airflow/commit/cb0bf4a142656ee40b43a01660b6f6b08a9840fa) | 2020-03-30 | Remove sql like function in base_hook (#7901) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [4d03e33c1](https://github.com/apache/airflow/commit/4d03e33c115018e30fa413c42b16212481ad25cc) | 2020-02-22 | [AIRFLOW-6817] remove imports from `airflow/__init__.py`, replaced implicit imports with explicit imports, added entry to `UPDATING.MD` - squashed/rebased (#7456) |
|
||||
| [f3ad5cf61](https://github.com/apache/airflow/commit/f3ad5cf6185b9d406d0fb0a4ecc0b5536f79217a) | 2020-02-03 | [AIRFLOW-4681] Make sensors module pylint compatible (#7309) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [057f3ae3a](https://github.com/apache/airflow/commit/057f3ae3a4afedf6d462ecf58b01dd6304d3e135) | 2020-01-29 | [AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286) |
|
||||
| [059eda05f](https://github.com/apache/airflow/commit/059eda05f82fefce4410f44f761f945a27d83daf) | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,19 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:----------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [99accec29](https://github.com/apache/airflow/commit/99accec29d71b0a57fd4e90151b9d4d10321be07) | 2020-09-25 | Fix incorrect Usage of Optional[str] & Optional[int] (#11141) |
|
||||
| [e3f96ce7a](https://github.com/apache/airflow/commit/e3f96ce7a8ac098aeef5e9930e6de6c428274d57) | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [d1bce91bb](https://github.com/apache/airflow/commit/d1bce91bb21d5a468fa6a0207156c28fe1ca6513) | 2020-08-25 | PyDocStyle: Enable D403: Capitalized first word of docstring (#10530) |
|
||||
| [f6734b3b8](https://github.com/apache/airflow/commit/f6734b3b850d33d3712763f93c114e80f5af9ffb) | 2020-08-12 | Enable Sphinx spellcheck for doc generation (#10280) |
|
||||
| [b43f90abf](https://github.com/apache/airflow/commit/b43f90abf4c7219d5d59cccb0514256bd3f2fdc7) | 2020-08-09 | Fix various typos in the repo (#10263) |
|
||||
| [edc51e313](https://github.com/apache/airflow/commit/edc51e313b50359e0258cce5f7f7283f69342fb9) | 2020-08-08 | Remove Unnecessary list literal in Tuple for Kylin Operator (#10252) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [a2c5389a6](https://github.com/apache/airflow/commit/a2c5389a60f68482a60eb40c67b1542d827c187e) | 2020-07-14 | Add kylin operator (#9149) |
|
|
@ -1,9 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,119 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-apache-kylin
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [New operators](#new-operators)
|
||||
- [Hooks](#hooks)
|
||||
- [New hooks](#new-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `apache.kylin` provider. All classes for this provider package
|
||||
are in `airflow.providers.apache.kylin` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-apache-kylin`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:--------------|:-------------------|
|
||||
| kylinpy | >=2.6 |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `apache.kylin` provider
|
||||
are in the `airflow.providers.apache.kylin` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
|
||||
### New operators
|
||||
|
||||
| New Airflow 2.0 operators: `airflow.providers.apache.kylin` package |
|
||||
|:-----------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.kylin_cube.KylinCubeOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/kylin/operators/kylin_cube.py) |
|
||||
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
### New hooks
|
||||
|
||||
| New Airflow 2.0 hooks: `airflow.providers.apache.kylin` package |
|
||||
|:---------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.kylin.KylinHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/kylin/hooks/kylin.py) |
|
||||
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:----------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [99accec29](https://github.com/apache/airflow/commit/99accec29d71b0a57fd4e90151b9d4d10321be07) | 2020-09-25 | Fix incorrect Usage of Optional[str] & Optional[int] (#11141) |
|
||||
| [e3f96ce7a](https://github.com/apache/airflow/commit/e3f96ce7a8ac098aeef5e9930e6de6c428274d57) | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [d1bce91bb](https://github.com/apache/airflow/commit/d1bce91bb21d5a468fa6a0207156c28fe1ca6513) | 2020-08-25 | PyDocStyle: Enable D403: Capitalized first word of docstring (#10530) |
|
||||
| [f6734b3b8](https://github.com/apache/airflow/commit/f6734b3b850d33d3712763f93c114e80f5af9ffb) | 2020-08-12 | Enable Sphinx spellcheck for doc generation (#10280) |
|
||||
| [b43f90abf](https://github.com/apache/airflow/commit/b43f90abf4c7219d5d59cccb0514256bd3f2fdc7) | 2020-08-09 | Fix various typos in the repo (#10263) |
|
||||
| [edc51e313](https://github.com/apache/airflow/commit/edc51e313b50359e0258cce5f7f7283f69342fb9) | 2020-08-08 | Remove Unnecessary list literal in Tuple for Kylin Operator (#10252) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [a2c5389a6](https://github.com/apache/airflow/commit/a2c5389a60f68482a60eb40c67b1542d827c187e) | 2020-07-14 | Add kylin operator (#9149) |
|
|
@ -1,18 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [4d03e33c1](https://github.com/apache/airflow/commit/4d03e33c115018e30fa413c42b16212481ad25cc) | 2020-02-22 | [AIRFLOW-6817] remove imports from `airflow/__init__.py`, replaced implicit imports with explicit imports, added entry to `UPDATING.MD` - squashed/rebased (#7456) |
|
||||
| [d3cf23dc0](https://github.com/apache/airflow/commit/d3cf23dc07b5fb92ee2a5be07b0685a4fca36f86) | 2020-02-19 | [AIRFLOW-5470] Add Apache Livy REST operator (#6090) |
|
|
@ -1,17 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,11 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [483068745](https://github.com/apache/airflow/commit/48306874538eea7cfd42358d5ebb59705204bfc4) | 2020-10-24 | Use Python 3 style super classes (#11806) |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,160 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-apache-livy
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [Cross provider package dependencies](#cross-provider-package-dependencies)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [New operators](#new-operators)
|
||||
- [Sensors](#sensors)
|
||||
- [New sensors](#new-sensors)
|
||||
- [Hooks](#hooks)
|
||||
- [New hooks](#new-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `apache.livy` provider. All classes for this provider package
|
||||
are in `airflow.providers.apache.livy` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-apache-livy`
|
||||
|
||||
## Cross provider package dependencies
|
||||
|
||||
Those are dependencies that might be needed in order to use all the features of the package.
|
||||
You need to install the specified backport providers package in order to use them.
|
||||
|
||||
You can install such cross-provider dependencies when installing from PyPI. For example:
|
||||
|
||||
```bash
|
||||
pip install apache-airflow-backport-providers-apache-livy[http]
|
||||
```
|
||||
|
||||
| Dependent package | Extra |
|
||||
|:---------------------------------------------------------------------------------------------------------------|:--------|
|
||||
| [apache-airflow-backport-providers-http](https://github.com/apache/airflow/tree/master/airflow/providers/http) | http |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `apache.livy` provider
|
||||
are in the `airflow.providers.apache.livy` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
|
||||
### New operators
|
||||
|
||||
| New Airflow 2.0 operators: `airflow.providers.apache.livy` package |
|
||||
|:-----------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.livy.LivyOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/livy/operators/livy.py) |
|
||||
|
||||
|
||||
|
||||
## Sensors
|
||||
|
||||
|
||||
### New sensors
|
||||
|
||||
| New Airflow 2.0 sensors: `airflow.providers.apache.livy` package |
|
||||
|:-----------------------------------------------------------------------------------------------------------------------|
|
||||
| [sensors.livy.LivySensor](https://github.com/apache/airflow/blob/master/airflow/providers/apache/livy/sensors/livy.py) |
|
||||
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
### New hooks
|
||||
|
||||
| New Airflow 2.0 hooks: `airflow.providers.apache.livy` package |
|
||||
|:-----------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.livy.LivyHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/livy/hooks/livy.py) |
|
||||
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [483068745](https://github.com/apache/airflow/commit/48306874538eea7cfd42358d5ebb59705204bfc4) | 2020-10-24 | Use Python 3 style super classes (#11806) |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [4d03e33c1](https://github.com/apache/airflow/commit/4d03e33c115018e30fa413c42b16212481ad25cc) | 2020-02-22 | [AIRFLOW-6817] remove imports from `airflow/__init__.py`, replaced implicit imports with explicit imports, added entry to `UPDATING.MD` - squashed/rebased (#7456) |
|
||||
| [d3cf23dc0](https://github.com/apache/airflow/commit/d3cf23dc07b5fb92ee2a5be07b0685a4fca36f86) | 2020-02-19 | [AIRFLOW-5470] Add Apache Livy REST operator (#6090) |
|
|
@ -1,22 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [9cbd7de6d](https://github.com/apache/airflow/commit/9cbd7de6d115795aba8bfb8addb060bfdfbdf87b) | 2020-02-18 | [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,18 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,10 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,135 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-apache-pig
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [Moved operators](#moved-operators)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `apache.pig` provider. All classes for this provider package
|
||||
are in `airflow.providers.apache.pig` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-apache-pig`
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `apache.pig` provider
|
||||
are in the `airflow.providers.apache.pig` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
|
||||
|
||||
### Moved operators
|
||||
|
||||
| Airflow 2.0 operators: `airflow.providers.apache.pig` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:-------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.pig.PigOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/pig/operators/pig.py) | [operators.pig_operator.PigOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/pig_operator.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.apache.pig` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:----------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.pig.PigCliHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/pig/hooks/pig.py) | [hooks.pig_hook.PigCliHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/hooks/pig_hook.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [9cbd7de6d](https://github.com/apache/airflow/commit/9cbd7de6d115795aba8bfb8addb060bfdfbdf87b) | 2020-02-18 | [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,20 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [45c898330](https://github.com/apache/airflow/commit/45c8983306ab1c54abdacd8f870e790fad25cb37) | 2020-04-13 | Less aggressive eager upgrade of requirements (#8267) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,14 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [e3f96ce7a](https://github.com/apache/airflow/commit/e3f96ce7a8ac098aeef5e9930e6de6c428274d57) | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,10 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,18 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.11.23
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [4873d9759](https://github.com/apache/airflow/commit/4873d9759dfdec1dd3663074f9e64ad69fa881cc) | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) |
|
||||
| [ae7cb4a1e](https://github.com/apache/airflow/commit/ae7cb4a1e2a96351f1976cf5832615e24863e05d) | 2020-11-17 | Update wrong commit hash in backport provider changes (#12390) |
|
||||
| [6889a333c](https://github.com/apache/airflow/commit/6889a333cff001727eb0a66e375544a28c9a5f03) | 2020-11-15 | Improvements for operators and hooks ref docs (#12366) |
|
||||
| [309b325c1](https://github.com/apache/airflow/commit/309b325c177d46f3cea8e1812a8728623c633604) | 2020-11-13 | Update deprecated Apache Pinot Broker API (#12333) |
|
||||
| [7825e8f59](https://github.com/apache/airflow/commit/7825e8f59034645ab3247229be83a3aa90baece1) | 2020-11-13 | Docs installation improvements (#12304) |
|
||||
| [85a18e13d](https://github.com/apache/airflow/commit/85a18e13d9dec84275283ff69e34704b60d54a75) | 2020-11-09 | Point at pypi project pages for cross-dependency of provider packages (#12212) |
|
||||
| [59eb5de78](https://github.com/apache/airflow/commit/59eb5de78c70ee9c7ae6e4cba5c7a2babb8103ca) | 2020-11-09 | Update provider READMEs for up-coming 1.0.0beta1 releases (#12206) |
|
||||
| [b2a28d159](https://github.com/apache/airflow/commit/b2a28d1590410630d66966aa1f2b2a049a8c3b32) | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
|
||||
| [41bf172c1](https://github.com/apache/airflow/commit/41bf172c1dc75099f4f9d8b3f3350b4b1f523ef9) | 2020-11-04 | Simplify string expressions (#12093) |
|
||||
| [4e8f9cc8d](https://github.com/apache/airflow/commit/4e8f9cc8d02b29c325b8a5a76b4837671bdf5f68) | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
|
||||
| [8c42cf1b0](https://github.com/apache/airflow/commit/8c42cf1b00c90f0d7f11b8a3a455381de8e003c5) | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
|
||||
| [5a439e84e](https://github.com/apache/airflow/commit/5a439e84eb6c0544dc6c3d6a9f4ceeb2172cd5d0) | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
|
|
@ -1,143 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-apache-pinot
|
||||
|
||||
Release: 2020.11.23
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.11.23](#release-20201123)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `apache.pinot` provider. All classes for this provider package
|
||||
are in `airflow.providers.apache.pinot` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-apache-pinot`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:--------------|:-------------------|
|
||||
| pinotdb | ==0.1.1 |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `apache.pinot` provider
|
||||
are in the `airflow.providers.apache.pinot` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.apache.pinot` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:--------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.pinot.PinotAdminHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/pinot/hooks/pinot.py) | [contrib.hooks.pinot_hook.PinotAdminHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/pinot_hook.py) |
|
||||
| [hooks.pinot.PinotDbApiHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/pinot/hooks/pinot.py) | [contrib.hooks.pinot_hook.PinotDbApiHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/pinot_hook.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.11.23
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [4873d9759](https://github.com/apache/airflow/commit/4873d9759dfdec1dd3663074f9e64ad69fa881cc) | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) |
|
||||
| [ae7cb4a1e](https://github.com/apache/airflow/commit/ae7cb4a1e2a96351f1976cf5832615e24863e05d) | 2020-11-17 | Update wrong commit hash in backport provider changes (#12390) |
|
||||
| [6889a333c](https://github.com/apache/airflow/commit/6889a333cff001727eb0a66e375544a28c9a5f03) | 2020-11-15 | Improvements for operators and hooks ref docs (#12366) |
|
||||
| [309b325c1](https://github.com/apache/airflow/commit/309b325c177d46f3cea8e1812a8728623c633604) | 2020-11-13 | Update deprecated Apache Pinot Broker API (#12333) |
|
||||
| [7825e8f59](https://github.com/apache/airflow/commit/7825e8f59034645ab3247229be83a3aa90baece1) | 2020-11-13 | Docs installation improvements (#12304) |
|
||||
| [85a18e13d](https://github.com/apache/airflow/commit/85a18e13d9dec84275283ff69e34704b60d54a75) | 2020-11-09 | Point at pypi project pages for cross-dependency of provider packages (#12212) |
|
||||
| [59eb5de78](https://github.com/apache/airflow/commit/59eb5de78c70ee9c7ae6e4cba5c7a2babb8103ca) | 2020-11-09 | Update provider READMEs for up-coming 1.0.0beta1 releases (#12206) |
|
||||
| [b2a28d159](https://github.com/apache/airflow/commit/b2a28d1590410630d66966aa1f2b2a049a8c3b32) | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
|
||||
| [41bf172c1](https://github.com/apache/airflow/commit/41bf172c1dc75099f4f9d8b3f3350b4b1f523ef9) | 2020-11-04 | Simplify string expressions (#12093) |
|
||||
| [4e8f9cc8d](https://github.com/apache/airflow/commit/4e8f9cc8d02b29c325b8a5a76b4837671bdf5f68) | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
|
||||
| [8c42cf1b0](https://github.com/apache/airflow/commit/8c42cf1b00c90f0d7f11b8a3a455381de8e003c5) | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
|
||||
| [5a439e84e](https://github.com/apache/airflow/commit/5a439e84eb6c0544dc6c3d6a9f4ceeb2172cd5d0) | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
|
||||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [e3f96ce7a](https://github.com/apache/airflow/commit/e3f96ce7a8ac098aeef5e9930e6de6c428274d57) | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [45c898330](https://github.com/apache/airflow/commit/45c8983306ab1c54abdacd8f870e790fad25cb37) | 2020-04-13 | Less aggressive eager upgrade of requirements (#8267) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,27 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [40bf8f28f](https://github.com/apache/airflow/commit/40bf8f28f97f17f40d993d207ea740eba54593ee) | 2020-06-18 | Detect automatically the lack of reference to the guide in the operator descriptions (#9290) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [7506c73f1](https://github.com/apache/airflow/commit/7506c73f1721151e9c50ef8bdb70d2136a16190b) | 2020-05-10 | Add default `conf` parameter to Spark JDBC Hook (#8787) |
|
||||
| [487b5cc50](https://github.com/apache/airflow/commit/487b5cc50c5b28a045cb12a1527a5453b0a6a7af) | 2020-05-06 | Add guide for Apache Spark operators (#8305) |
|
||||
| [87969a350](https://github.com/apache/airflow/commit/87969a350ddd41e9e77776af6d780b31e363eaca) | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
|
||||
| [be1451b0e](https://github.com/apache/airflow/commit/be1451b0e1b7e33f4621e24649f6a4fa87c34e01) | 2020-04-02 | [AIRFLOW-7026] Improve SparkSqlHook's error message (#7749) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [2327aa5a2](https://github.com/apache/airflow/commit/2327aa5a263f25beeaf4ba79670f10f001daf0bf) | 2020-03-12 | [AIRFLOW-7025] Fix SparkSqlHook.run_query to handle its parameter properly (#7677) |
|
||||
| [024b4bf96](https://github.com/apache/airflow/commit/024b4bf962bc30ecb70da9650e68b523a0dbcff8) | 2020-03-10 | [AIRFLOW-7024] Add the verbose parameter support to SparkSqlOperator (#7676) |
|
||||
| [b59042b5a](https://github.com/apache/airflow/commit/b59042b5ab083c77ba08ba804df76b7c728815dc) | 2020-02-28 | [AIRFLOW-6949] Respect explicit `spark.kubernetes.namespace` conf to SparkSubmitOperator (#7575) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,24 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [d76026545](https://github.com/apache/airflow/commit/d7602654526fdd2876466371404784bd17cfe0d2) | 2020-08-25 | PyDocStyle: No whitespaces allowed surrounding docstring text (#10533) |
|
||||
| [d1bce91bb](https://github.com/apache/airflow/commit/d1bce91bb21d5a468fa6a0207156c28fe1ca6513) | 2020-08-25 | PyDocStyle: Enable D403: Capitalized first word of docstring (#10530) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [7c206a82a](https://github.com/apache/airflow/commit/7c206a82a6f074abcc4898a005ecd2c84a920054) | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [1427e4acb](https://github.com/apache/airflow/commit/1427e4acb4a1dc5be28cfeef75c90032d515aab6) | 2020-07-22 | Update Spark submit operator for Spark 3 support (#8730) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [0873070e0](https://github.com/apache/airflow/commit/0873070e08f7216b6949e7de4e2329175a764321) | 2020-07-11 | Mask other forms of password arguments in SparkSubmitOperator (#9615) |
|
||||
| [13a827d80](https://github.com/apache/airflow/commit/13a827d80fef738e25f30ea20c095ad4dbd401f6) | 2020-07-09 | Ensure Kerberos token is valid in SparkSubmitOperator before running `yarn kill` (#9044) |
|
||||
| [067806d59](https://github.com/apache/airflow/commit/067806d5985301f21da78f0a81056dbec348e6ba) | 2020-06-29 | Add tests for spark_jdbc_script (#9491) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,11 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [d305876be](https://github.com/apache/airflow/commit/d305876bee328287ff391a29cc1cd632468cc731) | 2020-10-12 | Remove redundant None provided as default to dict.get() (#11448) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,158 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-apache-spark
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [Moved operators](#moved-operators)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `apache.spark` provider. All classes for this provider package
|
||||
are in `airflow.providers.apache.spark` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-apache-spark`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:--------------|:-------------------|
|
||||
| pyspark | |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `apache.spark` provider
|
||||
are in the `airflow.providers.apache.spark` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
|
||||
|
||||
### Moved operators
|
||||
|
||||
| Airflow 2.0 operators: `airflow.providers.apache.spark` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:-----------------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.spark_jdbc.SparkJDBCOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/spark/operators/spark_jdbc.py) | [contrib.operators.spark_jdbc_operator.SparkJDBCOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/spark_jdbc_operator.py) |
|
||||
| [operators.spark_sql.SparkSqlOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/spark/operators/spark_sql.py) | [contrib.operators.spark_sql_operator.SparkSqlOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/spark_sql_operator.py) |
|
||||
| [operators.spark_submit.SparkSubmitOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/spark/operators/spark_submit.py) | [contrib.operators.spark_submit_operator.SparkSubmitOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/spark_submit_operator.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.apache.spark` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:-----------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.spark_jdbc.SparkJDBCHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/spark/hooks/spark_jdbc.py) | [contrib.hooks.spark_jdbc_hook.SparkJDBCHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/spark_jdbc_hook.py) |
|
||||
| [hooks.spark_sql.SparkSqlHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/spark/hooks/spark_sql.py) | [contrib.hooks.spark_sql_hook.SparkSqlHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/spark_sql_hook.py) |
|
||||
| [hooks.spark_submit.SparkSubmitHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/spark/hooks/spark_submit.py) | [contrib.hooks.spark_submit_hook.SparkSubmitHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/spark_submit_hook.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [d305876be](https://github.com/apache/airflow/commit/d305876bee328287ff391a29cc1cd632468cc731) | 2020-10-12 | Remove redundant None provided as default to dict.get() (#11448) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [d76026545](https://github.com/apache/airflow/commit/d7602654526fdd2876466371404784bd17cfe0d2) | 2020-08-25 | PyDocStyle: No whitespaces allowed surrounding docstring text (#10533) |
|
||||
| [d1bce91bb](https://github.com/apache/airflow/commit/d1bce91bb21d5a468fa6a0207156c28fe1ca6513) | 2020-08-25 | PyDocStyle: Enable D403: Capitalized first word of docstring (#10530) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [7c206a82a](https://github.com/apache/airflow/commit/7c206a82a6f074abcc4898a005ecd2c84a920054) | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [1427e4acb](https://github.com/apache/airflow/commit/1427e4acb4a1dc5be28cfeef75c90032d515aab6) | 2020-07-22 | Update Spark submit operator for Spark 3 support (#8730) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [0873070e0](https://github.com/apache/airflow/commit/0873070e08f7216b6949e7de4e2329175a764321) | 2020-07-11 | Mask other forms of password arguments in SparkSubmitOperator (#9615) |
|
||||
| [13a827d80](https://github.com/apache/airflow/commit/13a827d80fef738e25f30ea20c095ad4dbd401f6) | 2020-07-09 | Ensure Kerberos token is valid in SparkSubmitOperator before running `yarn kill` (#9044) |
|
||||
| [067806d59](https://github.com/apache/airflow/commit/067806d5985301f21da78f0a81056dbec348e6ba) | 2020-06-29 | Add tests for spark_jdbc_script (#9491) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [40bf8f28f](https://github.com/apache/airflow/commit/40bf8f28f97f17f40d993d207ea740eba54593ee) | 2020-06-18 | Detect automatically the lack of reference to the guide in the operator descriptions (#9290) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [7506c73f1](https://github.com/apache/airflow/commit/7506c73f1721151e9c50ef8bdb70d2136a16190b) | 2020-05-10 | Add default `conf` parameter to Spark JDBC Hook (#8787) |
|
||||
| [487b5cc50](https://github.com/apache/airflow/commit/487b5cc50c5b28a045cb12a1527a5453b0a6a7af) | 2020-05-06 | Add guide for Apache Spark operators (#8305) |
|
||||
| [87969a350](https://github.com/apache/airflow/commit/87969a350ddd41e9e77776af6d780b31e363eaca) | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
|
||||
| [be1451b0e](https://github.com/apache/airflow/commit/be1451b0e1b7e33f4621e24649f6a4fa87c34e01) | 2020-04-02 | [AIRFLOW-7026] Improve SparkSqlHook's error message (#7749) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [2327aa5a2](https://github.com/apache/airflow/commit/2327aa5a263f25beeaf4ba79670f10f001daf0bf) | 2020-03-12 | [AIRFLOW-7025] Fix SparkSqlHook.run_query to handle its parameter properly (#7677) |
|
||||
| [024b4bf96](https://github.com/apache/airflow/commit/024b4bf962bc30ecb70da9650e68b523a0dbcff8) | 2020-03-10 | [AIRFLOW-7024] Add the verbose parameter support to SparkSqlOperator (#7676) |
|
||||
| [b59042b5a](https://github.com/apache/airflow/commit/b59042b5ab083c77ba08ba804df76b7c728815dc) | 2020-02-28 | [AIRFLOW-6949] Respect explicit `spark.kubernetes.namespace` conf to SparkSubmitOperator (#7575) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,19 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,15 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,10 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,129 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-apache-sqoop
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [Moved operators](#moved-operators)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `apache.sqoop` provider. All classes for this provider package
|
||||
are in `airflow.providers.apache.sqoop` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-apache-sqoop`
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `apache.sqoop` provider
|
||||
are in the `airflow.providers.apache.sqoop` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
|
||||
|
||||
### Moved operators
|
||||
|
||||
| Airflow 2.0 operators: `airflow.providers.apache.sqoop` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:---------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.sqoop.SqoopOperator](https://github.com/apache/airflow/blob/master/airflow/providers/apache/sqoop/operators/sqoop.py) | [contrib.operators.sqoop_operator.SqoopOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/sqoop_operator.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.apache.sqoop` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:---------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.sqoop.SqoopHook](https://github.com/apache/airflow/blob/master/airflow/providers/apache/sqoop/hooks/sqoop.py) | [contrib.hooks.sqoop_hook.SqoopHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/sqoop_hook.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [3b3287d7a](https://github.com/apache/airflow/commit/3b3287d7acc76430f12b758d52cec61c7f74e726) | 2020-08-05 | Enforce keyword only arguments on apache operators (#10170) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [7e6372a68](https://github.com/apache/airflow/commit/7e6372a681a2a543f4710b083219aeb53b074388) | 2020-03-23 | Add call to Super call in apache providers (#7820) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [0481b9a95](https://github.com/apache/airflow/commit/0481b9a95786a62de4776a735ae80e746583ef2b) | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
|
|
@ -1,17 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [059eda05f](https://github.com/apache/airflow/commit/059eda05f82fefce4410f44f761f945a27d83daf) | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
|
|
@ -1,15 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [24c8e4c2d](https://github.com/apache/airflow/commit/24c8e4c2d6e359ecc2c7d6275dccc68de4a82832) | 2020-08-06 | Changes to all the constructors to remove the args argument (#10163) |
|
||||
| [5bb228d84](https://github.com/apache/airflow/commit/5bb228d841585cd1780c15f6175c6d64cd98aeab) | 2020-07-11 | improve type hinting for celery provider (#9762) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,9 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,122 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-celery
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Sensors](#sensors)
|
||||
- [Moved sensors](#moved-sensors)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `celery` provider. All classes for this provider package
|
||||
are in `airflow.providers.celery` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-celery`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:--------------|:-------------------|
|
||||
| celery | ~=4.4.2 |
|
||||
| flower | >=0.7.3, <1.0 |
|
||||
| vine | ~=1.3 |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `celery` provider
|
||||
are in the `airflow.providers.celery` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Sensors
|
||||
|
||||
|
||||
|
||||
### Moved sensors
|
||||
|
||||
| Airflow 2.0 sensors: `airflow.providers.celery` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:-----------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [sensors.celery_queue.CeleryQueueSensor](https://github.com/apache/airflow/blob/master/airflow/providers/celery/sensors/celery_queue.py) | [contrib.sensors.celery_queue_sensor.CeleryQueueSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/celery_queue_sensor.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [24c8e4c2d](https://github.com/apache/airflow/commit/24c8e4c2d6e359ecc2c7d6275dccc68de4a82832) | 2020-08-06 | Changes to all the constructors to remove the args argument (#10163) |
|
||||
| [5bb228d84](https://github.com/apache/airflow/commit/5bb228d841585cd1780c15f6175c6d64cd98aeab) | 2020-07-11 | improve type hinting for celery provider (#9762) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [059eda05f](https://github.com/apache/airflow/commit/059eda05f82fefce4410f44f761f945a27d83daf) | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
|
|
@ -1,18 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:----------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [5648dfbc3](https://github.com/apache/airflow/commit/5648dfbc300337b10567ef4e07045ea29d33ec06) | 2020-03-23 | Add missing call to Super class in 'amazon', 'cloudant & 'databricks' providers (#7827) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [c42a375e7](https://github.com/apache/airflow/commit/c42a375e799e5adb3f9536616372dc90ff47e6c8) | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
|
|
@ -1,13 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [35fe97225](https://github.com/apache/airflow/commit/35fe97225ee0a29aa350bb6ed805428fd707ab2f) | 2020-07-15 | Improve type hinting to provider cloudant (#9825) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,9 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,119 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-cloudant
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `cloudant` provider. All classes for this provider package
|
||||
are in `airflow.providers.cloudant` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-cloudant`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:--------------|:-------------------|
|
||||
| cloudant | >=2.0 |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `cloudant` provider
|
||||
are in the `airflow.providers.cloudant` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.cloudant` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:--------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.cloudant.CloudantHook](https://github.com/apache/airflow/blob/master/airflow/providers/cloudant/hooks/cloudant.py) | [contrib.hooks.cloudant_hook.CloudantHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/cloudant_hook.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [35fe97225](https://github.com/apache/airflow/commit/35fe97225ee0a29aa350bb6ed805428fd707ab2f) | 2020-07-15 | Improve type hinting to provider cloudant (#9825) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:----------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [5648dfbc3](https://github.com/apache/airflow/commit/5648dfbc300337b10567ef4e07045ea29d33ec06) | 2020-03-23 | Add missing call to Super class in 'amazon', 'cloudant & 'databricks' providers (#7827) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [c42a375e7](https://github.com/apache/airflow/commit/c42a375e799e5adb3f9536616372dc90ff47e6c8) | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
|
|
@ -1,24 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
## Additional limitations
|
||||
|
||||
This provider is only usable with Apache Airflow >= 1.10.12 version due to refactorings implemented in
|
||||
Apache Airflow 1.10.11 and fixes implemented in 1.10.11. The package has appropriate requirements
|
||||
set so you should not be able to install it with Apache Airflow < 1.10.12.
|
|
@ -1,62 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [a888198c2](https://github.com/apache/airflow/commit/a888198c27bcdbc4538c02360c308ffcaca182fa) | 2020-09-27 | Allow overrides for pod_template_file (#11162) |
|
||||
| [0161b5ea2](https://github.com/apache/airflow/commit/0161b5ea2b805d62a0317e5cab6f797b92c8abf1) | 2020-09-26 | Increasing type coverage for multiple provider (#11159) |
|
||||
| [e3f96ce7a](https://github.com/apache/airflow/commit/e3f96ce7a8ac098aeef5e9930e6de6c428274d57) | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [b61225a88](https://github.com/apache/airflow/commit/b61225a8850b20be17842c2428b91d873584c4da) | 2020-09-21 | Add D204 pydocstyle check (#11031) |
|
||||
| [cba51d49e](https://github.com/apache/airflow/commit/cba51d49eea6a0563044191c8111978836d697ef) | 2020-09-17 | Simplify the K8sExecutor and K8sPodOperator (#10393) |
|
||||
| [1294e15d4](https://github.com/apache/airflow/commit/1294e15d44c08498e7f1022fdd6f0bc5e50e533f) | 2020-09-16 | KubernetesPodOperator template fix (#10963) |
|
||||
| [5d6d5a2f7](https://github.com/apache/airflow/commit/5d6d5a2f7d330c83297e1dc35728a0ba803aa866) | 2020-09-14 | Allow to specify path to kubeconfig in KubernetesHook (#10453) |
|
||||
| [7edfac957](https://github.com/apache/airflow/commit/7edfac957bc17c9abcdcfe8d524772bd2783ac5a) | 2020-09-09 | Add connection caching to KubernetesHook (#10447) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [90c150568](https://github.com/apache/airflow/commit/90c1505686b063332dba87c0c948a8b29d8fd1d4) | 2020-09-04 | Make grace_period_seconds option on K8sPodOperator (#10727) |
|
||||
| [338b412c0](https://github.com/apache/airflow/commit/338b412c04abc3fef8126f9724b448d1a9fd0bbc) | 2020-09-02 | Add on_kill support for the KubernetesPodOperator (#10666) |
|
||||
| [596bc1337](https://github.com/apache/airflow/commit/596bc1337988f9377571295ddb748ef8703c19c0) | 2020-08-31 | Adds 'cncf.kubernetes' package back to backport provider packages. (#10659) |
|
||||
| [1e5aa4465](https://github.com/apache/airflow/commit/1e5aa4465c5ef8f05745bda64da62fe542f2fe28) | 2020-08-26 | Spark-on-K8S sensor - add driver logs (#10023) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [2f2d8dbfa](https://github.com/apache/airflow/commit/2f2d8dbfafefb4be3dd80f22f31c649c8498f148) | 2020-08-25 | Remove all "noinspection" comments native to IntelliJ (#10525) |
|
||||
| [7c206a82a](https://github.com/apache/airflow/commit/7c206a82a6f074abcc4898a005ecd2c84a920054) | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
|
||||
| [8cd2be9e1](https://github.com/apache/airflow/commit/8cd2be9e161635480581a0dc723b69ed24166f8d) | 2020-08-11 | Fix KubernetesPodOperator reattachment (#10230) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [24c8e4c2d](https://github.com/apache/airflow/commit/24c8e4c2d6e359ecc2c7d6275dccc68de4a82832) | 2020-08-06 | Changes to all the constructors to remove the args argument (#10163) |
|
||||
| [aeea71274](https://github.com/apache/airflow/commit/aeea71274d4527ff2351102e94aa38bda6099e7f) | 2020-08-02 | Remove `args` parameter from provider operator constructors (#10097) |
|
||||
| [f1fd3e2c4](https://github.com/apache/airflow/commit/f1fd3e2c453ddce3e87ce63787598fea0707ffcf) | 2020-07-31 | Fix typo on reattach property of kubernetespodoperator (#10056) |
|
||||
| [03c435174](https://github.com/apache/airflow/commit/03c43517445019081c55b4ac5fad3b0debdee336) | 2020-07-31 | Allow `image` in `KubernetesPodOperator` to be templated (#10068) |
|
||||
| [88c160306](https://github.com/apache/airflow/commit/88c1603060fd484d4145bc253c0dc0e6797e13dd) | 2020-07-31 | Improve docstring note about GKEStartPodOperator on KubernetesPodOperator (#10049) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [c2db0dfeb](https://github.com/apache/airflow/commit/c2db0dfeb13ee679bf4d7b57874f0fcb39c0f0ed) | 2020-07-22 | More strict rules in mypy (#9705) (#9906) |
|
||||
| [719ae2bf6](https://github.com/apache/airflow/commit/719ae2bf6227894c3e926f717eb4dc669549d615) | 2020-07-22 | Dump Pod as YAML in logs for KubernetesPodOperator (#9895) |
|
||||
| [840799d55](https://github.com/apache/airflow/commit/840799d5597f0d005e1deec154f6c95bad6dce61) | 2020-07-20 | Improve KubernetesPodOperator guide (#9079) |
|
||||
| [44d4ae809](https://github.com/apache/airflow/commit/44d4ae809c1e3784ff95b6a5e95113c3412e56b3) | 2020-07-06 | Upgrade to latest pre-commit checks (#9686) |
|
||||
| [8bd15ef63](https://github.com/apache/airflow/commit/8bd15ef634cca40f3cf6ca3442262f3e05144512) | 2020-07-01 | Switches to Helm Chart for Kubernetes tests (#9468) |
|
||||
| [40bf8f28f](https://github.com/apache/airflow/commit/40bf8f28f97f17f40d993d207ea740eba54593ee) | 2020-06-18 | Detect automatically the lack of reference to the guide in the operator descriptions (#9290) |
|
||||
| [1d36b0303](https://github.com/apache/airflow/commit/1d36b0303b8632fce6de78ca4e782ae26ee06fea) | 2020-05-23 | Fix references in docs (#8984) |
|
||||
| [e742ef7c7](https://github.com/apache/airflow/commit/e742ef7c704c18bf69b7a7235adb7f75e742f902) | 2020-05-23 | Fix typo in test_project_structure (#8978) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [8985df0bf](https://github.com/apache/airflow/commit/8985df0bfcb5f2b2cd69a21b9814021f9f8ce953) | 2020-05-16 | Monitor pods by labels instead of names (#6377) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [f82ad452b](https://github.com/apache/airflow/commit/f82ad452b0f4ebd1428bc9669641a632dc87bb8c) | 2020-05-15 | Fix KubernetesPodOperator pod name length validation (#8829) |
|
||||
| [1ccafc617](https://github.com/apache/airflow/commit/1ccafc617c4cb9622e3460ad7c190f3ee67c3b32) | 2020-04-02 | Add spark_kubernetes system test (#7875) |
|
||||
| [cd546b664](https://github.com/apache/airflow/commit/cd546b664fa35a2bf85acd77af578c909a327d92) | 2020-03-23 | Add missing call to Super class in 'cncf' & 'docker' providers (#7825) |
|
||||
| [6c39a3bf9](https://github.com/apache/airflow/commit/6c39a3bf97414ba2438669894db65c36ccbeb61a) | 2020-03-10 | [AIRFLOW-6542] Add spark-on-k8s operator/hook/sensor (#7163) |
|
||||
| [42eef3821](https://github.com/apache/airflow/commit/42eef38217e709bc7a7f71bf0286e9e61293a43e) | 2020-03-07 | [AIRFLOW-6877] Add cross-provider dependencies as extras (#7506) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [0ec277412](https://github.com/apache/airflow/commit/0ec2774120d43fa667a371b384e6006e1d1c7821) | 2020-02-24 | [AIRFLOW-5629] Implement Kubernetes priorityClassName in KubernetesPodOperator (#7395) |
|
||||
| [9cbd7de6d](https://github.com/apache/airflow/commit/9cbd7de6d115795aba8bfb8addb060bfdfbdf87b) | 2020-02-18 | [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412) |
|
||||
| [967930c0c](https://github.com/apache/airflow/commit/967930c0cb6e2293f2a49e5c9add5aa1917f3527) | 2020-02-11 | [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file (#6230) |
|
||||
| [96f834389](https://github.com/apache/airflow/commit/96f834389e03884025534fabd862155061f53fd0) | 2020-02-03 | [AIRFLOW-6678] Pull event logs from Kubernetes (#7292) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [cf141506a](https://github.com/apache/airflow/commit/cf141506a25dbba279b85500d781f7e056540721) | 2020-02-02 | [AIRFLOW-6708] Set unique logger names (#7330) |
|
||||
| [373c6aa4a](https://github.com/apache/airflow/commit/373c6aa4a208284b5ff72987e4bd8f4e2ada1a1b) | 2020-01-30 | [AIRFLOW-6682] Move GCP classes to providers package (#7295) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [059eda05f](https://github.com/apache/airflow/commit/059eda05f82fefce4410f44f761f945a27d83daf) | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
|
|
@ -1,16 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [53e606210](https://github.com/apache/airflow/commit/53e6062105be0ae1761a354e2055eb0779d12e73) | 2020-10-21 | Enforce strict rules for yamllint (#11709) |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [eee4e30f2](https://github.com/apache/airflow/commit/eee4e30f2caf02e16088ff5d1af1ea380a73e982) | 2020-10-15 | Add better debug logging to K8sexec and K8sPodOp (#11502) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [8640fb6c1](https://github.com/apache/airflow/commit/8640fb6c100a2c6aa231798559ba194331576975) | 2020-10-09 | fix tests (#11368) |
|
||||
| [298052fce](https://github.com/apache/airflow/commit/298052fcee9d30b1f60b8dc1c9006398cd16645e) | 2020-10-10 | [airflow/providers/cncf/kubernetes] correct hook methods name (#11008) |
|
||||
| [49aad025b](https://github.com/apache/airflow/commit/49aad025b53211a5815b10aa35f7d7b489cb5316) | 2020-10-09 | Users can specify sub-secrets and paths k8spodop (#11369) |
|
||||
| [b93b6c5be](https://github.com/apache/airflow/commit/b93b6c5be3ab60960f650d0d4ee6c91271ac7909) | 2020-10-05 | Allow labels in KubernetesPodOperator to be templated (#10796) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,23 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.11.23
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [4873d9759](https://github.com/apache/airflow/commit/4873d9759dfdec1dd3663074f9e64ad69fa881cc) | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) |
|
||||
| [763b40d22](https://github.com/apache/airflow/commit/763b40d223e5e5512494a97f8335e16960e6adc3) | 2020-11-18 | Raise correct Warning in kubernetes/backcompat/volume_mount.py (#12432) |
|
||||
| [bc4bb3058](https://github.com/apache/airflow/commit/bc4bb30588607b10b069ab63ddf2ba7b7ee673ed) | 2020-11-18 | Fix docstrings for Kubernetes Backcompat module (#12422) |
|
||||
| [cab86d80d](https://github.com/apache/airflow/commit/cab86d80d48227849906319917126f6d558b2e00) | 2020-11-17 | Make K8sPodOperator backwards compatible (#12384) |
|
||||
| [ae7cb4a1e](https://github.com/apache/airflow/commit/ae7cb4a1e2a96351f1976cf5832615e24863e05d) | 2020-11-17 | Update wrong commit hash in backport provider changes (#12390) |
|
||||
| [6889a333c](https://github.com/apache/airflow/commit/6889a333cff001727eb0a66e375544a28c9a5f03) | 2020-11-15 | Improvements for operators and hooks ref docs (#12366) |
|
||||
| [221f809c1](https://github.com/apache/airflow/commit/221f809c1b4e4b78d5a437d012aa7daffd8410a4) | 2020-11-14 | Fix full_pod_spec for k8spodoperator (#12354) |
|
||||
| [7825e8f59](https://github.com/apache/airflow/commit/7825e8f59034645ab3247229be83a3aa90baece1) | 2020-11-13 | Docs installation improvements (#12304) |
|
||||
| [85a18e13d](https://github.com/apache/airflow/commit/85a18e13d9dec84275283ff69e34704b60d54a75) | 2020-11-09 | Point at pypi project pages for cross-dependency of provider packages (#12212) |
|
||||
| [59eb5de78](https://github.com/apache/airflow/commit/59eb5de78c70ee9c7ae6e4cba5c7a2babb8103ca) | 2020-11-09 | Update provider READMEs for up-coming 1.0.0beta1 releases (#12206) |
|
||||
| [3f59e75cd](https://github.com/apache/airflow/commit/3f59e75cdf4a95829ac60b151135e03267e63a12) | 2020-11-09 | KubernetesPodOperator: use randomized name to get the failure status (#12171) |
|
||||
| [b2a28d159](https://github.com/apache/airflow/commit/b2a28d1590410630d66966aa1f2b2a049a8c3b32) | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
|
||||
| [7825be50d](https://github.com/apache/airflow/commit/7825be50d80d04da0db8fcee55df5e1339864c88) | 2020-11-05 | Randomize pod name (#12117) |
|
||||
| [91a64db50](https://github.com/apache/airflow/commit/91a64db505e50712cd53928b4f2b84aece3cc1c0) | 2020-11-04 | Format all files (without excepions) by black (#12091) |
|
||||
| [4e8f9cc8d](https://github.com/apache/airflow/commit/4e8f9cc8d02b29c325b8a5a76b4837671bdf5f68) | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
|
||||
| [8c42cf1b0](https://github.com/apache/airflow/commit/8c42cf1b00c90f0d7f11b8a3a455381de8e003c5) | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
|
||||
| [5a439e84e](https://github.com/apache/airflow/commit/5a439e84eb6c0544dc6c3d6a9f4ceeb2172cd5d0) | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
|
|
@ -1,220 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-cncf-kubernetes
|
||||
|
||||
Release: 2020.11.23
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [New operators](#new-operators)
|
||||
- [Moved operators](#moved-operators)
|
||||
- [Sensors](#sensors)
|
||||
- [New sensors](#new-sensors)
|
||||
- [Hooks](#hooks)
|
||||
- [New hooks](#new-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.11.23](#release-20201123)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `cncf.kubernetes` provider. All classes for this provider package
|
||||
are in `airflow.providers.cncf.kubernetes` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
## Additional limitations
|
||||
|
||||
This provider is only usable with Apache Airflow >= 1.10.12 version due to refactorings implemented in
|
||||
Apache Airflow 1.10.11 and fixes implemented in 1.10.11. The package has appropriate requirements
|
||||
set so you should not be able to install it with Apache Airflow < 1.10.12.
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-cncf-kubernetes`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:--------------|:-------------------|
|
||||
| cryptography | >=2.0.0 |
|
||||
| kubernetes | >=3.0.0, <12.0.0 |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `cncf.kubernetes` provider
|
||||
are in the `airflow.providers.cncf.kubernetes` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
|
||||
### New operators
|
||||
|
||||
| New Airflow 2.0 operators: `airflow.providers.cncf.kubernetes` package |
|
||||
|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.spark_kubernetes.SparkKubernetesOperator](https://github.com/apache/airflow/blob/master/airflow/providers/cncf/kubernetes/operators/spark_kubernetes.py) |
|
||||
|
||||
|
||||
### Moved operators
|
||||
|
||||
| Airflow 2.0 operators: `airflow.providers.cncf.kubernetes` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:--------------------------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.kubernetes_pod.KubernetesPodOperator](https://github.com/apache/airflow/blob/master/airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py) | [contrib.operators.kubernetes_pod_operator.KubernetesPodOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/kubernetes_pod_operator.py) |
|
||||
|
||||
|
||||
## Sensors
|
||||
|
||||
|
||||
### New sensors
|
||||
|
||||
| New Airflow 2.0 sensors: `airflow.providers.cncf.kubernetes` package |
|
||||
|:--------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [sensors.spark_kubernetes.SparkKubernetesSensor](https://github.com/apache/airflow/blob/master/airflow/providers/cncf/kubernetes/sensors/spark_kubernetes.py) |
|
||||
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
### New hooks
|
||||
|
||||
| New Airflow 2.0 hooks: `airflow.providers.cncf.kubernetes` package |
|
||||
|:---------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.kubernetes.KubernetesHook](https://github.com/apache/airflow/blob/master/airflow/providers/cncf/kubernetes/hooks/kubernetes.py) |
|
||||
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.11.23
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [4873d9759](https://github.com/apache/airflow/commit/4873d9759dfdec1dd3663074f9e64ad69fa881cc) | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) |
|
||||
| [763b40d22](https://github.com/apache/airflow/commit/763b40d223e5e5512494a97f8335e16960e6adc3) | 2020-11-18 | Raise correct Warning in kubernetes/backcompat/volume_mount.py (#12432) |
|
||||
| [bc4bb3058](https://github.com/apache/airflow/commit/bc4bb30588607b10b069ab63ddf2ba7b7ee673ed) | 2020-11-18 | Fix docstrings for Kubernetes Backcompat module (#12422) |
|
||||
| [cab86d80d](https://github.com/apache/airflow/commit/cab86d80d48227849906319917126f6d558b2e00) | 2020-11-17 | Make K8sPodOperator backwards compatible (#12384) |
|
||||
| [ae7cb4a1e](https://github.com/apache/airflow/commit/ae7cb4a1e2a96351f1976cf5832615e24863e05d) | 2020-11-17 | Update wrong commit hash in backport provider changes (#12390) |
|
||||
| [6889a333c](https://github.com/apache/airflow/commit/6889a333cff001727eb0a66e375544a28c9a5f03) | 2020-11-15 | Improvements for operators and hooks ref docs (#12366) |
|
||||
| [221f809c1](https://github.com/apache/airflow/commit/221f809c1b4e4b78d5a437d012aa7daffd8410a4) | 2020-11-14 | Fix full_pod_spec for k8spodoperator (#12354) |
|
||||
| [7825e8f59](https://github.com/apache/airflow/commit/7825e8f59034645ab3247229be83a3aa90baece1) | 2020-11-13 | Docs installation improvements (#12304) |
|
||||
| [85a18e13d](https://github.com/apache/airflow/commit/85a18e13d9dec84275283ff69e34704b60d54a75) | 2020-11-09 | Point at pypi project pages for cross-dependency of provider packages (#12212) |
|
||||
| [59eb5de78](https://github.com/apache/airflow/commit/59eb5de78c70ee9c7ae6e4cba5c7a2babb8103ca) | 2020-11-09 | Update provider READMEs for up-coming 1.0.0beta1 releases (#12206) |
|
||||
| [3f59e75cd](https://github.com/apache/airflow/commit/3f59e75cdf4a95829ac60b151135e03267e63a12) | 2020-11-09 | KubernetesPodOperator: use randomized name to get the failure status (#12171) |
|
||||
| [b2a28d159](https://github.com/apache/airflow/commit/b2a28d1590410630d66966aa1f2b2a049a8c3b32) | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
|
||||
| [7825be50d](https://github.com/apache/airflow/commit/7825be50d80d04da0db8fcee55df5e1339864c88) | 2020-11-05 | Randomize pod name (#12117) |
|
||||
| [91a64db50](https://github.com/apache/airflow/commit/91a64db505e50712cd53928b4f2b84aece3cc1c0) | 2020-11-04 | Format all files (without excepions) by black (#12091) |
|
||||
| [4e8f9cc8d](https://github.com/apache/airflow/commit/4e8f9cc8d02b29c325b8a5a76b4837671bdf5f68) | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
|
||||
| [8c42cf1b0](https://github.com/apache/airflow/commit/8c42cf1b00c90f0d7f11b8a3a455381de8e003c5) | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
|
||||
| [5a439e84e](https://github.com/apache/airflow/commit/5a439e84eb6c0544dc6c3d6a9f4ceeb2172cd5d0) | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
|
||||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-----------------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [53e606210](https://github.com/apache/airflow/commit/53e6062105be0ae1761a354e2055eb0779d12e73) | 2020-10-21 | Enforce strict rules for yamllint (#11709) |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [eee4e30f2](https://github.com/apache/airflow/commit/eee4e30f2caf02e16088ff5d1af1ea380a73e982) | 2020-10-15 | Add better debug logging to K8sexec and K8sPodOp (#11502) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [8640fb6c1](https://github.com/apache/airflow/commit/8640fb6c100a2c6aa231798559ba194331576975) | 2020-10-09 | fix tests (#11368) |
|
||||
| [298052fce](https://github.com/apache/airflow/commit/298052fcee9d30b1f60b8dc1c9006398cd16645e) | 2020-10-10 | [airflow/providers/cncf/kubernetes] correct hook methods name (#11008) |
|
||||
| [49aad025b](https://github.com/apache/airflow/commit/49aad025b53211a5815b10aa35f7d7b489cb5316) | 2020-10-09 | Users can specify sub-secrets and paths k8spodop (#11369) |
|
||||
| [b93b6c5be](https://github.com/apache/airflow/commit/b93b6c5be3ab60960f650d0d4ee6c91271ac7909) | 2020-10-05 | Allow labels in KubernetesPodOperator to be templated (#10796) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [a888198c2](https://github.com/apache/airflow/commit/a888198c27bcdbc4538c02360c308ffcaca182fa) | 2020-09-27 | Allow overrides for pod_template_file (#11162) |
|
||||
| [0161b5ea2](https://github.com/apache/airflow/commit/0161b5ea2b805d62a0317e5cab6f797b92c8abf1) | 2020-09-26 | Increasing type coverage for multiple provider (#11159) |
|
||||
| [e3f96ce7a](https://github.com/apache/airflow/commit/e3f96ce7a8ac098aeef5e9930e6de6c428274d57) | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [b61225a88](https://github.com/apache/airflow/commit/b61225a8850b20be17842c2428b91d873584c4da) | 2020-09-21 | Add D204 pydocstyle check (#11031) |
|
||||
| [cba51d49e](https://github.com/apache/airflow/commit/cba51d49eea6a0563044191c8111978836d697ef) | 2020-09-17 | Simplify the K8sExecutor and K8sPodOperator (#10393) |
|
||||
| [1294e15d4](https://github.com/apache/airflow/commit/1294e15d44c08498e7f1022fdd6f0bc5e50e533f) | 2020-09-16 | KubernetesPodOperator template fix (#10963) |
|
||||
| [5d6d5a2f7](https://github.com/apache/airflow/commit/5d6d5a2f7d330c83297e1dc35728a0ba803aa866) | 2020-09-14 | Allow to specify path to kubeconfig in KubernetesHook (#10453) |
|
||||
| [7edfac957](https://github.com/apache/airflow/commit/7edfac957bc17c9abcdcfe8d524772bd2783ac5a) | 2020-09-09 | Add connection caching to KubernetesHook (#10447) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [90c150568](https://github.com/apache/airflow/commit/90c1505686b063332dba87c0c948a8b29d8fd1d4) | 2020-09-04 | Make grace_period_seconds option on K8sPodOperator (#10727) |
|
||||
| [338b412c0](https://github.com/apache/airflow/commit/338b412c04abc3fef8126f9724b448d1a9fd0bbc) | 2020-09-02 | Add on_kill support for the KubernetesPodOperator (#10666) |
|
||||
| [596bc1337](https://github.com/apache/airflow/commit/596bc1337988f9377571295ddb748ef8703c19c0) | 2020-08-31 | Adds 'cncf.kubernetes' package back to backport provider packages. (#10659) |
|
||||
| [1e5aa4465](https://github.com/apache/airflow/commit/1e5aa4465c5ef8f05745bda64da62fe542f2fe28) | 2020-08-26 | Spark-on-K8S sensor - add driver logs (#10023) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [2f2d8dbfa](https://github.com/apache/airflow/commit/2f2d8dbfafefb4be3dd80f22f31c649c8498f148) | 2020-08-25 | Remove all "noinspection" comments native to IntelliJ (#10525) |
|
||||
| [7c206a82a](https://github.com/apache/airflow/commit/7c206a82a6f074abcc4898a005ecd2c84a920054) | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
|
||||
| [8cd2be9e1](https://github.com/apache/airflow/commit/8cd2be9e161635480581a0dc723b69ed24166f8d) | 2020-08-11 | Fix KubernetesPodOperator reattachment (#10230) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [24c8e4c2d](https://github.com/apache/airflow/commit/24c8e4c2d6e359ecc2c7d6275dccc68de4a82832) | 2020-08-06 | Changes to all the constructors to remove the args argument (#10163) |
|
||||
| [aeea71274](https://github.com/apache/airflow/commit/aeea71274d4527ff2351102e94aa38bda6099e7f) | 2020-08-02 | Remove `args` parameter from provider operator constructors (#10097) |
|
||||
| [f1fd3e2c4](https://github.com/apache/airflow/commit/f1fd3e2c453ddce3e87ce63787598fea0707ffcf) | 2020-07-31 | Fix typo on reattach property of kubernetespodoperator (#10056) |
|
||||
| [03c435174](https://github.com/apache/airflow/commit/03c43517445019081c55b4ac5fad3b0debdee336) | 2020-07-31 | Allow `image` in `KubernetesPodOperator` to be templated (#10068) |
|
||||
| [88c160306](https://github.com/apache/airflow/commit/88c1603060fd484d4145bc253c0dc0e6797e13dd) | 2020-07-31 | Improve docstring note about GKEStartPodOperator on KubernetesPodOperator (#10049) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [c2db0dfeb](https://github.com/apache/airflow/commit/c2db0dfeb13ee679bf4d7b57874f0fcb39c0f0ed) | 2020-07-22 | More strict rules in mypy (#9705) (#9906) |
|
||||
| [719ae2bf6](https://github.com/apache/airflow/commit/719ae2bf6227894c3e926f717eb4dc669549d615) | 2020-07-22 | Dump Pod as YAML in logs for KubernetesPodOperator (#9895) |
|
||||
| [840799d55](https://github.com/apache/airflow/commit/840799d5597f0d005e1deec154f6c95bad6dce61) | 2020-07-20 | Improve KubernetesPodOperator guide (#9079) |
|
||||
| [44d4ae809](https://github.com/apache/airflow/commit/44d4ae809c1e3784ff95b6a5e95113c3412e56b3) | 2020-07-06 | Upgrade to latest pre-commit checks (#9686) |
|
||||
| [8bd15ef63](https://github.com/apache/airflow/commit/8bd15ef634cca40f3cf6ca3442262f3e05144512) | 2020-07-01 | Switches to Helm Chart for Kubernetes tests (#9468) |
|
||||
| [40bf8f28f](https://github.com/apache/airflow/commit/40bf8f28f97f17f40d993d207ea740eba54593ee) | 2020-06-18 | Detect automatically the lack of reference to the guide in the operator descriptions (#9290) |
|
||||
| [1d36b0303](https://github.com/apache/airflow/commit/1d36b0303b8632fce6de78ca4e782ae26ee06fea) | 2020-05-23 | Fix references in docs (#8984) |
|
||||
| [e742ef7c7](https://github.com/apache/airflow/commit/e742ef7c704c18bf69b7a7235adb7f75e742f902) | 2020-05-23 | Fix typo in test_project_structure (#8978) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [8985df0bf](https://github.com/apache/airflow/commit/8985df0bfcb5f2b2cd69a21b9814021f9f8ce953) | 2020-05-16 | Monitor pods by labels instead of names (#6377) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [f82ad452b](https://github.com/apache/airflow/commit/f82ad452b0f4ebd1428bc9669641a632dc87bb8c) | 2020-05-15 | Fix KubernetesPodOperator pod name length validation (#8829) |
|
||||
| [1ccafc617](https://github.com/apache/airflow/commit/1ccafc617c4cb9622e3460ad7c190f3ee67c3b32) | 2020-04-02 | Add spark_kubernetes system test (#7875) |
|
||||
| [cd546b664](https://github.com/apache/airflow/commit/cd546b664fa35a2bf85acd77af578c909a327d92) | 2020-03-23 | Add missing call to Super class in 'cncf' & 'docker' providers (#7825) |
|
||||
| [6c39a3bf9](https://github.com/apache/airflow/commit/6c39a3bf97414ba2438669894db65c36ccbeb61a) | 2020-03-10 | [AIRFLOW-6542] Add spark-on-k8s operator/hook/sensor (#7163) |
|
||||
| [42eef3821](https://github.com/apache/airflow/commit/42eef38217e709bc7a7f71bf0286e9e61293a43e) | 2020-03-07 | [AIRFLOW-6877] Add cross-provider dependencies as extras (#7506) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [0ec277412](https://github.com/apache/airflow/commit/0ec2774120d43fa667a371b384e6006e1d1c7821) | 2020-02-24 | [AIRFLOW-5629] Implement Kubernetes priorityClassName in KubernetesPodOperator (#7395) |
|
||||
| [9cbd7de6d](https://github.com/apache/airflow/commit/9cbd7de6d115795aba8bfb8addb060bfdfbdf87b) | 2020-02-18 | [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412) |
|
||||
| [967930c0c](https://github.com/apache/airflow/commit/967930c0cb6e2293f2a49e5c9add5aa1917f3527) | 2020-02-11 | [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file (#6230) |
|
||||
| [96f834389](https://github.com/apache/airflow/commit/96f834389e03884025534fabd862155061f53fd0) | 2020-02-03 | [AIRFLOW-6678] Pull event logs from Kubernetes (#7292) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [cf141506a](https://github.com/apache/airflow/commit/cf141506a25dbba279b85500d781f7e056540721) | 2020-02-02 | [AIRFLOW-6708] Set unique logger names (#7330) |
|
||||
| [373c6aa4a](https://github.com/apache/airflow/commit/373c6aa4a208284b5ff72987e4bd8f4e2ada1a1b) | 2020-01-30 | [AIRFLOW-6682] Move GCP classes to providers package (#7295) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [059eda05f](https://github.com/apache/airflow/commit/059eda05f82fefce4410f44f761f945a27d83daf) | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
|
|
@ -1,24 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [f1073381e](https://github.com/apache/airflow/commit/f1073381ed764a218b2502d15ca28a5b326f9f2d) | 2020-05-22 | Add support for spark python and submit tasks in Databricks operator(#8846) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [649935e8c](https://github.com/apache/airflow/commit/649935e8ce906759fdd08884ab1e3db0a03f6953) | 2020-04-27 | [AIRFLOW-8472]: `PATCH` for Databricks hook `_do_api_call` (#8473) |
|
||||
| [16903ba3a](https://github.com/apache/airflow/commit/16903ba3a6ee5e61f1c6b5d17a8c6cf3c3a9a7f6) | 2020-04-24 | [AIRFLOW-8474]: Adding possibility to get job_id from Databricks run (#8475) |
|
||||
| [5648dfbc3](https://github.com/apache/airflow/commit/5648dfbc300337b10567ef4e07045ea29d33ec06) | 2020-03-23 | Add missing call to Super class in 'amazon', 'cloudant & 'databricks' providers (#7827) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [4d03e33c1](https://github.com/apache/airflow/commit/4d03e33c115018e30fa413c42b16212481ad25cc) | 2020-02-22 | [AIRFLOW-6817] remove imports from `airflow/__init__.py`, replaced implicit imports with explicit imports, added entry to `UPDATING.MD` - squashed/rebased (#7456) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [c42a375e7](https://github.com/apache/airflow/commit/c42a375e799e5adb3f9536616372dc90ff47e6c8) | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
|
|
@ -1,20 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:----------------------------------------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [54353f874](https://github.com/apache/airflow/commit/54353f874589f9be236458995147d13e0e763ffc) | 2020-09-27 | Increase type coverage for five different providers (#11170) |
|
||||
| [966a06d96](https://github.com/apache/airflow/commit/966a06d96bbfe330f1d2825f7b7eaa16d43b7a00) | 2020-09-18 | Fetching databricks host from connection if not supplied in extras. (#10762) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [bfefcce0c](https://github.com/apache/airflow/commit/bfefcce0c9f273042dd79ff50eb9af032ecacf59) | 2020-08-25 | Updated REST API call so GET requests pass payload in query string instead of request body (#10462) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [2f2d8dbfa](https://github.com/apache/airflow/commit/2f2d8dbfafefb4be3dd80f22f31c649c8498f148) | 2020-08-25 | Remove all "noinspection" comments native to IntelliJ (#10525) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [e13a14c87](https://github.com/apache/airflow/commit/e13a14c8730f4f633d996dd7d3468fe827136a84) | 2020-06-21 | Enable & Fix Whitespace related PyDocStyle Checks (#9458) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,10 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,18 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.11.23
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [4873d9759](https://github.com/apache/airflow/commit/4873d9759dfdec1dd3663074f9e64ad69fa881cc) | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) |
|
||||
| [ae7cb4a1e](https://github.com/apache/airflow/commit/ae7cb4a1e2a96351f1976cf5832615e24863e05d) | 2020-11-17 | Update wrong commit hash in backport provider changes (#12390) |
|
||||
| [6889a333c](https://github.com/apache/airflow/commit/6889a333cff001727eb0a66e375544a28c9a5f03) | 2020-11-15 | Improvements for operators and hooks ref docs (#12366) |
|
||||
| [7825e8f59](https://github.com/apache/airflow/commit/7825e8f59034645ab3247229be83a3aa90baece1) | 2020-11-13 | Docs installation improvements (#12304) |
|
||||
| [b02722313](https://github.com/apache/airflow/commit/b0272231320a4975cc39968dec8f0abf7a5cca11) | 2020-11-13 | Add install/uninstall api to databricks hook (#12316) |
|
||||
| [85a18e13d](https://github.com/apache/airflow/commit/85a18e13d9dec84275283ff69e34704b60d54a75) | 2020-11-09 | Point at pypi project pages for cross-dependency of provider packages (#12212) |
|
||||
| [59eb5de78](https://github.com/apache/airflow/commit/59eb5de78c70ee9c7ae6e4cba5c7a2babb8103ca) | 2020-11-09 | Update provider READMEs for up-coming 1.0.0beta1 releases (#12206) |
|
||||
| [b2a28d159](https://github.com/apache/airflow/commit/b2a28d1590410630d66966aa1f2b2a049a8c3b32) | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
|
||||
| [7e0d08e1f](https://github.com/apache/airflow/commit/7e0d08e1f074871307f0eb9e9ae7a66f7ce67626) | 2020-11-09 | Add how-to Guide for Databricks operators (#12175) |
|
||||
| [4e8f9cc8d](https://github.com/apache/airflow/commit/4e8f9cc8d02b29c325b8a5a76b4837671bdf5f68) | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
|
||||
| [8c42cf1b0](https://github.com/apache/airflow/commit/8c42cf1b00c90f0d7f11b8a3a455381de8e003c5) | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
|
||||
| [5a439e84e](https://github.com/apache/airflow/commit/5a439e84eb6c0544dc6c3d6a9f4ceeb2172cd5d0) | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
|
|
@ -1,166 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-databricks
|
||||
|
||||
Release: 2020.11.23
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [Moved operators](#moved-operators)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.11.23](#release-20201123)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `databricks` provider. All classes for this provider package
|
||||
are in `airflow.providers.databricks` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-databricks`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:--------------|:-------------------|
|
||||
| requests | >=2.20.0, <3 |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `databricks` provider
|
||||
are in the `airflow.providers.databricks` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
|
||||
|
||||
### Moved operators
|
||||
|
||||
| Airflow 2.0 operators: `airflow.providers.databricks` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:-------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.databricks.DatabricksRunNowOperator](https://github.com/apache/airflow/blob/master/airflow/providers/databricks/operators/databricks.py) | [contrib.operators.databricks_operator.DatabricksRunNowOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/databricks_operator.py) |
|
||||
| [operators.databricks.DatabricksSubmitRunOperator](https://github.com/apache/airflow/blob/master/airflow/providers/databricks/operators/databricks.py) | [contrib.operators.databricks_operator.DatabricksSubmitRunOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/databricks_operator.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.databricks` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:----------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.databricks.DatabricksHook](https://github.com/apache/airflow/blob/master/airflow/providers/databricks/hooks/databricks.py) | [contrib.hooks.databricks_hook.DatabricksHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/databricks_hook.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.11.23
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------|
|
||||
| [4873d9759](https://github.com/apache/airflow/commit/4873d9759dfdec1dd3663074f9e64ad69fa881cc) | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) |
|
||||
| [ae7cb4a1e](https://github.com/apache/airflow/commit/ae7cb4a1e2a96351f1976cf5832615e24863e05d) | 2020-11-17 | Update wrong commit hash in backport provider changes (#12390) |
|
||||
| [6889a333c](https://github.com/apache/airflow/commit/6889a333cff001727eb0a66e375544a28c9a5f03) | 2020-11-15 | Improvements for operators and hooks ref docs (#12366) |
|
||||
| [7825e8f59](https://github.com/apache/airflow/commit/7825e8f59034645ab3247229be83a3aa90baece1) | 2020-11-13 | Docs installation improvements (#12304) |
|
||||
| [b02722313](https://github.com/apache/airflow/commit/b0272231320a4975cc39968dec8f0abf7a5cca11) | 2020-11-13 | Add install/uninstall api to databricks hook (#12316) |
|
||||
| [85a18e13d](https://github.com/apache/airflow/commit/85a18e13d9dec84275283ff69e34704b60d54a75) | 2020-11-09 | Point at pypi project pages for cross-dependency of provider packages (#12212) |
|
||||
| [59eb5de78](https://github.com/apache/airflow/commit/59eb5de78c70ee9c7ae6e4cba5c7a2babb8103ca) | 2020-11-09 | Update provider READMEs for up-coming 1.0.0beta1 releases (#12206) |
|
||||
| [b2a28d159](https://github.com/apache/airflow/commit/b2a28d1590410630d66966aa1f2b2a049a8c3b32) | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
|
||||
| [7e0d08e1f](https://github.com/apache/airflow/commit/7e0d08e1f074871307f0eb9e9ae7a66f7ce67626) | 2020-11-09 | Add how-to Guide for Databricks operators (#12175) |
|
||||
| [4e8f9cc8d](https://github.com/apache/airflow/commit/4e8f9cc8d02b29c325b8a5a76b4837671bdf5f68) | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
|
||||
| [8c42cf1b0](https://github.com/apache/airflow/commit/8c42cf1b00c90f0d7f11b8a3a455381de8e003c5) | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
|
||||
| [5a439e84e](https://github.com/apache/airflow/commit/5a439e84eb6c0544dc6c3d6a9f4ceeb2172cd5d0) | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
|
||||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:----------------------------------------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [54353f874](https://github.com/apache/airflow/commit/54353f874589f9be236458995147d13e0e763ffc) | 2020-09-27 | Increase type coverage for five different providers (#11170) |
|
||||
| [966a06d96](https://github.com/apache/airflow/commit/966a06d96bbfe330f1d2825f7b7eaa16d43b7a00) | 2020-09-18 | Fetching databricks host from connection if not supplied in extras. (#10762) |
|
||||
| [9549274d1](https://github.com/apache/airflow/commit/9549274d110f689a0bd709db829a4d69e274eed9) | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [bfefcce0c](https://github.com/apache/airflow/commit/bfefcce0c9f273042dd79ff50eb9af032ecacf59) | 2020-08-25 | Updated REST API call so GET requests pass payload in query string instead of request body (#10462) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [2f2d8dbfa](https://github.com/apache/airflow/commit/2f2d8dbfafefb4be3dd80f22f31c649c8498f148) | 2020-08-25 | Remove all "noinspection" comments native to IntelliJ (#10525) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [e13a14c87](https://github.com/apache/airflow/commit/e13a14c8730f4f633d996dd7d3468fe827136a84) | 2020-06-21 | Enable & Fix Whitespace related PyDocStyle Checks (#9458) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [f1073381e](https://github.com/apache/airflow/commit/f1073381ed764a218b2502d15ca28a5b326f9f2d) | 2020-05-22 | Add support for spark python and submit tasks in Databricks operator(#8846) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [649935e8c](https://github.com/apache/airflow/commit/649935e8ce906759fdd08884ab1e3db0a03f6953) | 2020-04-27 | [AIRFLOW-8472]: `PATCH` for Databricks hook `_do_api_call` (#8473) |
|
||||
| [16903ba3a](https://github.com/apache/airflow/commit/16903ba3a6ee5e61f1c6b5d17a8c6cf3c3a9a7f6) | 2020-04-24 | [AIRFLOW-8474]: Adding possibility to get job_id from Databricks run (#8475) |
|
||||
| [5648dfbc3](https://github.com/apache/airflow/commit/5648dfbc300337b10567ef4e07045ea29d33ec06) | 2020-03-23 | Add missing call to Super class in 'amazon', 'cloudant & 'databricks' providers (#7827) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [4d03e33c1](https://github.com/apache/airflow/commit/4d03e33c115018e30fa413c42b16212481ad25cc) | 2020-02-22 | [AIRFLOW-6817] remove imports from `airflow/__init__.py`, replaced implicit imports with explicit imports, added entry to `UPDATING.MD` - squashed/rebased (#7456) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [c42a375e7](https://github.com/apache/airflow/commit/c42a375e799e5adb3f9536616372dc90ff47e6c8) | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
|
|
@ -1,19 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [05443c6dc](https://github.com/apache/airflow/commit/05443c6dc8100e791446bbcc0df04de6e34017bb) | 2020-03-23 | Add missing call to Super class in remaining providers (#7828) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [c42a375e7](https://github.com/apache/airflow/commit/c42a375e799e5adb3f9536616372dc90ff47e6c8) | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
|
|
@ -1,15 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [24c8e4c2d](https://github.com/apache/airflow/commit/24c8e4c2d6e359ecc2c7d6275dccc68de4a82832) | 2020-08-06 | Changes to all the constructors to remove the args argument (#10163) |
|
||||
| [89fe5feb7](https://github.com/apache/airflow/commit/89fe5feb7b8088db7b5aaaec2b7a292cbc507209) | 2020-07-20 | improve typing for datadog provider (#9775) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,10 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,136 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-datadog
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Sensors](#sensors)
|
||||
- [Moved sensors](#moved-sensors)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `datadog` provider. All classes for this provider package
|
||||
are in `airflow.providers.datadog` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-datadog`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:--------------|:-------------------|
|
||||
| datadog | >=0.14.0 |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `datadog` provider
|
||||
are in the `airflow.providers.datadog` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Sensors
|
||||
|
||||
|
||||
|
||||
### Moved sensors
|
||||
|
||||
| Airflow 2.0 sensors: `airflow.providers.datadog` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:----------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [sensors.datadog.DatadogSensor](https://github.com/apache/airflow/blob/master/airflow/providers/datadog/sensors/datadog.py) | [contrib.sensors.datadog_sensor.DatadogSensor](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/sensors/datadog_sensor.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.datadog` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:----------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.datadog.DatadogHook](https://github.com/apache/airflow/blob/master/airflow/providers/datadog/hooks/datadog.py) | [contrib.hooks.datadog_hook.DatadogHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/datadog_hook.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [24c8e4c2d](https://github.com/apache/airflow/commit/24c8e4c2d6e359ecc2c7d6275dccc68de4a82832) | 2020-08-06 | Changes to all the constructors to remove the args argument (#10163) |
|
||||
| [89fe5feb7](https://github.com/apache/airflow/commit/89fe5feb7b8088db7b5aaaec2b7a292cbc507209) | 2020-07-20 | improve typing for datadog provider (#9775) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [05443c6dc](https://github.com/apache/airflow/commit/05443c6dc8100e791446bbcc0df04de6e34017bb) | 2020-03-23 | Add missing call to Super class in remaining providers (#7828) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [c42a375e7](https://github.com/apache/airflow/commit/c42a375e799e5adb3f9536616372dc90ff47e6c8) | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
|
|
@ -1,23 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [4d03e33c1](https://github.com/apache/airflow/commit/4d03e33c115018e30fa413c42b16212481ad25cc) | 2020-02-22 | [AIRFLOW-6817] remove imports from `airflow/__init__.py`, replaced implicit imports with explicit imports, added entry to `UPDATING.MD` - squashed/rebased (#7456) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [ceea293c1](https://github.com/apache/airflow/commit/ceea293c1652240e7e856c201e4341a87ef97a0f) | 2020-01-28 | [AIRFLOW-6656] Fix AIP-21 moving (#7272) |
|
||||
| [9a04013b0](https://github.com/apache/airflow/commit/9a04013b0e40b0d744ff4ac9f008491806d60df2) | 2020-01-27 | [AIRFLOW-6646][AIP-21] Move protocols classes to providers package (#7268) |
|
||||
| [c42a375e7](https://github.com/apache/airflow/commit/c42a375e799e5adb3f9536616372dc90ff47e6c8) | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
|
|
@ -1,17 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [720912f67](https://github.com/apache/airflow/commit/720912f67b3af0bdcbac64d6b8bf6d51c6247e26) | 2020-10-02 | Strict type check for multiple providers (#11229) |
|
||||
| [ce19657ec](https://github.com/apache/airflow/commit/ce19657ec685abff5871df80c8d47f8585eeed99) | 2020-09-15 | Fix case of GitHub. (#10955) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [aeea71274](https://github.com/apache/airflow/commit/aeea71274d4527ff2351102e94aa38bda6099e7f) | 2020-08-02 | Remove `args` parameter from provider operator constructors (#10097) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,11 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [172820db4](https://github.com/apache/airflow/commit/172820db4d2009dd26fa8aef4a864fb8a3d7e78d) | 2020-10-21 | Fix case of GitHub (#11398) |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,152 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-dingding
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [Cross provider package dependencies](#cross-provider-package-dependencies)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [Moved operators](#moved-operators)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `dingding` provider. All classes for this provider package
|
||||
are in `airflow.providers.dingding` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-dingding`
|
||||
|
||||
## Cross provider package dependencies
|
||||
|
||||
Those are dependencies that might be needed in order to use all the features of the package.
|
||||
You need to install the specified backport providers package in order to use them.
|
||||
|
||||
You can install such cross-provider dependencies when installing from PyPI. For example:
|
||||
|
||||
```bash
|
||||
pip install apache-airflow-backport-providers-dingding[http]
|
||||
```
|
||||
|
||||
| Dependent package | Extra |
|
||||
|:---------------------------------------------------------------------------------------------------------------|:--------|
|
||||
| [apache-airflow-backport-providers-http](https://github.com/apache/airflow/tree/master/airflow/providers/http) | http |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `dingding` provider
|
||||
are in the `airflow.providers.dingding` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
|
||||
|
||||
### Moved operators
|
||||
|
||||
| Airflow 2.0 operators: `airflow.providers.dingding` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:--------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.dingding.DingdingOperator](https://github.com/apache/airflow/blob/master/airflow/providers/dingding/operators/dingding.py) | [contrib.operators.dingding_operator.DingdingOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/dingding_operator.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.dingding` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:--------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.dingding.DingdingHook](https://github.com/apache/airflow/blob/master/airflow/providers/dingding/hooks/dingding.py) | [contrib.hooks.dingding_hook.DingdingHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/dingding_hook.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [172820db4](https://github.com/apache/airflow/commit/172820db4d2009dd26fa8aef4a864fb8a3d7e78d) | 2020-10-21 | Fix case of GitHub (#11398) |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [720912f67](https://github.com/apache/airflow/commit/720912f67b3af0bdcbac64d6b8bf6d51c6247e26) | 2020-10-02 | Strict type check for multiple providers (#11229) |
|
||||
| [ce19657ec](https://github.com/apache/airflow/commit/ce19657ec685abff5871df80c8d47f8585eeed99) | 2020-09-15 | Fix case of GitHub. (#10955) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [aeea71274](https://github.com/apache/airflow/commit/aeea71274d4527ff2351102e94aa38bda6099e7f) | 2020-08-02 | Remove `args` parameter from provider operator constructors (#10097) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [4d03e33c1](https://github.com/apache/airflow/commit/4d03e33c115018e30fa413c42b16212481ad25cc) | 2020-02-22 | [AIRFLOW-6817] remove imports from `airflow/__init__.py`, replaced implicit imports with explicit imports, added entry to `UPDATING.MD` - squashed/rebased (#7456) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [ceea293c1](https://github.com/apache/airflow/commit/ceea293c1652240e7e856c201e4341a87ef97a0f) | 2020-01-28 | [AIRFLOW-6656] Fix AIP-21 moving (#7272) |
|
||||
| [9a04013b0](https://github.com/apache/airflow/commit/9a04013b0e40b0d744ff4ac9f008491806d60df2) | 2020-01-27 | [AIRFLOW-6646][AIP-21] Move protocols classes to providers package (#7268) |
|
||||
| [c42a375e7](https://github.com/apache/airflow/commit/c42a375e799e5adb3f9536616372dc90ff47e6c8) | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
|
|
@ -1,19 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [ceea293c1](https://github.com/apache/airflow/commit/ceea293c1652240e7e856c201e4341a87ef97a0f) | 2020-01-28 | [AIRFLOW-6656] Fix AIP-21 moving (#7272) |
|
||||
| [9a04013b0](https://github.com/apache/airflow/commit/9a04013b0e40b0d744ff4ac9f008491806d60df2) | 2020-01-27 | [AIRFLOW-6646][AIP-21] Move protocols classes to providers package (#7268) |
|
||||
| [c42a375e7](https://github.com/apache/airflow/commit/c42a375e799e5adb3f9536616372dc90ff47e6c8) | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
|
|
@ -1,16 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [a518801f8](https://github.com/apache/airflow/commit/a518801f8d5abe4ceb8b8678c27e6858f51f288a) | 2020-07-12 | Add type hinting for discord provider (#9773) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,10 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,146 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-discord
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [Cross provider package dependencies](#cross-provider-package-dependencies)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [Moved operators](#moved-operators)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `discord` provider. All classes for this provider package
|
||||
are in `airflow.providers.discord` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-discord`
|
||||
|
||||
## Cross provider package dependencies
|
||||
|
||||
Those are dependencies that might be needed in order to use all the features of the package.
|
||||
You need to install the specified backport providers package in order to use them.
|
||||
|
||||
You can install such cross-provider dependencies when installing from PyPI. For example:
|
||||
|
||||
```bash
|
||||
pip install apache-airflow-backport-providers-discord[http]
|
||||
```
|
||||
|
||||
| Dependent package | Extra |
|
||||
|:---------------------------------------------------------------------------------------------------------------|:--------|
|
||||
| [apache-airflow-backport-providers-http](https://github.com/apache/airflow/tree/master/airflow/providers/http) | http |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `discord` provider
|
||||
are in the `airflow.providers.discord` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
|
||||
|
||||
### Moved operators
|
||||
|
||||
| Airflow 2.0 operators: `airflow.providers.discord` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:---------------------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.discord_webhook.DiscordWebhookOperator](https://github.com/apache/airflow/blob/master/airflow/providers/discord/operators/discord_webhook.py) | [contrib.operators.discord_webhook_operator.DiscordWebhookOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/discord_webhook_operator.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.discord` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:---------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.discord_webhook.DiscordWebhookHook](https://github.com/apache/airflow/blob/master/airflow/providers/discord/hooks/discord_webhook.py) | [contrib.hooks.discord_webhook_hook.DiscordWebhookHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/hooks/discord_webhook_hook.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [33f0cd265](https://github.com/apache/airflow/commit/33f0cd2657b2e77ea3477e0c93f13f1474be628e) | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
|
||||
| [4d74ac211](https://github.com/apache/airflow/commit/4d74ac2111862186598daf92cbf2c525617061c2) | 2020-07-19 | Increase typing for Apache and http provider package (#9729) |
|
||||
| [a518801f8](https://github.com/apache/airflow/commit/a518801f8d5abe4ceb8b8678c27e6858f51f288a) | 2020-07-12 | Add type hinting for discord provider (#9773) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [ceea293c1](https://github.com/apache/airflow/commit/ceea293c1652240e7e856c201e4341a87ef97a0f) | 2020-01-28 | [AIRFLOW-6656] Fix AIP-21 moving (#7272) |
|
||||
| [9a04013b0](https://github.com/apache/airflow/commit/9a04013b0e40b0d744ff4ac9f008491806d60df2) | 2020-01-27 | [AIRFLOW-6646][AIP-21] Move protocols classes to providers package (#7268) |
|
||||
| [c42a375e7](https://github.com/apache/airflow/commit/c42a375e799e5adb3f9536616372dc90ff47e6c8) | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
|
|
@ -1,31 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [4a74cf1a3](https://github.com/apache/airflow/commit/4a74cf1a34cf20e49383f27e7cdc3ae80b9b0cde) | 2020-06-08 | Fix xcom in DockerOperator when auto_remove is used (#9173) |
|
||||
| [b4b84a193](https://github.com/apache/airflow/commit/b4b84a1933d055a2803b80b990482a7257a203ff) | 2020-06-07 | Add kernel capabilities in DockerOperator(#9142) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [511d98e30](https://github.com/apache/airflow/commit/511d98e30ded2bcce9d246b358f806cea45ebcb7) | 2020-05-01 | [AIRFLOW-4363] Fix JSON encoding error (#8287) |
|
||||
| [0a1de1668](https://github.com/apache/airflow/commit/0a1de16682da1d0a3fac668437434a72b3149fda) | 2020-04-27 | Stop DockerSwarmOperator from pulling Docker images (#8533) |
|
||||
| [3237c7e31](https://github.com/apache/airflow/commit/3237c7e31d008f73e6ba0ecc1f2331c7c80f0e17) | 2020-04-26 | [AIRFLOW-5850] Capture task logs in DockerSwarmOperator (#6552) |
|
||||
| [9626b03d1](https://github.com/apache/airflow/commit/9626b03d19905c6d1bfbd53064f85ffd3c39f0bf) | 2020-03-30 | [AIRFLOW-6574] Adding private_environment to docker operator. (#7671) |
|
||||
| [733d3d3c3](https://github.com/apache/airflow/commit/733d3d3c32e0305691f82102cfc346e8e85478b0) | 2020-03-25 | [AIRFLOW-4363] Fix JSON encoding error (#7628) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [cd546b664](https://github.com/apache/airflow/commit/cd546b664fa35a2bf85acd77af578c909a327d92) | 2020-03-23 | Add missing call to Super class in 'cncf' & 'docker' providers (#7825) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [4d03e33c1](https://github.com/apache/airflow/commit/4d03e33c115018e30fa413c42b16212481ad25cc) | 2020-02-22 | [AIRFLOW-6817] remove imports from `airflow/__init__.py`, replaced implicit imports with explicit imports, added entry to `UPDATING.MD` - squashed/rebased (#7456) |
|
||||
| [dbcd3d878](https://github.com/apache/airflow/commit/dbcd3d8787741fd8203b6d9bdbc5d1da4b10a15b) | 2020-02-18 | [AIRFLOW-6804] Add the basic test for all example DAGs (#7419) |
|
||||
| [9cbd7de6d](https://github.com/apache/airflow/commit/9cbd7de6d115795aba8bfb8addb060bfdfbdf87b) | 2020-02-18 | [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [059eda05f](https://github.com/apache/airflow/commit/059eda05f82fefce4410f44f761f945a27d83daf) | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
|
|
@ -1,21 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [e3f96ce7a](https://github.com/apache/airflow/commit/e3f96ce7a8ac098aeef5e9930e6de6c428274d57) | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
|
||||
| [2e56ee7b2](https://github.com/apache/airflow/commit/2e56ee7b2283d9413cab6939ffbe241c154b39e2) | 2020-08-27 | DockerOperator extra_hosts argument support added (#10546) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [2f2d8dbfa](https://github.com/apache/airflow/commit/2f2d8dbfafefb4be3dd80f22f31c649c8498f148) | 2020-08-25 | Remove all "noinspection" comments native to IntelliJ (#10525) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [d79e7221d](https://github.com/apache/airflow/commit/d79e7221de76f01b5cd36c15224b59e8bb451c90) | 2020-08-06 | Type annotation for Docker operator (#9733) |
|
||||
| [aeea71274](https://github.com/apache/airflow/commit/aeea71274d4527ff2351102e94aa38bda6099e7f) | 2020-08-02 | Remove `args` parameter from provider operator constructors (#10097) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [c2db0dfeb](https://github.com/apache/airflow/commit/c2db0dfeb13ee679bf4d7b57874f0fcb39c0f0ed) | 2020-07-22 | More strict rules in mypy (#9705) (#9906) |
|
||||
| [5d61580c5](https://github.com/apache/airflow/commit/5d61580c572118ed97b9ff32d7e3684be1fcb755) | 2020-06-21 | Enable 'Public function Missing Docstrings' PyDocStyle Check (#9463) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,10 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,155 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-docker
|
||||
|
||||
Release: 2020.10.29
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [PIP requirements](#pip-requirements)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Operators](#operators)
|
||||
- [Moved operators](#moved-operators)
|
||||
- [Hooks](#hooks)
|
||||
- [Moved hooks](#moved-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `docker` provider. All classes for this provider package
|
||||
are in `airflow.providers.docker` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-docker`
|
||||
|
||||
## PIP requirements
|
||||
|
||||
| PIP package | Version required |
|
||||
|:--------------|:-------------------|
|
||||
| docker | ~=3.0 |
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `docker` provider
|
||||
are in the `airflow.providers.docker` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Operators
|
||||
|
||||
|
||||
|
||||
### Moved operators
|
||||
|
||||
| Airflow 2.0 operators: `airflow.providers.docker` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:-----------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [operators.docker.DockerOperator](https://github.com/apache/airflow/blob/master/airflow/providers/docker/operators/docker.py) | [operators.docker_operator.DockerOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/operators/docker_operator.py) |
|
||||
| [operators.docker_swarm.DockerSwarmOperator](https://github.com/apache/airflow/blob/master/airflow/providers/docker/operators/docker_swarm.py) | [contrib.operators.docker_swarm_operator.DockerSwarmOperator](https://github.com/apache/airflow/blob/v1-10-stable/airflow/contrib/operators/docker_swarm_operator.py) |
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
|
||||
### Moved hooks
|
||||
|
||||
| Airflow 2.0 hooks: `airflow.providers.docker` package | Airflow 1.10.* previous location (usually `airflow.contrib`) |
|
||||
|:------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.docker.DockerHook](https://github.com/apache/airflow/blob/master/airflow/providers/docker/hooks/docker.py) | [hooks.docker_hook.DockerHook](https://github.com/apache/airflow/blob/v1-10-stable/airflow/hooks/docker_hook.py) |
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [e3f96ce7a](https://github.com/apache/airflow/commit/e3f96ce7a8ac098aeef5e9930e6de6c428274d57) | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
|
||||
| [2e56ee7b2](https://github.com/apache/airflow/commit/2e56ee7b2283d9413cab6939ffbe241c154b39e2) | 2020-08-27 | DockerOperator extra_hosts argument support added (#10546) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [2f2d8dbfa](https://github.com/apache/airflow/commit/2f2d8dbfafefb4be3dd80f22f31c649c8498f148) | 2020-08-25 | Remove all "noinspection" comments native to IntelliJ (#10525) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [d79e7221d](https://github.com/apache/airflow/commit/d79e7221de76f01b5cd36c15224b59e8bb451c90) | 2020-08-06 | Type annotation for Docker operator (#9733) |
|
||||
| [aeea71274](https://github.com/apache/airflow/commit/aeea71274d4527ff2351102e94aa38bda6099e7f) | 2020-08-02 | Remove `args` parameter from provider operator constructors (#10097) |
|
||||
| [7d24b088c](https://github.com/apache/airflow/commit/7d24b088cd736cfa18f9214e4c9d6ce2d5865f3d) | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
|
||||
| [c2db0dfeb](https://github.com/apache/airflow/commit/c2db0dfeb13ee679bf4d7b57874f0fcb39c0f0ed) | 2020-07-22 | More strict rules in mypy (#9705) (#9906) |
|
||||
| [5d61580c5](https://github.com/apache/airflow/commit/5d61580c572118ed97b9ff32d7e3684be1fcb755) | 2020-06-21 | Enable 'Public function Missing Docstrings' PyDocStyle Check (#9463) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [4a74cf1a3](https://github.com/apache/airflow/commit/4a74cf1a34cf20e49383f27e7cdc3ae80b9b0cde) | 2020-06-08 | Fix xcom in DockerOperator when auto_remove is used (#9173) |
|
||||
| [b4b84a193](https://github.com/apache/airflow/commit/b4b84a1933d055a2803b80b990482a7257a203ff) | 2020-06-07 | Add kernel capabilities in DockerOperator(#9142) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [511d98e30](https://github.com/apache/airflow/commit/511d98e30ded2bcce9d246b358f806cea45ebcb7) | 2020-05-01 | [AIRFLOW-4363] Fix JSON encoding error (#8287) |
|
||||
| [0a1de1668](https://github.com/apache/airflow/commit/0a1de16682da1d0a3fac668437434a72b3149fda) | 2020-04-27 | Stop DockerSwarmOperator from pulling Docker images (#8533) |
|
||||
| [3237c7e31](https://github.com/apache/airflow/commit/3237c7e31d008f73e6ba0ecc1f2331c7c80f0e17) | 2020-04-26 | [AIRFLOW-5850] Capture task logs in DockerSwarmOperator (#6552) |
|
||||
| [9626b03d1](https://github.com/apache/airflow/commit/9626b03d19905c6d1bfbd53064f85ffd3c39f0bf) | 2020-03-30 | [AIRFLOW-6574] Adding private_environment to docker operator. (#7671) |
|
||||
| [733d3d3c3](https://github.com/apache/airflow/commit/733d3d3c32e0305691f82102cfc346e8e85478b0) | 2020-03-25 | [AIRFLOW-4363] Fix JSON encoding error (#7628) |
|
||||
| [4bde99f13](https://github.com/apache/airflow/commit/4bde99f1323d72f6c84c1548079d5e98fc0a2a9a) | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
|
||||
| [cd546b664](https://github.com/apache/airflow/commit/cd546b664fa35a2bf85acd77af578c909a327d92) | 2020-03-23 | Add missing call to Super class in 'cncf' & 'docker' providers (#7825) |
|
||||
| [3320e432a](https://github.com/apache/airflow/commit/3320e432a129476dbc1c55be3b3faa3326a635bc) | 2020-02-24 | [AIRFLOW-6817] Lazy-load `airflow.DAG` to keep user-facing API untouched (#7517) |
|
||||
| [4d03e33c1](https://github.com/apache/airflow/commit/4d03e33c115018e30fa413c42b16212481ad25cc) | 2020-02-22 | [AIRFLOW-6817] remove imports from `airflow/__init__.py`, replaced implicit imports with explicit imports, added entry to `UPDATING.MD` - squashed/rebased (#7456) |
|
||||
| [dbcd3d878](https://github.com/apache/airflow/commit/dbcd3d8787741fd8203b6d9bdbc5d1da4b10a15b) | 2020-02-18 | [AIRFLOW-6804] Add the basic test for all example DAGs (#7419) |
|
||||
| [9cbd7de6d](https://github.com/apache/airflow/commit/9cbd7de6d115795aba8bfb8addb060bfdfbdf87b) | 2020-02-18 | [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412) |
|
||||
| [97a429f9d](https://github.com/apache/airflow/commit/97a429f9d0cf740c5698060ad55f11e93cb57b55) | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
|
||||
| [83c037873](https://github.com/apache/airflow/commit/83c037873ff694eed67ba8b30f2d9c88b2c7c6f2) | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
|
||||
| [059eda05f](https://github.com/apache/airflow/commit/059eda05f82fefce4410f44f761f945a27d83daf) | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
|
|
@ -1,16 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [65dd28eb7](https://github.com/apache/airflow/commit/65dd28eb77d996ec8306c67d5ce1ccee2c14cc9d) | 2020-02-18 | [AIRFLOW-1202] Create Elasticsearch Hook (#7358) |
|
|
@ -1,19 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:--------------------------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [ac943c9e1](https://github.com/apache/airflow/commit/ac943c9e18f75259d531dbda8c51e650f57faa4c) | 2020-09-08 | [AIRFLOW-3964][AIP-17] Consolidate and de-dup sensor tasks using Smart Sensor (#5499) |
|
||||
| [70f05ac67](https://github.com/apache/airflow/commit/70f05ac6775152d856d212f845e9561282232844) | 2020-09-01 | Add `log_id` field to log lines on ES handler (#10411) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [d76026545](https://github.com/apache/airflow/commit/d7602654526fdd2876466371404784bd17cfe0d2) | 2020-08-25 | PyDocStyle: No whitespaces allowed surrounding docstring text (#10533) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [d5d119bab](https://github.com/apache/airflow/commit/d5d119babc97bbe3f3f690ad4a93e3b73bd3b172) | 2020-07-21 | Increase typing coverage for Elasticsearch (#9911) |
|
||||
| [a79e2d4c4](https://github.com/apache/airflow/commit/a79e2d4c4aa105f3fac5ae6a28e29af9cd572407) | 2020-07-06 | Move provider's log task handlers to the provider package (#9604) |
|
||||
| [e13a14c87](https://github.com/apache/airflow/commit/e13a14c8730f4f633d996dd7d3468fe827136a84) | 2020-06-21 | Enable & Fix Whitespace related PyDocStyle Checks (#9458) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
|
@ -1,10 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
|
@ -1,12 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.11.13
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------|
|
||||
| [b2a28d159](https://github.com/apache/airflow/commit/b2a28d1590410630d66966aa1f2b2a049a8c3b32) | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
|
||||
| [4e8f9cc8d](https://github.com/apache/airflow/commit/4e8f9cc8d02b29c325b8a5a76b4837671bdf5f68) | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
|
||||
| [8c42cf1b0](https://github.com/apache/airflow/commit/8c42cf1b00c90f0d7f11b8a3a455381de8e003c5) | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
|
||||
| [5a439e84e](https://github.com/apache/airflow/commit/5a439e84eb6c0544dc6c3d6a9f4ceeb2172cd5d0) | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
|
||||
| [872b1566a](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-25 | Generated backport providers readmes/setup for 2020.10.29 (#11826) |
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
|
@ -1,130 +0,0 @@
|
|||
<!--
|
||||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
||||
-->
|
||||
|
||||
|
||||
# Package apache-airflow-backport-providers-elasticsearch
|
||||
|
||||
Release: 2020.11.13
|
||||
|
||||
**Table of contents**
|
||||
|
||||
- [Backport package](#backport-package)
|
||||
- [Installation](#installation)
|
||||
- [Provider class summary](#provider-classes-summary)
|
||||
- [Hooks](#hooks)
|
||||
- [New hooks](#new-hooks)
|
||||
- [Releases](#releases)
|
||||
- [Release 2020.11.13](#release-20201113)
|
||||
- [Release 2020.10.29](#release-20201029)
|
||||
- [Release 2020.10.5](#release-2020105)
|
||||
- [Release 2020.6.24](#release-2020624)
|
||||
|
||||
## Backport package
|
||||
|
||||
This is a backport providers package for `elasticsearch` provider. All classes for this provider package
|
||||
are in `airflow.providers.elasticsearch` python package.
|
||||
|
||||
**Only Python 3.6+ is supported for this backport package.**
|
||||
|
||||
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you
|
||||
want to use this backport package.
|
||||
|
||||
|
||||
|
||||
## Installation
|
||||
|
||||
You can install this package on top of an existing airflow 1.10.* installation via
|
||||
`pip install apache-airflow-backport-providers-elasticsearch`
|
||||
|
||||
# Provider classes summary
|
||||
|
||||
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the `elasticsearch` provider
|
||||
are in the `airflow.providers.elasticsearch` package. You can read more about the naming conventions used
|
||||
in [Naming conventions for provider packages](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#naming-conventions-for-provider-packages)
|
||||
|
||||
|
||||
## Hooks
|
||||
|
||||
|
||||
### New hooks
|
||||
|
||||
| New Airflow 2.0 hooks: `airflow.providers.elasticsearch` package |
|
||||
|:----------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| [hooks.elasticsearch.ElasticsearchHook](https://github.com/apache/airflow/blob/master/airflow/providers/elasticsearch/hooks/elasticsearch.py) |
|
||||
|
||||
|
||||
|
||||
|
||||
## Releases
|
||||
|
||||
### Release 2020.11.13
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------------|
|
||||
| [b2a28d159](https://github.com/apache/airflow/commit/b2a28d1590410630d66966aa1f2b2a049a8c3b32) | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
|
||||
| [4e8f9cc8d](https://github.com/apache/airflow/commit/4e8f9cc8d02b29c325b8a5a76b4837671bdf5f68) | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
|
||||
| [8c42cf1b0](https://github.com/apache/airflow/commit/8c42cf1b00c90f0d7f11b8a3a455381de8e003c5) | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
|
||||
| [5a439e84e](https://github.com/apache/airflow/commit/5a439e84eb6c0544dc6c3d6a9f4ceeb2172cd5d0) | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
|
||||
| [872b1566a](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-25 | Generated backport providers readmes/setup for 2020.10.29 (#11826) |
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
|
||||
|
||||
### Release 2020.10.29
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:-------------------------------------------------------------|
|
||||
| [b680bbc0b](https://github.com/apache/airflow/commit/872b1566a11cb73297e657ff325161721b296574) | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
|
||||
| [349b0811c](https://github.com/apache/airflow/commit/349b0811c3022605426ba57d30936240a7c2848a) | 2020-10-20 | Add D200 pydocstyle check (#11688) |
|
||||
| [16e712971](https://github.com/apache/airflow/commit/16e7129719f1c0940aef2a93bed81368e997a746) | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
|
||||
| [0a0e1af80](https://github.com/apache/airflow/commit/0a0e1af80038ef89974c3c8444461fe867945daa) | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
|
||||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:--------------------------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [f3e87c503](https://github.com/apache/airflow/commit/f3e87c503081a3085dff6c7352640d7f08beb5bc) | 2020-09-22 | Add D202 pydocstyle check (#11032) |
|
||||
| [ac943c9e1](https://github.com/apache/airflow/commit/ac943c9e18f75259d531dbda8c51e650f57faa4c) | 2020-09-08 | [AIRFLOW-3964][AIP-17] Consolidate and de-dup sensor tasks using Smart Sensor (#5499) |
|
||||
| [70f05ac67](https://github.com/apache/airflow/commit/70f05ac6775152d856d212f845e9561282232844) | 2020-09-01 | Add `log_id` field to log lines on ES handler (#10411) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [d76026545](https://github.com/apache/airflow/commit/d7602654526fdd2876466371404784bd17cfe0d2) | 2020-08-25 | PyDocStyle: No whitespaces allowed surrounding docstring text (#10533) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [d5d119bab](https://github.com/apache/airflow/commit/d5d119babc97bbe3f3f690ad4a93e3b73bd3b172) | 2020-07-21 | Increase typing coverage for Elasticsearch (#9911) |
|
||||
| [a79e2d4c4](https://github.com/apache/airflow/commit/a79e2d4c4aa105f3fac5ae6a28e29af9cd572407) | 2020-07-06 | Move provider's log task handlers to the provider package (#9604) |
|
||||
| [e13a14c87](https://github.com/apache/airflow/commit/e13a14c8730f4f633d996dd7d3468fe827136a84) | 2020-06-21 | Enable & Fix Whitespace related PyDocStyle Checks (#9458) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
||||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [65dd28eb7](https://github.com/apache/airflow/commit/65dd28eb77d996ec8306c67d5ce1ccee2c14cc9d) | 2020-02-18 | [AIRFLOW-1202] Create Elasticsearch Hook (#7358) |
|
|
@ -1,17 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.6.24
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:------------------------------------------------------------------------|
|
||||
| [12af6a080](https://github.com/apache/airflow/commit/12af6a08009b8776e00d8a0aab92363eb8c4e8b1) | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
|
||||
| [c7e5bce57](https://github.com/apache/airflow/commit/c7e5bce57fe7f51cefce4f8a41ce408ac5675d13) | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
|
||||
| [f6bd817a3](https://github.com/apache/airflow/commit/f6bd817a3aac0a16430fc2e3d59c1f17a69a15ac) | 2020-06-16 | Introduce 'transfers' packages (#9320) |
|
||||
| [0b0e4f7a4](https://github.com/apache/airflow/commit/0b0e4f7a4cceff3efe15161fb40b984782760a34) | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
|
||||
| [00642a46d](https://github.com/apache/airflow/commit/00642a46d019870c4decb3d0e47c01d6a25cb88c) | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
|
||||
| [1d36b0303](https://github.com/apache/airflow/commit/1d36b0303b8632fce6de78ca4e782ae26ee06fea) | 2020-05-23 | Fix references in docs (#8984) |
|
||||
| [375d1ca22](https://github.com/apache/airflow/commit/375d1ca229464617780623c61c6e8a1bf570c87f) | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
|
||||
| [12c5e5d8a](https://github.com/apache/airflow/commit/12c5e5d8ae25fa633efe63ccf4db389e2b796d79) | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
|
||||
| [f3521fb0e](https://github.com/apache/airflow/commit/f3521fb0e36733d8bd356123e56a453fd37a6dca) | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
|
||||
| [92585ca4c](https://github.com/apache/airflow/commit/92585ca4cb375ac879f4ab331b3a063106eb7b92) | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
|
||||
| [69dc91b4e](https://github.com/apache/airflow/commit/69dc91b4ef92d0f89abe097afd27bbe7ec2febd0) | 2020-04-02 | [AIRFLOW-6982] add native python exasol support (#7621) |
|
|
@ -1,16 +0,0 @@
|
|||
|
||||
|
||||
### Release 2020.10.5
|
||||
|
||||
| Commit | Committed | Subject |
|
||||
|:-----------------------------------------------------------------------------------------------|:------------|:---------------------------------------------------------------------|
|
||||
| [ca4238eb4](https://github.com/apache/airflow/commit/ca4238eb4d9a2aef70eb641343f59ee706d27d13) | 2020-10-02 | Fixed month in backport packages to October (#11242) |
|
||||
| [5220e4c38](https://github.com/apache/airflow/commit/5220e4c3848a2d2c81c266ef939709df9ce581c5) | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
|
||||
| [54353f874](https://github.com/apache/airflow/commit/54353f874589f9be236458995147d13e0e763ffc) | 2020-09-27 | Increase type coverage for five different providers (#11170) |
|
||||
| [fdd9b6f65](https://github.com/apache/airflow/commit/fdd9b6f65b608c516b8a062b058972d9a45ec9e3) | 2020-08-25 | Enable Black on Providers Packages (#10543) |
|
||||
| [3696c34c2](https://github.com/apache/airflow/commit/3696c34c28c6bc7b442deab999d9ecba24ed0e34) | 2020-08-24 | Fix typo in the word "release" (#10528) |
|
||||
| [ee7ca128a](https://github.com/apache/airflow/commit/ee7ca128a17937313566f2badb6cc569c614db94) | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
|
||||
| [8f8db8959](https://github.com/apache/airflow/commit/8f8db8959e526be54d700845d36ee9f315bae2ea) | 2020-08-12 | DbApiHook: Support kwargs in get_pandas_df (#9730) |
|
||||
| [cdec30125](https://github.com/apache/airflow/commit/cdec3012542b45d23a05f62d69110944ba542e2a) | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
|
||||
| [aeea71274](https://github.com/apache/airflow/commit/aeea71274d4527ff2351102e94aa38bda6099e7f) | 2020-08-02 | Remove `args` parameter from provider operator constructors (#10097) |
|
||||
| [d0e7db402](https://github.com/apache/airflow/commit/d0e7db4024806af35e3c9a2cae460fdeedd4d2ec) | 2020-06-19 | Fixed release number for fresh release (#9408) |
|
Некоторые файлы не были показаны из-за слишком большого количества измененных файлов Показать больше
Загрузка…
Ссылка в новой задаче