[AIRFLOW-XXX] Extract reverse proxy info to a separate file (#4657)

This commit is contained in:
Kamil Breguła 2019-02-06 19:45:46 +01:00 коммит произвёл Ash Berlin-Taylor
Родитель 2e19e1842a
Коммит 6f122f4fc5
3 изменённых файлов: 83 добавлений и 69 удалений

Просмотреть файл

@ -37,6 +37,7 @@ configuring an Airflow environment.
executor/use-celery executor/use-celery
executor/use-dask executor/use-dask
executor/use-mesos executor/use-mesos
run-behind-proxy
run-with-systemd run-with-systemd
run-with-upstart run-with-upstart
use-test-config use-test-config

Просмотреть файл

@ -0,0 +1,82 @@
.. Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at
.. http://www.apache.org/licenses/LICENSE-2.0
.. Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
Running Airflow behind a reverse proxy
======================================
Airflow can be set up behind a reverse proxy, with the ability to set its endpoint with great
flexibility.
For example, you can configure your reverse proxy to get:
::
https://lab.mycompany.com/myorg/airflow/
To do so, you need to set the following setting in your `airflow.cfg`::
base_url = http://my_host/myorg/airflow
Additionally if you use Celery Executor, you can get Flower in `/myorg/flower` with::
flower_url_prefix = /myorg/flower
Your reverse proxy (ex: nginx) should be configured as follow:
- pass the url and http header as it for the Airflow webserver, without any rewrite, for example::
server {
listen 80;
server_name lab.mycompany.com;
location /myorg/airflow/ {
proxy_pass http://localhost:8080;
proxy_set_header Host $host;
proxy_redirect off;
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection "upgrade";
}
}
- rewrite the url for the flower endpoint::
server {
listen 80;
server_name lab.mycompany.com;
location /myorg/flower/ {
rewrite ^/myorg/flower/(.*)$ /$1 break; # remove prefix from http header
proxy_pass http://localhost:5555;
proxy_set_header Host $host;
proxy_redirect off;
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection "upgrade";
}
}
To ensure that Airflow generates URLs with the correct scheme when
running behind a TLS-terminating proxy, you should configure the proxy
to set the `X-Forwarded-Proto` header, and enable the `ProxyFix`
middleware in your `airflow.cfg`::
enable_proxy_fix = True
.. note::
You should only enable the `ProxyFix` middleware when running
Airflow behind a trusted proxy (AWS ELB, nginx, etc.).

Просмотреть файл

@ -18,81 +18,12 @@
Integration Integration
=========== ===========
- :ref:`ReverseProxy`
- :ref:`Azure` - :ref:`Azure`
- :ref:`AWS` - :ref:`AWS`
- :ref:`Databricks` - :ref:`Databricks`
- :ref:`GCP` - :ref:`GCP`
- :ref:`Qubole` - :ref:`Qubole`
.. _ReverseProxy:
Reverse Proxy
-------------
Airflow can be set up behind a reverse proxy, with the ability to set its endpoint with great
flexibility.
For example, you can configure your reverse proxy to get:
::
https://lab.mycompany.com/myorg/airflow/
To do so, you need to set the following setting in your `airflow.cfg`::
base_url = http://my_host/myorg/airflow
Additionally if you use Celery Executor, you can get Flower in `/myorg/flower` with::
flower_url_prefix = /myorg/flower
Your reverse proxy (ex: nginx) should be configured as follow:
- pass the url and http header as it for the Airflow webserver, without any rewrite, for example::
server {
listen 80;
server_name lab.mycompany.com;
location /myorg/airflow/ {
proxy_pass http://localhost:8080;
proxy_set_header Host $host;
proxy_redirect off;
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection "upgrade";
}
}
- rewrite the url for the flower endpoint::
server {
listen 80;
server_name lab.mycompany.com;
location /myorg/flower/ {
rewrite ^/myorg/flower/(.*)$ /$1 break; # remove prefix from http header
proxy_pass http://localhost:5555;
proxy_set_header Host $host;
proxy_redirect off;
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection "upgrade";
}
}
To ensure that Airflow generates URLs with the correct scheme when
running behind a TLS-terminating proxy, you should configure the proxy
to set the `X-Forwarded-Proto` header, and enable the `ProxyFix`
middleware in your `airflow.cfg`::
enable_proxy_fix = True
.. note::
You should only enable the `ProxyFix` middleware when running
Airflow behind a trusted proxy (AWS ELB, nginx, etc.).
.. _Azure: .. _Azure:
Azure: Microsoft Azure Azure: Microsoft Azure