54e07d5508
[AIRFLOW-4929] Pretty print JSON Variables in UI ( #5573 )
...
- serialize JSON variables with newlines and indentation
- use monospace font family for `val` textarea
- set height of `val` textarea dynamically
2019-07-16 10:34:50 +01:00
496d7c9695
[AIRFLOW-4865] Add context manager to set temporary config values in tests. ( #5569 )
2019-07-16 10:24:12 +01:00
7d08cacfbb
[AIRFLOW-4954] Remove unused variables from tests ( #5588 )
2019-07-15 21:42:42 +02:00
b33b989867
[AIRFLOW-XXX] Disable intersphinx loading of `requests` modules ( #5590 )
...
Their website is currently not responding making this inventory
unreachable which is causing all our builds to fail.
2019-07-15 13:23:41 +01:00
18e60f4a29
[AIRFLOW-4942] Drop six.next ( #5576 )
2019-07-14 14:23:16 +02:00
b5fb370446
[AIRFLOW-4943] Replace six assertion method with native ( #5577 )
2019-07-14 07:12:20 +02:00
4f332382da
[AIRFLOW-4944] Use new types syntax ( #5578 )
2019-07-14 07:11:13 +02:00
c2f5698eda
[AIRFLOW-4947] Remove six types ( #5581 )
2019-07-14 07:09:19 +02:00
4a56abea3a
[AIRFLOW-4949] Use OSError exception ( #5583 )
2019-07-14 07:07:20 +02:00
6aaa19b9e5
[AIRFLOW-4946] Use yield from syntax ( #5580 )
2019-07-13 23:06:54 +02:00
b9ba6d85b0
[AIRFLOW-4884] Roll up import_errors in UI ( #5516 )
2019-07-13 21:53:44 +01:00
fe20a9aa01
[AIRFLOW-4945] Use super() syntax ( #5579 )
2019-07-13 21:11:11 +02:00
f06ae8fbe9
[AIRFLOW-4882] Make GCP tests and examples Pylint compatible ( #5522 )
2019-07-13 13:24:40 +02:00
9efa2e90b5
[AIRFLOW-XXX] Add Instacart to list of companies who use Airflow ( #5575 )
2019-07-12 16:26:55 -07:00
e7bb1a0a8f
[AIRFLOW-XXX] Add Premise to list of companies who use Airflow ( #5568 )
2019-07-12 16:42:52 +01:00
3b64e59391
[AIRFLOW-4937] Fix lodash security issue with version below 4.17.13 ( #5572 )
...
Issue fixed in https://github.com/lodash/lodash/pull/4336
2019-07-12 16:33:47 +01:00
2c32435667
[AIRFLOW-4934] Bump Flask to resolve Werkzeug ProxyFix ( #5571 )
2019-07-12 16:22:12 +01:00
ccfe23d294
[AIRFLOW-4934] Fix ProxyFix due to Werkzeug upgrade ( #5563 )
2019-07-12 08:25:06 +01:00
d3884493c7
[AIRFLOW-4136] fix key_file of hook is overwritten by SSHHook connection ( #5558 )
...
Prevent overwrite of key_file by connection if parameter was provided to SSHHook
2019-07-12 07:57:04 +08:00
d2f224992e
[AIRFLOW-XXX] Correct BaseSensorOperator docs ( #5562 )
2019-07-11 18:35:04 +01:00
f29c7fc114
[AIRFLOW-1740] Fix xcom creation and update via RBAC UI ( #5561 )
2019-07-11 18:28:48 +01:00
8f41eb75ad
[AIRFLOW-4905] Add colours to flake8 output ( #5541 )
2019-07-11 14:06:44 +01:00
fb93df142b
[AIRFLOW-3495] Validate one of query and query_uri passed to DataProcSparkSqlOperator ( #5510 )
...
DataProcSparkSqlOperator and DataProcHiveOperator are working either with query
or query_uri. Passing both doesn't make sense so check at construction time.
2019-07-11 13:52:46 +01:00
b516183d68
[AIRFLOW-4868] Fix typo in kubernetes/docker/build.sh ( #5505 )
2019-07-11 11:33:35 +01:00
b49cbdd237
[AIRFLOW-4925] Improve css style for Variables Import file field ( #5552 )
2019-07-11 11:27:46 +01:00
d1be189b9a
[AIRFLOW-XXX] Add Caesars Entertainment to list of users ( #5536 )
...
[ci-skip]
2019-07-11 11:24:53 +01:00
f45ae7ed39
[AIRFLOW-3761] Skip drop constraint for SQLlite, not necessary ( #5538 )
2019-07-11 11:24:07 +01:00
516e017cff
[AIRFLOW-4906] Improve debugging for the SparkSubmitHook ( #5542 )
2019-07-11 11:22:20 +01:00
f340a81133
[AIRFLOW-4904] Retrieve test config file from $AIRFLOW_TEST_CONFIG ( #5540 )
...
It defaults to the same location but this allows the location to be changed.
We may remove this test config file entirely in the future, but for now this lets the
location of this file be controlled.
2019-07-11 11:20:58 +01:00
356b7fe756
[AIRFLOW-XXX] adding a Cryptalizer.com to list of companies ( #5529 )
...
[ci-skip]
2019-07-11 11:16:34 +01:00
10570ef9fa
[AIRFLOW-4587] Replace self.conn with self.get_conn() in AWSAthenaHook ( #5545 )
2019-07-11 11:13:36 +01:00
5aaeb721ce
[AIRFLOW-4926] Fix example dags where its start_date is datetime.utcnow() ( #5553 )
2019-07-11 14:13:27 +08:00
6de4ba3313
[AIRFLOW-4919] DataProcJobBaseOperator dataproc_properties templated ( #5554 )
...
* [AIRFLOW-4919] DataProcJobBaseOperator change dataproc_properties to be templated
Add dataproc_properties to templated fields.
2019-07-10 21:40:32 +02:00
a1f9d9a03f
[AIRFLOW-4911] Silence the FORBIDDEN errors from the KubernetesExecutor ( #5547 )
...
* [AIRFLOW-4911] Silence the FORBIDDEN errors from the KubernetesExecutor
* switch to WARN
* add to show message from ApiException
2019-07-08 16:04:05 -07:00
9d92eae22e
[AIRFLOW-XXX] Adds Beamly to the list of users ( #5537 )
2019-07-08 10:27:26 -07:00
7577fef9e4
[AIRLFOW-XXX] Add Revolut to the list of Airflow users ( #5544 )
2019-07-07 21:03:15 -07:00
2b366934cd
[AIRFLOW-4900] Resolve incompatible version of Werkzeug ( #5535 )
...
* [AIRFLOW-4900] Resolve incompatible version of Werkzeug
Pin Werkzeug version to >= 0.15 as flask requirement needs it.
* Update setup.py
2019-07-05 20:16:57 +02:00
332be91d00
[AIRFLOW-4876] Making tests in CoreTest rerunnable ( #5508 )
...
- all related DagRun, TaskInstance and TaskFail objects are properly removed on tear down
- replaced "models.<ModelName>" importing with "<ModelName>" direct usage
- extracted test specific DAG ids into test suit constants
- small linter improvements
2019-07-05 18:57:41 +02:00
2bdb053db6
[AIRFLOW-4797] Improve performance and behaviour of zombie detection ( #5511 )
...
Moved query to fetch zombies from DagFileProcessorManager to DagBag class. Changed query to only look for DAGs of the current DAG bag. The query now uses index ti_dag_state instead of ti_state. Removed no longer required zombies parameters from many function signatures.
The query is now executed on every call to DagBag.kill_zombies which is called when the DAG file is processed which frequency depends on scheduler_heartbeat_sec and processor_poll_interval (AFAIU). The query is faster than the previous one (see also stats below). It's also negligible IMHO because during DAG file processing many other queries (DAG runs and task instances are created, task instance dependencies are checked) are executed.
2019-07-04 21:49:21 +01:00
977af469d3
[AIRFLOW-4895] Import Iterable from collections.abc to fix DeprecationWarning in airflow.utils ( #5533 )
2019-07-04 20:41:32 +01:00
21a7e7ec67
[AIRFLOW-XXX] Add Huq Industries to company list in readme ( #5532 )
2019-07-04 22:19:52 +08:00
526c65a572
[AIRFLOW-4478] Lazily instantiate default resources objects. ( #5259 )
...
Instantiating `Resources` and its child classes takes non-negligible
time when users create many operators. To save time, don't create the
resources object until it is needed.
2019-07-04 14:55:55 +01:00
dc6909f0e2
[AIRFLOW-4891] Extend list of pylint good-names ( #5524 )
2019-07-04 15:12:09 +02:00
6f795ff8ae
[AIRFLOW-3360] Make the DAGs search respect other querystring parameters with url-search-params-polyfill for IE support ( #5503 )
2019-07-04 14:05:44 +01:00
ce6fe31f2a
[AIRFLOW-4896] Make KubernetesExecutorConfig's default args immutable ( #5534 )
2019-07-04 14:03:12 +01:00
42033d2fec
[AIRFLOW-4494] Remove `shell=True` in DaskExecutor ( #5273 )
...
Signed-off-by: MisLink <gjq.uoiai@outlook.com>
2019-07-04 12:02:12 +01:00
75872a2c41
[AIRFLOW-4510] Don't mutate default_args during DAG initialization ( #5277 )
...
While initializing a DAG, default_args is being mutated. If another
DAG is created in the same file with the same default_args, it gets
initialized with the incorrect Timezone information.
2019-07-04 11:29:59 +02:00
be6a0e76a9
[AIRFLOW-XXX] Add City of Toronto to official users list ( #5526 )
...
[ci skip]
2019-07-03 19:03:55 +01:00
9652d30606
[AIRFLOW-XXX] Add Growbots as the user of Airflow ( #5523 )
...
[ci skip]
2019-07-03 14:46:43 +01:00
738e2b7d1e
[AIRFLOW-XXX] Add LokSuvidha to list of companies using Airflow ( #5520 )
...
[ci skip]
2019-07-03 13:38:24 +01:00
Elliott Shugerman
Joshua Carp
Kamil Breguła
Ash Berlin-Taylor
shuwen-zhang
Tomek
Lu Zhu
jmccallum-premise
Jarek Potiuk
Nathaniel Ritholtz
eladkal
Matthew Bowden
Felix Uellendall
Facu
Bluesn0w
Andrii Soldatenko
Fokko Driesprong
Matthew Rastovac
smogili1
Bhavika Tekwani
Christopher Alcock
Canh Duong
Luqman Abdul Mushawwir
Jarek
Stefan Seelmann
Xtreak
Alessandro Puccetti
Alex
Philippe Gagnon
MisLink
Abhishek Ray
Evan Savage
Saurabh Wahile