Граф коммитов

9419 Коммитов

Автор SHA1 Сообщение Дата
Kaxil Naik 5c895154ed
Make airflow/models/xcom.py Pylint Compatible (#9658) 2020-07-05 08:56:43 +02:00
Kaxil Naik a2abac937a
Remove duplicate License lines in airflow/lineage/entities.py (#9659)
The license details are repeated twice
2020-07-05 08:55:58 +02:00
j-y-matsubara 5670e6f185
Support .airflowignore for plugins (#9531) 2020-07-04 11:04:05 +02:00
Jarek Potiuk 5e4b801b32
Test are triggered now on more changes. (#9646)
Sometimes tests were not triggered when they should be.
This change will cause the tests to be triggered when anything
changes in "airflow" or "charts" additionally to what we had
before.
2020-07-03 23:50:57 +02:00
Jarek Potiuk be6ed86ccd
Fixed failing Kubernetes tests after deny_all for experimental API (#9647)
The tests were broken by #9611
2020-07-03 21:28:43 +01:00
Aneesh Joseph a99aaeb496
Allow setting Hashicorp Vault token from File (#9644) 2020-07-03 18:15:56 +01:00
Ephraim Anierobi fddc5721c9
Customizable page size limit in API (#9431)
Co-authored-by: Kamil Breguła <mik-laj@users.noreply.github.com>
2020-07-03 10:14:31 +02:00
Bryant Larsen 72d5a58fd7
Fixing typo in chart/README.me (#9632)
* Fixing typo in readme
2020-07-02 22:57:55 +02:00
Aviral Agrawal 37ca8ad638
Updated link to official documentation (#9629)
The link to official documentation should point to the documentation page instead of the home page.
2020-07-02 16:23:27 +02:00
Aneesh Joseph 611d449a45
Use supports_read instead of is_supported in log endpoint (#9628) 2020-07-02 15:55:49 +02:00
Ephraim Anierobi ee20086b8c
Move S3TaskHandler to the AWS provider package (#9602) 2020-07-02 12:45:58 +02:00
Tomek Urbaszek ce9bad4914
Improve queries number SchedulerJob._process_executor_events (#9488) 2020-07-02 12:30:17 +02:00
Mauricio De Diana e50e94613a
Task logging handlers can provide custom log links (#9354)
Use a mixin to define log handlers based on remote services. The main
changes are:
 - Create RemoteLoggingMixin to define remote log handlers.
 - Remove explicit mentions to Elasticsearch in dag.html.
 - Rename the /elasticsearch endpoint in views.py to
   /redirect_to_remote_log and dispatch the remote URL building to the
   log handler.

Co-authored-by: Kamil Breguła <mik-laj@users.noreply.github.com>
2020-07-02 11:15:53 +02:00
Kaxil Naik 5cf2585445
Fix docstrings in exceptions.py (#9622) 2020-07-02 09:55:17 +01:00
Tomek Urbaszek cd3d9d9340
Fix using .json template extension in GMP operators (#9566) 2020-07-02 10:43:44 +02:00
Kaxil Naik 63a8c79aa9
Replace old SubDag zoom screenshot with new (#9621) 2020-07-02 00:18:08 +01:00
Kaxil Naik 05c88cb392
Replace old Variables View Screenshot with new (#9620) 2020-07-01 23:51:18 +01:00
Kaxil Naik bc3f48c966
Change 'initiate' to 'initialize' in installation.rst (#9619)
`Initiating Airflow Database` -> `Initializing Airflow Database`
2020-07-01 23:34:25 +01:00
Kaxil Naik 7ef7f5880d
Update docs about the change to default auth for experimental API (#9617) 2020-07-01 22:59:13 +01:00
Kaxil Naik 1655fa9253
Restrict changing XCom values from the Webserver (#9614) 2020-07-01 22:13:10 +01:00
Jarek Potiuk a3a52c78b2
Removes importlib usage - it's not needed (fails on Airflow 1.10) (#9613) 2020-07-01 18:07:12 +02:00
Ash Berlin-Taylor 9e305d6b81
Change default auth for experimental backend to deny_all (#9611)
In a move that should surprise no one, a number of users do not read,
and leave the API wide open by default. Safe is better than powned
2020-07-01 17:04:35 +01:00
Kaxil Naik 65855e558f
Add docs to change Colors on the Webserver (#9607)
Feature was added in https://github.com/apache/airflow/pull/9520
2020-07-01 16:17:29 +01:00
Kamil Breguła 48a8316646
Fix quarantined tests - TestCliWebServer (#9598) 2020-07-01 15:12:47 +01:00
Jarek Potiuk f3e1f9a313
Update Breeze documentation (#9608)
* Update Breeze documentation
2020-07-01 16:02:24 +02:00
Jarek Potiuk 8bd15ef634
Switches to Helm Chart for Kubernetes tests (#9468)
The Kubernetes tests are now run using Helm chart
rather than the custom templates we used to have.

The Helm Chart uses locally build production image
so the tests are testing not only Airflow but also
Helm Chart and a Production image - all at the
same time. Later on we will add more tests
covering more functionalities of both Helm Chart
and Production Image. This is the first step to
get all of those bundle together and become
testable.

This change introduces also 'shell' sub-command
for Breeze's kind-cluster command and
EMBEDDED_DAGS build args for production image -
both of them useful to run the Kubernetes tests
more easily - without building two images
and with an easy-to-iterate-over-tests
shell command - which works without any
other development environment.

Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
Co-authored-by: Daniel Imberman <daniel@astronomer.io>
2020-07-01 14:50:30 +02:00
Giancarlo Romeo 2d3677fe7d
Fix typo in tutorial.rst (#9605) 2020-07-01 12:12:23 +02:00
Kaxil Naik 7a5441836b
Move XCom tests to tests/models/test_xcom.py (#9601)
Move XCom tests from `tests/models/test_cleartasks.py` to `tests/models/test_xcom.py`
2020-07-01 08:38:49 +02:00
Kaxil Naik 58edc38f45
Fix typo in the word 'available' (#9599)
`avaible` -> `available`
2020-07-01 08:36:19 +02:00
Danylo Baibak 87d83a1ae3
Fix regression in SQLThresholdCheckOperator (#9312) 2020-07-01 00:22:37 +02:00
Kaxil Naik bbfaafeb55
Fix broken link in chart/README.md (#9591)
`CONTRIBUTING.md` -> `../CONTRIBUTING.rst`
2020-06-30 17:03:11 +01:00
Kaxil Naik d6b323b0cd
Remove redundant airflowVersion from Helm Chart readme (#9592)
We no longer use `airflowVersion` , we instead use `defaultAirflowRepository` and `defaultAirflowTag`
2020-06-30 17:02:56 +01:00
Kaxil Naik f429c3c8e3
Fix failing test in test_webserver_command (#9589) 2020-06-30 14:03:25 +01:00
Tomek Urbaszek 4799af30ee
Extend BigQuery example with include clause (#9572) 2020-06-30 14:02:23 +02:00
Tomek Urbaszek e33f1a12d7
Add template_ext to BigQueryInsertJobOperator (#9568) 2020-06-30 14:00:44 +02:00
Kaxil Naik b6c27f2879
Change worker_refresh_interval fallback to default of 30 (#9588)
The default value for worker_refresh_interval is 30, so we should align the fallback to 30 too
2020-06-30 12:58:59 +01:00
Tomek Urbaszek 7f70f6f720
Use pfromat instead of str to render arguments in WebUI (#9587) 2020-06-30 12:21:57 +02:00
Kaxil Naik 4de5089fd2
Add more info on dry-run CLI option (#9582)
fixes  https://github.com/apache/airflow/issues/9561
2020-06-30 10:04:25 +02:00
Kaxil Naik d0e010f1f7
Add XCom.get_one() method back (#9580) 2020-06-30 08:34:23 +01:00
angadsingh af14fb22f9
Add TruFactor to Airflow users list (#9584) 2020-06-30 09:07:52 +02:00
Omair Khan ac070cf006
Remove PATCH /dags/{dag_id}/dagRuns/{dag_run_id} endpoint(#9476)
Dag Runs are immutable for third-party applications.
2020-06-30 07:50:20 +02:00
Omair Khan 22fbd0f32d
Add CRUD Endpoints for pools (#9329) 2020-06-30 07:47:48 +02:00
Ephraim Anierobi 59035a0b36
Add log endpoint (#9331)
Co-authored-by: Kamil Breguła <kamil.bregula@polidea.com>
2020-06-30 07:44:35 +02:00
Kaxil Naik d214f8dbef
Fix typos in cloud_memorystore.rst (#9581) 2020-06-30 01:39:40 +01:00
Kaxil Naik a2cf5a0e3f
Fix typo in password (#9579)
`pasword` -> `password`
2020-06-30 01:00:01 +01:00
Kaxil Naik ce4c2297c6
Add docs on using DAGRun.conf (#9578)
closes https://github.com/apache/airflow/issues/8900
2020-06-30 00:59:40 +01:00
Kamil Breguła 656c48da9c
Add docs about reload_on_plugin_change opiton (#9575) 2020-06-29 23:24:24 +02:00
Kamil Breguła bb2f3fed28
Raise exception on invalid type in pre_commit_yaml_to_cfg.py (#9577) 2020-06-29 23:22:40 +02:00
Kamil Breguła 9858294f72
Fix failing tests from #8997 (#9576) 2020-06-29 22:09:53 +02:00
rahul-ve ada8366d1c
"build-essential" are needed for proper install on Linux (#9573)
On a fresh install of Windows Subsystem for Linux (Ubuntu 20.04), created a conda environment and tried to follow the above guide  to install airflow but was getting gcc errors. Installing build-essential solved the issue.  

On Windows 10, with a clean conda environment, setproctitle fails to install with error "Microsoft Visual C++ 14.0 is required". Suggests to install "Microsoft Visual C++ Build Tools".  I got this both on Python version 3.8.3 and 3.5.6

May be add some prerequisites about Windows and Python versions?
2020-06-29 21:13:13 +02:00