Dingding is popular team collaboration tools talk
just like Slack. This PR is add it to master, could
help us easy send message to Dingding.
Add how to operator dingding section tell users
how to send different kind of dingding message or
how to use dingding as callback funtion in DAG
and add example to show how to use.
Set operator UI color as dingding icon color
Some command for installing extra packages like
`pip install apache-airflow[devel]` cause error
in special situation/shell, We should clear them
by add quotation like
`pip install 'apache-airflow[devel]'`
Some command for installing extra packages are
`pip install apache-airflow[devel]` we should
clear install extra package command to
`pip install 'apache-airflow[devel]'`
[ci skip]
* [AIRFLOW-3272] add base grpc hook
* [AIRFLOW-3272] fix based on comments and add more docs
* [AIRFLOW-3272] add extra fields to www_rabc view in connection model
* [AIRFLOW-3272] change url for grpc, fix some bugs
* [AIRFLOW-3272] Add mcck for grpc
* [AIRFLOW-3272] add unit tests for grpc hook
* [AIRFLOW-3272] add gRPC connection howto doc
* [AIRFLOW-3813] Add CLI commands to manage roles
Here is the help text of the new command `airflow roles`:
usage: airflow roles [-h] [-c] [-l] [role [role ...]]
positional arguments:
role The name of a role
optional arguments:
-h, --help show this help message and exit
-c, --create Create a new role
-l, --list List roles
Create is reentrant, i.e., it only adds a new role if it does not exist.
* Update docs on role creation
* [AIRFLOW-3752] Add/remove user from role via the CLI
Update the `users` subcommand to enable 2 new actions:
- `--add-role`: Make the user a member of the given role
- `--remove-role`: Remove the user's membership in the given role
For installations that use an external identity provider (e.g., Google
OAuth) the username is typically a long ID string. For the sake of
convenience, we allow the CLI operator to reference the target user
via either their `username` or their `email` (but not both).
* Update argparse spec
Accidentally left off this update to the argparse spec in the last
commit.
* Add unit tests
* Fix lint failures
This commit performs consistency change for tests for all GCP-related operators.
The operators were evolving over time and the approach to implement those
have changed over time. After some 30+ operators implemented, it's time
to introduce some consistency across all the operators. Those are:
* Separating out System test cases from Unit test cases
* Consistent names of variables that are used in system test cases
* Updated documentation to be consistent across the operators
* Updated examples to be better readable and runnable as System Tests
* Added helper methods that allow to make setUp/tearDown for System Tests
Extend the functionality of "/health" endpoint by:
1. Checking if database backend can be connected;
2. Checking the latest scheduler heartbeat
The response will be in format:
{
"metadatabase":{
"status":"healthy"
},
"scheduler":{
"status":"healthy",
"latest_scheduler_heartbeat":"2018-12-26 17:15:11+00:00"
}
}
This is done for both /www and /www_rbac.
No authentication is required to access this endpoint (no
sensitive information will be exposed through it).
Tests & documentation are added accordingly.
(Deleted an unnecessary line in airflow/www/views.py as well)
* Better instructions for airflow flower
It is not clear in the documentation that you need to have flower installed to successful run airflow flower. If you don't have flower installed, running airflow flower will show the following error which is not of much help:
airflow flower
[2018-11-20 17:01:14,836] {__init__.py:51} INFO - Using executor SequentialExecutor
Traceback (most recent call last):
File "/mnt/secondary/workspace/f4/typo-backend/pipelines/model-pipeline/airflow/bin/airflow", line 32, in <module>
args.func(args)
File "/mnt/secondary/workspace/f4/typo-backend/pipelines/model-pipeline/airflow/lib/python3.6/site-packages/airflow/utils/cli.py", line
74, in wrapper
return f(*args, **kwargs)
File "/mnt/secondary/workspace/f4/typo-backend/pipelines/model-pipeline/airflow/lib/python3.6/site-packages/airflow/bin/cli.py", line 1
221, in flower
broka, address, port, api, flower_conf, url_prefix])
File "/mnt/secondary/workspace/f4/typo-backend/pipelines/model-pipeline/airflow/lib/python3.6/os.py", line 559, in execvp
_execvpe(file, args)
File "/mnt/secondary/workspace/f4/typo-backend/pipelines/model-pipeline/airflow/lib/python3.6/os.py", line 604, in _execvpe
raise last_exc.with_traceback(tb)
File "/mnt/secondary/workspace/f4/typo-backend/pipelines/model-pipeline/airflow/lib/python3.6/os.py", line 594, in _execvpe
exec_func(fullname, *argrest) FileNotFoundError: [Errno 2] No such file or directory
* Update use-celery.rst
Antoni Smoliński
Kamil Breguła
Jiajie Zhong
Ryan Yuan
Ash Berlin-Taylor
Jarek Potiuk
morgendave
Jyothsna Kullatira
Szymon Przedwojski
Davor Cubranic
Andrew Stahlman
Tao Feng
Dana Ma
Joshua Carp
Vivek
Xiaodong
Dariusz Aniszewski
Felix
Kaxil Naik
Gabriel Nicolas Avellaneda