b7f0245e36
AIRFLOW-21 upgrade GCP client lib
2016-05-05 08:56:50 +02:00
844eb2c8d0
AIRFLOW-15: Remove gcloud
2016-04-28 13:45:09 -07:00
11c34c4353
Implement a Cloudant hook
2016-04-19 16:11:54 -04:00
afb826aec2
Add PyOpenSSL to Google cloud gcp_api.
2016-04-12 12:22:49 -07:00
4865ee66ba
Merge pull request #855 from bolkedebruin/ISSUE-852
...
Use proper signal handling and cascade signals to children (Fix #852 )
2016-04-06 20:41:24 +02:00
e8c1144bb8
Add consistent and thorough signal handling and logging
...
Airflow spawns childs in the form of a webserver, scheduler, and executors.
If the parent gets terminated (SIGTERM) it needs to properly propagate the
signals to the childs otherwise these will get orphaned and end up as
zombie processes. This patch resolves that issue.
In addition Airflow does not store the PID of its services so they can be
managed by traditional unix systems services like rc.d / upstart / systemd
and the likes. This patch adds the "--pid" flag. By default it stores the
PID in ~/airflow/airflow-<service>.pid
Lastly, the patch adds support for different log file locations: log,
stdout, and stderr (respectively: --log-file, --stdout, --stderr). By
default these are stored in ~/airflow/airflow-<service>.log/out/err.
* Resolves ISSUE-852
2016-04-06 20:40:43 +02:00
81ff5cccb7
Allow Operators to specify SKIPPED status internally
...
* Added ability to skip DAG elements based on raised Exception
* Added nose-parameterized to test dependencies
* Fix for broken mysql test - provided by jlowin
2016-04-06 13:23:49 -04:00
6581858703
Missing comma in setup.py
2016-04-05 08:21:43 -04:00
10ee622330
Deprecate *args and **kwargs in BaseOperator
...
BaseOperator silently accepts any arguments. This deprecates the
behavior with a warning that says it will be forbidden in Airflow 2.0.
This PR also turns on DeprecationWarnings by default, which in turn
revealed that inspect.getargspec is deprecated. Here it is replaced by
`inspect.signature` (Python 3) or `funcsigs.signature` (Python 2).
Lastly, this brought to attention that example_http_operator was
passing an illegal argument.
2016-04-05 10:04:55 +02:00
da43737e73
Add pypi meta data and sync version number
2016-03-31 21:42:30 +02:00
f347ee709f
Merge pull request #1128 from bolkedebruin/hivemeta_sasl
...
Add GSSAPI SASL to HiveMetaStoreHook.
2016-03-30 09:17:50 +02:00
1981f6cb6e
Fix required gcloud version
2016-03-28 18:33:39 -04:00
657aebbd0e
Merge branch 'master' into hivemeta_sasl
2016-03-28 12:07:47 +02:00
a7c9c4a11a
Changes to Contributing to reflect more closely the current state of development.
2016-03-21 15:12:08 -07:00
1b75315cd5
Merge remote-tracking branch 'upstream/master' into minicluster
2016-03-20 10:20:43 +01:00
5603afa5f7
Use unicodecsv to make it py3 compatible
2016-03-19 13:21:44 +01:00
4af24ee2df
Allow users to set hdfs_namenode_principal in HDFSHook config
...
snakebite library just added the support to specify hdfs_namenode_principal
for Kerberos auth method, and this PR allows users to pass in this config from HDFSHook
Also bump the version of snakebite
2016-03-18 11:25:02 -07:00
ee9d372d5a
Merge branch 'impyla' into minicluster
2016-03-18 14:07:49 +01:00
4c73677bf1
Merge pull request #1137 from jlowin/rls3
...
Remote Log Storage (take 2)
2016-03-17 16:08:53 -07:00
e2336faa79
version cap for gcp_api
2016-03-17 17:49:02 -04:00
cbf139cfb6
Cranking up slackclient dep to 1.0
2016-03-08 17:26:19 -05:00
166c78d9c9
Add GSSAPI SASL to HiveMetaStoreHook.
...
Will probably only work with python 2.7 until thrift 1.0 is released
2016-03-05 22:18:31 +01:00
e45372fb55
ISSUE-1123 Use impyla instead of pyhs2
2016-03-05 20:15:41 +01:00
7e9fb21bb8
Merge branch 'gcp_api' into gcp
2016-03-04 18:46:44 -05:00
a4b9e5849f
rename gcp -> gcloud
2016-03-04 17:47:11 -05:00
bdd8ade782
add google-api-python-client to extras
2016-03-04 16:37:53 -05:00
596270fcde
add gcp extras
2016-03-04 16:26:04 -05:00
4d7c75e1c5
move oauth2client<2 and httplib2 out of requirements
2016-03-04 16:07:04 -05:00
668b879c2f
Add direct dependencies for Google cloud contribs
...
Switch freeze version to use setup.py like other requirements do.
2016-02-17 07:56:40 -08:00
c4e4b0606a
Adding mock lib to devel extras_require
2016-02-07 13:07:11 -08:00
eac1edd8ae
Merge pull request #882 from asnir/docker_operator
...
Docker operator
2016-01-29 09:27:08 -08:00
5779c18632
typos and xcom changes
2016-01-18 16:14:49 +05:30
2e6bf9b72f
The code was taken from: https://github.com/wndhydrnt/airflow/tree/docker_operator
...
Credit to: @wndhydrnt
This branch, came to solve the CI problems.
2016-01-17 11:44:06 +02:00
841d47c0d0
hoping it'll resolve conflicts
2016-01-15 17:32:59 +05:30
d0c32c90da
merging with master
2016-01-15 16:07:14 +05:30
645fda1d8e
Merge pull request #802 from mtp401/github_enterprise_auth
...
Implemented GitHub Enterprise Authentication
2016-01-05 15:54:04 -08:00
ed0f11b5fa
Merge pull request #822 from airbnb/airbnb_prod
...
Merging prod hotfixes into master
2016-01-05 11:13:57 -08:00
85ff87ee12
Adding missing file
2016-01-04 23:59:58 -08:00
8d0995159a
Upgrading from flask-admin 1.2 to 1.4
2016-01-04 23:46:32 -08:00
072f4e8d27
[hotfix] gunicorn version 19.4.? has issues serving static files
2016-01-04 12:56:37 -08:00
161e473ee4
v1.6.2
2016-01-04 12:19:18 -08:00
1486b43202
Trying to pin flask-admin lib to fix build
2016-01-02 22:14:31 -08:00
256578517c
Adding Qubole Operator
2015-12-28 17:50:28 +05:30
4796245be5
Implemented GHE authentication
2015-12-22 14:21:15 -05:00
8c7189ab0d
update requirements, tests and all that jazz
2015-11-30 09:47:36 -08:00
b0559e0c4b
adding an extra setup command to clean builds
2015-11-24 16:48:46 -08:00
819d2344bf
v1.6.1
2015-11-14 22:18:12 -08:00
14427019e8
Increase version for alembic due to
...
https://bitbucket.org/zzzeek/alembic/issues/333/batch-fails-on-tables-that-have-indexes
2015-11-14 19:57:52 +01:00
c595e1f455
Merge remote-tracking branch 'upstream/master'
2015-11-13 09:18:28 +01:00
fe4476f98a
Port of kerberos_login to new backend structure. Some cosmetic fixes to ldap_auth
2015-11-13 09:16:59 +01:00
Alex Van Boxel
Chris Riccomini
Matt Pelland
bolkedebruin
Bolke de Bruin
Paul Rhodes
Jeremiah Lowin
Arthur Wiedmer
Jiasi Zeng
Chris Riccomini
Maxime Beauchemin
Sumit Maheshwari
asnir
Rimas Silkaitis