Граф коммитов

753 Коммитов

Автор SHA1 Сообщение Дата
Maxime Beauchemin 89df0b34e4 Merge pull request #227 from mistercrunch/mysql_preoperator
Adding a preoperator to HiveToMySqloperator to allow idempotence
2015-05-21 08:50:26 -04:00
Maxime 0cfc4b89b6 Adding a preoperator to HiveToMySqloperator to allow idempotence 2015-05-21 12:29:07 +00:00
Maxime Beauchemin 8e3539db29 Merge pull request #225 from mistercrunch/run_remote_works
Remote run won't pickle by default anymore
2015-05-21 08:16:50 -04:00
Maxime Beauchemin b80522a54a Merge pull request #226 from mistercrunch/remove_log_to_stdout_for_task_status
for consistency with list_dags and list_tasks
2015-05-21 08:07:43 -04:00
Arthur Wiedmer ca4c66139c for consistency with list_dags and list_tasks 2015-05-20 22:35:16 -07:00
Maxime 015d977304 Remote run won't pickle by default anymore 2015-05-21 05:21:58 +00:00
Maxime Beauchemin 1fb575a593 Docs tweaks 2015-05-20 16:14:35 -04:00
Maxime Beauchemin d45ab12cad Merge pull request #224 from mistercrunch/docs
Forgot to add the file...
2015-05-20 16:06:24 -04:00
Maxime a30d985ace Forgot to add the file... 2015-05-20 20:05:55 +00:00
Maxime Beauchemin 1b726135ac Merge pull request #223 from mistercrunch/docs
Added an entry for the Scheduler in the docs
2015-05-20 16:04:57 -04:00
Maxime b0e3602423 Added an entry for the Scheduler in the docs 2015-05-20 20:04:14 +00:00
Maxime 48a35b33e7 Smoother loading on main page 2015-05-20 19:04:38 +00:00
Maxime Beauchemin e974c73287 Merge pull request #222 from mistercrunch/load_exmamples
Adding a config param to not load example dags
2015-05-20 09:41:07 -04:00
Maxime Beauchemin f36c22048e Adding a config param to not load example dags 2015-05-20 09:28:32 -04:00
Arthur Wiedmer 9e9ec09c6c Merge pull request #221 from mistercrunch/artwr/s3_fuzzy_key_matching
Adding wildcard matching for S3 hook and operators
2015-05-19 22:02:30 -07:00
Arthur Wiedmer c47b59b99e Adding wildcard matching for S3 hook and operators 2015-05-19 18:05:12 -07:00
Maxime Beauchemin 50e38080be Adding redis to reqs.txt 2015-05-18 22:34:09 -07:00
Maxime Beauchemin 1a62f00d07 Merge pull request #220 from mistercrunch/tmpfolder_hive_op
Running HiveCliHook execute in a temp working directory
2015-05-18 15:12:41 -07:00
Maxime f591039258 Running HiveCliHook execute in a temp working directory 2015-05-18 20:53:46 +00:00
Maxime Beauchemin 51ea192a04 Catching celery's REVOKED state 2015-05-18 11:05:42 -07:00
Maxime a9e6807885 Preventing odd RabbitMQ failures 2015-05-18 04:56:32 +00:00
Maxime Beauchemin 5c5a82c581 Merge pull request #219 from mistercrunch/main_page
Minor UI polish
2015-05-17 21:48:14 -07:00
Maxime f2fe74b57b Minor UI polish 2015-05-18 04:47:34 +00:00
Maxime Beauchemin e82accb783 Only one heartbeat after all DAGs are enqueued 2015-05-17 18:20:56 -07:00
Maxime Beauchemin a414fd0324 One more debug logging message in the scheduler 2015-05-17 17:42:02 -07:00
Maxime Beauchemin e5b379f218 Merge pull request #218 from mistercrunch/main_page
New main page
2015-05-17 14:51:24 -07:00
Maxime d5d1e9ddaf New main page 2015-05-17 21:49:46 +00:00
Maxime Beauchemin d8d66c786d Fixes around HDFSSensor 2015-05-16 14:48:24 -07:00
Maxime Beauchemin 4fb8bff70f Merge pull request #215 from mistercrunch/add_sqlite_default_conn
add sqlite default connection
2015-05-16 14:26:59 -07:00
Maxime Beauchemin 5e7680da21 Allowing different executors for the SubDagOperator 2015-05-16 14:21:29 -07:00
Maxime Beauchemin e4d1c25fcb More debug logging for the Scheduler 2015-05-16 11:50:20 -07:00
Maxime Beauchemin d113d39884 Adding logging entry in CeleryExecutor to help debug 2015-05-16 09:44:13 -07:00
Aaron Keys c61a5d8d81 add sqlite default connection 2015-05-15 21:26:34 -07:00
Maxime Beauchemin 1540654541 Merge pull request #214 from mistercrunch/add_sqlite_hook
add sqlite hook
2015-05-15 21:20:50 -07:00
Aaron Keys 5489ff9f56 add doctests 2015-05-15 20:57:50 -07:00
Maxime Beauchemin 3523d660ef BaseExecutor bugfix 2015-05-15 14:20:00 -07:00
Aaron Keys d5494dffeb fix docstring 2015-05-15 09:44:32 -07:00
Maxime f6ce1e2c01 Adding shortcut to filtered dag view on TaskInstance view 2015-05-15 15:50:32 +00:00
Maxime Beauchemin 46949db993 Bugfix 2015-05-15 08:26:28 -07:00
Maxime Beauchemin 9ae7e6c847 Merge pull request #207 from mistercrunch/priority
Prioritization and concurency limitation on executor queues
2015-05-15 07:38:51 -07:00
Aaron Keys 4069c55013 add sqlite hook 2015-05-14 23:14:17 -07:00
Maxime Beauchemin ec8bf5489a Removing unique constraint on conn_id 2015-05-14 16:54:09 -07:00
Maxime Beauchemin e96ceb7860 Fix 2 ongoing issues 2015-05-14 16:33:13 -07:00
Arthur Wiedmer 6fc5c86a79 Merge pull request #211 from mistercrunch/cli_task_state
add task_state command and correct help messages for misc options
2015-05-12 08:51:03 -07:00
Maxime b9fc46ca5c Showing paused DAGs in DAGs view 2015-05-11 23:39:38 +00:00
Maxime 935aa88324 Fixed collision on self.queue 2015-05-11 23:35:37 +00:00
Aaron Keys 77bcb1b8ea Merge pull request #209 from mistercrunch/hdfs_hook
add hdfs hook and update hdfs sensor to work with HA configuration
2015-05-11 15:56:24 -07:00
Arthur Wiedmer 07b3ff9210 add task_state command and correct help messages for misc options 2015-05-11 09:44:51 -07:00
Maxime Beauchemin 6500af8f1b Merge pull request #210 from mistercrunch/conns
Fixing os file timestamp read race condition
2015-05-11 08:16:14 -07:00
Maxime Beauchemin cb9b1b9696 Fixing file timestamp read race condition 2015-05-11 08:13:29 -07:00