Azure
/
azure-event-hubs-spark
зеркало из https://github.com/Azure/azure-event-hubs-spark.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
300 коммитов 32 Ветки 39 Теги 23 MiB
Граф коммитов

300 Коммитов

Автор SHA1 Сообщение Дата
Sabee Grewal 192c132812 adding template for issues and pull requests 2017-10-11 11:19:50 -07:00
Sabee Grewal 035826e525 Update CONTRIBUTING.md 2017-10-10 10:57:19 -07:00
Sabee Grewal 20a257c891 Update CONTRIBUTING.md 2017-10-10 10:56:52 -07:00
Sabee Grewal 1e30af4de8 second draft: fixed broken links, formatting, and typos 2017-10-10 10:55:01 -07:00
Sabee Grewal ec4e007d29 first draft of CONTRIBUTING.md 2017-10-10 10:49:00 -07:00
Sabee Grewal f815f1f3e2 Last round of edits to README 2017-10-10 10:11:39 -07:00
Sabee Grewal d6c1ff5ac7 additional updates to the README: bolded phrases and fixed broken links 2017-10-10 10:08:13 -07:00
Sabee Grewal 20510f9f3e initial repo clean up: first draft of new README, unfinished docs/README and CONTRIBUTING, removed javadocs folder 2017-10-10 09:53:29 -07:00
sabeegrewal 0a9704a4db updating pom and README with new repo location 2017-10-09 15:10:00 -07:00
sabeegrewal b51c385d81 updating to latest EventHubs java client and removing redundancies in traces 2017-10-06 09:20:10 -07:00
sabeegrewal c14b59793e adding tracing in shutdown methods 2017-10-04 15:28:10 -07:00
Sabee Grewal c9d864249f Excluding maven-repo branch from Travis CI 2017-10-03 15:16:17 -07:00
sabeegrewal 3c601e0894 updating pom and README to show up to date repo status 2017-10-03 15:08:54 -07:00
Sabee Grewal 03bd8509a0 Merge pull request #166 from sabeegrewal/2.1.x 
2.1.x
 2017-10-03 13:43:57 -07:00
Sabee Grewal be0df5b2d4 Update ProgressTrackerBase.scala 2017-10-03 13:39:13 -07:00
Sabee Grewal 289b617109 Update ProgressTrackerBase.scala 2017-10-03 13:36:49 -07:00
Sabee Grewal 7a34e39bd9 Merge branch 'master' into 2.1.x 2017-10-03 13:35:31 -07:00
Sabee Grewal 5100b4a5e8 Merge pull request #164 from sabeegrewal/progressClean 
Moving to version 0.15.0 of the EventHubs Java Client
 2017-10-02 17:18:18 -07:00
sabeegrewal 2f6d2c2913 updating import order 2017-10-02 17:11:01 -07:00
sabeegrewal ef3781eeee updating to new namespace in tests as well 2017-10-02 17:08:47 -07:00
sabeegrewal ba45c101bb updating import statements to new eventhubs namespace 2017-10-02 17:06:52 -07:00
sabeegrewal 00fe018f0c moving to the latest eventhubs java client 2017-10-02 16:59:46 -07:00
Sabee Grewal 119192860e Merge pull request #163 from sabeegrewal/progressClean 
Slight cleanup to code base
 2017-10-02 16:38:26 -07:00
sabeegrewal 978013d7a3 splitting lines at arguments 2017-10-02 16:27:39 -07:00
sabeegrewal 62e026187e reverting minor style changes 2017-10-02 16:23:45 -07:00
sabeegrewal 2da0b9e507 removing unused print statement 2017-10-02 15:01:57 -07:00
sabeegrewal 8f85f53097 updating comments and spacing for more consistent style 2017-10-02 14:50:10 -07:00
sabeegrewal 93cb52cf86 reverting to scalastyle 0.8.0 2017-10-02 13:39:58 -07:00
sabeegrewal f65f54e0e3 fixing bug in test 2017-09-29 16:30:46 -07:00
sabeegrewal 784465dc5e more scalastyle fixes 2017-09-29 15:16:14 -07:00
sabeegrewal afb2fad2fb fixing scalastyle issues and build warnings 2017-09-29 15:12:37 -07:00
sabeegrewal ac08f53112 changing scalastyle version 2017-09-29 14:51:50 -07:00
sabeegrewal 7efda0fe29 cleaning up code and re-working progress tracking code 2017-09-29 14:43:24 -07:00
Nan Zhu ca3223964e fast initialization of progress tracker (#162) 
* [spark-2.1.x] making EventHub API call every batch (#156)

* making EventHub API call every batch

* remove unused import

* style fix

* Bug fix

* same bug fix but for DStreams

* [2.1.x] fast initialization of progress tracker (#158)

* metadata path setup and fall back to list all mechanism

* delete progress file directory after each test

* fix the failed test

* add test for metdata exist

* add test for read progress file

* revise mockito test

* update pom

* pass in all params with mockit

* change the return value of getLatestFile

* add test for checking if really queried metadata

* test: When metadata presents, we should respect it even the more recent progress file is there

* update import

* add writing logic of metadata

* update tests

* add log

* add logging

* revise logging

* add logging in commit() of structured streaming

* fix the test

* revise test for metadata not committed

* revise tests

* fix the failed test

* add partially committed progress file test

* add test of upgrade

* update upgrade test

* add test for upgrading structured streaming

* add test for no metadata

* update test name

* enabling cleanup thread

* cancel cleanup task

* add tracing

* test for fishy change

* test for fishy change

* fix the path

* code clean

* address the comments

* missed one
 2017-09-29 09:15:13 -07:00
Nan Zhu 750c30df42 [2.1.x] fast initialization of progress tracker (#158) 
* metadata path setup and fall back to list all mechanism

* delete progress file directory after each test

* fix the failed test

* add test for metdata exist

* add test for read progress file

* revise mockito test

* update pom

* pass in all params with mockit

* change the return value of getLatestFile

* add test for checking if really queried metadata

* test: When metadata presents, we should respect it even the more recent progress file is there

* update import

* add writing logic of metadata

* update tests

* add log

* add logging

* revise logging

* add logging in commit() of structured streaming

* fix the test

* revise test for metadata not committed

* revise tests

* fix the failed test

* add partially committed progress file test

* add test of upgrade

* update upgrade test

* add test for upgrading structured streaming

* add test for no metadata

* update test name

* enabling cleanup thread

* cancel cleanup task

* add tracing

* test for fishy change

* test for fishy change

* fix the path

* code clean

* address the comments

* missed one
 2017-09-28 08:39:45 -07:00
Nan Zhu c06e0fbc69 prepare for 2.2 release (#159) 
* update version for 2.1.3

* [2.1.x] should update highest offset when wake up by notify() (#153)

* should update highest offset when wake up by notify()

* fix test

* making EventHubs API call for every partition each batch
 2017-09-26 16:07:52 -07:00
Sabee Grewal 8c9b755355 [spark-2.1.x] making EventHub API call every batch (#156) 
* making EventHub API call every batch

* remove unused import

* style fix

* Bug fix

* same bug fix but for DStreams
 2017-09-25 12:00:09 -07:00
SJ f24cf42e64 Merge pull request #155 from sabeegrewal/2.1.x 
making EventHubs API call for every partition each batch
 2017-09-23 21:01:37 -07:00
Sabee Grewal 612cb99d30 making EventHubs API call for every partition each batch 2017-09-23 17:23:20 -07:00
Nan Zhu b1e026758a update version number (#154) 
* change version number to 2.1.4

* update to 2.1.5-SNAPSHOT
 2017-09-21 09:49:16 -07:00
Nan Zhu bf811ad983 Update change_log.md 2017-09-21 09:46:16 -07:00
Nan Zhu ab9eea9bea Update README.md 2017-09-21 09:44:04 -07:00
Nan Zhu e3bbd70d3b Update README.md 2017-09-20 20:10:43 -07:00
Nan Zhu 83ecc28dd1 [2.1.x] should update highest offset when wake up by notify() (#153) 
* should update highest offset when wake up by notify()

* fix test
 2017-09-20 13:44:59 -07:00
Nan Zhu a204d3bb3b update version number (#148) 2017-09-19 13:35:07 -07:00
Nan Zhu c107b5c928 update version to 2.1.4-SNAPSHOT (#147) 2017-09-19 13:32:24 -07:00
Nan Zhu dd9c13ecb2 Update change_log.md 2017-09-19 08:35:49 -07:00
Nan Zhu e20c96fe7c fix wrong start offset in the first batch (#146) 
* update version for 2.1.3

* Update README.md

* Update Change Log

* fix wrong start offset in the first batch
 2017-09-18 15:15:11 -07:00
Nan Zhu 44f1d9e46a fix wrong start offset in the first batch (#145) 2017-09-18 15:14:05 -07:00
Nan Zhu 3c3fb4d548 change log (#144) 
* update version for 2.1.3

* Update README.md

* Update Change Log
 2017-09-18 11:18:11 -07:00