* metadata path setup and fall back to list all mechanism
* delete progress file directory after each test
* fix the failed test
* add test for metdata exist
* add test for read progress file
* revise mockito test
* update pom
* pass in all params with mockit
* change the return value of getLatestFile
* add test for checking if really queried metadata
* test: When metadata presents, we should respect it even the more recent progress file is there
* update import
* add writing logic of metadata
* update tests
* add log
* add logging
* revise logging
* add logging in commit() of structured streaming
* fix the test
* revise test for metadata not committed
* revise tests
* fix the failed test
* add partially committed progress file test
* add test of upgrade
* update upgrade test
* add test for upgrading structured streaming
* add test for no metadata
* update test name
* enabling cleanup thread
* cancel cleanup task
* add tracing
* test for fishy change
* test for fishy change
* fix the path
* code clean
* address the comments
* missed one
* refactor client part
* stylistic fix
* refactor rate control
* sketch
* sync
* add ProgressTrackerBase
* refactor read
* create progress package in common and rename CommonUtils to RateControlUtils
* refactor RDD classes
* refactor test cases
* get rid of stream id and partial progress tracker in eventhubssource
fix the last commit
* upgrade dependency and basic flow in EventHubsSource
* fix issues of initial offsets
* Integration test (#16)
* init commit of integration test
* fix examples
* fix output mode
* fix enqueuetime type issue
* fix dir structure issue
* fix source registration
* fix uid issue
* add logging
* fix the offset management issue
* fix offset update issue
* add logging
* add logging
* fix the issue of immature initialization of progress tracker
* test
* use parquet output stream
* fix
* fix serializedOffset issue
* fix issue
* test
* fix
* fix typo
* fix batch id
* addlogging
* fix recovery logic
* fix
* sync
* refactor ProgressTracker to support multi streams in structured streaming
* fix
* refactor progress writer
* test
* test
* try
* test
* test
* fix it
* fix
* test
* fix directory structure
* test
* test
* partial fix
* fix the failed test case
* do not clean temp files at the beginning
* Added structured streaming progress tracker suite
* Refactoring simulated eventhubs setup
* Added simple EventHubsSource tests
* use Row instead of InternalRow
* Add unit test for user-defined keys
* accept optional userDefinedKey config entry
* fix unser issue
* test with userDefinedKeys
* refactor client part
* stylistic fix
* refactor rate control
* sync
* add ProgressTrackerBase
* refactor read
* refactor commit methods
* create progress package in common and rename CommonUtils to RateControlUtils
* refactor test cases
* get rid of stream id and partial progress tracker in eventhubssource
fix the last commit
* upgrade dependency and basic flow in EventHubsSource
* make EventHubsOffset a nested class
* Integration test (#16)
* init commit of integration test
* fix examples
* fix output mode
* fix enqueuetime type issue
* fix dir structure issue
* fix source registration
* fix uid issue
* add logging
* fix the offset management issue
* fix offset update issue
* add logging
* add logging
* fix the issue of immature initialization of progress tracker
* test
* use parquet output stream
* fix
* fix serializedOffset issue
* fix issue
* test
* fix
* fix typo
* fix batch id
* addlogging
* fix recovery logic
* fix
* sync
* refactor ProgressTracker to support multi streams in structured streaming
* fix
* refactor progress writer
* test
* test
* try
* test
* test
* fix it
* fix
* test
* fix directory structure
* test
* test
* partial fix
* fix the failed test case
* do not clean temp files at the beginning
* sync
* sync
* try to test
* fix the typo
* unit test for enqueueTime
* implement eventhubs search with time functionality
* fix compilation issue
* logging
* logging more
* logging
* fix bug in search params
* build date from instant
* fix issues in expected output
* fix
* fix offset
* add test case for checkpointing offset type
* fix test case
* enable fallback read in test
* remove duplicate code
* test enqueuetim
* configure enqueuetime
* fix
* update to 0.13.1
* test
* test
* try instant parsing
* fix typo
* fix
* logging
* test
* test
* add test for illegal filtering time
* test
* fix failed test cases
* fix inconsistent epoch second / milliseconds
* Eventhub reader (#17)
* Added more Event Hubs source unit tests
* Few more event hubs source unit tests added
* Addressed review comments
* New Eventhubs source unit test
* small changes
* try to fix
* Broken unit test
* try to fix
* try to fix
* try to fix
* try to fix
* fix compilation issue
* changes
* changes
* Updated broken unit test
* Fix unit test
* Refactored code for unit tests
* test
* test
* hi
* fix
* resolve directory conflict
* merge and clean
* stylistic fix
* fix compilation issue
* fix compilation issue
* recover some changes
* stylistic fix
* fix adding data issue
* add test for filtering
* fix typo
* add more logging
* adjust logging
* update logging
* test
* test
* test
* partial check
* more test
* fix test
* test
* test
* test
* add logging
* test
* test
* fix ambiguous of test
* advance clock
* test
* fix eh name
* test
* test
* add unit test
* remove unnecessary printStackTrace
Sabee Grewal
Nan Zhu
SJ
Sabee Grewal
Nan Zhu
Jacek Laskowski
Yun Tang