8592dd2878
Update to suggest confluent-kafka-dotnet client
...
rdkafka-dotnet has been superceeded by confluent-kafka-dotnet (which is based on rdkafka-dotnet).
2017-02-24 09:37:28 +01:00
8c53608db6
Adding a note to README.md
2016-10-31 09:46:51 -07:00
2b43ba1279
Merge pull request #61 from YixuanLiu/ConsumerOffsetsFix
...
ConsumerOffset fix when OffsetOutOfRange
2016-05-20 11:36:29 -07:00
88d6356e64
When FetcherRunnable detects about outOfRange, it tries to fix the issue by bump up both fectedoffset and consumedoffset ahead to the valid one. As Fetcher thread don't own and shouldn't own the consumedoffset, the consumerIterator who is the actual owner of consumedoffset update the consumedoffset back to the position it actually consumed. In the next iteration of Fetcher thread, it detects that the lag between fectedoffset consumedoffset is big enough so it stop fetching more. It is true during normal case, but it is not true when the fetchedoffset being manually set ahead instead of fetched ahead.
...
The fix is first, FetcherRunnable shouldn't just set the consumedoffset as it doesn't own how far it consumed. When FetcherRunnable detects about outofrange error, it signal PartitionTopicInfo to fix its offset. Creae a private variable lastKnownGoodNextRequestOffset for pti to save the old marker of NextRequestOffset When OutOfRange happens. In the next iteration of fetcher, use that to caculate the actual messages in the queue. After the successful fetch, it set back to align with NextRequestOffset.
Also cleaned up messageOffset as it is never being used.
2016-05-16 17:00:47 -07:00
b535f4952a
Merge pull request #55 from mhorstma/log4netRevert
...
Revert log4net update due to public key change in newer versions of log4net
2016-05-05 10:50:10 -07:00
b02e1a7ee9
Merge pull request #50 from Microsoft/soumyajitsahu_kafkanetfix
...
Add a destructor to close the underlying connection
2016-05-05 10:23:05 -07:00
00251b9b27
Updated nuspec's log4net dependency version
2016-05-05 10:07:14 -07:00
ff355e93a6
Merge remote-tracking branch 'upstream/master' into log4netRevert
2016-05-05 10:03:19 -07:00
d23ae4b248
Reverted log4net package references back to 1.2.10
2016-05-05 09:16:50 -07:00
5649dc2d5c
Merge pull request #52 from mhorstma/nugetCleanup
...
Nuget package versioning fix
2016-05-04 10:21:48 -07:00
2e0727d752
Added AssemblyVersion attribs to assemblyinfo.cs
2016-05-03 14:23:02 -07:00
e25388861d
Cleaning up assemblyinfo.cs project references
2016-05-03 13:41:58 -07:00
5fcf4f0f29
Updating nuspec to use assembly version. Updating log4net dependency version.
2016-05-03 11:29:08 -07:00
00746efcf3
Merge pull request #48 from dtauzell/log4net-update
...
Update to use log4net 2.0.5 (1.2.15).
2016-05-02 17:17:49 -07:00
5d43e7b4e2
Add a destructor to close the underlying connection
2016-04-27 11:36:55 -07:00
d4c2dda4c3
Merge pull request #49 from danielli90/connect
...
change Connect() to use async connect call and honor receiveTimeoutMs…
2016-04-22 17:35:50 -07:00
bdb85152dd
Merge pull request #46 from Microsoft/soumyajitsahu_kafkanetfix
...
1) Fix log loss scenario during rebalance, 2) use api version 0 inste…
2016-04-19 11:52:51 -07:00
4b743bc0a9
change Connect() to use async connect call and honor receiveTimeoutMs as connectionTimeout
2016-04-19 11:29:31 -07:00
a606a4555e
Renaming to CSharpClient-for-Kafka
2016-04-18 10:11:26 -07:00
045ef8a3d0
Modify Repo name and references to CSharpKafkaClient instead of Kafkanet
2016-04-14 13:58:57 -07:00
bc2085b0e6
Merge branch 'master' of https://github.com/Microsoft/Kafkanet
2016-04-14 13:50:20 -07:00
4ab7f2a444
Update to use log4n 2.0.3 (also called 2.0.15). The current version used, 1.2.10, is
...
not compatible with later versions of log4net.
2016-04-08 13:47:45 -05:00
186b9cd2c3
1) Fix log loss scenario during rebalance, 2) use api version 0 instead of
...
1, 3) Some minor performance improvement and bug fixes
2016-04-04 11:22:21 -07:00
0398697ffc
Merge pull request #42 from mhorstma/master
...
Fix nuget package creation of KafkaNET.library
2016-04-01 13:52:03 -07:00
bb0634fbdd
Merge pull request #1 from mhorstma/mhorstma-nugetPackCleanup
...
Mhorstma nuget pack cleanup
2016-04-01 12:48:34 -07:00
7fae04b850
Deleted commented out files section
2016-04-01 11:46:46 -07:00
5eea147cd9
Removing explicit assembly references from nuspec
2016-04-01 11:25:32 -07:00
5a1d275702
Merge pull request #40 from hoppity/fix/new-consumer-old-topic
...
Fix new consumer group blocking
2016-04-01 16:52:04 +11:00
3e6b6c55e5
Merge pull request #37 from hoppity/feature/config-fetch-max-wait
...
add fetch wait max ms and fetch min bytes to consumer configuration
2016-04-01 16:42:11 +11:00
a3cdbe0e8f
Merge pull request #36 from hoppity/feature/consumer-connector-interface
...
Add IZookeeperConsumerConnector interface
2016-04-01 16:27:08 +11:00
ca2b86e19b
setup partition info with consumedOffset = auto.offset.reset - 1 for new consumer group
2016-03-31 11:47:05 +11:00
22dc16d7ec
add fetch wait max ms and fetch min bytes to consumer configuration
2016-03-28 15:19:34 +11:00
7bcbd6f331
use kafka message stream interface in zookeeper consumer connector interface
...
* return list of IKafkaMessageStream from ZookeeperConsumerConnector.CreateMessageStreams
* change IKafkaMessageStream to return IKafkaMessageStream from GetCancellable instead of IEnumerable
2016-03-28 14:06:52 +11:00
4c6de1b652
addition of the zookeeperconsumerconnector interface, this is to allow mocking for unit tests
2016-03-28 13:36:54 +11:00
2e2e9cabdc
Merge pull request #30 from hoppity/feature/stream-interface
...
Message stream interfaces
2016-03-22 09:59:07 -07:00
57cba9752b
extract interface for KafkaMessageStream and ConsumerIterator
2016-03-17 06:34:07 +11:00
5b901476b1
Merge pull request #29 from hoppity/feature/producer-interface
...
expose producer method to send multiple producerdata
2016-03-15 22:58:55 -07:00
da27013e4d
Merge pull request #24 from hoppity/fix/commit-offset
...
override setting position of fetch offset with flag
2016-03-15 22:44:56 -07:00
db6c2fd662
expose producer method to send multiple producerdata in single operation on interface
2016-03-16 16:32:42 +11:00
86a6e78192
override setting position of fetch offset with flag
2016-03-09 10:47:16 +11:00
271fd7ddcb
Merge pull request #21 from jthelin/ConsumeGroupFindNewLeaderSleepIntervalMs-assign
...
[PVS-Studio] ConsumeGroupFindNewLeaderSleepIntervalMs initialization
2016-03-08 14:55:59 -08:00
802a9be130
[PVS-Studio] ConsumeGroupFindNewLeaderSleepIntervalMs variable assigned to itself
...
The kind people at Viva64 gave an evaluation license for PVS-Studio to try out on some OSS projects, and running it on Kafkanet source code found this problem.
http://www.viva64.com/en/pvs-studio/
Error V3005. The 'ConsumeGroupFindNewLeaderSleepIntervalMs' variable is assigned to itself
http://www.viva64.com/en/d/0403/print/
Fixes issue #20
2016-03-05 10:48:32 -08:00
34f2bfa15b
Merge pull request #19 from Microsoft/GeneralFixes
...
Intial .nuspec
2016-03-03 11:59:06 -08:00
8bcb5b4d81
Intial .nuspec
2016-03-03 11:26:37 -08:00
cc9e1f7908
Revert "Intial .nuspec"
...
This reverts commit 84b459b6dd
2016-03-03 11:24:51 -08:00
84b459b6dd
Intial .nuspec
2016-03-03 11:24:19 -08:00
7ed22ad691
Merge pull request #18 from Microsoft/GeneralFixes
...
test typo fix
2016-03-03 10:37:44 -08:00
4379b90680
test typo fix
2016-03-03 10:30:06 -08:00
ec24477f6e
Merge pull request #17 from jthelin/nuget-build-problems
...
Fix some build issues related to VS nuget package restore + references.
2016-03-02 21:37:36 -08:00
bab4b37eb6
Fix some build issues related to VS nuget package restore + references.
...
- Adding some missing package dependencies that Visual Studio 2013 complained were missing.
- Ran the migrateToAutomaticPackageRestore.ps1 script to fix problems with nuget package auto-restore when building from inside Visual Studio.
https://github.com/owen2/AutomaticPackageRestoreMigrationScript
2016-03-02 20:47:41 -08:00
Magnus Edenhill
Soumyajit Sahu
YixuanLiu
Razvan Iamandii
mhorstma
Som Sahu
danielli90
Razvan Iamandii
Dave Tauzell
Ducas Francis
Ducas Francis
geoff tsai
jthelin