Magnus Edenhill
a28689cff3
Added snappy and gzip compression support to the producer
2013-09-06 00:00:57 +02:00
Magnus Edenhill
9100fcad6a
Added Andi Kleen's Snappy compression C implementation
...
http://github.com/andikleen/snappy-c
2013-09-05 23:44:23 +02:00
Magnus Edenhill
657e2f78c2
Avoid typedef redefinitions (issue #18 )
2013-09-02 23:46:17 +02:00
Faidon Liambotis
a29956d2eb
Update README.md with new URLs
...
Varnishkafka has a simpler github project name now. Also, the separate
librdkafka repository for Debian doesn't exist and it was merged with
this one, in a separate branch.
2013-08-28 16:56:00 +03:00
Faidon Liambotis
1caac0ceae
Use CC rather than LD for linking
...
LDFLAGS is really meant to be passed to CC, not LD. The current code
fails e.g. with Debian's default LDFLAGS (-Wl,-z,relro).
Fix this by switching our Makefile to use CC for linking.
2013-08-27 14:38:31 +03:00
Magnus Edenhill
de504c008d
Metadata triggered debug messages should be in metadata context.
2013-08-26 22:34:51 +02:00
Magnus Edenhill
67391491b5
Some locking fixes
2013-08-26 22:34:23 +02:00
Magnus Edenhill
c12ceab8ea
Proper broker metadata refresh on leader failure. (issue #14 )
...
Config property:
Config property: "topic.metadata.refresh.fast.cnt" (def 10)
Config property: "topic.metadata.refresh.fast.interval.ms" (def 250ms)v
2013-08-26 22:33:59 +02:00
Magnus Edenhill
30f0d36a30
Moved topic.metadata.refresh.interval.ms to global (not producer-specific) config.
2013-08-26 21:58:52 +02:00
Magnus Edenhill
bf288c5de5
Debugging is now controlled per context
...
Config property: "debug" = "<context(,s)>"
Contexts: all,generic,broker,topic,metadata,producer,queue,msg
Usage:
rd_kafka_conf_set(&conf, "debug", "topic,producer,...", ..);
2013-08-26 21:58:19 +02:00
Magnus Edenhill
0fcf8618c5
Line trimming in README.md
2013-08-26 21:35:11 +02:00
Magnus Edenhill
0a6effd62e
Describe Kafka protocol version support for different branches.
2013-08-21 00:51:01 +02:00
Magnus Edenhill
2798d3f178
Merge branch '0.8-wip' into master.
2013-08-21 00:49:51 +02:00
Magnus Edenhill
07e713012a
rdkafka_example: Proper SIGINT handling
2013-08-21 00:23:46 +02:00
Magnus Edenhill
735bed66fd
rdkafka_example: added logger callback and -d command line argument to enable debugging.
2013-08-21 00:22:39 +02:00
Magnus Edenhill
350e1dd8af
rdkafka_example: dump rdkafka internal state info to stdout on SIGUSR1
2013-08-21 00:22:07 +02:00
Magnus Edenhill
25da6a4ad8
Indent fix
2013-08-21 00:21:16 +02:00
Magnus Edenhill
4a0441cf0f
Use proper define for RD_POLL_NOWAIT
2013-08-21 00:21:10 +02:00
Magnus Edenhill
23dad17cfb
Constified rd_kafka_name() argument
2013-08-21 00:20:51 +02:00
Magnus Edenhill
6e985ac5b6
Added broker state name printouts to rd_kafka_dump()
2013-08-21 00:20:32 +02:00
Magnus Edenhill
dce858c80c
If new topic is unknown, requery brokers to find a leader (issue #16 )
2013-08-21 00:19:59 +02:00
Magnus Edenhill
edf5336c91
Re-delegate all affected topic+partitions when a broker fails (issue #14 )
2013-08-21 00:19:51 +02:00
Magnus Edenhill
4c745a474b
Let non-broker threads trigger leader queries.
2013-08-21 00:18:05 +02:00
Magnus Edenhill
bac7e2714d
Merge pull request #12 from ZhuYouzhi/master
...
Add return code for Kafka::produce and free message payload memory in rd_kafka_example when queue is full
2013-08-09 15:47:35 -07:00
Magnus Edenhill
405c1fae0b
Proper DESTDIR usage in install target
2013-07-08 23:11:40 +02:00
Magnus Edenhill
a352d32703
Error out on NULL topics in rd_kafka_topic_new().
2013-06-23 23:45:03 +02:00
Magnus Edenhill
6f0cbee3b4
Updated documentation.
2013-06-23 23:44:22 +02:00
Magnus Edenhill
f39fb720f0
Dont require individual builds of each example program.
2013-06-23 23:44:01 +02:00
Magnus Edenhill
7cae2c6c9e
rd_kafka_set_logger() is now per rd_kafka_t handle.
2013-06-23 23:43:31 +02:00
Magnus Edenhill
41e42e0c19
Added named configuration property support matching the standard Apache Kafka properties.
2013-06-23 23:42:34 +02:00
Magnus Edenhill
bedc479e12
Initial 0.8 producer support.
...
This is work in progress but functional and ready for testing.
2013-06-05 22:22:20 +02:00
ZhuYouzhi
b6fff10a1a
Add return code for Kafka::produce; Free payload when rkq is full
2013-06-05 10:22:52 +08:00
Magnus Edenhill
52440eaeee
Merge branch '0.7'
2013-06-03 09:00:14 +02:00
Magnus Edenhill
c4e2479e79
Merge pull request #9 from eugpermar/0.7
...
Added all required headers for 'install' target
2013-05-24 05:40:34 -07:00
Eugenio Pérez
fef41b259a
Fix: Makefile doesn't contained all the headers in HDRS variable
2013-05-24 12:25:36 +00:00
Magnus Edenhill
06fd28eeef
Added conf.producer.max_outq_msg_cnt: allows the application to limit the outgoing message queue size.
2013-05-20 15:10:34 +02:00
Magnus Edenhill
813cd789ae
Merge pull request #8 from eugpermar/0.7
...
Created a small c++ librdkafka produce wrapper.
2013-05-19 13:12:04 -07:00
Magnus Edenhill
7622d75b21
travis-ci.org integration
...
(cherry picked from commit 2103defc23
)
2013-05-19 22:07:22 +02:00
Magnus Edenhill
2103defc23
travis-ci.org integration
2013-05-19 22:04:40 +02:00
eu
6d3aebf18d
Make somme fixes:
...
Added c++ headers in the project Makefile
modified: Makefile
Remove some duplicated entry in examples/Makefile
modified: examples/Makefile
Some fixes done here.
modified: examples/rdkafka_example.cpp
Updated some not-C++ compilant code
modified: rdaddr.h
renamed: c++/rdkafka.h -> rdkafkacpp.h
2013-05-17 22:09:25 +02:00
eu
9a237b7c6b
Created a small c++ librdkafka produce wrapper. It will grow in the nexts commits.
...
new file: ../c++/rdkafka.h
modified: .gitignore
modified: Makefile
new file: rdkafka_example.cpp
modified: ../rdaddr.h
2013-05-09 13:56:50 +02:00
Magnus Edenhill
d794585af1
Clarified the use of 'payload' in rd_kafka_produce() and who is responsible for freeing the data
2013-04-23 23:03:02 +02:00
Magnus Edenhill
2a59d62f6b
Updated README
2013-04-16 21:25:14 +02:00
Magnus Edenhill
d3d60eb048
Strip irrelevant address families from rd_family2str() (AF_NETLINK, for example)
2013-03-28 15:25:10 +01:00
Magnus Edenhill
4b6cbfb036
Proper format for size_t (issue #7 )
2013-03-27 07:43:22 +01:00
Magnus Edenhill
2326c715e9
Improved derefcnting
2013-03-08 16:55:35 +01:00
Magnus Edenhill
f808f2760b
Added examples/rdkafka_performance performance testing tool.
2013-01-15 22:10:50 +01:00
Magnus Edenhill
c15c314a63
Calling application must ignore or handle SIGPIPE to avoid termination if connection drops. (issue #2 )
2013-01-07 21:29:42 +01:00
Magnus Edenhill
c818ae545c
Merge pull request #1 from bmilekic/master
...
Bugfix in example code
2012-11-13 06:55:44 -08:00
Magnus Edenhill
dc56ee0936
Added Coderwall endorse button
2012-11-01 19:58:12 +01:00