Граф коммитов

4636 Коммитов

Автор SHA1 Сообщение Дата
Jun Rao d42450715c Hadoop Consumer goes into an infinite loop; patched by Sam William; reviewed by Richard Park; KAFKA-131
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1166424 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 21:47:26 +00:00
Jun Rao c8e507aba4 fix string formatting; write data to stdout in ConsumerShell
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1164353 13f79535-47bb-0310-9956-ffa450edef68
2011-09-02 05:19:15 +00:00
Jun Rao ec21a5e841 DumpLogSegments outputs wrong offsets; kafka-128 patched by junrao; reviewed by Joel
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1163929 13f79535-47bb-0310-9956-ffa450edef68
2011-09-01 07:49:31 +00:00
Edward Jay Kreps c247dfa884 KAFKA-124 Console consumer does not stop consuming if the program reading from standard out dies. Check for errors on the output stream and exit if no one is listening.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1163911 13f79535-47bb-0310-9956-ffa450edef68
2011-09-01 05:47:21 +00:00
Chris Burroughs 92b1dd9252 Enable logging for tests, at a reasonable verbosity
patch by cburroughs; reviewed by junrao for KAFKA-113

git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1163693 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 16:53:38 +00:00
Jun Rao d72b388236 more info in DumpLogSegments; KAFKA-122 ; patched by Jun; reviewed by Neha
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1161664 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 17:47:03 +00:00
Neha Narkhede b5ea7c9055 A new file part of KAFKA-116 was accidentally not checked in. This commit fixes it; patched by nehanarkhede; reviewed by chrisburroughs
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1161276 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 21:10:03 +00:00
Neha Narkhede 72544aa51e Code clean up in FetcherRunnable and ZookeeperConsumerConnector; KAFKA-120; patched by junrao; reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160953 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 01:33:59 +00:00
Neha Narkhede bf30ae996f The FetcherRunnable busy waits on empty fetch requests; KAFKA-117; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160952 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 01:27:42 +00:00
Neha Narkhede 4cdc982e22 Producer performance tool should use the new blocking async producer instead of the sleep timeout hack; KAFKA-118; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160947 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 00:50:28 +00:00
Neha Narkhede c79c4f6f94 AsyncProducer shutdown logic causes data loss; KAFKA-116; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160946 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 00:44:22 +00:00
Chris Burroughs e311cbb6bb Explicitly list ZooKeeper as a dependency instead of including jar in-tree
patch by cburroughs; reviewed by nehanarkhede and hsaputra for KAFKA-90


git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160905 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 22:22:13 +00:00
Neha Narkhede 2e05fbfa22 Improve the command line tools in the bin directory to use the compression feature correctly; KAFKA-112; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160529 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 02:36:24 +00:00
Neha Narkhede a484c1bcd1 Kafka server access log does not log request details coming from a MultiProduceRequest; KAFKA-115; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160527 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 02:31:56 +00:00
Edward Jay Kreps 4a688c5d6c KAFKA-99 Enforce a max request size in socket server to avoid running out of memory with very large requests.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1159837 13f79535-47bb-0310-9956-ffa450edef68
2011-08-20 04:08:06 +00:00
Neha Narkhede 4f56e44100 ByteBufferMessageSet iterator bug returning incorrect offsets after reading a compressed empty message set KAFKA-111; patched by Jun; reviewed by Neha
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1159466 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 01:09:26 +00:00
Neha Narkhede 76ccf2211d Bug in the collate logic of the DefaultEventHandler dispatches empty list of messages using the producer KAFKA-110; patched by Neha; reviewed by Jun
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1159465 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 01:00:07 +00:00
Neha Narkhede 28984e6c18 Some new unit tests for ByteBufferMessageSet iterator KAFKA-108; patched by Jun; reviewed by Neha
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1159461 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 00:51:20 +00:00
Neha Narkhede 900496eeda CompressionUtils introduces a GZIP header while compressing empty message sets KAFKA-109; patched by Neha; reviewed by Jun
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1159459 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 00:47:34 +00:00
Neha Narkhede 8a07bdb71e Bug in serialize and collate logic in the DefaultEventHandler KAFKA-107; patched by Neha; reviewed by Jun
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1159452 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 00:29:09 +00:00
Jun Rao 82b42163a5 change whitelist config for mirroring; patched by Joel; KAFKA-103
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1158969 13f79535-47bb-0310-9956-ffa450edef68
2011-08-17 23:34:08 +00:00
Jun Rao 4cf1f16746 fix log4j to avoid duplicating log entries in kafka
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1158447 13f79535-47bb-0310-9956-ffa450edef68
2011-08-16 21:07:54 +00:00
Edward Jay Kreps 6d1b6f2827 KAFKA-98 Fix hardcoded ports in unit tests so you can run them while running kafka.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1157922 13f79535-47bb-0310-9956-ffa450edef68
2011-08-15 17:34:24 +00:00
Edward Jay Kreps 7976993f9e KAFKA-102 Patch from Blake Matheny. Clean up logging.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1157920 13f79535-47bb-0310-9956-ffa450edef68
2011-08-15 17:31:35 +00:00
Jun Rao d7e0b11d87 fix kafka-server-start.sh to take an optional producer property
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1157560 13f79535-47bb-0310-9956-ffa450edef68
2011-08-14 16:42:35 +00:00
Jun Rao 944da579ba KafkaServer can throw a NullPointerException during startup if zookeeper is down; KAFKA-94
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1156940 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 02:09:56 +00:00
Jun Rao 49f3b40179 auto-discovery of topics for mirroring; patched by Joel; reviewed by Jun; KAFKA-74
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1156393 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 22:32:23 +00:00
Henry Saputra d0c980dab2 KAFKA-93 | add license to missed files and remove LinkedIn copyright line per ASF guideline. Thanks to Joel Koshy for pointing it out
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1156299 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 18:32:09 +00:00
Henry Saputra 462dfda513 KAFKA-93 | Change and add ASF source header to follow standard ASF source header (http://www.apache.org/legal/src-headers.html).
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1156232 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 15:33:21 +00:00
Chris Burroughs e96cf1facf Update readme links.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1156166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 13:14:28 +00:00
Jun Rao ed34f0cb35 change default zk connection limit to infinite; KAFKA-88
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1155041 13f79535-47bb-0310-9956-ffa450edef68
2011-08-08 18:27:54 +00:00
Jun Rao f7046c247d Options in SyncProducerConfig and AsyncProducerConfig can leak, KAFKA-83
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1154804 13f79535-47bb-0310-9956-ffa450edef68
2011-08-07 23:56:05 +00:00
Jun Rao 96b8e03dd1 commit offset before consumer shutdown KAFKA-84; rename util.StringSerializer to ZKStringSerializer to avoid confusion with producer.StringSerializer
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1154719 13f79535-47bb-0310-9956-ffa450edef68
2011-08-07 16:29:55 +00:00
Jun Rao 665f1d0527 upgrade zkclient jar; #KAFKA-82
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1154064 13f79535-47bb-0310-9956-ffa450edef68
2011-08-05 01:36:43 +00:00
Chris Burroughs cbbfbaf331 gitignore for git-svn users.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1153592 13f79535-47bb-0310-9956-ffa450edef68
2011-08-03 17:34:03 +00:00
Edward Jay Kreps 642da2f28c Initial checkin of Kafka to Apache SVN. This corresponds to 709afe4ec7 except that git specific files have been removed and code has been put into trunk/branches/site/etc. This is just a copy of master, branches and history are not being converted since we can't find a good tool for it.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1152970 13f79535-47bb-0310-9956-ffa450edef68
2011-08-01 23:41:24 +00:00