Edward Jay Kreps
|
6e6522c7c9
|
KAFKA-544. Follow-up items on key-retention. Addresses misc. comments from Joel, see ticket for details.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1413839 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
3f432cd01c
|
copy branch 0.8 to trunk
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1413738 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
602acaf412
|
move shutting down of fetcher thread out of critical path; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-612
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1411070 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Neha Narkhede
|
8e7b0d4016
|
KAFKA-532 Multiple controllers can co-exist during soft failures; patched by Neha Narkhede; reviewed by Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1411010 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Joel Jacob Koshy
|
79d3be9293
|
Fix deadlock between leader-finder-thread and consumer-fetcher-thread during broker failure; patched by Joel Koshy; reviewed by Jun Rao; KAFKA-618
pre-commit-status-crumb=5e65bf7a-f347-4600-b3ae-99eed1cd2a78
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1410665 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
39edb7beea
|
MigrationTool should disable shallow iteration in the 0.7 consumer; patched by Yang Ye; reviewed by Jun Rao; KAFKA-613
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1410662 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
92d64170bb
|
DumpLogSegment offset verification is incorrect for compressed messages; patched by Yang Ye; reviewed by Jun Rao; KAFKA-614
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1410649 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Edward Jay Kreps
|
8c884ee6a6
|
KAFKA-544 Trivial fix--migration tool is using message when it should be using a byte array. Checked in w/o review.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1410588 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
e13ecfc1df
|
System Test - Log Retention Cases should wait longer before getting the common starting offset in replica log segments; patched by John Fung; reviewed by Jun Rao; KAFKA-605
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1410547 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
125548274a
|
trivial fix to make the default value replica.fetch.min.bytes better for replication
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1410125 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Edward Jay Kreps
|
60d0587e8f
|
KAFKA-545 Add some log performance tests.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1410088 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Edward Jay Kreps
|
f4ccf21d5d
|
KAFKA-544 Store the key given to the producer in the message. Expose this key in the consumer. Patch reviewed by Jun.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1410055 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Neha Narkhede
|
22e032fdd4
|
KAFKA-574 KafkaController unnecessarily reads leaderAndIsr info from ZK ; patched by Prashanth; reviewed by Jun and Neha
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1409618 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Joel Jacob Koshy
|
6c97767b88
|
Remove custom metrics jar and replace with latest from metrics HEAD; patched by Joel Koshy; reviewed by Jun Rao; KAFKA-585.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1409296 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
1cc8c3beab
|
Add test cases to test log size retention and more; patched by John Fung; reviewed by Jun Rao; KAFKA-591
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1407680 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
6800b0ed3b
|
Fix commit() in zk consumer for compressed messages; patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-546
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1406940 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Neha Narkhede
|
ed6243852a
|
KAFKA-593 Empty log index file created when it shouldn't be empty; Patched by Yang Ye; reviewed by Jun and Jay
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1406036 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
f54f481873
|
extend DumpLogSegments to verify consistency btw data and index; patched by Yang Ye; reviewed by Jun Rao; KAFKA-577
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1406009 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
989c9bfbab
|
LogSegment.firstAppendTime not reset after truncate to; patched by Swapnil Ghike; reviewed by Jun Rao, Neha Narkhede; KAFKA-596
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1406004 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Edward Jay Kreps
|
75fc5eab35
|
KAFKA-188 Support multiple data directories.
Patch reviewed by Neha and Jun.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1405102 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
3adf92151a
|
KafkaRequestHandler needs to handle exceptions; patched by Yang Ye; reviewed by Jun Rao; KAFKA-491
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1404857 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
1828b1852c
|
system test configs are broken; patched by John Fung; reviewed by Jun Rao; kafka-586
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1404203 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
6d86e43f0a
|
Update System Test due to new argument --sync in ProducerPerformance; patched by Jun Rao; reviewed by Neha Narkhede and Jun Rao; kafka-594
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1404197 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Edward Jay Kreps
|
414e9faf9b
|
KAFKA-588 Fix bug in OffsetIndex.truncateTo. Reviewed by Neha.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1403859 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
4d7c0b7a51
|
Register metrics beans at kafka server startup; patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-592
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1403601 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
ddabfa7da5
|
Partition.makeFollower() reads broker info from ZK; patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-575
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1403598 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
743ac37382
|
extend DumpLogSegments to verify consistency btw data and index; patched by Yang Ye; reviewed by Neha Narkhede and Jun Rao; KAFKA-577
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1403553 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
4f529c7444
|
trivial fix to use foreach instead of map
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1402731 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Joel Jacob Koshy
|
947ad072af
|
Implement clean shutdown in replication; patched by Joel Koshy; reviewed by Jun Rao and Neha Narkhede; KAFKA-340
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1402395 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
9eb9e51011
|
produce/fetch remote time metric not set correctly when num.acks = 1; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-584
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1402250 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
4ef9166769
|
trivial fix to add the missing Logging class
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401909 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
adebb7d78a
|
Add more test cases to System Test ; patched by John Fung; reviewed by Jun Rao; KAFKA-571
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401875 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
0d9f7ffe4d
|
provides windows batch script for starting Kafka/Zookeeper; patched by Antoine Vianey; reviewed by Jun Rao; kafka-581
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401782 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
68d8f59045
|
remove connection timeout in SyncProducer; patched by Swapnil Ghike; reviewed by Jun Rao; kafka-579
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401775 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
23bce10e77
|
Change MessageSet.sizeInBytes to Int; patched by Swapnil Ghike; reviewed by Jun Rao; kafka-556
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401760 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
3deb6cd420
|
SimpleConsumer throws UnsupportedOperationException: empty.head; patched by Yang Ye; reviewed by Jun Rao; kafka-576
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401704 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
2c66f5b701
|
system test testcase_0122 under replication fails due to large # of data loss; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-580
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401356 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Neha Narkhede
|
1b7b43c6e1
|
KAFKA-541 Move to metrics csv reporter for system tests; patched by Yang Ye; reviewed by Neha, Jun and Joel
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401138 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
e35854062f
|
System Test : Leader Failure Log Segment Checksum Mismatched When request-num-acks is 1; patched by Jun Rao; reviewed by John Fung, Joel Koshy and Neha Narkhede; KAFKA-573
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1399934 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Neha Narkhede
|
98f6407089
|
KAFKA-537 Expose clientId in ConsumerConfig and fix correlation id; patched by Yang Ye; reviewed by Neha Narkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1398893 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Edward Jay Kreps
|
d1a22b2e3b
|
KAFKA-569 Split up utils package and do some cleanup. Patch reviewed by Neha.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397765 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Neha Narkhede
|
3015d0a447
|
KAFKA-43 Move leader to preferred replica; patched by Neha Narkhede; reviewed by Joel Koshy and Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397747 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Neha Narkhede
|
669ae397f8
|
KAFKA-548 remove partition from ProducerRequestPartitionData and FetchResponsePartitionData; patched by Yang Ye; reviewed by Neha and Joel
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397744 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
c0fdcd305c
|
Replication Data Loss in Mirror Maker Bouncing testcase; patched by Jun Rao; reviewed by Joel Koshy, John Fung and Neha Narkhede; kafka-567
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397717 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Jun Rao
|
2b13581711
|
trival fix to remove 2 empty files
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397623 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Neha Narkhede
|
3629f6f882
|
Changing kafka-server-stop.sh to use SIGTERM for Kafka server process termination. No review
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397434 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Neha Narkhede
|
dd44ec672a
|
KAFKA-432 allow consumer to read from followers; patched by Yang Ye; reviewed by Neha and Jun
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397422 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Edward Jay Kreps
|
97d434513f
|
KAFKA-506 Hadoop consumer not advancing to next offset. No review.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397388 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Neha Narkhede
|
eb06b93f97
|
KAFKA-510 Broker needs to know replication factor per partition; patched by Yang Ye; reviewed by Neha Narkhede, Jun Rao and Joel Koshy
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397372 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |
Edward Jay Kreps
|
4324235183
|
KAFKA-557 Patch to avoid assigning offsets to Log.appends as part of replication. Reviewed by Neha.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397190 13f79535-47bb-0310-9956-ffa450edef68
|
12 years ago |