This PR adds failover to simple end to end mirror maker test
Marked as WIP for 2 reasons:
- We may want to add a couple more test cases where kafka is being used to store offsets
- There appears to be a test failure in the hard failover case
Author: Geoff Anderson <geoff@confluent.io>
Reviewers: Ewen Cheslack-Postava
Closes#427 from granders/KAFKA-2258-mirrormaker-test
The bug causes only the first instance of group metadata in the topic to be written to the cache (because of the putIfNotExists in addGroup). Coordinator fail-over won't work properly unless the cache is loaded with the right metadata.
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Guozhang Wang
Closes#462 from hachikuji/hotfix-group-loading
Close socket channel in finally block to avoid file descriptor leak when remote end closes the connection
Author: Rajini Sivaram <rajinisivaram@googlemail.com>
Reviewers: Ismael Juma <ismael@juma.me.uk>, Jun Rao <junrao@gmail.com>
Closes#460 from rajinisivaram/KAFKA-2779
Looks like this println might have been left in there by mistake.
Author: Rajini Sivaram <rajinisivaram@googlemail.com>
Reviewers: Guozhang Wang
Closes#429 from rajinisivaram/latency-args-print
Noticed that there was a small typo in section 4.1 of the Design documentation on the [website](https://kafka.apache.org/documentation.html#majordesignelements) ('new' vs. 'knew'). This patch corrects that.
Author: Chris Pinola <chris@pinola.co>
Reviewers: Guozhang Wang
Closes#391 from chrnola/minor/design-doc-typo
Added support for uppercase hostnames in BrokerEndPoint. Added unit test
to cover this scenario.
Author: jholoman <jeff.holoman@gmail.com>
Reviewers: Grant Henke, Guozhang Wang
Closes#415 from jholoman/KAFKA-2735
Also fix the incorrect consumer group ID setting which was giving each task its
own group instead of one for the entire sink connector.
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Guozhang
Closes#431 from ewencp/kafka-2748-sink-task-rebalance-commit
…atching its inter-broker security protocol
Author: Gwen Shapira <cshapi@gmail.com>
Reviewers: Jun Rao, Guozhang Wang
Closes#428 from gwenshap/KAFKA-2738
Two tests:
1. One consumer subscribes to 2 topics, each with 2 partitions; includes adding and removing a topic.
2. Several consumers subscribe to 2 topics, several partition each; includes adding one more consumer after initial assignment is done and verified.
Author: Anna Povzner <anna@confluent.io>
Reviewers: Guozhang Wang
Closes#413 from apovzner/cpkafka-76
There are no functional changes to the modified scripts.
Author: Michael G. Noll <michael@confluent.io>
Reviewers: Guozhang Wang
Closes#419 from miguno/KAFKA-2740
The patch has two changes:
1. fixed a bug in controller that it sends UpdateMetadataRequest of all the partitions in the cluster.
2. Uses the following rules to propagate ISR change: 1) if there are ISR changes pending propagation and the last ISR change is more than five seconds ago, propagate the changes. 2) if there is ISR change at T in the recent five seconds, delay the propagation until T + 5s. 3) if the last propagation is more than 1 min ago, ignore rule No.2 and propagate ISR change if there are changes pending propagation.
This algorithm avoids a fixed configuration of ISR propagation interval as we discussed about in KIP-29.
Author: Jiangjie Qin <becket.qin@gmail.com>
Reviewers: Jun Rao <junrao@gmail.com>
Closes#402 from becketqin/KAFKA-2722
Run sanity check, replication tests and benchmarks with SASL/Kerberos using MiniKdc.
Author: Rajini Sivaram <rajinisivaram@googlemail.com>
Reviewers: Geoff Anderson <geoff@confluent.io>, Jun Rao <junrao@gmail.com>
Closes#358 from rajinisivaram/KAFKA-2644
Jason Gustafson
Grant Henke
Geoff Anderson
Ewen Cheslack-Postava
Rajini Sivaram
Ashish Singh
Gwen Shapira
Flavio Junqueira
Guozhang Wang
Chris Pinola
Matthew Bruce
Jeff Holoman
Anna Povzner
Yasuhiro Matsuda
Michael G. Noll
Jiangjie Qin