e0098b4567
KAFKA-2770: Catch and ignore WakeupException for commit upon closing
...
Author: Guozhang Wang <wangguoz@gmail.com>
Reviewers: Gwen Shapira, Geoff Anderson, Jason Gustafson
Closes #470 from guozhangwang/K2770
9 years ago
ea702c384f
KAFKA-2801; Process any remaining data in SSL network read buffer after handshake
...
Process any remaining data in the network read buffer in `SslTransportLayer` when `read()` is invoked. On handshake completion, there could be application data ready to be processed that was read into `netReadBuffer` during handshake processing. `read()` is already invoked from `Selector` after handshake completion, but data already read into the `netReadBuffer` was not being processed. This PR adds a check for remaining data and continues with processing data if data is available.
Author: Rajini Sivaram <rajinisivaram@googlemail.com>
Reviewers: Jun Rao <junrao@gmail.com>
Closes #493 from rajinisivaram/KAFKA-2801
9 years ago
04827e6e99
KAFKA-2752: Follow up to fix checkstlye
...
Author: Grant Henke <granthenke@gmail.com>
Reviewers: Ewen Cheslack-Postava
Closes #492 from granthenke/fix
9 years ago
9d9bb708bf
KAFKA-2799: skip wakeup in the follow-up poll() call.
...
Author: Guozhang Wang <wangguoz@gmail.com>
Reviewers: Jason Gustafson
Closes #490 from guozhangwang/K2799
9 years ago
8db55618d5
KAFKA-2752: Add VerifiableSource/Sink connectors and rolling bounce Copycat system tests.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Ben Stopford, Geoff Anderson, Guozhang Wang
Closes #432 from ewencp/kafka-2752-copycat-clean-bounce-test
9 years ago
64a1bfeb9b
KAFKA-2793: Use ByteArrayDeserializer instead of StringDeserializer for keys in ConsoleConsumer with new consumer.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira
Closes #482 from ewencp/kafka-2793-console-consumer-new-consumer-deserializer
9 years ago
60c06734b3
KAFKA-2788; Allow specifying principals with comman in ACL CLI.
...
Author: Parth Brahmbhatt <brahmbhatt.parth@gmail.com>
Reviewers: Jun Rao <junrao@gmail.com>
Closes #489 from Parth-Brahmbhatt/KAFKA-2788
9 years ago
c455e608c1
KAFKA-2795: fix potential NPE in GroupMetadataManager.addGroup
...
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Onur Karaman, Guozhang Wang
Closes #488 from hachikuji/KAFKA-2795
9 years ago
1d884d1f60
MINOR: update system test readme
...
Author: Geoff Anderson <geoff@confluent.io>
Reviewers: Guozhang Wang
Closes #487 from granders/minor-update-test-readme
9 years ago
403d89edea
KAFKA-2798: Use prefixedd configurations for Kafka Connect producer and consumer settings so they do not conflict with the distributed herder's settings.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira
Closes #486 from ewencp/kafka-2798-conflicting-herder-producer-consumer-configs
9 years ago
ae5a5d7c08
KAFKA-2792: Don't wait for a response to the leave group message when closing the new consumer.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Onur Karaman, Gwen Shapira
Closes #480 from ewencp/kafka-2792-fix-blocking-consumer-close
9 years ago
fe11488a77
KAFKA-2797: Only run rat when in the .git repository since it require s the .gitignore to generate the list of files to ignore
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira
Closes #485 from ewencp/kafka-2797-disable-rat-when-git-missing
9 years ago
590a4616a1
KAFKA-2786: Only respond to SinkTask onPartitionsRevoked after the WorkerSinkTask has finished starting up.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira
Closes #476 from ewencp/kafka-2786-on-partitions-assigned-only-after-start
9 years ago
bce664b42a
KAFKA-2274: verifiable consumer and integration testing
...
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Guozhang Wang, Geoff Anderson
Closes #465 from hachikuji/KAFKA-2274
9 years ago
c9264b4c89
KAFKA-2769; Multi-consumer integration tests for consumer assignment incl. session timeouts and corresponding fixes
...
-- Refactored multi-consumer integration group assignment validation tests for round-robin assignment
-- Added multi-consumer integration tests for session timeout expiration:
1. When a consumer stops polling
2. When a consumer calls close()
-- Fixes to issues found with session timeout expiration tests woth help from Jason Gustafson: Try to avoid SendFailedException exception by cancelling the scheduled tasks and ensuring metadata update before sending group leave requests + send leave group request with retries.
Author: Anna Povzner <anna@confluent.io>
Reviewers: Jason Gustafson, Guozhang Wang
Closes #472 from apovzner/cpkafka-81
9 years ago
c6b93fa50d
KAFKA-2773: Fixed broken vagrant provision scripts for static zk/broker cluster
...
Author: Geoff Anderson <geoff@confluent.io>
Reviewers: Ewen Cheslack-Postava
Closes #454 from granders/KAFKA-2773-vagrant-fix
9 years ago
83eaf3284f
KAFKA-2379: Add basic documentation for Kafka Connect.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira
Closes #475 from ewencp/kafka-2379-connect-docs
9 years ago
79bdc17ab4
KAFKA-2785; Include Kafka Connect jars in releaseTarGz.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Jun Rao <junrao@gmail.com>
Closes #473 from ewencp/kafka-2785-include-copycat-jars-in-release
9 years ago
e2794a79c8
MINOR: Make sure generated docs don't get checked in
...
Author: Grant Henke <granthenke@gmail.com>
Reviewers: Guozhang Wang
Closes #469 from granthenke/generated-configs
9 years ago
3ebb4ee1b0
MINOR: Improve exception message that gets thrown for non-existent group
...
Author: Ashish Singh <asingh@cloudera.com>
Reviewers: Guozhang Wang
Closes #471 from SinghAsDev/ExceptionMessage
9 years ago
a87b978223
MINOR: remove old producer in config sections to align with APIs
...
Author: Guozhang Wang <wangguoz@gmail.com>
Reviewers: Gwen Shapira
Closes #468 from guozhangwang/WikiUpdate
9 years ago
359be3a682
KAFKA-2674: clarify onPartitionsRevoked behavior
...
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Guozhang Wang
Closes #467 from hachikuji/KAFKA-2674
9 years ago
69af573b35
KAFKA-2783; Drop outdated hadoop contrib modules
...
Author: Grant Henke <granthenke@gmail.com>
Reviewers: Gwen Shapira
Closes #466 from granthenke/drop-contrib
9 years ago
7073fa7efe
KAFKA-2258: add failover to mirrormaker test
...
This PR adds failover to simple end to end mirror maker test
Marked as WIP for 2 reasons:
- We may want to add a couple more test cases where kafka is being used to store offsets
- There appears to be a test failure in the hard failover case
Author: Geoff Anderson <geoff@confluent.io>
Reviewers: Ewen Cheslack-Postava
Closes #427 from granders/KAFKA-2258-mirrormaker-test
9 years ago
75f2b8c8b4
KAFKA-2782: Fix KafkaBasedLogTest assertion and move it to the main test thread.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira
Closes #463 from ewencp/kafka-2782-fix-kafka-based-log-test-assertion
9 years ago
13ba57dcfc
KAFKA-2778: Use zero loss settings by default for Connect source producers.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira
Closes #459 from ewencp/kafka-2778-connect-source-zero-loss-settings
9 years ago
bc76e6704e
KAFKA-2775: Move exceptions into API package for Kafka Connect.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira
Closes #457 from ewencp/kafka-2775-exceptions-in-api-package
9 years ago
2b04004de8
HOTFIX: bug updating cache when loading group metadata
...
The bug causes only the first instance of group metadata in the topic to be written to the cache (because of the putIfNotExists in addGroup). Coordinator fail-over won't work properly unless the cache is loaded with the right metadata.
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Guozhang Wang
Closes #462 from hachikuji/hotfix-group-loading
9 years ago
e9fc7b8c84
KAFKA-2776: Fix lookup of schema conversion cache size in JsonConverter.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira
Closes #458 from ewencp/kafka-2776-json-converter-cache-config-fix
9 years ago
a24f9a23a6
KAFKA-2781; Only require signing artifacts when uploading archives.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Jun Rao <junrao@gmail.com>
Closes #461 from ewencp/kafka-2781-no-signing-for-install
9 years ago
efbebc6e84
KAFKA-2779; Close SSL socket channel on remote connection close
...
Close socket channel in finally block to avoid file descriptor leak when remote end closes the connection
Author: Rajini Sivaram <rajinisivaram@googlemail.com>
Reviewers: Ismael Juma <ismael@juma.me.uk>, Jun Rao <junrao@gmail.com>
Closes #460 from rajinisivaram/KAFKA-2779
9 years ago
f2031d4063
KAFKA-2774: Rename Copycat to Kafka Connect
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira
Closes #456 from ewencp/kafka-2774-rename-copycat
9 years ago
f4b87deefe
KAFKA-2480: Handle retriable and non-retriable exceptions thrown by sink tasks.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira
Closes #450 from ewencp/kafka-2480-unrecoverable-task-errors
9 years ago
83fb734603
HOTFIX: fix group coordinator edge cases around metadata storage callback
...
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Guozhang Wang
Closes #451 from hachikuji/hotfix-group-coordinator
9 years ago
34d9976656
KAFKA-2761: enable whitelist regex subscription for new consumer in ConsoleConsumer
...
#412 is a pre-req.
Author: Ashish Singh <asingh@cloudera.com>
Reviewers: Guozhang Wang
Closes #445 from SinghAsDev/KAFKA-2761
9 years ago
23cc9c77b2
KAFKA-2723: new consumer exception cleanup
...
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Guozhang Wang
Closes #441 from hachikuji/K2723
9 years ago
b4e1bdf48b
KAFKA-2666: Docs: Automatically generate documentation from config classes
...
…the way we always planned to
Author: Gwen Shapira <cshapi@gmail.com>
Reviewers: Jun Rao, Guozhang Wang
Closes #382 from gwenshap/KAFKA-2666
9 years ago
30bf985348
KAFKA-2767; Upgrade ZkClient version to 0.7
...
Author: Flavio Junqueira <fpj@apache.org>
Reviewers: Jun Rao <junrao@gmail.com>
Closes #449 from fpj/KAFKA-2767
9 years ago
15524d0970
KAFKA-2766: use new producer by default in tooling
...
Also update the API docs for new consumer.
Author: Guozhang Wang <wangguoz@gmail.com>
Reviewers: Gwen Shapira
Closes #448 from guozhangwang/K2766
9 years ago
d297b3af26
KAFKA-2765: Add versions to Copycat Connector and Task interfaces and log versions when instantiating connectors and tasks.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira
Closes #446 from ewencp/connector-versions
9 years ago
130a561ad5
MINOR: Remove unnecessary println
...
Looks like this println might have been left in there by mistake.
Author: Rajini Sivaram <rajinisivaram@googlemail.com>
Reviewers: Guozhang Wang
Closes #429 from rajinisivaram/latency-args-print
9 years ago
09ff686738
MINOR: Fix homophone typo in Design documentation
...
Noticed that there was a small typo in section 4.1 of the Design documentation on the [website](https://kafka.apache.org/documentation.html#majordesignelements ) ('new' vs. 'knew'). This patch corrects that.
Author: Chris Pinola <chris@pinola.co>
Reviewers: Guozhang Wang
Closes #391 from chrnola/minor/design-doc-typo
9 years ago
a9e4ce79fe
KAFKA-2734: kafka-console-consumer should allow empty topic for old consumer.
...
…ot specifying topic
Author: Ashish Singh <asingh@cloudera.com>
Reviewers: Sriharsha Chintalapani, Guozhang Wang
Closes #412 from SinghAsDev/KAFKA-2734
9 years ago
a423316d38
KAFKA-2760: Clean up interface of AdminClient.describeConsumerGroup.
...
…roupId)
Author: Ashish Singh <asingh@cloudera.com>
Reviewers: Jason Gustafson, Guozhang Wang
Closes #442 from SinghAsDev/KAFKA-2760
9 years ago
c006c5916e
KAFKA-2764: Change use of Properties in Copycat to Maps.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira, Guozhang Wang
Closes #444 from ewencp/kafka-2764-maps-not-properties
9 years ago
a76660ac81
KAFKA-2713: Run task start and stop methods in worker threads so they execute in parallel and cannot block the herder thread.
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Gwen Shapira
Closes #443 from ewencp/kafka-2713-task-start-stop-threaded
9 years ago
b1eaa46a51
HOTFIX: unsubscribe does not clear user assignment properly
...
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Gwen Shapira
Closes #439 from hachikuji/unsubscribe-hotfix
9 years ago
c3c0c04e62
KAFKA-2490: support new consumer in ConsumerGroupCommand
...
Author: Ashish Singh <asingh@cloudera.com>
Reviewers: Guozhang Wang, Jason Gustafson
Closes #299 from SinghAsDev/KAFKA-2490
9 years ago
33e879a389
KAFKA-2702: ConfigDef toHtmlTable() sorts in a way that is a bit conf…
...
…using
Author: Grant Henke <granthenke@gmail.com>
Reviewers: Gwen Shapira
Closes #379 from granthenke/config-html
9 years ago
76bcccd61f
KAFKA-2745: Update JavaDoc for new / updated consumer APIs
...
Author: Guozhang Wang <wangguoz@gmail.com>
Reviewers: Jeff Holoman, Jason Gustafson, Gwen Shapira
Closes #425 from guozhangwang/K2745
9 years ago
Guozhang Wang
Rajini Sivaram
Grant Henke
Ewen Cheslack-Postava
Parth Brahmbhatt
Jason Gustafson
Geoff Anderson
Anna Povzner
Ashish Singh
Gwen Shapira
Flavio Junqueira
Chris Pinola