src-kafka

Commit Graph

Author	SHA1	Message	Date
Apurva Mehta	bdf4cba047	KAFKA-4817; Add idempotent producer semantics This is from the KIP-98 proposal. The main points of discussion surround the correctness logic, particularly the Log class where incoming entries are validated and duplicates are dropped, and also the producer error handling to ensure that the semantics are sound from the users point of view. There is some subtlety in the idempotent producer semantics. This patch only guarantees idempotent production upto the point where an error has to be returned to the user. Once we hit a such a non-recoverable error, we can no longer guarantee message ordering nor idempotence without additional logic at the application level. In particular, if an application wants guaranteed message order without duplicates, then it needs to do the following in the error callback: 1. Close the producer so that no queued batches are sent. This is important for guaranteeing ordering. 2. Read the tail of the log to inspect the last message committed. This is important for avoiding duplicates. Author: Apurva Mehta <apurva@confluent.io> Author: hachikuji <jason@confluent.io> Author: Apurva Mehta <apurva.1618@gmail.com> Author: Guozhang Wang <wangguoz@gmail.com> Author: fpj <fpj@apache.org> Author: Jason Gustafson <jason@confluent.io> Reviewers: Jason Gustafson <jason@confluent.io>, Ismael Juma <ismael@juma.me.uk>, Jun Rao <junrao@gmail.com> Closes #2735 from apurvam/exactly-once-idempotent-producer	8 years ago
Jason Gustafson	5bd06f1d54	KAFKA-4816; Message format changes for idempotent/transactional producer (KIP-98) Author: Jason Gustafson <jason@confluent.io> Reviewers: Jun Rao <junrao@gmail.com>, Apurva Mehta <apurva@confluent.io>, Guozhang Wang <wangguoz@gmail.com>, Ismael Juma <ismael@juma.me.uk> Closes #2614 from hachikuji/exactly-once-message-format	8 years ago
Damian Guy	de05c9d3a0	MINOR: Add code quality checks (and suppressions) to checkstyle.xml Author: Damian Guy <damian.guy@gmail.com> Reviewers: Guozhang Wang <wangguoz@gmail.com>, Ewen Cheslack-Postava <me@ewencp.org>, Jason Gustafson <jason@confluent.io>, Ismael Juma <ismael@juma.me.uk> Closes #2594 from dguy/checkstyle	8 years ago
Matthias J. Sax	d0e436c471	MINOR: improve license header check by providing head file instead of (prefix) header regex Author: Matthias J. Sax <matthias@confluent.io> Reviewers: Jason Gustafson <jason@confluent.io>, Ewen Cheslack-Postava <ewen@confluent.io> Closes #2303 from mjsax/licenseHeader	8 years ago
Guozhang Wang	768328689a	MINOR: Modify checkstyle to allow import classes only used in javadoc Author: Guozhang Wang <wangguoz@gmail.com> Reviewers: Gwen Shapira, Ismael Juma Closes #1317 from guozhangwang/KJavaDocImport	9 years ago
Rajini Sivaram	9d71489ff0	KAFKA-3548: Use root locale for case transformation of constant strings For enums and other constant strings, use locale independent case conversions to enable comparisons to work regardless of the default locale. Author: Rajini Sivaram <rajinisivaram@googlemail.com> Reviewers: Manikumar Reddy, Ismael Juma, Guozhang Wang, Gwen Shapira Closes #1220 from rajinisivaram/KAFKA-3548	9 years ago
manasvigupta	a0d21407cb	KAFKA-3009; Disallow star imports Summary of code changes ------------------------------------ 1) Added a new Checkstyle rule to flag any code using star imports 2) Fixed ALL existing code violations using star imports Testing ----------- Local build was successful ALL JUnits ran successfully on local. ewencp - Request you to please review changes. Thank you ! I state that the contribution is my original work and I license the work to the project under the project's open source license. Author: manasvigupta <manasvigupta@yahoo.co.in> Reviewers: Ewen Cheslack-Postava <ewen@confluent.io> Closes #700 from manasvigupta/KAFKA-3009	9 years ago
Grant Henke	0a52ddfd03	MINOR: Fix building from subproject directory This patch fixes some releative paths so bulding from a subproject directory like ($rootDir/core) will not fail Author: Grant Henke <granthenke@gmail.com> Reviewers: Ewen Chesklack-Postava Closes #509 from granthenke/minor	9 years ago
Ismael Juma	4e7db39556	MINOR: Make indenting in `checkstyle.xml` and `import-control.xml` consistent They now both use 2 spaces for indents, which is what `checkstyle.xml` was already doing. `import.xml` had a mixture of tabs and 4 spaces previously. Author: Ismael Juma <ismael@juma.me.uk> Reviewers: Gwen Shapira Closes #253 from ijuma/fix-xml-indents	9 years ago
Guozhang Wang	263c10ab7c	KIP-28: Add a processor client for Kafka Streaming This work has been contributed by Jesse Anderson, Randall Hauch, Yasuhiro Matsuda and Guozhang Wang. The detailed design can be found in https://cwiki.apache.org/confluence/display/KAFKA/KIP-28+-+Add+a+processor+client. Author: Guozhang Wang <wangguoz@gmail.com> Author: Yasuhiro Matsuda <yasuhiro.matsuda@gmail.com> Author: Yasuhiro Matsuda <yasuhiro@confluent.io> Author: ymatsuda <yasuhiro.matsuda@gmail.com> Author: Randall Hauch <rhauch@gmail.com> Author: Jesse Anderson <jesse@smokinghand.com> Author: Ismael Juma <ismael@juma.me.uk> Author: Jesse Anderson <eljefe6a@gmail.com> Reviewers: Ismael Juma, Randall Hauch, Edward Ribeiro, Gwen Shapira, Jun Rao, Jay Kreps, Yasuhiro Matsuda, Guozhang Wang Closes #130 from guozhangwang/streaming	9 years ago
Jay Kreps	1c6d5bbac6	KAFKA-1915: Add checkstyle for java code.	10 years ago

11 Commits (46aa88b9cf82971a0890f4f83efa9639f84c677b)