src-kafka

Commit Graph

Author	SHA1	Message	Date
Jason Gustafson	dfa3c8a92d	KAFKA-5316; LogCleaner should account for larger record sets after cleaning Author: Jason Gustafson <jason@confluent.io> Reviewers: Ismael Juma <ismael@juma.me.uk>, Jun Rao <junrao@gmail.com> Closes #3142 from hachikuji/KAFKA-5316	8 years ago
Matthias J. Sax	495836a4a2	KAFKA-4923: Modify compatibility test for Exaclty-Once Semantics in Streams - add broker compatibility system tests Author: Matthias J. Sax <matthias@confluent.io> Reviewers: Damian Guy, Eno Thereska, Guozhang Wang Closes #2974 from mjsax/kafka-4923-add-eos-to-streams-add-broker-check-and-system-test	8 years ago
Jiangjie Qin	7fad45557e	KAFKA-3995; KIP-126 Allow KafkaProducer to split and resend oversized batches Author: Jiangjie Qin <becket.qin@gmail.com> Reviewers: Joel Koshy <jjkoshy.w@gmail.com>, Ismael Juma <ismael@juma.me.uk> Closes #2638 from becketqin/KAFKA-3995	8 years ago
Xavier Léauté	e287523577	KAFKA-5192: add WindowStore range scan (KIP-155) Implements range scan for keys in windowed and session stores Modifies caching session and windowed stores to use segmented cache keys. Cache keys are internally prefixed with their segment id to ensure key ordering in the cache matches the ordering in the underlying store for keys spread across multiple segments. This should also result in fewer cache keys getting scanned for queries spanning only some segments. Author: Xavier Léauté <xavier@confluent.io> Reviewers: Damian Guy, Guozhang Wang Closes #3027 from xvrl/windowstore-range-scan	8 years ago
Guozhang Wang	c64cfd2e2b	KAFKA-5231: Bump up producer epoch when sending abort txn markers on InitPid Author: Guozhang Wang <wangguoz@gmail.com> Reviewers: Jason Gustafson, Jun Rao Closes #3066 from guozhangwang/K5231-bump-up-epoch-when-abort-txn	8 years ago
Apurva Mehta	bdf4cba047	KAFKA-4817; Add idempotent producer semantics This is from the KIP-98 proposal. The main points of discussion surround the correctness logic, particularly the Log class where incoming entries are validated and duplicates are dropped, and also the producer error handling to ensure that the semantics are sound from the users point of view. There is some subtlety in the idempotent producer semantics. This patch only guarantees idempotent production upto the point where an error has to be returned to the user. Once we hit a such a non-recoverable error, we can no longer guarantee message ordering nor idempotence without additional logic at the application level. In particular, if an application wants guaranteed message order without duplicates, then it needs to do the following in the error callback: 1. Close the producer so that no queued batches are sent. This is important for guaranteeing ordering. 2. Read the tail of the log to inspect the last message committed. This is important for avoiding duplicates. Author: Apurva Mehta <apurva@confluent.io> Author: hachikuji <jason@confluent.io> Author: Apurva Mehta <apurva.1618@gmail.com> Author: Guozhang Wang <wangguoz@gmail.com> Author: fpj <fpj@apache.org> Author: Jason Gustafson <jason@confluent.io> Reviewers: Jason Gustafson <jason@confluent.io>, Ismael Juma <ismael@juma.me.uk>, Jun Rao <junrao@gmail.com> Closes #2735 from apurvam/exactly-once-idempotent-producer	8 years ago
Jason Gustafson	5bd06f1d54	KAFKA-4816; Message format changes for idempotent/transactional producer (KIP-98) Author: Jason Gustafson <jason@confluent.io> Reviewers: Jun Rao <junrao@gmail.com>, Apurva Mehta <apurva@confluent.io>, Guozhang Wang <wangguoz@gmail.com>, Ismael Juma <ismael@juma.me.uk> Closes #2614 from hachikuji/exactly-once-message-format	8 years ago
Damian Guy	de05c9d3a0	MINOR: Add code quality checks (and suppressions) to checkstyle.xml Author: Damian Guy <damian.guy@gmail.com> Reviewers: Guozhang Wang <wangguoz@gmail.com>, Ewen Cheslack-Postava <me@ewencp.org>, Jason Gustafson <jason@confluent.io>, Ismael Juma <ismael@juma.me.uk> Closes #2594 from dguy/checkstyle	8 years ago
Matthias J. Sax	d0e436c471	MINOR: improve license header check by providing head file instead of (prefix) header regex Author: Matthias J. Sax <matthias@confluent.io> Reviewers: Jason Gustafson <jason@confluent.io>, Ewen Cheslack-Postava <ewen@confluent.io> Closes #2303 from mjsax/licenseHeader	8 years ago
Guozhang Wang	768328689a	MINOR: Modify checkstyle to allow import classes only used in javadoc Author: Guozhang Wang <wangguoz@gmail.com> Reviewers: Gwen Shapira, Ismael Juma Closes #1317 from guozhangwang/KJavaDocImport	9 years ago
Rajini Sivaram	9d71489ff0	KAFKA-3548: Use root locale for case transformation of constant strings For enums and other constant strings, use locale independent case conversions to enable comparisons to work regardless of the default locale. Author: Rajini Sivaram <rajinisivaram@googlemail.com> Reviewers: Manikumar Reddy, Ismael Juma, Guozhang Wang, Gwen Shapira Closes #1220 from rajinisivaram/KAFKA-3548	9 years ago
manasvigupta	a0d21407cb	KAFKA-3009; Disallow star imports Summary of code changes ------------------------------------ 1) Added a new Checkstyle rule to flag any code using star imports 2) Fixed ALL existing code violations using star imports Testing ----------- Local build was successful ALL JUnits ran successfully on local. ewencp - Request you to please review changes. Thank you ! I state that the contribution is my original work and I license the work to the project under the project's open source license. Author: manasvigupta <manasvigupta@yahoo.co.in> Reviewers: Ewen Cheslack-Postava <ewen@confluent.io> Closes #700 from manasvigupta/KAFKA-3009	9 years ago
Grant Henke	0a52ddfd03	MINOR: Fix building from subproject directory This patch fixes some releative paths so bulding from a subproject directory like ($rootDir/core) will not fail Author: Grant Henke <granthenke@gmail.com> Reviewers: Ewen Chesklack-Postava Closes #509 from granthenke/minor	9 years ago
Ismael Juma	4e7db39556	MINOR: Make indenting in `checkstyle.xml` and `import-control.xml` consistent They now both use 2 spaces for indents, which is what `checkstyle.xml` was already doing. `import.xml` had a mixture of tabs and 4 spaces previously. Author: Ismael Juma <ismael@juma.me.uk> Reviewers: Gwen Shapira Closes #253 from ijuma/fix-xml-indents	9 years ago
Guozhang Wang	263c10ab7c	KIP-28: Add a processor client for Kafka Streaming This work has been contributed by Jesse Anderson, Randall Hauch, Yasuhiro Matsuda and Guozhang Wang. The detailed design can be found in https://cwiki.apache.org/confluence/display/KAFKA/KIP-28+-+Add+a+processor+client. Author: Guozhang Wang <wangguoz@gmail.com> Author: Yasuhiro Matsuda <yasuhiro.matsuda@gmail.com> Author: Yasuhiro Matsuda <yasuhiro@confluent.io> Author: ymatsuda <yasuhiro.matsuda@gmail.com> Author: Randall Hauch <rhauch@gmail.com> Author: Jesse Anderson <jesse@smokinghand.com> Author: Ismael Juma <ismael@juma.me.uk> Author: Jesse Anderson <eljefe6a@gmail.com> Reviewers: Ismael Juma, Randall Hauch, Edward Ribeiro, Gwen Shapira, Jun Rao, Jay Kreps, Yasuhiro Matsuda, Guozhang Wang Closes #130 from guozhangwang/streaming	9 years ago
Jay Kreps	1c6d5bbac6	KAFKA-1915: Add checkstyle for java code.	10 years ago

16 Commits (b7684b47b80a2a7d604632bb325fde49e570480f)