This fix should be fine for Linux and OS X. Not sure about Windows though. This is a very specific fix for new functionality added in KAFKA-2384. There are other places where a similar error could occur, but are less likely.
The script doesn't really support Unicode input at the moment.
Author: Ismael Juma <ismael@juma.me.uk>
Reviewers: Guozhang
Closes#109 from ijuma/kafka-2384-hotfix and squashes the following commits:
0ab8958 [Ismael Juma] Encode/decode to utf-8 for commit title IO in kafka-merge-pr.py
There are two race conditions in the test case "testGenerationIdIncrementsOnRebalance." First, a delay before the second join group request can timeout the initial group and cause the generationId to unexpectedly reset. Second, a delay in the join group request handling will timeout the request itself and cause the test to fail. This commit doesn't address these race conditions, but increases the timeouts to make them more unlikely. If the problem reoccurs, then we'll probably need a better solution.
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Gwen Shapira <cshapi@gmail.com>
Closes#107 from hachikuji/KAFKA-2386 and squashes the following commits:
a53460a [Jason Gustafson] KAFKA-2386; increase timeouts for transient test failure in ConsumerCoordinatorResponseTest
When running Kafka server from sources, logs directory gets created in root of repository, and kafka server logs end up there. Currently that directory is not ignored by git.
This change adds root logs directory to .gitignore so that Kafka server logs are ignored and do not get tracked by git.
Author: Stevo Slavić <sslavic@gmail.com>
Reviewers: Ismael Juma
Closes#94 from sslavic/patch-7 and squashes the following commits:
c7b62a7 [Stevo Slavić] MINOR: Added to .gitignore Kafka server logs
Author: Ismael Juma <ismael@juma.me.uk>
Reviewers: Guozhang
Closes#105 from ijuma/kafka-2384-override-commit-message-title and squashes the following commits:
e042242 [Ismael Juma] Support overriding of commit message title in kafka-merge-pr.py
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Ismael, Ashish, Guozhang
Closes#100 from hachikuji/KAFKA-2350 and squashes the following commits:
250e823 [Jason Gustafson] KAFKA-2350; KafkaConsumer pause/resume API
Refactoring of ConsumerRecord made in 0699ff2ce6 (diff-fafe8d3a3942f3c6394927881a9389b2) left ConsumerRecord constructor javadoc inconsistent with implementation.
This patch fixes ConsumerRecord constructor javadoc to be inline with implementation.
Author: Stevo Slavić <sslavic@gmail.com>
Reviewers: Ismael, Guozhang
Closes#85 from sslavic/patch-3 and squashes the following commits:
c289c4f [Stevo Slavić] MINOR: Fixed ConsumerRecord constructor javadoc
Initial patch for KIP-25
Note that to install ducktape, do *not* use pip to install ducktape. Instead:
```
$ git clone gitgithub.com:confluentinc/ducktape.git
$ cd ducktape
$ python setup.py install
```
Author: Geoff Anderson <geoff@confluent.io>
Author: Geoff <granders@gmail.com>
Author: Liquan Pei <liquanpei@gmail.com>
Reviewers: Ewen, Gwen, Jun, Guozhang
Closes#70 from granders/KAFKA-2276 and squashes the following commits:
a62fb6c [Geoff Anderson] fixed checkstyle errors
a70f0f8 [Geoff Anderson] Merged in upstream trunk.
8b62019 [Geoff Anderson] Merged in upstream trunk.
47b7b64 [Geoff Anderson] Created separate tools jar so that the clients package does not pull in dependencies on the Jackson JSON tools or argparse4j.
a9e6a14 [Geoff Anderson] Merged in upstream changes
d18db7b [Geoff Anderson] fixed :rat errors (needed to add licenses)
321fdf8 [Geoff Anderson] Ignore tests/ and vagrant/ directories when running rat build task
795fc75 [Geoff Anderson] Merged in changes from upstream trunk.
1d93f06 [Geoff Anderson] Updated provisioning to use java 7 in light of KAFKA-2316
2ea4e29 [Geoff Anderson] Tweaked README, changed default log collection behavior on VerifiableProducer
0eb6fdc [Geoff Anderson] Merged in system-tests
69dd7be [Geoff Anderson] Merged in trunk
4034dd6 [Geoff Anderson] Merged in upstream trunk
ede6450 [Geoff] Merge pull request #4 from confluentinc/move_muckrake
7751545 [Geoff Anderson] Corrected license headers
e6d532f [Geoff Anderson] java 7 -> java 6
8c61e2d [Geoff Anderson] Reverted jdk back to 6
f14c507 [Geoff Anderson] Removed mode = "test" from Vagrantfile and Vagrantfile.local examples. Updated testing README to clarify aws setup.
98b7253 [Geoff Anderson] Updated consumer tests to pre-populate kafka logs
e6a41f1 [Geoff Anderson] removed stray println
b15b24f [Geoff Anderson] leftover KafkaBenchmark in super call
0f75187 [Geoff Anderson] Rmoved stray allow_fail. kafka_benchmark_test -> benchmark_test
f469f84 [Geoff Anderson] Tweaked readme, added example Vagrantfile.local
3d73857 [Geoff Anderson] Merged downstream changes
42dcdb1 [Geoff Anderson] Tweaked behavior of stop_node, clean_node to generally fail fast
7f7c3e0 [Geoff Anderson] Updated setup.py for kafkatest
c60125c [Geoff Anderson] TestEndToEndLatency -> EndToEndLatency
4f476fe [Geoff Anderson] Moved aws scripts to vagrant directory
5af88fc [Geoff Anderson] Updated README to include aws quickstart
e5edf03 [Geoff Anderson] Updated example aws Vagrantfile.local
96533c3 [Geoff] Update aws-access-keys-commands
25a413d [Geoff] Update aws-example-Vagrantfile.local
884b20e [Geoff Anderson] Moved a bunch of files to kafkatest directory
fc7c81c [Geoff Anderson] added setup.py
632be12 [Geoff] Merge pull request #3 from confluentinc/verbose-client
51a94fd [Geoff Anderson] Use argparse4j instead of joptsimple. ThroughputThrottler now has more intuitive behavior when targetThroughput is 0.
a80a428 [Geoff Anderson] Added shell program for VerifiableProducer.
d586fb0 [Geoff Anderson] Updated comments to reflect that throttler is not message-specific
6842ed1 [Geoff Anderson] left out a file from last commit
1228eef [Geoff Anderson] Renamed throttler
9100417 [Geoff Anderson] Updated command-line options for VerifiableProducer. Extracted throughput logic to make it reusable.
0a5de8e [Geoff Anderson] Fixed checkstyle errors. Changed name to VerifiableProducer. Added synchronization for thread safety on println statements.
475423b [Geoff Anderson] Convert class to string before adding to json object.
bc009f2 [Geoff Anderson] Got rid of VerboseProducer in core (moved to clients)
c0526fe [Geoff Anderson] Updates per review comments.
8b4b1f2 [Geoff Anderson] Minor updates to VerboseProducer
2777712 [Geoff Anderson] Added some metadata to producer output.
da94b8c [Geoff Anderson] Added number of messages option.
07cd1c6 [Geoff Anderson] Added simple producer which prints status of produced messages to stdout.
a278988 [Geoff Anderson] fixed typos
f1914c3 [Liquan Pei] Merge pull request #2 from confluentinc/system_tests
81e4156 [Liquan Pei] Bootstrap Kafka system tests
Author: Ismael Juma <ismael@juma.me.uk>
Reviewers: Guozhang
Closes#97 from ijuma/kafka-2321 and squashes the following commits:
4834464 [Ismael Juma] KAFKA-2321; Introduce CONTRIBUTING.md
`testAll` passed locally.
Author: Ismael Juma <ismael@juma.me.uk>
Reviewers: Harsha, Ewen, Guozhang
Closes#87 from ijuma/kafka-2348-drop-support-for-scala-2.9 and squashes the following commits:
cf9796a [Ismael Juma] KAFKA-2348; Drop support for Scala 2.9
The first 4 commits are adapted from changes that have been done to the Spark version and the last one is the feature that gwenshap asked for.
Author: Ismael Juma <ismael@juma.me.uk>
Reviewers: Gwen Shapira <cshapi@gmail.com>
Closes#90 from ijuma/kafka-2344-merge-pr-improvements and squashes the following commits:
900c371 [Ismael Juma] Allow reviewers to be entered during merge
ac06347 [Ismael Juma] Allow primary author to be overridden during merge
b309829 [Ismael Juma] Set JIRA resolution to "Fixed" instead of relying on default transition
0c69a64 [Ismael Juma] Check return value of doctest.testmod()
061cdce [Ismael Juma] Fix instructions on how to install the `jira-python` library
Author: Jason Gustafson <jason@confluent.io>
Closes#88 from hachikuji/KAFKA-2342 and squashes the following commits:
cabb017 [Jason Gustafson] KAFKA-2342; KafkaConsumer rebalance with in-flight fetch can cause invalid position
The right command to get the branch name is `git rev-parse --abbrev-ref HEAD` instead of `git rev-parse HEAD`. The latter gives the commit hash causing a detached branch when we checkout to it. Seems like a bug we inherited from the Spark script.
Author: Ismael Juma <ismael@juma.me.uk>
Closes#84 from ijuma/kafka-2328-merge-script-no-detached-branch and squashes the following commits:
ae201dd [Ismael Juma] KAFKA-2328; merge-kafka-pr.py script should not leave user in a detached branch
Author: Ismael Juma <ismael@juma.me.uk>
Closes#82 from ijuma/kafka-2324 and squashes the following commits:
d71bf5c [Ismael Juma] KAFKA-2324; Update to Scala 2.11.7
This commit fixes a minor issue introduced in the patch for KAFKA-2123. The schedule method requires the time the task should be executed, not a delay.
Author: Jason Gustafson <jason@confluent.io>
Closes#79 from hachikuji/KAFKA-2123-fix and squashes the following commits:
6eb7ec6 [Jason Gustafson] [Minor] fix new consumer heartbeat reschedule bug
Author: Jason Gustafson <jason@confluent.io>
Closes#78 from hachikuji/KAFKA-2335 and squashes the following commits:
c697998 [Jason Gustafson] KAFKA-2335; fix comment about consumer thread safety
Added unit tests as well. These fail without the fix, but pass with the fix.
Author: Geoff Anderson <geoff@confluent.io>
Closes#73 from granders/KAFKA-2327 and squashes the following commits:
52a2085 [Geoff Anderson] Cleaned up unecessary toString calls
23b3340 [Geoff Anderson] Fixes KAFKA-2327
Ismael Juma
lvfangmin
Jason Gustafson
Stevo Slavić
Manikumar Reddy
David Jacot
Geoff Anderson
Rajini Sivaram
Ashish Singh
Guozhang Wang
Edward Ribeiro
Grant Henke
Gwen Shapira
Ewen Cheslack-Postava
Jason Gustafson
Alexey Ozeritskiy
Dong Lin
Ismael Juma
Parth Brahmbhatt
Tim Brooks
Joel Koshy
Sriharsha Chintalapani
Onur Karaman
Joe Stein