Magnus Edenhill
60c36b0984
MINOR: Fix var typo in verifiable_consumer assertion
...
Author: Magnus Edenhill <magnus@edenhill.se>
Reviewers: Jason Gustafson <jason@confluent.io>
Closes #4098 from edenhill/verfcons_var_fix
7 years ago
Jason Gustafson
462767660b
HOTFIX: Fix unsafe dependence on class name in VerifiableClientJava
...
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Ewen Cheslack-Postava <ewen@confluent.io>
Closes #2736 from hachikuji/hotfix-verifiable-clients
8 years ago
Magnus Edenhill
d5cec01f2a
MINOR: Pluggable verifiable clients
...
This adds support for pluggable VerifiableConsumer and VerifiableProducers test client implementations
allowing third-party clients to be used in-place of the Java client in kafkatests.
A new VerifiableClientMixin class is added and the standard Java Verifiable{Producer,Consumer}
classes have been changed to use it.
While third-party client drivers may be implemented with a complete class based on the Mixin, a simpler
alternative which requries no kafkatest class implementation is available through the VerifiableClientApp class that uses ducktape's global param to specify the client app to use (passed to ducktape through the `--globals <json>` command line argument).
Some existing kafkatest clients for reference:
Go: https://github.com/confluentinc/confluent-kafka-go/tree/master/kafkatest
Python: https://github.com/confluentinc/confluent-kafka-python/tree/master/confluent_kafka/kafkatest
C++: https://github.com/edenhill/librdkafka/blob/0.9.2.x/examples/kafkatest_verifiable_client.cpp
C#/.NET: https://github.com/confluentinc/confluent-kafka-dotnet/tree/master/test/Confluent.Kafka.VerifiableClient
This PR also contains documentation for the simplex JSON-based verifiable\* client protocol.
There are also some minor improvements that makes troubleshooting failing client tests easier.
Author: Magnus Edenhill <magnus@edenhill.se>
Reviewers: Ewen Cheslack-Postava <ewen@confluent.io>
Closes #2048 from edenhill/pluggable_verifiable_clients
8 years ago
Jason Gustafson
76550dd895
KAFKA-4719: Consumption timeout should take into account producer request timeout
...
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Ewen Cheslack-Postava <ewen@confluent.io>
Closes #2479 from hachikuji/KAFKA-4719
8 years ago
Ewen Cheslack-Postava
6264cc1557
KAFKA-4450; Add upgrade tests for 0.10.1 and rename TRUNK to DEV_BRANCH to reduce confusion
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Ismael Juma <ismael@juma.me.uk>
Closes #2457 from ewencp/kafka-4450-upgrade-tests
8 years ago
Ewen Cheslack-Postava
9b8d99b1b8
KAFKA-4673: Fix thread-safety of Python VerifiableConsumer class
...
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Jason Gustafson <jason@confluent.io>
Closes #2427 from ewencp/kafka-4673-verifiable-consumer-thread-safety
8 years ago
Rajini Sivaram
3f6c4f63c9
KAFKA-4580; Use sasl.jaas.config for some system tests
...
Switched console_consumer, verifiable_consumer and verifiable_producer to use new sasl.jaas_config property instead of static JAAS configuration file when used with SASL_PLAINTEXT.
Author: Rajini Sivaram <rajinisivaram@googlemail.com>
Reviewers: Ewen Cheslack-Postava <ewen@confluent.io>, Ismael Juma <ismael@juma.me.uk>
Closes #2323 from rajinisivaram/KAFKA-4580
8 years ago
Geoff Anderson
62e043a865
KAFKA-4140: Upgrade to ducktape 0.6.0 and make system tests parallel friendly
...
Updates to take advantage of soon-to-be-released ducktape features.
Author: Geoff Anderson <geoff@confluent.io>
Author: Ewen Cheslack-Postava <me@ewencp.org>
Reviewers: Ewen Cheslack-Postava <ewen@confluent.io>
Closes #1834 from granders/systest-parallel-friendly
8 years ago
Geoff Anderson
54092c12ed
KAFKA-3592: System test - configurable paths
...
This patch adds logic for the following:
- remove hard-coded paths to various scripts and jars in kafkatest service classes
- provide a mechanism for overriding path resolution logic with a "pluggable" path resolver class
Author: Geoff Anderson <geoff@confluent.io>
Reviewers: Ewen Cheslack-Postava <ewen@confluent.io>
Closes #1245 from granders/configurable-install-path
9 years ago
Geoff Anderson
b6cd0e2791
KAFKA-3581: add timeouts to joins in background thread services
...
This actually removes joins altogether, as well as references to self.worker_threads, which is best left as an implementation detail in BackgroundThreadService.
This makes use of hachikuji 's recent ducktape patch, and updates ducktape dependency to 0.5.0.
Author: Geoff Anderson <geoff@confluent.io>
Reviewers: Jason Gustafson <jason@confluent.io>, Ewen Cheslack-Postava <ewen@confluent.io>
Closes #1297 from granders/KAFKA-3581-systest-add-join-timeout
9 years ago
Jason Gustafson
976fa192d4
KAFKA-2989; System tests should verify partitions consumed after rebalancing
...
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Ewen Cheslack-Postava <ewen@confluent.io>
Closes #702 from hachikuji/KAFKA-2989
9 years ago
Jason Gustafson
cd54fc8816
KAFKA-2931: add system test for consumer rolling upgrades
...
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Ismael Juma, Guozhang Wang
Closes #619 from hachikuji/KAFKA-2931
9 years ago
Ben Stopford
0264127ba8
KAFKA-2915: Fix problem with System Tests that use bootstrap.servers embedded in jinja files
...
Fixes problems in mirror maker and consumer tests
http://jenkins.confluent.io/job/kafka_system_tests_branch_builder/290/
http://jenkins.confluent.io/job/kafka_system_tests_branch_builder/289/
Author: Ben Stopford <benstopford@gmail.com>
Reviewers: Guozhang Wang
Closes #608 from benstopford/KAFKA-2915-jinja-bug
9 years ago
Ben Stopford
6b4cc2ea2b
KAFKA-2771: Added rolling upgrade system test (ducktape) for Secured Cluster
...
Tests rolling upgrade from PLAINTEXT to SSL
Author: Ben Stopford <benstopford@gmail.com>
Reviewers: Geoff Anderson, Ismael Juma
Closes #496 from benstopford/security-upgrade-test
9 years ago
Jason Gustafson
78e7f87db8
MINOR: fix verifiable consumer assertion
...
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Guozhang Wang
Closes #597 from hachikuji/fix-verifiable-consumer-assertion
9 years ago
Jason Gustafson
b16817a54c
KAFKA-2812: improve consumer integration tests
...
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Geoff Anderson
Closes #500 from hachikuji/KAFKA-2812
9 years ago
Jason Gustafson
bce664b42a
KAFKA-2274: verifiable consumer and integration testing
...
Author: Jason Gustafson <jason@confluent.io>
Reviewers: Guozhang Wang, Geoff Anderson
Closes #465 from hachikuji/KAFKA-2274
9 years ago