src-kafka

Commit Graph

Author	SHA1	Message	Date
Ismael Juma	a5f1158c31	KAFKA-3558; Add compression_type parameter to benchmarks in benchmark_test.py * Use a fixed `Random` seed in `EndToEndLatency.scala` for determinism * Add `compression_type` to and remove `consumer_fetch_max_wait` from `end_to_end_latency.py`. The latter was never used. * Tweak logging of `end_to_end_latency.py` to be similar to `consumer_performance.py`. * Add `compression_type` to `benchmark_test.py` methods and add `snappy` to `matrix` annotation * Use randomly generated bytes from a restricted range for `ProducerPerformance` payload. This is a simple fix for now. It can be improved in the PR for KAFKA-3554. Author: Ismael Juma <ismael@juma.me.uk> Reviewers: Ewen Cheslack-Postava <ewen@confluent.io> Closes #1225 from ijuma/kafka-3558-add-compression_type-benchmark_test.py	9 years ago
Ismael Juma	c1694833d5	KAFKA-3490; Multiple version support for ducktape performance tests Author: Ismael Juma <ismael@juma.me.uk> Author: Geoff Anderson <geoff@confluent.io> Reviewers: Geoff Anderson <geoff@confluent.io>, Ewen Cheslack-Postava <ewen@confluent.io> Closes #1173 from ijuma/kafka-3490-multiple-version-support-perf-tests	9 years ago
Ben Stopford	6b4cc2ea2b	KAFKA-2771: Added rolling upgrade system test (ducktape) for Secured Cluster Tests rolling upgrade from PLAINTEXT to SSL Author: Ben Stopford <benstopford@gmail.com> Reviewers: Geoff Anderson, Ismael Juma Closes #496 from benstopford/security-upgrade-test	9 years ago
Geoff Anderson	b206a807f3	KAFKA-2820: Remove log threshold on appender in tools-log4j.properties Removed a config in tools-log4j.properties which prevented certain service classes from logging at TRACE level. Author: Geoff Anderson <geoff@confluent.io> Reviewers: Ewen Cheslack-Postava, Gwen Shapira Closes #556 from granders/KAFKA-2820-systest-tool-loglevel	9 years ago
Rajini Sivaram	98db5ea94f	KAFKA-2644; Run relevant ducktape tests with SASL_PLAINTEXT and SASL_SSL Run sanity check, replication tests and benchmarks with SASL/Kerberos using MiniKdc. Author: Rajini Sivaram <rajinisivaram@googlemail.com> Reviewers: Geoff Anderson <geoff@confluent.io>, Jun Rao <junrao@gmail.com> Closes #358 from rajinisivaram/KAFKA-2644	9 years ago
Manikumar reddy O	1cc44830b9	KAFKA-2562: update kafka scripts to use new tools/code Updated kafka-producer-perf-test.sh to use org.apache.kafka.clients.tools.ProducerPerformance. Updated build.gradle to add kafka-tools-0.9.0.0-SNAPSHOT.jar to kafka/libs folder. Author: Manikumar reddy O <manikumar.reddy@gmail.com> Reviewers: Gwen Shapira, Ismael Juma Closes #242 from omkreddy/KAFKA-2562	9 years ago
Geoff Anderson	e6b343302f	KAFKA-1888: rolling upgrade test ewencp gwenshap This needs some refactoring to avoid the duplicated code between replication test and upgrade test, but in shape for initial feedback. I'm interested in feedback on the added `KafkaConfig` class and `kafka_props` file. This addition makes it: - easier to attach different configs to different nodes (e.g. during broker upgrade process) - easier to reason about the configuration of a particular node Notes: - in the default values in the KafkaConfig class, I removed many properties which were in kafka.properties before. This is because most of those properties were set to what is already the default value. - when running non-trunk VerifiableProducer, I append the trunk tools jar to the classpath, and run it with the non-trunk kafka-run-class.sh script Author: Geoff Anderson <geoff@confluent.io> Reviewers: Dong Lin, Ewen Cheslack-Postava Closes #229 from granders/KAFKA-1888-upgrade-test	9 years ago
Grant Henke	2e4aed7070	KAFKA-2516: Rename o.a.k.client.tools to o.a.k.tools Author: Grant Henke <granthenke@gmail.com> Reviewers: Gwen Shapira, Ewen Cheslack-Postava Closes #310 from granthenke/tools-packaging	9 years ago
Ewen Cheslack-Postava	14c128a162	MINOR: Capture stderr in ConsumerPerformanceService. Author: Ewen Cheslack-Postava <me@ewencp.org> Reviewers: Guozhang Wang Closes #331 from ewencp/minor-capture-consumer-performance-stderr	9 years ago
Dong Lin	123d27e4d0	KAFKA-2527; System Test for Quotas in Ducktape granders Can you take a look at this quota system test? Author: Dong Lin <lindong28@gmail.com> Reviewers: Geoff Anderson, Ewen Cheslack-Postava Closes #275 from lindong28/KAFKA-2527	9 years ago
Rajini Sivaram	dd514b2bb8	KAFKA-2581: Run some existing ducktape tests with SSL Parametrize console consumer sanity test, replication tests and benchmarks tests to run with both PLAINTEXT and SSL. Author: Rajini Sivaram <rajinisivaram@googlemail.com> Reviewers: Geoff Anderson, Ewen Cheslack-Postava, Guozhang Wang Closes #271 from rajinisivaram/KAFKA-2581	9 years ago
Geoff Anderson	b8b1bca440	KAFKA-2489: add benchmark for new consumer ewencp The changes here are smaller than they look - mostly refactoring/cleanup. - ConsumerPerformanceService: added new_consumer flag, and exposed more command-line settings - benchmark.py: refactored to use `parametrize` and `matrix` - this reduced some amount of repeated code - benchmark.py: added consumer performance tests with new consumer (using `parametrize`) - benchmark.py: added more detailed test descriptions - performance.py: broke into separate files Author: Geoff Anderson <geoff@confluent.io> Reviewers: Ewen Cheslack-Postava, Jason Gustafson, Gwen Shapira Closes #179 from granders/KAFKA-2489-benchmark-new-consumer	9 years ago

12 Commits (32bf83e5a792c5ee9eb88660da71b73aad5bbc02)