src-kafka

Commit Graph

Author	SHA1	Message	Date
Geoff Anderson	c188a68e2b	MINOR: Add vagrant up wrapper for simple parallel bringup on aws The main impediment to bringing up aws machines in parallel using vagrant was the interaction between `vagrant-hostmanager` and `vagrant-aws`. If you disable hostmanager during the `up` phase, and run it after the cluster is up, parallel bringup is possible. The only caveat is that machines must be brought up in small-ish batches to prevent rate limit errors from AWS since `vagrant-aws` doesn't seem to have mechanisms to This PR: - disables `vagrant-hostmanager` during bringup - adds a wrapper script to make it convenient to bring machines up in batches on aws Author: Geoff Anderson <geoff@confluent.io> Reviewers: Ewen Cheslack-Postava <ewen@confluent.io> Closes #982 from granders/vagrant-disable-hostmanager	9 years ago
Eno Thereska	04ef9c3547	MINOR: Increased default EC2 instance size AWS instance size increased to m3.xlarge to allow all system tests to pass. ijuma ewencp have a look please. Author: Eno Thereska <eno.thereska@gmail.com> Reviewers: Gwen Shapira Closes #1046 from enothereska/minor-aws	9 years ago
Ewen Cheslack-Postava	8ee9846e01	MINOR: Fix typo in sample Vagrantfile.local for AWS system tests Author: Ewen Cheslack-Postava <me@ewencp.org> Reviewers: Gwen Shapira Closes #565 from ewencp/fix-aws-vagrantfile-local-example	9 years ago
Geoff Anderson	e43c9aff92	KAFKA-2276; KIP-25 initial patch Initial patch for KIP-25 Note that to install ducktape, do not use pip to install ducktape. Instead: ``` $ git clone gitgithub.com:confluentinc/ducktape.git $ cd ducktape $ python setup.py install ``` Author: Geoff Anderson <geoff@confluent.io> Author: Geoff <granders@gmail.com> Author: Liquan Pei <liquanpei@gmail.com> Reviewers: Ewen, Gwen, Jun, Guozhang Closes #70 from granders/KAFKA-2276 and squashes the following commits: `a62fb6c` [Geoff Anderson] fixed checkstyle errors `a70f0f8` [Geoff Anderson] Merged in upstream trunk. `8b62019` [Geoff Anderson] Merged in upstream trunk. `47b7b64` [Geoff Anderson] Created separate tools jar so that the clients package does not pull in dependencies on the Jackson JSON tools or argparse4j. `a9e6a14` [Geoff Anderson] Merged in upstream changes `d18db7b` [Geoff Anderson] fixed :rat errors (needed to add licenses) `321fdf8` [Geoff Anderson] Ignore tests/ and vagrant/ directories when running rat build task `795fc75` [Geoff Anderson] Merged in changes from upstream trunk. `1d93f06` [Geoff Anderson] Updated provisioning to use java 7 in light of KAFKA-2316 `2ea4e29` [Geoff Anderson] Tweaked README, changed default log collection behavior on VerifiableProducer `0eb6fdc` [Geoff Anderson] Merged in system-tests `69dd7be` [Geoff Anderson] Merged in trunk `4034dd6` [Geoff Anderson] Merged in upstream trunk `ede6450` [Geoff] Merge pull request #4 from confluentinc/move_muckrake `7751545` [Geoff Anderson] Corrected license headers `e6d532f` [Geoff Anderson] java 7 -> java 6 `8c61e2d` [Geoff Anderson] Reverted jdk back to 6 `f14c507` [Geoff Anderson] Removed mode = "test" from Vagrantfile and Vagrantfile.local examples. Updated testing README to clarify aws setup. `98b7253` [Geoff Anderson] Updated consumer tests to pre-populate kafka logs `e6a41f1` [Geoff Anderson] removed stray println `b15b24f` [Geoff Anderson] leftover KafkaBenchmark in super call `0f75187` [Geoff Anderson] Rmoved stray allow_fail. kafka_benchmark_test -> benchmark_test `f469f84` [Geoff Anderson] Tweaked readme, added example Vagrantfile.local `3d73857` [Geoff Anderson] Merged downstream changes `42dcdb1` [Geoff Anderson] Tweaked behavior of stop_node, clean_node to generally fail fast `7f7c3e0` [Geoff Anderson] Updated setup.py for kafkatest `c60125c` [Geoff Anderson] TestEndToEndLatency -> EndToEndLatency `4f476fe` [Geoff Anderson] Moved aws scripts to vagrant directory `5af88fc` [Geoff Anderson] Updated README to include aws quickstart `e5edf03` [Geoff Anderson] Updated example aws Vagrantfile.local `96533c3` [Geoff] Update aws-access-keys-commands `25a413d` [Geoff] Update aws-example-Vagrantfile.local `884b20e` [Geoff Anderson] Moved a bunch of files to kafkatest directory `fc7c81c` [Geoff Anderson] added setup.py `632be12` [Geoff] Merge pull request #3 from confluentinc/verbose-client `51a94fd` [Geoff Anderson] Use argparse4j instead of joptsimple. ThroughputThrottler now has more intuitive behavior when targetThroughput is 0. `a80a428` [Geoff Anderson] Added shell program for VerifiableProducer. `d586fb0` [Geoff Anderson] Updated comments to reflect that throttler is not message-specific `6842ed1` [Geoff Anderson] left out a file from last commit `1228eef` [Geoff Anderson] Renamed throttler `9100417` [Geoff Anderson] Updated command-line options for VerifiableProducer. Extracted throughput logic to make it reusable. `0a5de8e` [Geoff Anderson] Fixed checkstyle errors. Changed name to VerifiableProducer. Added synchronization for thread safety on println statements. `475423b` [Geoff Anderson] Convert class to string before adding to json object. `bc009f2` [Geoff Anderson] Got rid of VerboseProducer in core (moved to clients) `c0526fe` [Geoff Anderson] Updates per review comments. `8b4b1f2` [Geoff Anderson] Minor updates to VerboseProducer `2777712` [Geoff Anderson] Added some metadata to producer output. `da94b8c` [Geoff Anderson] Added number of messages option. `07cd1c6` [Geoff Anderson] Added simple producer which prints status of produced messages to stdout. `a278988` [Geoff Anderson] fixed typos `f1914c3` [Liquan Pei] Merge pull request #2 from confluentinc/system_tests `81e4156` [Liquan Pei] Bootstrap Kafka system tests	9 years ago
Sriharsha Chintalapani	1363ed7c52	KAFKA-1438 Migrate client tools out of perf; reviewed by Neha Narkhede	11 years ago
Nathan Brown	edbed2823f	kafka-1278; More flexible helper scripts; patched by Nathan Brown; reviewed by Jun Rao	11 years ago
Jay Kreps	3e7c9c6abf	KAFKA-1081 Clean up shell scripts. Removed re-run of failed command. Use exec instead of subprocess execution.	11 years ago
Jay Kreps	14af713252	Misc. minor house-keeping fixes: add reasonable GC settings, fix up README, fix up example configs, fix the logging for tools, use a log directory for logs instead of the root directory.	11 years ago
Neha Narkhede	fa09aacdbd	KAFKA-141 Check and make sure that the files that have been donated have been updated to reflect the new ASF copyright;patched by nehanarkhede; reviewd by jjkoshy git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1180185 13f79535-47bb-0310-9956-ffa450edef68	13 years ago
Neha Narkhede	f34dfc002d	Reverting accidental commit 1180110, which is pending review for KAFKA-141 git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1180117 13f79535-47bb-0310-9956-ffa450edef68	13 years ago
Neha Narkhede	a99becbe49	Minor patch, removing the .gitigore file git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1180110 13f79535-47bb-0310-9956-ffa450edef68	13 years ago
Edward Jay Kreps	642da2f28c	Initial checkin of Kafka to Apache SVN. This corresponds to `709afe4ec7` except that git specific files have been removed and code has been put into trunk/branches/site/etc. This is just a copy of master, branches and history are not being converted since we can't find a good tool for it. git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1152970 13f79535-47bb-0310-9956-ffa450edef68	13 years ago

4 Commits (2ff955044aa875176aaa58a9be4a79c494a3fb27)