Mirror of Apache Kafka
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
Joe Stein 15bb3961d9 KAFKA-1133 LICENSE and NOTICE files need to get into META-INF when jars are built before they're signed for publishing to maven reviewed by Joel Koshy 11 years ago
bin KAFKA-1081 Remove re-run functionality from start script and use exec to launch commands to avoid spurious .sh process. 11 years ago
config kafka-1076; system tests in 0.8 are broken due to wrong log4j config; patched by Joel Koshy; reviewed by Jay Kreps and Jun Rao 11 years ago
contrib kafka-946; Kafka Hadoop Consumer fails when verifying message checksum; patched by Sam Meder; reviewed by Jun Rao 11 years ago
core KAFKA-1086 Improve GetOffsetShell to find metadata automatically; reviwed by Jun Rao and Joel Koshy 11 years ago
examples kafka-871; Rename ZkConfig properties; patched by Swapnil Ghike; reviewed by Jun Rao 12 years ago
lib Updated SBT JAR to 0.12.1 12 years ago
perf KAFKA-1046 Added support for Scala 2.10 builds while maintaining compatibility with 2.8.x; reviewed by Neha and Jun 11 years ago
project KAFKA-1133 LICENSE and NOTICE files need to get into META-INF when jars are built before they're signed for publishing to maven reviewed by Joel Koshy 11 years ago
system_test KAFKA-1089; Fix run-class and log4j for migration tool system test; 11 years ago
.gitignore Re-applied old patch from KAFKA-139 12 years ago
.rat-excludes KAFKA-151 Standard .rat-excludes file and rat script;patched by nehanarkhede; reviewed by junrao 13 years ago
.reviewboardrc KAFKA-1053 Kafka patch review tool that integrates JIRA and reviewboard; reviewed by Joel Koshy, Swapnil Ghike and Guozhang Wang 11 years ago
LICENSE KAFKA-533 changes to NOTICE and LICENSE related to KAFKA-534 removing client libraries from repo 12 years ago
NOTICE KAFKA-533 changes to NOTICE and LICENSE related to KAFKA-534 removing client libraries from repo 12 years ago
README.md kafka-954; tidy up README file for better general availability; patched by Jun Rao; reviewed by Joe Stein and Neha Narkhede 11 years ago
kafka-patch-review.py KAFKA-1094 Configure reviewboard url in kafka-patch-review tool; reviewed by Neha Narkhede 11 years ago
sbt kafka-843; Re-add the release-zip sbt target; patched by Cosmin Lehene; reviewed by Jun Rao 12 years ago
sbt.bat provides windows batch script for starting Kafka/Zookeeper; patched by Antoine Vianey; reviewed by Jun Rao; kafka-581 12 years ago

README.md

Apache Kafka

See our web site for details on the project.

Building it

  1. ./sbt update
  2. ./sbt package
  3. ./sbt assembly-package-dependency

To build for a particular version of Scala (either 2.8.0, 2.8.2, 2.9.1, 2.9.2 or 2.10.1), change step 2 above to: 2. ./sbt "++2.8.0 package"

To build for all supported versions of Scala, change step 2 above to: 2. ./sbt +package

Running it

Follow instuctions in http://kafka.apache.org/documentation.html#quickstart

Running unit tests

./sbt test

Building a binary release zip or gzipped tar ball

./sbt release-zip ./sbt release-tar The release file can be found inside ./target/RELEASE/.

Other Build Tips

Here are some useful sbt commands, to be executed at the sbt command prompt (./sbt). Prefixing with "++ " runs the command for a specific Scala version, prefixing with "+" will perform the action for all versions of Scala, and no prefix runs the command for the default (2.8.0) version of Scala. -

tasks : Lists all the sbt commands and their descriptions clean : Deletes all generated files (the target directory). compile : Compile all the sub projects, but not create the jars test : Run all unit tests in all sub projects release-zip : Create all the jars, run unit tests and create a deployable release zip release-tar : Create all the jars, run unit tests and create a deployable release gzipped tar tall package: Creates jars for src, test, docs etc projects : List all the sub projects project sub_project_name : Switch to a particular sub-project. For example, to switch to the core kafka code, use "project core-kafka"

The following commands can be run only on a particular sub project - test-only package.test.TestName : Runs only the specified test in the current sub project run : Provides options to run any of the classes that have a main method. For example, you can switch to project java-examples, and run the examples there by executing "project java-examples" followed by "run"

For more details please see the SBT documentation

Contribution

Kafka is a new project, and we are interested in building the community; we would welcome any thoughts or patches. You can reach us on the Apache mailing lists.

To contribute follow the instructions here:

We also welcome patches for the website and documentation which can be found here: