diff --git a/docs/implementation.html b/docs/implementation.html index 16ba07a456c..91e17a68a71 100644 --- a/docs/implementation.html +++ b/docs/implementation.html @@ -337,7 +337,7 @@ Each of the consumers in the group registers under its group and creates a znode Consumers track the maximum offset they have consumed in each partition. This value is stored in a ZooKeeper directory if offsets.storage=zookeeper.

-/consumers/[group_id]/offsets/[topic]/[partition_id] --> offset_counter_value ((persistent node)
+/consumers/[group_id]/offsets/[topic]/[partition_id] --> offset_counter_value (persistent node)
 

Partition Owner registry

@@ -350,6 +350,15 @@ Each broker partition is consumed by a single consumer within a given consumer g /consumers/[group_id]/owners/[topic]/[partition_id] --> consumer_node_id (ephemeral node) +

Cluster Id

+ +

+ The cluster id is a unique and immutable identifier assigned to a Kafka cluster. The cluster id can have a maximum of 22 characters and the allowed characters are defined by the regular expression [a-zA-Z0-9_\-]+, which corresponds to the characters used by the URL-safe Base64 variant with no padding. Conceptually, it is auto-generated when a cluster is started for the first time. +

+

+ Implementation-wise, it is generated when a broker with version 0.10.1 or later is successfully started for the first time. The broker tries to get the cluster id from the /cluster/id znode during startup. If the znode does not exist, the broker generates a new cluster id and creates the znode with this cluster id. +

+

Broker node registration

diff --git a/docs/upgrade.html b/docs/upgrade.html index 629babb4e36..21740183216 100644 --- a/docs/upgrade.html +++ b/docs/upgrade.html @@ -52,17 +52,24 @@ Note: Because new protocols are introduced, it is important to upgrade your Kafk

  • The open file handlers of 0.10.0 will increase by ~33% because of the addition of time index files for each segment.
  • The time index and offset index share the same index size configuration. Since each time index entry is 1.5x the size of offset index entry. User may need to increase log.index.size.max.bytes to avoid potential frequent log rolling.
  • Due to the increased number of index files, on some brokers with large amount the log segments (e.g. >15K), the log loading process during the broker startup could be longer. Based on our experiment, setting the num.recovery.threads.per.data.dir to one may reduce the log loading time.
  • -
  • ListOffsetRequest v1 is introduced and used by default to support accurate offset search based on timestamp. +
    Notable changes in 0.10.1.0
    +
    New Protocol Versions
    + +

    Upgrading from 0.8.x or 0.9.x to 0.10.0.0

    0.10.0.0 has potential breaking changes (please review before upgrading) and possible performance impact following the upgrade. By following the recommended rolling upgrade plan below, you guarantee no downtime and no performance impact during and following the upgrade.