2、kafka伪分布多broker部署

谁践踏了优雅 2022-08-01 06:15 231阅读 0赞

\[root@baozi kafka\_2.10-0.8.2.1\]\# ll config

总用量 32  
\-rw-r--r--. 1 root root 1199 2月  27 06:02 consumer.properties  
\-rw-r--r--. 1 root root 3846 2月  27 06:03 log4j.properties  
\-rw-r--r--. 1 root root 2228 2月  27 06:02 producer.properties  
\-rw-r--r--. 1 root root 5566 6月  20 20:35 server.properties  
\-rw-r--r--. 1 root root 3325 2月  27 06:02 test-log4j.properties  
\-rw-r--r--. 1 root root  993 2月  27 06:02 tools-log4j.properties  
\-rw-r--r--. 1 root root 1023 2月  27 06:02 zookeeper.properties  
  
  
1、复制一份server.properties为server1.properties  
\[root@baozi kafka\_2.10-0.8.2.1\]\# cp config/server.properties config/server1.properties  
  
  
2、修改配置文件server1.properties：  
broker.id=1  
port=9040  
log.dirs=/mykafka1/kafka-logs  
  
3、启动多个broker：  
\[root@baozi kafka\_2.10-0.8.2.1\]\# bin/kafka-server-start.sh config/server.properties >/dev/null 2>&1 &  
  
\[root@baozi ~\]\# jps  
2134 Kafka  
2939 Jps  
2028 QuorumPeerMain  
\[root@baozi ~\]\#  
  
\[root@baozi kafka\_2.10-0.8.2.1\]\# bin/kafka-server-start.sh config/server1.properties >/dev/null 2>&1 &  
  
  
会有两个kafka进程：  
\[root@baozi kafka\_2.10-0.8.2.1\]\# jps  
2134 Kafka  
3014 Jps  
2028 QuorumPeerMain  
2961 Kafka  
\[root@baozi kafka\_2.10-0.8.2.1\]\#  
  
  
4、创建主题：  
\[root@baozi kafka\_2.10-0.8.2.1\]\# bin/kafka-topics.sh --create --zookeeper 192.168.1.200:2181 --replication-factor 1 --partitions 3 --topic test  
\[2015-06-20 21:28:20,773\] INFO Accepted socket connection from /192.168.1.200:48550 (org.apache.zookeeper.server.NIOServerCnxnFactory)  
\[2015-06-20 21:28:20,782\] INFO Client attempting to establish new session at /192.168.1.200:48550 (org.apache.zookeeper.server.ZooKeeperServer)  
\[2015-06-20 21:28:20,784\] INFO Established session 0x14e10fd34b30015 with negotiated timeout 30000 for client /192.168.1.200:48550 (org.apache.zookeeper.server.ZooKeeperServer)  
\[2015-06-20 21:28:21,173\] INFO Got user-level KeeperException when processing sessionid:0x14e10fd34b30015 type:setData cxid:0x3 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/config/topics/test Error:KeeperErrorCode = NoNode for /config/topics/test (org.apache.zookeeper.server.PrepRequestProcessor)  
\[2015-06-20 21:28:21,205\] INFO Got user-level KeeperException when processing sessionid:0x14e10fd34b30015 type:create cxid:0x4 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/config/topics Error:KeeperErrorCode = NodeExists for /config/topics (org.apache.zookeeper.server.PrepRequestProcessor)  
Created topic "test".  
\[2015-06-20 21:28:21,308\] INFO Processed session termination for sessionid: 0x14e10fd34b30015 (org.apache.zookeeper.server.PrepRequestProcessor)  
\[2015-06-20 21:28:21,315\] INFO Closed socket connection for client /192.168.1.200:48550 which had sessionid 0x14e10fd34b30015 (org.apache.zookeeper.server.NIOServerCnxn)  
\[2015-06-20 21:28:21,432\] INFO Got user-level KeeperException when processing sessionid:0x14e10fd34b30000 type:create cxid:0x71 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/brokers/topics/test/partitions/1 Error:KeeperErrorCode = NoNode for /brokers/topics/test/partitions/1 (org.apache.zookeeper.server.PrepRequestProcessor)  
\[2015-06-20 21:28:21,436\] INFO Got user-level KeeperException when processing sessionid:0x14e10fd34b30000 type:create cxid:0x72 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/brokers/topics/test/partitions Error:KeeperErrorCode = NoNode for /brokers/topics/test/partitions (org.apache.zookeeper.server.PrepRequestProcessor)  
\[2015-06-20 21:28:21,459\] INFO Got user-level KeeperException when processing sessionid:0x14e10fd34b30000 type:create cxid:0x76 zxid:0x87 txntype:-1 reqpath:n/a Error Path:/brokers/topics/test/partitions/2 Error:KeeperErrorCode = NoNode for /brokers/topics/test/partitions/2 (org.apache.zookeeper.server.PrepRequestProcessor)  
\[2015-06-20 21:28:21,470\] INFO Got user-level KeeperException when processing sessionid:0x14e10fd34b30000 type:create cxid:0x79 zxid:0x8a txntype:-1 reqpath:n/a Error Path:/brokers/topics/test/partitions/0 Error:KeeperErrorCode = NoNode for /brokers/topics/test/partitions/0 (org.apache.zookeeper.server.PrepRequestProcessor)  
\[root@baozi kafka\_2.10-0.8.2.1\]\#  
  
  
查看所有主题：  
\[root@baozi kafka\_2.10-0.8.2.1\]\# bin/kafka-topics.sh --list --zookeeper 192.168.1.200:2181  
\[2015-06-20 21:29:09,118\] INFO Accepted socket connection from /192.168.1.200:48552 (org.apache.zookeeper.server.NIOServerCnxnFactory)  
\[2015-06-20 21:29:09,126\] INFO Client attempting to establish new session at /192.168.1.200:48552 (org.apache.zookeeper.server.ZooKeeperServer)  
\[2015-06-20 21:29:09,128\] INFO Established session 0x14e10fd34b30016 with negotiated timeout 30000 for client /192.168.1.200:48552 (org.apache.zookeeper.server.ZooKeeperServer)  
test  
test1 - marked for deletion  
test2  
\[2015-06-20 21:29:09,334\] INFO Processed session termination for sessionid: 0x14e10fd34b30016 (org.apache.zookeeper.server.PrepRequestProcessor)  
\[2015-06-20 21:29:09,337\] INFO Closed socket connection for client /192.168.1.200:48552 which had sessionid 0x14e10fd34b30016 (org.apache.zookeeper.server.NIOServerCnxn)  
\[root@baozi kafka\_2.10-0.8.2.1\]\#