一、 Kafka常用操作命令

 檢視當前伺服器中的所有topic

[root@hadoop3 kafka]# bin/kafka-topics.sh --list --zookeeper hadoop11:2181
[root@hadoop3 kafka]#

資訊寫入到
 建立topic

[[email protected] kafka]# bin/kafka-topics.sh --create --zookeeper hadoop11:2181 --replication-factor 1 -partitions 1 --topic test
Created topic
 
 "test".
[[email protected] kafka]# bin/kafka-topics.sh --list --zookeeper hadoop11:2181
test

通過上面，可以看到已經建立了一個test的topic

 刪除topic

[root@hadoop2 kafka]# bin/kafka-topics.sh --create --zookeeper hadoop11:2181 --replication-factor 1 -partitions 1 --topic test2
Created topic "test2".
[root@hadoop2
 
 kafka]# bin/kafka-topics.sh --list --zookeeper hadoop11:2181
itheima
test
test2
[root@hadoop2 kafka]# bin/kafka-topics.sh --delete --zookeeper hadoop11:2181 --topic test2
Topic test2 is marked for deletion.
Note: This will have no impact if delete.topic.enable is not set to true.
[root@hadoop2 kafka]# bin/kafka-topics.sh --list --zookeeper hadoop11:2181
 

itheima
test
[root@hadoop2 kafka]#

需要server.properties中設定delete.topic.enable=true否則只是標記刪除或者直接重啟。
 通過shell命令傳送訊息
要注意的是要指定topic，表示要在哪個topic中生產訊息，這裡的topic需要時上面建立的topic

[[email protected] kafka]# bin/kafka-console-producer.sh --broker-list hadoop1:9092 --topic test
asdfasdfasd
asdfasdf
asdfasdf
toto test
tuto test2

注意命令中指定的–block-list hadoop1:9092,當改成hadoop2:9092時，也可以。

 通過shell消費訊息
要指明的是要使用哪個topic中的資料，這裡的topic需要時上面建立的topic：

[[email protected] kafka]# sh bin/kafka-console-consumer.sh --zookeeper hadoop11:2181 --from-beginning --topic test
asdfasdfasd
asdfasdf
asdfasdf
toto test
tuto test2

注意：這裡要指定消費那個topic，這裡使用的是test.

 檢視消費位置

[[email protected] kafka]# sh bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --zookeeper hadoop11:2181 --group testGroup

 檢視某個Topic的詳情

[root@hadoop3 kafka]# sh bin/kafka-topics.sh --topic test --describe --zookeeper hadoop11:2181
Topic:test  PartitionCount:1    ReplicationFactor:1 Configs:
    Topic: test Partition: 0    Leader: 0   Replicas: 0 Isr: 0
[root@hadoop3 kafka]#

 對分割槽數進行修改

[[email protected] kafka]# bin/kafka-topics.sh --zookeeper hadoop11:2181 -alter --partitions 15 --topic test
WARNING: If partitions are increased for a topic that has a key, the partition logic or ordering of the messages will be affected
Adding partitions succeeded!
[[email protected] kafka]#