1. 程式人生 > >HDFS叢集遇到的問題

HDFS叢集遇到的問題

1.namenode格式化失敗

18/11/16 15:05:05 WARN namenode.NameNode: Encountered exception during format: 
org.apache.hadoop.hdfs.qjournal.client.QuorumException: Unable to check if JNs are ready for formatting. 2 successful responses:
192.168.100.132:8485: false
192.168.100.133:8485: false
1 exceptions thrown:
192.168.100.131:8485: Call From hadoop01/192.168.100.128 to hadoop02:8485 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
	at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81)
	at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223)
	at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.hasSomeData(QuorumJournalManager.java:232)
	at org.apache.hadoop.hdfs.server.common.Storage.confirmFormat(Storage.java:899)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.confirmFormat(FSImage.java:171)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:941)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1387)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1512)
18/11/16 15:05:05 FATAL namenode.NameNode: Failed to start namenode.

沒有格式化journalnode
hadoop-daemon.sh start journalnode

2.zookeeper啟動失敗

問題描述:使用zkServer.sh start命令啟動zookeeper後,檢視zookeeper狀態,發現並沒有啟動成功。

ZooKeeper JMX enabled by default
Using config: /opt/software/zookeeper-3.4.10/bin/../conf/zoo.cfg
Error contacting service. It is probably not running.

很大程度上是上一次kill掉zookeeper後,埠依舊被佔用。
檢視埠狀態:netstat -ntpl
kill掉佔用2181埠的程序。