HDFS叢集遇到的問題
阿新 • • 發佈:2018-12-21
1.namenode格式化失敗
18/11/16 15:05:05 WARN namenode.NameNode: Encountered exception during format: org.apache.hadoop.hdfs.qjournal.client.QuorumException: Unable to check if JNs are ready for formatting. 2 successful responses: 192.168.100.132:8485: false 192.168.100.133:8485: false 1 exceptions thrown: 192.168.100.131:8485: Call From hadoop01/192.168.100.128 to hadoop02:8485 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.hasSomeData(QuorumJournalManager.java:232) at org.apache.hadoop.hdfs.server.common.Storage.confirmFormat(Storage.java:899) at org.apache.hadoop.hdfs.server.namenode.FSImage.confirmFormat(FSImage.java:171) at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:941) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1387) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1512) 18/11/16 15:05:05 FATAL namenode.NameNode: Failed to start namenode.
沒有格式化journalnode
hadoop-daemon.sh start journalnode
2.zookeeper啟動失敗
問題描述:使用zkServer.sh start命令啟動zookeeper後,檢視zookeeper狀態,發現並沒有啟動成功。
ZooKeeper JMX enabled by default
Using config: /opt/software/zookeeper-3.4.10/bin/../conf/zoo.cfg
Error contacting service. It is probably not running.
很大程度上是上一次kill掉zookeeper後,埠依舊被佔用。
檢視埠狀態:netstat -ntpl
kill掉佔用2181埠的程序。