1. 程式人生 > >4、NameNode啟動過程詳解

4、NameNode啟動過程詳解

NameNode

  • 記憶體
  • 本地磁碟
    • fsimage
    • edits

第一次啟動HDFS
  1. 格式化HDFS,目的就是生成fsimage
  2. start NameNode,讀取fsimage檔案
  3. start DataNode,向NameNode註冊;block report(塊彙報)
  4. create dir /user/hw/tmp -> write [edits]
  5. put files /user/beifeg/tmp(*-site.xml) -> write [edits]
  6. delete file /user/beifeng/tmp/core-site.xml -> write [edits]

第二次啟動HDFS
  1. NameNode
    • read [fsimage]
    • read [edits]
    • gen write fsimage [new]
    • gen edits [null]
  2. DataNode
    • 註冊
    • block report
  3. create dir /user/beifeng/tmp -> write [edits]
  4. put files /user/beifeg/tmp(*-site.xml) -> write [edits]
  5. delete file /user/beifeng/tmp/core-site.xml -> write [edits]

SecondaryNameNode輔助功能講解

  • NameNode中的編輯日誌檔案太大的話如何處理。需要藉助SecondaryNameNode.
  • 定期的合併 fsimage+edits ->new fsimage