850      微軟  Office

臨時記錄Hadoop 2.x HA cluster

1.每個節點啟動zookeeper 服務

zkServer.sh start

2.每個節點先啟動journal node

hadoop-daemon.sh start journalnode

3.在某一台NameNode節點,例如nn1上格式化文件係統，並啟動nn1的namenode

#格式化hdfs
 hdfs namenode -format 
#啟動當前節點NameNode
 hadoop-daemon.sh start namenode

4.在另一台NameNode nn2上同步nn1的數據,並啟動nn2

#從另一台NameNode節點同步數據
 hdfs namenode -bootstrapStandby
#啟動當前節點NameNode
 hadoop-daemon.sh start namenode
#每個節點啟動DataNode
hadoop-daemon.sh start datanodes

5.在zookeeper中初始化namenode的信息

hdfs zkfc -formatZK

6.停止所有hdfs

stop-dfs.sh

7.啟動hdfs文件係統

start-dfs.sh

8.正常的話會啟動nn，dn，jn，zkController

[beifeng@hadoop-master ~]$ start-dfs.sh
Starting namenodes on [hadoop-master hadoop-slave1]
hadoop-slave1: starting namenode, logging to /opt/app/hadoop-2.5.0/logs/hadoop-beifeng-namenode-hadoop-slave1.out
hadoop-master: starting namenode, logging to /opt/app/hadoop-2.5.0/logs/hadoop-beifeng-namenode-hadoop-master.out
hadoop-slave2: starting datanode, logging to /opt/app/hadoop-2.5.0/logs/hadoop-beifeng-datanode-hadoop-slave2.out
hadoop-slave1: starting datanode, logging to /opt/app/hadoop-2.5.0/logs/hadoop-beifeng-datanode-hadoop-slave1.out
hadoop-master: starting datanode, logging to /opt/app/hadoop-2.5.0/logs/hadoop-beifeng-datanode-hadoop-master.out
Starting journal nodes [hadoop-master hadoop-slave1 hadoop-slave2]
hadoop-master: starting journalnode, logging to /opt/app/hadoop-2.5.0/logs/hadoop-beifeng-journalnode-hadoop-master.out
hadoop-slave1: starting journalnode, logging to /opt/app/hadoop-2.5.0/logs/hadoop-beifeng-journalnode-hadoop-slave1.out
hadoop-slave2: starting journalnode, logging to /opt/app/hadoop-2.5.0/logs/hadoop-beifeng-journalnode-hadoop-slave2.out
Starting ZK Failover Controllers on NN hosts [hadoop-master hadoop-slave1]
hadoop-slave1: starting zkfc, logging to /opt/app/hadoop-2.5.0/logs/hadoop-beifeng-zkfc-hadoop-slave1.out
hadoop-master: starting zkfc, logging to /opt/app/hadoop-2.5.0/logs/hadoop-beifeng-zkfc-hadoop-master.out

9.啟動yarn

start-yarn.sh

10.啟動曆史人物日誌功能

mr-jobhistory-daemon.sh start historyserver

最後更新：2017-08-13 22:36:41

  上一篇：  新工具——TensorLayer：管理深度學習發展的複雜性

  下一篇：  ZooKeeper 集群的搭建