Hadoop从入门到进阶 HDFS高可用集群 && Yarn高可用集群搭建（四）

灰太狼 2023-06-12 06:29 61阅读 0赞

# 1 Hadoop 高可用概述 #

1）Active NameNode 和 Standby NameNode：两台 NameNode 形成互备，一台处于 Active 状态，为主 NameNode，另外一台处于 Standby 状态，为备 NameNode，只有主 NameNode 才能对外提供读写服务。  
2）主备切换控制器 ZKFailoverController：ZKFailoverController 作为独立的进程运行，对 NameNode 的主备切换进行总体控制。ZKFailoverController 能及时检测到 NameNode 的健康状况，在主 NameNode 故障时借助 Zookeeper 实现自动的主备选举和切换，当然 NameNode 目前也支持不依赖于 Zookeeper 的手动主备切换。  
3）Zookeeper 集群：为主备切换控制器提供主备选举支持。  
4）JounalNode：用于Active NameNode，Standby NameNode同步数据，本身由一组JounnalNode结点组成，该组结点基数个，支持Paxos协议，保证高可用，是CDH5唯一支持的共享方式（相对于CDH4 促在NFS共享方式）  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70]

## 2 高可用搭建 ##

### 2.1 环境准备 ###

#node1,node2免登陆其余节点
    node1  jdk hadoop zookeeper  NameNode  zkfc  ResourceManager  
    node2  jdk hadoop            NameNode  zkfc  ResourceManager  
    node3  jdk hadoop            DataNode  NodeManager  JournalNode
    node4  jdk hadoop            DataNode  NodeManager  JournalNode
    node5  jdk hadoop            DataNode  NodeManager  JournalNode

## 2.2 安装单机节点zookeeper（比较easy安装步骤略） ##

![在这里插入图片描述][2019110101155110.png]

## 2.3 修改core-site.xml ##

cd /usr/local/hadoop-2.8.5/etc/hadoop
    vim core-site.xml
    <configuration>
             
             <property>
                <name>fs.defaultFS</name>
                <value>hdfs://nameservice/</value>
             </property>
            
            <property>
                 <name>ha.zookeeper.quorum</name>
                 <value>node1:2181</value>
            </property>
    </configuration>

## 2.4 修改hdfs-site.xml ##

vim hdfs-site.xml
    
    <configuration>
    
    <property>
            <name>dfs.nameservices</name>
            <value>nameservice</value>
    </property>
    
    <property>
            <name>dfs.ha.namenodes.nameservice</name>
            <value>nn1,nn2</value>
    </property>
    
    <property>
            <name>dfs.namenode.rpc-address.nameservice.nn1</name>
            <value>node1:9000</value>
    </property>
    
    <property>
            <name>dfs.namenode.http-address.nameservice.nn1</name>
            <value>node1:50070</value>
    </property>
    
    <property>
            <name>dfs.namenode.rpc-address.nameservice.nn2</name>
            <value>node2:9000</value>
    </property>
    
    <property>
            <name>dfs.namenode.http-address.nameservice.nn2</name>
            <value>node2:50070</value>
    </property>
    
    <property>
            <name>dfs.namenode.name.dir</name>
            <value>/usr/local/data/namenode</value>
    </property>
    <property>
            <name>dfs.datanode.data.dir</name>
            <value>/usr/local/data/datanode</value>
    </property>
    
    <property>
            <name>dfs.namenode.shared.edits.dir</name>
            <value>qjournal://node3:8485;node4:8485;node5:8485/nameservice</value>
    </property>
    
    <property>
            <name>dfs.journalnode.edits.dir</name>
            <value>/usr/local/data/journaldata</value>
    </property>
    
    <property>
            <name>dfs.ha.automatic-failover.enabled</name>
            <value>true</value>
    </property>
    
    <property>
            <name>dfs.client.failover.proxy.provider.nameservice</name>
            <value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
    </property>
    
    <property>
            <name>dfs.ha.fencing.methods</name>
            <value>
            sshfence
            shell(/bin/true)
            </value>
    </property>
    
    <property>
            <name>dfs.ha.fencing.ssh.private-key-files</name>
            <value>/root/.ssh/id_rsa</value>
    </property>
    
    <property>
            <name>dfs.ha.fencing.ssh.connect-timeout</name>
            <value>30000</value>
    </property>
    
    </configuration>

## 2.5 修改mapred-site.xml ##

vim mapred-site.xml
    <configuration>
            
            <property>
              <name>mapreduce.framework.name</name>
              <value>yarn</value>
           </property>
    </configuration>

## 2.6 修改yarn-site.xml ##

vim yarn-site.xml
    <configuration>
    
    <property>
            <name>yarn.resourcemanager.ha.enabled</name>
            <value>true</value>
    </property>
    
    <property>
            <name>yarn.resourcemanager.cluster-id</name>
            <value>yrc</value>
    </property>
    
    <property>
            <name>yarn.resourcemanager.ha.rm-ids</name>
            <value>rm1,rm2</value>
    </property>
    
    <property>
            <name>yarn.resourcemanager.hostname.rm1</name>
            <value>node1</value>
    </property>
    <property>
            <name>yarn.resourcemanager.hostname.rm2</name>
            <value>node2</value>
    </property>
    
    <property>
            <name>yarn.resourcemanager.zk-address</name>
            <value>node1:2181</value>
    </property>
    <property>
            <name>yarn.nodemanager.aux-services</name>
            <value>mapreduce_shuffle</value>
    </property>
    </configuration>

## 2.7 修改slaves ##

#node1
    vim slaves
    
    node3
    node4
    node5

## 2.8 把当前节点配置文件复制到其它节点上 ##

#node1把配置文件复制到其它节点上
    cd /usr/local/hadoop-2.8.5/etc
    scp -r  ./hadoop node2:/usr/local/hadoop-2.8.5/etc
    scp -r  ./hadoop node3:/usr/local/hadoop-2.8.5/etc
    scp -r  ./hadoop node4:/usr/local/hadoop-2.8.5/etc
    scp -r  ./hadoop node5:/usr/local/hadoop-2.8.5/etc

## 2.9 启动 ##

1）启动zk  
![在这里插入图片描述][20191101011815130.png]  
2）启动journalnode

#必须先启动journalnode，node3 node4 node5。
    cd /usr/local/hadoop-2.8.5/sbin
    ./hadoop-daemon.sh start journalnode
    #查看
    jps

![在这里插入图片描述][2019110101183432.png]  
3）格式化namenode

#node1
    cd /usr/local/hadoop-2.8.5/bin
    ./hadoop namenode -format
    #为了保持node2和node1数据一致那么把namenode1的格式化数据复制过去
    cd /usr/local/data
    scp -r  namenode/ node2:/usr/local/data/

4）格式化zkfc

#node1
    cd /usr/local/hadoop-2.8.5/bin
    #格式化
    ./hdfs zkfc -formatZK

![在这里插入图片描述][20191101011901595.png]  
![在这里插入图片描述][20191101011907820.png]  
5）启动hdfs集群5）启动hdfs集群

#进入目录
    cd  /usr/local/hadoop-2.8.5/sbin
    #开启hdfs集群
    ./start-dfs.sh

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 1]  
6）查看web界面

http://192.168.0.38:50070
    http://192.168.0.39:50070

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 2]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 3]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 4]  
7）启动yarn

#node1
    cd  /usr/local/hadoop-2.8.5/sbin
    ./start-yarn.sh
    #node2
    cd  /usr/local/hadoop-2.8.5/sbin
    ./yarn-daemon.sh start resourcemanager

![在这里插入图片描述][2019110101200344.png]  
8）关闭acitve机器  
node2 jps 杀进程，node1变成了主节点  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 5]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 6]  
9）恢复node2

#恢复挂掉相关日志
    cd /usr/local/hadoop-2.8.5/bin
    ./hadoop namenode -recover
    cd /usr/local/hadoop-2.8.5/sbin
    ./hadoop-daemon.sh start namenode
    #访问URL
    http://192.168.0.38:50070/dfshealth.html#tab-overview

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 7]

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70]: /images/20230531/06b9b3e0a2844ed5ac57e44dabc58dfe.png
[2019110101155110.png]: /images/20230531/69c8bd9e414f43a28a612dcb8f29b9b3.png
[20191101011815130.png]: /images/20230531/046c2ba6b5db4b71b5594ec2d86380b9.png
[2019110101183432.png]: /images/20230531/9daddd73abbb4e5e8d0204c59f386d3a.png
[20191101011901595.png]: /images/20230531/76542817d1a2421e819246f53e2d9b39.png
[20191101011907820.png]: /images/20230531/374f7bc02a424b7a95760a6e7b6df876.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 1]: /images/20230531/cd9c6adf548c43fa90095e2a3311971c.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 2]: /images/20230531/6591709ae41b47faa4e10777e7812684.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 3]: /images/20230531/3621aaccb5904403b37d53f59faaf400.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 4]: /images/20230531/f47d85d1e7614d52bcbe381bd1325ab7.png
[2019110101200344.png]: /images/20230531/d060647695304e78ae24f7572dffce3f.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 5]: /images/20230531/4858c8c9c98e43c2a76cec92224a958a.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 6]: /images/20230531/1f9541cb7808464d91ce0a8977de5993.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM0MTI1OTk5_size_16_color_FFFFFF_t_70 7]: /images/20230531/18d0763cdc714bc199ba7d39b3e156e7.png