在CDH集群中禁用HDFS的HA

清疚 2022-03-20 01:37 207阅读 0赞

本篇文章主要讲述如何使用Cloudera Manager禁用HDFS HA。关于如何开启HA，请参考：[https://blog.csdn.net/czz1141979570/article/details/86805598][https_blog.csdn.net_czz1141979570_article_details_86805598]

1.禁用HDFS HA

> 1.使用管理员用户登录Cloudera Manager的Web管理界面，进入HDFS服务
> 
> ![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70][]
> 
> 2.点击“禁用High Avaiability”，选择禁用HA后运行NameNode的主机及SecondNameNode主机
> 
> ![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 1][]
> 
> 3.点击“继续”，设置HDFS的检查点目录，默认继承SecondNameNode Default Group
> 
> ![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 2][]
> 
> 4.点击“继续”，禁用High Availability
> 
> ![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 3][]
> 
> 5.点击“完成” ，查看HDFS的实例
> 
> ![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 4][]
> 
> 通过实例列表可以看到HDFS HA相关的服务已被删除，只剩下NameNode和SecondNameNode服务，至此已完成HDFS HA禁用，接下来更新Hive Metastore NameNode及简单的功能测试。

2.更新Hive Metastore NameNode

> 1.停止Hive服务
> 
> ![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 5][]
> 
> 2.进入Hive服务，点击“操作”
> 
> ![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 6][]
> 
> 3.点击“更新Hive Metastore NameNode”
> 
> ![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 7][]
> 
> 4.更新Hive Metastore NameNode
> 
> ![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 8][]
> 
> 5.启动Hive服务
> 
> ![20190209140131397.png][]
> 
> 启动成功
> 
> ![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 9][]
> 
> Hive服务启动成功，至此就完成了Hive Metastore NameNode数据更新。

3.HDFS功能可用性测试

> 对HDFS进行mkdir、put、get、rmr等操作，验证HDFS服务功能是否可用。
> 
>     [root@ip-172-31-6-148 ~]# hadoop fs -mkdir /tmp/test
>     [root@ip-172-31-6-148 ~]# hadoop fs -put test.tar.gz /tmp/test
>     [root@ip-172-31-6-148 ~]# hadoop fs -ls /tmp/test
>     Found 1 items
>     -rw-r--r--   3 root supergroup 1180315150 2017-11-23 09:44 /tmp/test/test.tar.gz
>     [root@ip-172-31-6-148 ~]# rm -rf test.tar.gz 
>     [root@ip-172-31-6-148 ~]# hadoop fs -get /tmp/test/test.tar.gz 
>     [root@ip-172-31-6-148 ~]# ll test.tar.gz 
>     -rw-r--r-- 1 root root 1180315150 Nov 23 09:44 test.tar.gz

4.Hive测试

> 执行select操作
> 
> ![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 10][]

[https_blog.csdn.net_czz1141979570_article_details_86805598]: https://blog.csdn.net/czz1141979570/article/details/86805598
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70]: /images/20220320/aff9a88a265249cd8cfa7c673a6a9fe7.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 1]: /images/20220320/b66aa16ec29144fba0951940e74b5a70.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 2]: /images/20220320/57ec2b5cd5ce415d9c4722bcbdc547ea.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 3]: /images/20220320/e6bded958365456881195d956c8e1cea.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 4]: /images/20220320/5e0059997cf24003828130dd62cde9de.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 5]: /images/20220320/cf7245249fc143c1b18bbbfccdd5268f.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 6]: /images/20220320/6f8343b00f804f63a275183398782989.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 7]: /images/20220320/f1fb1f5d4b844d7d8d6937623e0c7a03.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 8]: /images/20220320/89d1c913b72646a8a360ad524b6f5e00.png
[20190209140131397.png]: /images/20220320/36c03f4480ac484697e95de2609ef0bd.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 9]: /images/20220320/22b699fdaaf348829e1d2b97cf3d3357.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2N6ejExNDE5Nzk1NzA_size_16_color_FFFFFF_t_70 10]: /images/20220320/e4c1b53d19b54ba8b61583437891bdfe.png