Hadoop 总章

绝地灬酷狼 2022-02-22 06:19 181阅读 0赞

### 前言 ###

`Hadoop`作为离线计算和分布式存储的基础, 至关重要. 虽然, 至如今, 分布式计算正在向`Spark`上进行迁移, 但是`Hadoop`中的分布式存储`HDFS`及`离线计算`仍然值得学习.

--------------------

### 相关章节 ###

##### 部署&安装 #####

[Hadoop 安装(单结点)][Hadoop]  
[Hadoop安装(YARN 集群)][Hadoop_YARN]

##### HDFS #####

[Hadoop Shell 命令 与 WordCount][Hadoop Shell _ _ WordCount]  
[Hadoop HDFS的Java API使用][Hadoop HDFS_Java API]  
[Hadoop HDFS 基本原理(文件上传 & 文件下载 & NameNode & Secondary NameNode)][Hadoop HDFS _ _ _ _ NameNode _ Secondary NameNode]

##### MR #####

[Hadoop MR 之(一) 编写自己的WordCount][Hadoop MR _ _WordCount]  
[Hadoop MR 之(二) 传递自定义数据类型 & 排序][Hadoop MR _ _ _]  
[Hadoop MR 之(三) Combiner类 / Partitioner 类 / GroupingComparator 类][Hadoop MR _ Combiner_ _ Partitioner _ _ GroupingComparator]  
[Hadoop MR 之(四) InputFormat 类 / OutputFormat类][Hadoop MR _ InputFormat _ _ OutputFormat]  
[Hadoop MR 之(五) 小文件的处理][Hadoop MR _]  
[Hadoop MR 之(六) Join操作 (MapJoin & ReduceJon & 缓存)][Hadoop MR _ Join_ _MapJoin _ ReduceJon _]  
[Hadoop MR 之(七) 其他基本操作][Hadoop MR _ 1]  
[Hadoop MR 基本运维参数][Hadoop MR]  
[Hadoop MR 核心原理][Hadoop MR 1]

--------------------

### 其他相关问题 ###

*  慢结点问题.  
    [Hadoop节点"慢磁盘"监控][Hadoop 1]  
    [大数据开发面试部分：Hadoop 如何应对某些节点运行较慢的问题][Hadoop 2]  
    [集群提交MapReduce作业执行卡住问题解决方案][MapReduce]
 *  `MapTask`与`ReduceTask`的指定问题.  
    [hadoop中map和reduce的数量设置问题][hadoop_map_reduce]
 *  多表`Join`问题(与`Hive`内较为类似)  
    [Hadoop 实现多个数据表的join操作][Hadoop _join]
 *  面试题  
    [ hadoop常见面试题 ][hadoop_]  
    [请查收：TOP 25大常见Hadoop面试题及答案][TOP 25_Hadoop]  
    [hadoop面试100道收集（带答案）][hadoop_100]  
    [98道常见Hadoop面试题及答案解析][98_Hadoop]

[Hadoop]: https://yanxml.blog.csdn.net/article/details/88788572
[Hadoop_YARN]: https://yanxml.blog.csdn.net/article/details/88810097
[Hadoop Shell _ _ WordCount]: https://yanxml.blog.csdn.net/article/details/88915893
[Hadoop HDFS_Java API]: https://yanxml.blog.csdn.net/article/details/88984618
[Hadoop HDFS _ _ _ _ NameNode _ Secondary NameNode]: https://yanxml.blog.csdn.net/article/details/89007145
[Hadoop MR _ _WordCount]: https://yanxml.blog.csdn.net/article/details/89050203
[Hadoop MR _ _ _]: https://yanxml.blog.csdn.net/article/details/89050417
[Hadoop MR _ Combiner_ _ Partitioner _ _ GroupingComparator]: https://yanxml.blog.csdn.net/article/details/89054461
[Hadoop MR _ InputFormat _ _ OutputFormat]: https://yanxml.blog.csdn.net/article/details/89054546
[Hadoop MR _]: https://yanxml.blog.csdn.net/article/details/89054605
[Hadoop MR _ Join_ _MapJoin _ ReduceJon _]: https://yanxml.blog.csdn.net/article/details/89054738
[Hadoop MR _ 1]: https://yanxml.blog.csdn.net/article/details/89058868
[Hadoop MR]: https://yanxml.blog.csdn.net/article/details/89058937
[Hadoop MR 1]: https://yanxml.blog.csdn.net/article/details/89061921
[Hadoop 1]: https://blog.csdn.net/qq_26562641/article/details/50344613
[Hadoop 2]: https://blog.csdn.net/wyqwilliam/article/details/81031535
[MapReduce]: https://blog.csdn.net/WYpersist/article/details/80202055
[hadoop_map_reduce]: https://www.cnblogs.com/hadoop-dev/p/5902787.html
[Hadoop _join]: https://www.cnblogs.com/luchen927/archive/2012/03/01/2375842.html
[hadoop_]: https://www.cnblogs.com/gala1021/p/8552850.html
[TOP 25_Hadoop]: http://baijiahao.baidu.com/s?id=1587115450883918800&wfr=spider&for=pc
[hadoop_100]: https://blog.csdn.net/kingmax54212008/article/details/51257067
[98_Hadoop]: https://blog.csdn.net/away30/article/details/78039682