部署v1.18.6版本Kubernetes集群

ゝ一世哀愁。 2022-12-01 14:22 161阅读 0赞

## 一、集群环境准备 ##

本文系搭建kubernetes v1.18.6 集群笔记，使用三台虚拟机作为 CentOS 测试机，安装kubeadm、kubelet、kubectl均使用yum安装，网络组件选用的是 flannel行文中难免出现错误，如果读者有高见，请评论与我交流、如需转载请注明原始出处：[https://www.cnblogs.com/luoahong/p/13432410.html][https_www.cnblogs.com_luoahong_p_13432410.html]

**部署集群没有特殊说明均使用root用户执行命令**

### 1、硬件信息 ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 7 8 9 10 11 12 13 14 </td> 
 <td> <code>root@master ~]</code><code># lscpu</code> <code>......</code> <code>CPU(s):&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 4</code> <code>CPU MHz:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2397.220</code> <code>Hypervisor vendor:&nbsp;&nbsp;&nbsp;&nbsp; KVM</code> &nbsp; <code>[root@master ~]</code><code># free -h</code> <code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</code><code>total&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; used&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</code><code>free</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>shared&nbsp; buff</code><code>/cache</code>&nbsp;&nbsp;&nbsp;<code>available</code> <code>Mem:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 17G&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1.0G&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 13G&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 17M&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2.6G&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 16G</code> &nbsp; <code>[root@master ~]</code><code># lsblk</code> <code>NAME&nbsp;&nbsp; MAJ:MIN RM&nbsp; SIZE RO TYPE MOUNTPOINT</code> <code>sr0&nbsp;&nbsp;&nbsp;&nbsp; 11:0&nbsp;&nbsp;&nbsp; 1 1024M&nbsp; 0 rom&nbsp;</code> <code>vda&nbsp;&nbsp;&nbsp; 253:0&nbsp;&nbsp;&nbsp; 0&nbsp; 100G&nbsp; 0 disk</code> </td> 
 </tr> 
 </tbody> 
</table>

### 2、软件信息 ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 7 8 9 </td> 
 <td> <code>[root@master ~]</code><code># cat /etc/redhat-release</code> <code>CentOS Linux release 7.5.1804 (Core)</code> &nbsp; <code>[root@master ~]</code><code># kubectl version</code> <code>Client Version: version.Info{Major:</code><code>"1"</code><code>, Minor:</code><code>"18"</code><code>, GitVersion:</code><code>"v1.18.6"</code> &nbsp; <code>[root@master ~]</code><code># docker version</code> <code>Client: Docker Engine - Community</code> <code>&nbsp;</code><code>Version:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 19.03.12</code> </td> 
 </tr> 
 </tbody> 
</table>

### 3、保证环境正确性 ###

<table> 
 <thead> 
 <tr> 
 <th>purpose</th> 
 <th>commands</th> 
 </tr> 
 </thead> 
 <tbody> 
 <tr> 
 <td>保证集群各节点互通</td> 
 <td><code>ping -c 3 &lt;ip&gt;</code></td> 
 </tr> 
 <tr> 
 <td>保证MAC地址唯一</td> 
 <td><code>ip link</code>&nbsp;或&nbsp;<code>ifconfig -a</code></td> 
 </tr> 
 <tr> 
 <td>保证集群内主机名唯一</td> 
 <td>查询&nbsp;<code>hostnamectl status</code>，修改&nbsp;<code>hostnamectl set-hostname &lt;hostname&gt;</code></td> 
 </tr> 
 <tr> 
 <td>保证系统产品uuid唯一</td> 
 <td><code>dmidecode -s system-uuid</code>&nbsp;或&nbsp;<code>sudo cat /sys/class/dmi/id/product_uuid</code></td> 
 </tr> 
 </tbody> 
</table>

## ##

### 4、确保端口开放正常 ###

kube-master节点端口检查：

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 </td> 
 <td> <code>[root@master ~]</code><code># netstat -lntup</code> <code>Active Internet connections (only servers)</code> <code>Proto Recv-Q Send-Q Local Address&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Foreign Address&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; State&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; PID</code><code>/Program</code>&nbsp;<code>name</code> <code>tcp6&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 :::10250&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :::*&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LISTEN&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 14154</code><code>/kubelet</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</code>&nbsp; <code>tcp&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 127.0.0.1:10249&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0.0.0.0:*&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LISTEN&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 14494</code><code>/kube-proxy</code> <code>tcp6&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 :::10256&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :::*&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LISTEN&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 14494</code><code>/kube-proxy</code> <code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</code>&nbsp; <code>tcp&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 192.168.118.4:2379&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0.0.0.0:*&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LISTEN&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 13805</code><code>/etcd</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <code>tcp&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 192.168.118.4:2380&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0.0.0.0:*&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LISTEN&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 13805</code><code>/etcd</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</code>&nbsp; <code>tcp&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 127.0.0.1:10257&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0.0.0.0:*&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LISTEN&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 13817</code><code>/kube-controll</code> &nbsp; <code>tcp&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 127.0.0.1:10259&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0.0.0.0:*&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LISTEN&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 13877</code><code>/kube-schedule</code>&nbsp;&nbsp;&nbsp; <code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</code>&nbsp; <code>tcp6&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 :::6443&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :::*&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LISTEN&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 13755</code><code>/kube-apiserve</code> </td> 
 </tr> 
 </tbody> 
</table>

kube-node\*节点端口检查：

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 7 8 9 10 </td> 
 <td> <code>[root@node1 ~]</code><code># netstat -lntup</code> <code>Active Internet connections (only servers)</code> <code>Proto Recv-Q Send-Q Local Address&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Foreign Address&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; State&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; PID</code><code>/Program</code>&nbsp;<code>name&nbsp;&nbsp;&nbsp;</code> &nbsp; <code>xy&nbsp;&nbsp;&nbsp;</code> <code>tcp&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 0.0.0.0:30443&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0.0.0.0:*&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LISTEN&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 13294</code><code>/kube-proxy</code>&nbsp;&nbsp;&nbsp; <code>tcp&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 0.0.0.0:30964&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0.0.0.0:*&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LISTEN&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 13294</code><code>/kube-proxy</code>&nbsp; <code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</code>&nbsp; <code>tcp6&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 :::10250&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :::*&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LISTEN&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 12951</code><code>/kubelet</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <code>tcp6&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 :::10256&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :::*&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LISTEN&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 13294</code><code>/kube-proxy</code> </td> 
 </tr> 
 </tbody> 
</table>

## 二、环境初始化（所有节点执行）　　 ##

### 1、配置主机互信 ###

1、分别在各节点配置hosts映射：

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 </td> 
 <td> <code>cat</code>&nbsp;<code>&gt;&gt;&nbsp;</code><code>/etc/hosts</code>&nbsp;<code>&lt;&lt;EOF</code> <code>192.168.118.4 master</code> <code>192.168.118.19 node1</code> <code>192.168.118.20 node2</code> <code>EOF</code> </td> 
 </tr> 
 </tbody> 
</table>

2、**master**生成ssh密钥，分发公钥到各节点：

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 7 </td> 
 <td> <code>#生成ssh密钥，直接一路回车</code> <code>ssh</code><code>-keygen -t rsa</code> &nbsp; <code>#复制刚刚生成的密钥到各节点可信列表中，需分别输入各主机密码</code> <code>ssh</code><code>-copy-</code><code>id</code>&nbsp;<code>/root/</code><code>.</code><code>ssh</code><code>/id_rsa</code><code>.pub master</code> <code>ssh</code><code>-copy-</code><code>id</code>&nbsp;<code>/root/</code><code>.</code><code>ssh</code><code>/id_rsa</code><code>.pub node1</code> <code>ssh</code><code>-copy-</code><code>id</code>&nbsp;<code>/root/</code><code>.</code><code>ssh</code><code>/id_rsa</code><code>.pub node2</code> </td> 
 </tr> 
 </tbody> 
</table>

### 2、禁用swap ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 </td> 
 <td> <code>swapoff -a</code> <code>sed</code>&nbsp;<code>-i&nbsp;</code><code>'s/.*swap.*/#&amp;/'</code>&nbsp;<code>/etc/fstab</code><code>三、部署docker</code> </td> 
 </tr> 
 </tbody> 
</table>

## 三、部署docker（所有节点执行） ##

### 1、添加docker yum源 ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 </td> 
 <td> <code>#安装必要依赖</code> <code>yum&nbsp;</code><code>install</code>&nbsp;<code>-y yum-utils device-mapper-persistent-data lvm2</code> <code>#添加aliyun docker-ce yum源</code> <code>yum-config-manager --add-repo http:</code><code>//mirrors</code><code>.aliyun.com</code><code>/docker-ce/linux/centos/docker-ce</code><code>.repo</code> <code>#重建yum缓存</code> <code>yum makecache fast</code> </td> 
 </tr> 
 </tbody> 
</table>

### 2、安装docker ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 </td> 
 <td> <code>#查看可用docker版本</code> <code>yum list docker-ce.x86_64 --showduplicates |&nbsp;</code><code>sort</code>&nbsp;<code>-r</code> &nbsp; <code>#安装指定版本docker</code> <code>yum&nbsp;</code><code>install</code>&nbsp;<code>-y docker-ce-19.03.12-3.el7</code> </td> 
 </tr> 
 </tbody> 
</table>

### 3、确保网络模块开机自动加载 ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 </td> 
 <td> <code>lsmod |&nbsp;</code><code>grep</code>&nbsp;<code>overlay</code> <code>lsmod |&nbsp;</code><code>grep</code>&nbsp;<code>br_netfilter</code> </td> 
 </tr> 
 </tbody> 
</table>

若上面命令无返回值输出或提示文件不存在，需执行以下命令：

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 </td> 
 <td> <code>cat</code>&nbsp;<code>&gt;&nbsp;</code><code>/etc/modules-load</code><code>.d</code><code>/docker</code><code>.conf &lt;&lt;EOF</code> <code>overlay</code> <code>br_netfilter</code> <code>EOF</code> <code>modprobe overlay</code> <code>modprobe br_netfilter</code> </td> 
 </tr> 
 </tbody> 
</table>

### 4、使桥接流量对iptables可见 ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 </td> 
 <td> <code>cat</code>&nbsp;<code>&gt;&nbsp;</code><code>/etc/sysctl</code><code>.d</code><code>/k8s</code><code>.conf &lt;&lt;EOF</code> <code>net.bridge.bridge-nf-call-ip6tables = 1</code> <code>net.bridge.bridge-nf-call-iptables = 1</code> <code>EOF</code> <code>sysctl --system</code> </td> 
 </tr> 
 </tbody> 
</table>

验证是否生效，均返回 `1` 即正确

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 </td> 
 <td> <code>sysctl -n net.bridge.bridge-nf-call-iptables</code> <code>sysctl -n net.bridge.bridge-nf-call-ip6tables</code> </td> 
 </tr> 
 </tbody> 
</table>

### 5、配置docker ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 </td> 
 <td> <code>mkdir</code>&nbsp;<code>/etc/docker</code> <code>#修改cgroup驱动为systemd[k8s官方推荐]、限制容器日志量、修改存储类型，最后的docker家目录可修改</code> <code>cat</code>&nbsp;<code>&gt;&nbsp;</code><code>/etc/docker/daemon</code><code>.json &lt;&lt;EOF</code> <code>{ </code> <code>&nbsp;&nbsp;</code><code>"exec-opts"</code><code>: [</code><code>"native.cgroupdriver=systemd"</code><code>],</code> <code>&nbsp;&nbsp;</code><code>"log-driver"</code><code>:&nbsp;</code><code>"json-file"</code><code>,</code> <code>&nbsp;&nbsp;</code><code>"log-opts"</code><code>: { </code> <code>&nbsp;&nbsp;&nbsp;&nbsp;</code><code>"max-size"</code><code>:&nbsp;</code><code>"100m"</code> <code>&nbsp;&nbsp;</code><code>},</code> <code>&nbsp;&nbsp;</code><code>"storage-driver"</code><code>:&nbsp;</code><code>"overlay2"</code><code>,</code> <code>&nbsp;&nbsp;</code><code>"storage-opts"</code><code>: [</code> <code>&nbsp;&nbsp;&nbsp;&nbsp;</code><code>"overlay2.override_kernel_check=true"</code> <code>&nbsp;&nbsp;</code><code>],</code> <code>&nbsp;&nbsp;</code><code>"registry-mirrors"</code><code>: [</code><code>"https://7uuu3esz.mirror.aliyuncs.com"</code><code>],</code> <code>&nbsp;&nbsp;</code><code>"data-root"</code><code>:&nbsp;</code><code>"/data/docker"</code> <code>}</code> <code>EOF</code> <code>#添加开机自启，立即启动</code> <code>systemctl&nbsp;</code><code>enable</code>&nbsp;<code>--now docker</code> </td> 
 </tr> 
 </tbody> 
</table>

### 6、验证docker是否正常 ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 </td> 
 <td> <code>#查看docker信息，判断是否与配置一致</code> <code>docker info</code> <code>#hello-docker测试</code> <code>docker run --</code><code>rm</code>&nbsp;<code>hello-world</code> <code>#删除测试image</code> <code>docker rmi hello-world</code> </td> 
 </tr> 
 </tbody> 
</table>

## 四、部署kubernetes集群 ##

**未特殊说明，各节点均需执行如下步骤**

### 1、添加kubernetes源 ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 7 8 9 10 11 </td> 
 <td> <code>cat</code>&nbsp;<code>&gt;&nbsp;</code><code>/etc/yum</code><code>.repos.d</code><code>/kubernetes</code><code>.repo &lt;&lt;EOF</code> <code>[kubernetes]</code> <code>name=Kubernetes</code> <code>baseurl=https:</code><code>//mirrors</code><code>.aliyun.com</code><code>/kubernetes/yum/repos/kubernetes-el7-x86_64/</code> <code>enabled=1</code> <code>gpgcheck=1</code> <code>repo_gpgcheck=1</code> <code>gpgkey=https:</code><code>//mirrors</code><code>.aliyun.com</code><code>/kubernetes/yum/doc/yum-key</code><code>.gpg https:</code><code>//mirrors</code><code>.aliyun.com</code><code>/kubernetes/yum/doc/rpm-package-key</code><code>.gpg</code> <code>EOF</code> <code>#重建yum缓存，输入y添加证书认证</code> <code>yum makecache fast</code> </td> 
 </tr> 
 </tbody> 
</table>

### 2、安装kubeadm、kubelet、kubectl ###

各节点均需安装kubeadm、kubelet，**kubectl仅kube-master节点需安装（作为worker节点，kubectl无法使用，可以不装）**

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 </td> 
 <td> <code>yum&nbsp;</code><code>install</code>&nbsp;<code>-y kubelet kubeadm kubectl --disableexcludes=kubernetes</code> <code>systemctl&nbsp;</code><code>enable</code>&nbsp;<code>--now kubelet</code> </td> 
 </tr> 
 </tbody> 
</table>

### 3、配置自动补全命令 ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 </td> 
 <td> <code>#安装bash自动补全插件</code> <code>yum&nbsp;</code><code>install</code>&nbsp;<code>bash</code><code>-completion -y</code> <code>#设置kubectl与kubeadm命令补全，下次login生效</code> <code>kubectl completion&nbsp;</code><code>bash</code>&nbsp;<code>&gt;</code><code>/etc/bash_completion</code><code>.d</code><code>/kubectl</code> <code>kubeadm completion&nbsp;</code><code>bash</code>&nbsp;<code>&gt;&nbsp;</code><code>/etc/bash_completion</code><code>.d</code><code>/kubeadm</code> </td> 
 </tr> 
 </tbody> 
</table>

### 4、预拉取kubernetes镜像 ###

脚本添加可执行权限，执行脚本拉取镜像：

**由于网络原因建议在早上7点前执行速度更佳、其他时段速度很慢甚至连接超时**

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 </td> 
 <td> <code>chmod</code>&nbsp;<code>+x get-k8s-images.sh</code> <code>.</code><code>/get-k8s-images</code><code>.sh</code> </td> 
 </tr> 
 </tbody> 
</table>

拉取完成，执行 `docker images` 查看镜像

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 7 8 9 </td> 
 <td> <code>[root@master ~]</code><code># docker images</code> <code>REPOSITORY&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; TAG&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; IMAGE ID&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; CREATED&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; SIZE</code> <code>k8s.gcr.io</code><code>/kube-proxy</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>v1.18.6&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; c3d62d6fe412&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2 weeks ago&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 117MB</code> <code>k8s.gcr.io</code><code>/kube-controller-manager</code>&nbsp;&nbsp;&nbsp;<code>v1.18.6&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ffce5e64d915&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2 weeks ago&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 162MB</code> <code>k8s.gcr.io</code><code>/kube-apiserver</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>v1.18.6&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 56acd67ea15a&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2 weeks ago&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 173MB</code> <code>k8s.gcr.io</code><code>/kube-scheduler</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>v1.18.6&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0e0972b2b5d1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2 weeks ago&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 95.3MB</code> <code>k8s.gcr.io</code><code>/pause</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>3.2&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 80d28bedfe5d&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 5 months ago&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 683kB</code> <code>k8s.gcr.io</code><code>/coredns</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>1.6.7&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 67da37a9a360&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 6 months ago&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 43.8MB</code> <code>k8s.gcr.io</code><code>/etcd</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>3.4.3-0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 303ce5db0e90&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 9 months ago&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 288MB</code> </td> 
 </tr> 
 </tbody> 
</table>

##  五、初始化master（仅 master 节点需要执行此步骤） ##

### **1、修改kubelet配置默认cgroup driver** ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 </td> 
 <td> <code>cat</code>&nbsp;<code>&gt;&nbsp;</code><code>/var/lib/kubelet/config</code><code>.yaml &lt;&lt;EOF</code> <code>apiVersion: kubelet.config.k8s.io</code><code>/v1beta1</code> <code>kind: KubeletConfiguration</code> <code>cgroupDriver: systemd</code> <code>EOF</code> <code>systemctl restart kubelet</code> </td> 
 </tr> 
 </tbody> 
</table>

### **2、****初始化master 10.244.0.0/16是flannel固定使用的IP段，设置取决于网络组件要求** ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 </td> 
 <td> <code>[root@master ~]</code><code># kubeadm init --pod-network-cidr=10.244.0.0/16 --kubernetes-version=v1.18.6</code> <code>W0803 23:20:21.320111&nbsp;&nbsp; 12805 configset.go:202] WARNING: kubeadm cannot validate component configs&nbsp;</code><code>for</code>&nbsp;<code>API&nbsp;</code><code>groups</code>&nbsp;<code>[kubelet.config.k8s.io kubeproxy.config.k8s.io]</code> <code>[init] Using Kubernetes version: v1.18.6</code> <code>[preflight] Running pre-flight checks</code> <code>[preflight] Pulling images required&nbsp;</code><code>for</code>&nbsp;<code>setting up a Kubernetes cluster</code> <code>[preflight] This might take a minute or two, depending on the speed of your internet connection</code> <code>[preflight] You can also perform this action&nbsp;</code><code>in</code>&nbsp;<code>beforehand using&nbsp;</code><code>'kubeadm config images pull'</code> <code>[kubelet-start] Writing kubelet environment&nbsp;</code><code>file</code>&nbsp;<code>with flags to&nbsp;</code><code>file</code>&nbsp;<code>"/var/lib/kubelet/kubeadm-flags.env"</code> <code>[kubelet-start] Writing kubelet configuration to&nbsp;</code><code>file</code>&nbsp;<code>"/var/lib/kubelet/config.yaml"</code> <code>[kubelet-start] Starting the kubelet</code> <code>[certs] Using certificateDir folder&nbsp;</code><code>"/etc/kubernetes/pki"</code> <code>[certs] Generating&nbsp;</code><code>"ca"</code>&nbsp;<code>certificate and key</code> <code>[certs] Generating&nbsp;</code><code>"apiserver"</code>&nbsp;<code>certificate and key</code> <code>[certs] apiserver serving cert is signed&nbsp;</code><code>for</code>&nbsp;<code>DNS names [master kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.</code><code>local</code><code>] and IPs [10.96.0.1 192.168.118.4]</code> <code>[certs] Generating&nbsp;</code><code>"apiserver-kubelet-client"</code>&nbsp;<code>certificate and key</code> <code>[certs] Generating&nbsp;</code><code>"front-proxy-ca"</code>&nbsp;<code>certificate and key</code> <code>[certs] Generating&nbsp;</code><code>"front-proxy-client"</code>&nbsp;<code>certificate and key</code> <code>[certs] Generating&nbsp;</code><code>"etcd/ca"</code>&nbsp;<code>certificate and key</code> <code>[certs] Generating&nbsp;</code><code>"etcd/server"</code>&nbsp;<code>certificate and key</code> <code>[certs] etcd</code><code>/server</code>&nbsp;<code>serving cert is signed&nbsp;</code><code>for</code>&nbsp;<code>DNS names [master localhost] and IPs [192.168.118.4 127.0.0.1 ::1]</code> <code>[certs] Generating&nbsp;</code><code>"etcd/peer"</code>&nbsp;<code>certificate and key</code> <code>[certs] etcd</code><code>/peer</code>&nbsp;<code>serving cert is signed&nbsp;</code><code>for</code>&nbsp;<code>DNS names [master localhost] and IPs [192.168.118.4 127.0.0.1 ::1]</code> <code>[certs] Generating&nbsp;</code><code>"etcd/healthcheck-client"</code>&nbsp;<code>certificate and key</code> <code>[certs] Generating&nbsp;</code><code>"apiserver-etcd-client"</code>&nbsp;<code>certificate and key</code> <code>[certs] Generating&nbsp;</code><code>"sa"</code>&nbsp;<code>key and public key</code> <code>[kubeconfig] Using kubeconfig folder&nbsp;</code><code>"/etc/kubernetes"</code> <code>[kubeconfig] Writing&nbsp;</code><code>"admin.conf"</code>&nbsp;<code>kubeconfig&nbsp;</code><code>file</code> <code>[kubeconfig] Writing&nbsp;</code><code>"kubelet.conf"</code>&nbsp;<code>kubeconfig&nbsp;</code><code>file</code> <code>[kubeconfig] Writing&nbsp;</code><code>"controller-manager.conf"</code>&nbsp;<code>kubeconfig&nbsp;</code><code>file</code> <code>[kubeconfig] Writing&nbsp;</code><code>"scheduler.conf"</code>&nbsp;<code>kubeconfig&nbsp;</code><code>file</code> <code>[control-plane] Using manifest folder&nbsp;</code><code>"/etc/kubernetes/manifests"</code> <code>[control-plane] Creating static Pod manifest&nbsp;</code><code>for</code>&nbsp;<code>"kube-apiserver"</code> <code>[control-plane] Creating static Pod manifest&nbsp;</code><code>for</code>&nbsp;<code>"kube-controller-manager"</code> <code>W0803 23:20:28.237080&nbsp;&nbsp; 12805 manifests.go:225] the default kube-apiserver authorization-mode is&nbsp;</code><code>"Node,RBAC"</code><code>; using&nbsp;</code><code>"Node,RBAC"</code> <code>[control-plane] Creating static Pod manifest&nbsp;</code><code>for</code>&nbsp;<code>"kube-scheduler"</code> <code>W0803 23:20:28.238090&nbsp;&nbsp; 12805 manifests.go:225] the default kube-apiserver authorization-mode is&nbsp;</code><code>"Node,RBAC"</code><code>; using&nbsp;</code><code>"Node,RBAC"</code> <code>[etcd] Creating static Pod manifest&nbsp;</code><code>for</code>&nbsp;<code>local</code>&nbsp;<code>etcd&nbsp;</code><code>in</code>&nbsp;<code>"/etc/kubernetes/manifests"</code> <code>[wait-control-plane] Waiting&nbsp;</code><code>for</code>&nbsp;<code>the kubelet to boot up the control plane as static Pods from directory&nbsp;</code><code>"/etc/kubernetes/manifests"</code><code>. This can take up to 4m0s</code> <code>[apiclient] All control plane components are healthy after 20.503032 seconds</code> <code>[upload-config] Storing the configuration used&nbsp;</code><code>in</code>&nbsp;<code>ConfigMap&nbsp;</code><code>"kubeadm-config"</code>&nbsp;<code>in</code>&nbsp;<code>the&nbsp;</code><code>"kube-system"</code>&nbsp;<code>Namespace</code> <code>[kubelet] Creating a ConfigMap&nbsp;</code><code>"kubelet-config-1.18"</code>&nbsp;<code>in</code>&nbsp;<code>namespace kube-system with the configuration&nbsp;</code><code>for</code>&nbsp;<code>the kubelets&nbsp;</code><code>in</code>&nbsp;<code>the cluster</code> <code>[upload-certs] Skipping phase. Please see --upload-certs</code> <code>[mark-control-plane] Marking the node master as control-plane by adding the label&nbsp;</code><code>"node-role.kubernetes.io/master=''"</code> <code>[mark-control-plane] Marking the node master as control-plane by adding the taints [node-role.kubernetes.io</code><code>/master</code><code>:NoSchedule]</code> <code>[bootstrap-token] Using token: aw0koc.6d40t5a2ydm299c9</code> <code>[bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles</code> <code>[bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes</code> <code>[bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs&nbsp;</code><code>in</code>&nbsp;<code>order&nbsp;</code><code>for</code>&nbsp;<code>nodes to get long term certificate credentials</code> <code>[bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token</code> <code>[bootstrap-token] configured RBAC rules to allow certificate rotation&nbsp;</code><code>for</code>&nbsp;<code>all node client certificates&nbsp;</code><code>in</code>&nbsp;<code>the cluster</code> <code>[bootstrap-token] Creating the&nbsp;</code><code>"cluster-info"</code>&nbsp;<code>ConfigMap&nbsp;</code><code>in</code>&nbsp;<code>the&nbsp;</code><code>"kube-public"</code>&nbsp;<code>namespace</code> <code>[kubelet-finalize] Updating&nbsp;</code><code>"/etc/kubernetes/kubelet.conf"</code>&nbsp;<code>to point to a rotatable kubelet client certificate and key</code> <code>[addons] Applied essential addon: CoreDNS</code> <code>[addons] Applied essential addon: kube-proxy</code> &nbsp; <code>Your Kubernetes control-plane has initialized successfully!</code> &nbsp; <code>To start using your cluster, you need to run the following as a regular user:</code> &nbsp; <code>&nbsp;&nbsp;</code><code>mkdir</code>&nbsp;<code>-p $HOME/.kube</code> <code>&nbsp;&nbsp;</code><code>sudo</code>&nbsp;<code>cp</code>&nbsp;<code>-i&nbsp;</code><code>/etc/kubernetes/admin</code><code>.conf $HOME/.kube</code><code>/config</code> <code>&nbsp;&nbsp;</code><code>sudo</code>&nbsp;<code>chown</code>&nbsp;<code>$(</code><code>id</code>&nbsp;<code>-u):$(</code><code>id</code>&nbsp;<code>-g) $HOME/.kube</code><code>/config</code> &nbsp; <code>You should now deploy a pod network to the cluster.</code> <code>Run&nbsp;</code><code>"kubectl apply -f [podnetwork].yaml"</code>&nbsp;<code>with one of the options listed at:</code> <code>&nbsp;&nbsp;</code><code>https:</code><code>//kubernetes</code><code>.io</code><code>/docs/concepts/cluster-administration/addons/</code> &nbsp; <code>Then you can&nbsp;</code><code>join</code>&nbsp;<code>any number of worker nodes by running the following on each as root:</code> &nbsp; <code>kubeadm&nbsp;</code><code>join</code>&nbsp;<code>192.168.118.4:6443 --token aw0koc.6d40t5a2ydm299c9 \</code> <code>&nbsp;&nbsp;&nbsp;&nbsp;</code><code>--discovery-token-ca-cert-</code><code>hash</code>&nbsp;<code>sha256:38343d02ddd645b2f74ddf886925c93115604ea72a01b0b03088ca1d2ac14c6f</code> </td> 
 </tr> 
 </tbody> 
</table>

### 3、**为日常使用集群的用户添加kubectl使用权限** ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 </td> 
 <td> <code>[root@master ~]</code><code>#mkdir -p $HOME/.kube</code> <code>[root@master ~]</code><code>#sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config</code> <code>[root@master ~]</code><code>#sudo chown $(id -u):$(id -g) $HOME/.kube/config</code> <code>[root@master ~]</code><code># echo "export KUBECONFIG=$HOME/.kube/admin.conf" &gt;&gt; ~/.bashrc</code> </td> 
 </tr> 
 </tbody> 
</table>

### **4、配置master认证** ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 </td> 
 <td> <code>[root@master ~]</code><code># echo 'export KUBECONFIG=/etc/kubernetes/admin.conf' &gt;&gt; /etc/profile</code> <code>[root@master ~]</code><code># . /etc/profile</code> </td> 
 </tr> 
 </tbody> 
</table>

**如果不配置这个，会提示如下输出：**

<table> 
 <tbody> 
 <tr> 
 <td> 1 </td> 
 <td> <code>The connection to the server localhost:8080 was refused - did you specify the right host or port?</code> </td> 
 </tr> 
 </tbody> 
</table>

**此时master节点已经初始化成功，但是还未完装网络组件，还无法与其他节点通讯**

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 </td> 
 <td> <code>[root@master ~]</code><code># kubectl get nodes</code> <code>NAME&nbsp;&nbsp;&nbsp;&nbsp; STATUS&nbsp;&nbsp;&nbsp;&nbsp; ROLES&nbsp;&nbsp;&nbsp; AGE&nbsp;&nbsp; VERSION</code> <code>master&nbsp;&nbsp; NotReady&nbsp;&nbsp; master&nbsp;&nbsp; 81s&nbsp;&nbsp; v1.18.6</code> </td> 
 </tr> 
 </tbody> 
</table>

### **5、安装网络组件，以flannel为例** ###

**由于网络原因建议在早上7点前执行速度更佳、其他时段速度很慢甚至连接超时**

**创建运行**

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 </td> 
 <td> <code>[root@master ~]</code><code># wget https://raw.githubusercontent.com/coreos/flannel/master/Documentation/kube-flannel.yml</code> <code>[root@master ~]</code><code># kubectl apply -f kube-flannel.yml　　</code> </td> 
 </tr> 
 </tbody> 
</table>

查看是否都正常运行

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 7 8 9 </td> 
 <td> <code>[root@master ~]</code><code># kubectl get pod -n kube-system</code> <code>NAME&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; READY&nbsp;&nbsp; STATUS&nbsp;&nbsp;&nbsp; RESTARTS&nbsp;&nbsp; AGE</code> <code>coredns-66bff467f8-d9xjc&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1</code><code>/1</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>Running&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2m22s</code> <code>coredns-66bff467f8-lvldb&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1</code><code>/1</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>Running&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2m22s</code> <code>etcd-master&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1</code><code>/1</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>Running&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2m34s</code> <code>kube-apiserver-master&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1</code><code>/1</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>Running&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2m34s</code> <code>kube-controller-manager-master&nbsp;&nbsp; 1</code><code>/1</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>Running&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2m34s</code> <code>kube-proxy-lg58q&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1</code><code>/1</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>Running&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2m22s</code> <code>kube-scheduler-master&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1</code><code>/1</code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<code>Running&nbsp;&nbsp; 0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2m33s</code> </td> 
 </tr> 
 </tbody> 
</table>

**查看kube-master节点状态**

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 </td> 
 <td> <code>[root@master ~]</code><code># kubectl get nodes</code> <code>NAME&nbsp;&nbsp;&nbsp;&nbsp; STATUS&nbsp;&nbsp; ROLES&nbsp;&nbsp;&nbsp; AGE&nbsp;&nbsp; VERSION</code> <code>master&nbsp;&nbsp; Ready&nbsp;&nbsp;&nbsp; master&nbsp;&nbsp; 12h&nbsp;&nbsp; v1.18.6</code> </td> 
 </tr> 
 </tbody> 
</table>

如果STATUS提示`NotReady`，可以通过 `kubectl describe node master` 查看具体的描述信息，性能差的服务器到达Ready状态时间会长些

### 六、初始化node\*节点并加入集群 ###

### **1、备份镜像供其他节点使用** ###

**便于后续传输给其他node节点，当然有镜像仓库更好**

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 7 </td> 
 <td> <code>docker save k8s.gcr.io</code><code>/kube-proxy</code><code>:v1.18.6 \</code> <code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</code><code>k8s.gcr.io</code><code>/kube-apiserver</code><code>:v1.18.6 \</code> <code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</code><code>k8s.gcr.io</code><code>/kube-controller-manager</code><code>:v1.18.6 \</code> <code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</code><code>k8s.gcr.io</code><code>/kube-scheduler</code><code>:v1.18.6 \</code> <code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</code><code>k8s.gcr.io</code><code>/pause</code><code>:3.2 \</code> <code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</code><code>k8s.gcr.io</code><code>/coredns</code><code>:1.6.7 \</code> <code>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</code><code>k8s.gcr.io</code><code>/etcd</code><code>:3.4.3-0 &gt; k8s-imagesV1.18.6.</code><code>tar</code> </td> 
 </tr> 
 </tbody> 
</table>

**拷贝镜像到node节点**

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 </td> 
 <td> <code>[root@master ~]</code><code>#scp k8s-imagesV1.18.6.tar node1</code> <code>[root@master ~]</code><code>#scp k8s-imagesV1.18.6.tar node2</code> </td> 
 </tr> 
 </tbody> 
</table>

### 2、node节点载入镜像 ###

### 3、**获取加入kubernetes命令** ###

**刚才在初始化master节点时，有在最后输出其加入集群的命令，假如我没记下来，那怎么办呢？**

访问kube-master输入创建新token命令，同时输出加入集群的命令：

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 </td> 
 <td> <code>[root@master ~]</code><code># kubeadm token create --print-join-command</code> <code>W0804 11:51:54.344223&nbsp;&nbsp; 11517 configset.go:202] WARNING: kubeadm cannot validate component configs&nbsp;</code><code>for</code>&nbsp;<code>API&nbsp;</code><code>groups</code>&nbsp;<code>[kubelet.config.k8s.io kubeproxy.config.k8s.io]</code> <code>kubeadm&nbsp;</code><code>join</code>&nbsp;<code>192.168.118.4:6443 --token eynx2u.ph1ohakkqx1utkl8&nbsp;&nbsp;&nbsp;&nbsp; --discovery-token-ca-cert-</code><code>hash</code>&nbsp;<code>sha256:38343d02ddd645b2f74ddf886925c93115604ea72a01b0b03088ca1d2ac14c6f</code> </td> 
 </tr> 
 </tbody> 
</table>

和初始化的集群命令对比

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 </td> 
 <td> <code>Your Kubernetes control-plane has initialized successfully!</code> &nbsp; <code>To start using your cluster, you need to run the following as a regular user:</code> &nbsp; <code>&nbsp;&nbsp;</code><code>mkdir</code>&nbsp;<code>-p $HOME/.kube</code> <code>&nbsp;&nbsp;</code><code>sudo</code>&nbsp;<code>cp</code>&nbsp;<code>-i&nbsp;</code><code>/etc/kubernetes/admin</code><code>.conf $HOME/.kube</code><code>/config</code> <code>&nbsp;&nbsp;</code><code>sudo</code>&nbsp;<code>chown</code>&nbsp;<code>$(</code><code>id</code>&nbsp;<code>-u):$(</code><code>id</code>&nbsp;<code>-g) $HOME/.kube</code><code>/config</code> &nbsp; <code>You should now deploy a pod network to the cluster.</code> <code>Run&nbsp;</code><code>"kubectl apply -f [podnetwork].yaml"</code>&nbsp;<code>with one of the options listed at:</code> <code>&nbsp;&nbsp;</code><code>https:</code><code>//kubernetes</code><code>.io</code><code>/docs/concepts/cluster-administration/addons/</code> &nbsp; <code>Then you can&nbsp;</code><code>join</code>&nbsp;<code>any number of worker nodes by running the following on each as root:</code> <code>#建议记录下来便于以后添加新的node使用</code> <code>kubeadm&nbsp;</code><code>join</code>&nbsp;<code>192.168.118.4:6443 --token aw0koc.6d40t5a2ydm299c9 \</code> <code>&nbsp;&nbsp;&nbsp;&nbsp;</code><code>--discovery-token-ca-cert-</code><code>hash</code>&nbsp;<code>sha256:38343d02ddd645b2f74ddf886925c93115604ea72a01b0b03088ca1d2ac14c6f</code> <code>&nbsp;&nbsp;&nbsp;&nbsp;</code><code>#以下是通过kubeadm token create --print-join-command命令获实时取的</code> <code>kubeadm&nbsp;</code><code>join</code>&nbsp;<code>192.168.118.4:6443 --token eynx2u.ph1ohakkqx1utkl8&nbsp;&nbsp;&nbsp;&nbsp; --discovery-token-ca-cert-</code><code>hash</code>&nbsp;<code>sha256:38343d02ddd645b2f74ddf886925c93115604ea72a01b0b03088ca1d2ac14c6f</code> </td> 
 </tr> 
 </tbody> 
</table>

### 4、**在node\*节点上执行加入集群命令** ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 </td> 
 <td> <code>[root@node1 ~]</code><code># kubeadm join 192.168.118.4:6443 --token aw0koc.6d40t5a2ydm299c9 \</code> <code>&gt;&nbsp;&nbsp;&nbsp;&nbsp; --discovery-token-ca-cert-</code><code>hash</code>&nbsp;<code>sha256:38343d02ddd645b2f74ddf886925c93115604ea72a01b0b03088ca1d2ac14c6f</code> <code>W0803 23:41:00.380582&nbsp;&nbsp; 12778&nbsp;</code><code>join</code><code>.go:346] [preflight] WARNING: JoinControlPane.controlPlane settings will be ignored when control-plane flag is not&nbsp;</code><code>set</code><code>.</code> <code>[preflight] Running pre-flight checks</code> <code>[preflight] Reading configuration from the cluster...</code> <code>[preflight] FYI: You can&nbsp;</code><code>look</code>&nbsp;<code>at this config&nbsp;</code><code>file</code>&nbsp;<code>with&nbsp;</code><code>'kubectl -n kube-system get cm kubeadm-config -oyaml'</code> <code>[kubelet-start] Downloading configuration&nbsp;</code><code>for</code>&nbsp;<code>the kubelet from the&nbsp;</code><code>"kubelet-config-1.18"</code>&nbsp;<code>ConfigMap&nbsp;</code><code>in</code>&nbsp;<code>the kube-system namespace</code> <code>[kubelet-start] Writing kubelet configuration to&nbsp;</code><code>file</code>&nbsp;<code>"/var/lib/kubelet/config.yaml"</code> <code>[kubelet-start] Writing kubelet environment&nbsp;</code><code>file</code>&nbsp;<code>with flags to&nbsp;</code><code>file</code>&nbsp;<code>"/var/lib/kubelet/kubeadm-flags.env"</code> <code>[kubelet-start] Starting the kubelet</code> <code>[kubelet-start] Waiting&nbsp;</code><code>for</code>&nbsp;<code>the kubelet to perform the TLS Bootstrap...</code> &nbsp; <code>This node has joined the cluster:</code> <code>* Certificate signing request was sent to apiserver and a response was received.</code> <code>* The Kubelet was informed of the new secure connection details.</code> &nbsp; <code>Run&nbsp;</code><code>'kubectl get nodes'</code>&nbsp;<code>on the control-plane to see this node&nbsp;</code><code>join</code>&nbsp;<code>the cluster.</code> </td> 
 </tr> 
 </tbody> 
</table>

### 5、查看集群节点状态 ###

<table> 
 <tbody> 
 <tr> 
 <td> 1 2 3 4 5 </td> 
 <td> <code>[root@master ~]</code><code># kubectl get nodes</code> <code>NAME&nbsp;&nbsp;&nbsp;&nbsp; STATUS&nbsp;&nbsp; ROLES&nbsp;&nbsp;&nbsp; AGE&nbsp;&nbsp; VERSION</code> <code>master&nbsp;&nbsp; Ready&nbsp;&nbsp;&nbsp; master&nbsp;&nbsp; 12h&nbsp;&nbsp; v1.18.6</code> <code>node1&nbsp;&nbsp;&nbsp; Ready&nbsp;&nbsp;&nbsp; &lt;none&gt;&nbsp;&nbsp; 11h&nbsp;&nbsp; v1.18.6</code> <code>node2&nbsp;&nbsp;&nbsp; Ready&nbsp;&nbsp;&nbsp; &lt;none&gt;&nbsp;&nbsp; 11h&nbsp;&nbsp; v1.18.6</code> </td> 
 </tr> 
 </tbody> 
</table>

[https_www.cnblogs.com_luoahong_p_13432410.html]: https://www.cnblogs.com/luoahong/p/13432410.html