kubesphere 3.0离线安装

左手的ㄟ右手 2023-10-05 18:24 14阅读 0赞

## 离线安装 ##

离线安装几乎与在线安装相同，不同之处是您必须创建一个本地仓库来托管 Docker 镜像。本教程演示了如何在离线环境中将 KubeSphere 安装到 Kubernetes 上。

开始下方步骤之前，请先参阅[准备工作][Link 1]。

### 步骤 1：准备一个私有镜像仓库 ###

您可以使用 Harbor 或者其他任意私有镜像仓库。本教程以 Docker 仓库作为示例，并使用[自签名证书][Link 2]（如果您有自己的私有镜像仓库，可以跳过这一步）。

#### 使用自签名证书 ####

1.  执行以下命令生成您自己的证书：
    
        mkdir -p certs
    
        openssl req \
        -newkey rsa:4096 -nodes -sha256 -keyout certs/domain.key \
        -x509 -days 36500 -out certs/domain.crt
2.  当您生成自己的证书时，请确保在字段 `Common Name` 中指定一个域名。例如，本示例中该字段被指定为 `dockerhub.kubekey.local`。
    
    ![自签名证书][34130e432cda60d4ba4490ca62023df9.png]

#### 启动 Docker 仓库 ####

执行以下命令启动 Docker 仓库：

docker run -d \
      --restart=always \
      --name registry \
      -v "$(pwd)"/certs:/certs \
      -v /mnt/registry:/var/lib/registry \
      -e REGISTRY_HTTP_ADDR=0.0.0.0:443 \
      -e REGISTRY_HTTP_TLS_CERTIFICATE=/certs/domain.crt \
      -e REGISTRY_HTTP_TLS_KEY=/certs/domain.key \
      -p 443:443 \
      registry:2

> 备注
> 
> Docker 使用 `/var/lib/docker` 作为默认路径来存储所有 Docker 相关文件（包括镜像）。建议您添加附加存储卷，分别给 `/var/lib/docker` 和 `/mnt/registry` 挂载至少 **100G**。请参见 [fdisk][] 的参考命令。

#### 配置仓库 ####

1.  在 `/etc/hosts` 中添加一个条目，将主机名（即仓库域名；在本示例中是 `dockerhub.kubekey.local`）映射到您机器的私有 IP 地址，如下所示。
    
        # docker registry
        192.168.0.2 dockerhub.kubekey.local
2.  执行以下命令，复制证书到指定目录，并使 Docker 信任该证书。
    
        mkdir -p  /etc/docker/certs.d/dockerhub.kubekey.local
    
        cp certs/domain.crt  /etc/docker/certs.d/dockerhub.kubekey.local/ca.crt
    
    备注
    
    证书的路径与域名相关联。当您复制路径时，如果与上面设置的路径不同，请使用实际域名。
3.  要验证私有仓库是否有效，您可以先复制一个镜像到您的本地机器，然后使用 `docker push` 和 `docker pull` 来测试。

### 步骤 2：准备安装镜像 ###

当您在离线环境中安装 KubeSphere 时，需要事先准备一个包含所有必需镜像的镜像包。

1.  使用以下命令从能够访问互联网的机器上下载镜像清单文件 `images-list.txt`：
    
        curl -L -O https://github.com/kubesphere/ks-installer/releases/download/v3.0.0/images-list.txt
    
    备注
    
    该文件根据不同的模块列出了 `##+modulename` 下的镜像。您可以按照相同的规则把自己的镜像添加到这个文件中。要查看完整文件，请参见[附录][Link 3]。
2.  下载 `offline-installation-tool.sh`。
    
        curl -L -O https://github.com/kubesphere/ks-installer/releases/download/v3.0.0/offline-installation-tool.sh
3.  使 `.sh` 文件可执行。
    
        chmod +x offline-installation-tool.sh
4.  您可以执行命令 `./offline-installation-tool.sh -h` 来查看如何使用脚本：
    
        root@master:/home/ubuntu# ./offline-installation-tool.sh -h
        Usage:
           
          ./offline-installation-tool.sh [-l IMAGES-LIST] [-d IMAGES-DIR] [-r PRIVATE-REGISTRY] [-v KUBERNETES-VERSION ]
           
        Description:
          -b                     : save kubernetes' binaries.
          -d IMAGES-DIR          : the dir of files (tar.gz) which generated by `docker save`. default: ./kubesphere-images
          -l IMAGES-LIST         : text file with list of images.
          -r PRIVATE-REGISTRY    : target private registry:port.
          -s                     : save model will be applied. Pull the images in the IMAGES-LIST and save images as a tar.gz file.
          -v KUBERNETES-VERSION  : download kubernetes' binaries. default: v1.17.9
          -h                     : usage message
5.  在 `offline-installation-tool.sh` 中拉取镜像。
    
        ./offline-installation-tool.sh -s -l images-list.txt -d ./kubesphere-images
    
    备注
    
    您可以根据需要选择拉取的镜像。例如，如果已经有一个 Kubernetes 集群了，您可以在 `images-list.text` 中删除 `##k8s-images` 和在它下面的相关镜像。

### 步骤 3：推送镜像至私有仓库 ###

将打包的镜像文件传输至您的本地机器，并运行以下命令把它推送至仓库。

./offline-installation-tool.sh -l images-list.txt -d ./kubesphere-images -r dockerhub.kubekey.local

备注

命令中的域名是 `dockerhub.kubekey.local`。请确保使用您**自己仓库的地址**。

### 步骤 4：下载部署文件 ###

与在现有 Kubernetes 集群上在线安装 KubeSphere 相似，您也需要事先下载 `cluster-configuration.yaml` 和 `kubesphere-installer.yaml`。

1.  执行以下命令下载这两个文件，并将它们传输至您充当任务机的机器，用于安装。
    
        curl -L -O https://github.com/kubesphere/ks-installer/releases/download/v3.0.0/cluster-configuration.yaml
        curl -L -O https://github.com/kubesphere/ks-installer/releases/download/v3.0.0/kubesphere-installer.yaml
2.  编辑 `cluster-configuration.yaml` 添加您的私有镜像仓库。例如，本教程中的仓库地址是 `dockerhub.kubekey.local`，将它用作 `.spec.local_registry` 的值，如下所示：
    
        spec:
          persistence:
            storageClass: ""
          authentication:
            jwtSecret: ""
          local_registry: dockerhub.kubekey.local # Add this line manually; make sure you use your own registry address.
    
    备注
    
    您可以在该 YAML 文件中启用可插拔组件，体验 KubeSphere 的更多功能。有关详情，请参考[启用可插拔组件][Link 4]。
3.  编辑完成后保存 `cluster-configuration.yaml`。使用以下命令将 `ks-installer` 替换为您**自己仓库的地址**。
    
        sed -i "s#^\s*image: kubesphere.*/ks-installer:.*#        image: dockerhub.kubekey.local/kubesphere/ks-installer:v3.0.0#" kubesphere-installer.yaml
    
    警告
    
    命令中的仓库地址是 `dockerhub.kubekey.local`。请确保使用您自己仓库的地址。

### 步骤 5：开始安装 ###

确定完成上面所有步骤后，您可以执行以下命令。

kubectl apply -f kubesphere-installer.yaml
    kubectl apply -f cluster-configuration.yaml

### 步骤 6：验证安装 ###

安装完成后，您会看到以下内容：

#####################################################
    ###              Welcome to KubeSphere!           ###
    #####################################################
    
    Console: http://192.168.0.2:30880
    Account: admin
    Password: P@88w0rd
    
    NOTES：
      1. After logging into the console, please check the
         monitoring status of service components in
         the "Cluster Management". If any service is not
         ready, please wait patiently until all components
         are ready.
      2. Please modify the default password after login.
    
    #####################################################
    https://kubesphere.io             20xx-xx-xx xx:xx:xx
    #####################################################

现在，您可以通过 `http://{IP}:30880` 使用默认帐户和密码 `admin/P@88w0rd` 访问 KubeSphere 的 Web 控制台。

> **备注**
> 
> 要访问控制台，请确保在您的安全组中打开端口 30880。

![登录 kubesphere][kubesphere]

### 附录 ###

#### KubeSphere v3.0.0 镜像清单 ####

##k8s-images
    kubesphere/kube-apiserver:v1.17.9          
    kubesphere/kube-scheduler:v1.17.9          
    kubesphere/kube-proxy:v1.17.9              
    kubesphere/kube-controller-manager:v1.17.9 
    kubesphere/kube-apiserver:v1.18.6          
    kubesphere/kube-scheduler:v1.18.6          
    kubesphere/kube-proxy:v1.18.6              
    kubesphere/kube-controller-manager:v1.18.6 
    kubesphere/kube-apiserver:v1.16.13         
    kubesphere/kube-scheduler:v1.16.13         
    kubesphere/kube-proxy:v1.16.13             
    kubesphere/kube-controller-manager:v1.16.13
    kubesphere/kube-apiserver:v1.15.12         
    kubesphere/kube-scheduler:v1.15.12         
    kubesphere/kube-proxy:v1.15.12             
    kubesphere/kube-controller-manager:v1.15.12
    kubesphere/pause:3.1                       
    kubesphere/pause:3.2                       
    kubesphere/etcd:v3.3.12                    
    calico/kube-controllers:v3.15.1            
    calico/node:v3.15.1                        
    calico/cni:v3.15.1                         
    calico/pod2daemon-flexvol:v3.15.1          
    coredns/coredns:1.6.9                      
    kubesphere/k8s-dns-node-cache:1.15.12      
    kubesphere/node-disk-manager:0.5.0         
    kubesphere/node-disk-operator:0.5.0        
    kubesphere/provisioner-localpv:1.10.0      
    kubesphere/linux-utils:1.10.0
    kubesphere/nfs-client-provisioner:v3.1.0-k8s1.11
    
    ##ks-core-images
    kubesphere/ks-apiserver:v3.0.0                  
    kubesphere/ks-console:v3.0.0                    
    kubesphere/ks-controller-manager:v3.0.0         
    kubesphere/ks-installer:v3.0.0                  
    kubesphere/etcd:v3.2.18                         
    kubesphere/kubectl:v1.0.0
    kubesphere/ks-upgrade:v3.0.0
    kubesphere/ks-devops:flyway-v3.0.0                       
    redis:5.0.5-alpine                              
    alpine:3.10.4                                   
    haproxy:2.0.4                                   
    mysql:8.0.11                                    
    nginx:1.14-alpine                               
    minio/minio:RELEASE.2019-08-07T01-59-21Z        
    minio/mc:RELEASE.2019-08-07T23-14-43Z           
    mirrorgooglecontainers/defaultbackend-amd64:1.4 
    kubesphere/nginx-ingress-controller:0.24.1      
    osixia/openldap:1.3.0                           
    csiplugin/snapshot-controller:v2.0.1            
    kubesphere/kubefed:v0.3.0                       
    kubesphere/tower:v0.1.0                         
    kubesphere/prometheus-config-reloader:v0.38.3   
    kubesphere/prometheus-operator:v0.38.3          
    prom/alertmanager:v0.21.0                       
    prom/prometheus:v2.20.1                         
    kubesphere/node-exporter:ks-v0.18.1             
    jimmidyson/configmap-reload:v0.3.0              
    kubesphere/notification-manager-operator:v0.1.0 
    kubesphere/notification-manager:v0.1.0          
    kubesphere/metrics-server:v0.3.7                
    kubesphere/kube-rbac-proxy:v0.4.1               
    kubesphere/kube-state-metrics:v1.9.6
    
    ##ks-logging-images                 
    kubesphere/elasticsearch-oss:6.7.0-1      
    kubesphere/elasticsearch-curator:v5.7.6 
    kubesphere/fluentbit-operator:v0.2.0       
    kubesphere/fluentbit-operator:migrator     
    kubesphere/fluent-bit:v1.4.6             
    elastic/filebeat:6.7.0  
    kubesphere/kube-auditing-operator:v0.1.0   
    kubesphere/kube-auditing-webhook:v0.1.0    
    kubesphere/kube-events-exporter:v0.1.0     
    kubesphere/kube-events-operator:v0.1.0     
    kubesphere/kube-events-ruler:v0.1.0        
    kubesphere/log-sidecar-injector:1.1
    docker:19.03
    
    ##istio-images
    istio/citadel:1.4.8                         
    istio/galley:1.4.8                          
    istio/kubectl:1.4.8                         
    istio/mixer:1.4.8                           
    istio/pilot:1.4.8                           
    istio/proxyv2:1.4.8                         
    istio/sidecar_injector:1.4.8                
    jaegertracing/jaeger-agent:1.17             
    jaegertracing/jaeger-collector:1.17         
    jaegertracing/jaeger-operator:1.17.1        
    jaegertracing/jaeger-query:1.17
    jaegertracing/jaeger-es-index-cleaner:1.17.1
    
    ##ks-devops-images
    jenkins/jenkins:2.176.2                     
    jenkins/jnlp-slave:3.27-1                   
    kubesphere/jenkins-uc:v3.0.0                
    kubesphere/s2ioperator:v2.1.1               
    kubesphere/s2irun:v2.1.1                    
    kubesphere/builder-base:v2.1.0              
    kubesphere/builder-nodejs:v2.1.0            
    kubesphere/builder-maven:v2.1.0             
    kubesphere/builder-go:v2.1.0                
    kubesphere/s2i-binary:v2.1.0                
    kubesphere/tomcat85-java11-centos7:v2.1.0   
    kubesphere/tomcat85-java11-runtime:v2.1.0   
    kubesphere/tomcat85-java8-centos7:v2.1.0    
    kubesphere/tomcat85-java8-runtime:v2.1.0    
    kubesphere/java-11-centos7:v2.1.0           
    kubesphere/java-8-centos7:v2.1.0            
    kubesphere/java-8-runtime:v2.1.0            
    kubesphere/java-11-runtime:v2.1.0           
    kubesphere/nodejs-8-centos7:v2.1.0          
    kubesphere/nodejs-6-centos7:v2.1.0          
    kubesphere/nodejs-4-centos7:v2.1.0          
    kubesphere/python-36-centos7:v2.1.0         
    kubesphere/python-35-centos7:v2.1.0         
    kubesphere/python-34-centos7:v2.1.0         
    kubesphere/python-27-centos7:v2.1.0
    kubesphere/notification:flyway_v2.1.2       
    kubesphere/notification:v2.1.2              
    kubesphere/alert-adapter:v3.0.0             
    kubesphere/alerting-dbinit:v3.0.0           
    kubesphere/alerting:v2.1.2
    
    ##openpitrix-images
    openpitrix/generate-kubeconfig:v0.5.0       
    openpitrix/openpitrix:flyway-v0.5.0         
    openpitrix/openpitrix:v0.5.0                
    openpitrix/release-app:v0.5.0
    
    ##example-images
    kubesphere/examples-bookinfo-productpage-v1:1.13.0
    kubesphere/examples-bookinfo-reviews-v1:1.13.0
    kubesphere/examples-bookinfo-reviews-v2:1.13.0
    kubesphere/examples-bookinfo-reviews-v3:1.13.0
    kubesphere/examples-bookinfo-details-v1:1.13.0
    kubesphere/examples-bookinfo-ratings-v1:1.13.0
    busybox:1.31.1
    joosthofman/wget:1.0
    kubesphere/netshoot:v1.0
    nginxdemos/hello:plain-text
    wordpress:4.8-apache
    mirrorgooglecontainers/hpa-example:latest
    java:openjdk-8-jre-alpine
    fluent/fluentd:v1.4.2-2.0
    perl:latest
    
    ##csi-images
    csiplugin/csi-neonsan:v1.2.0 
    csiplugin/csi-neonsan-ubuntu:v1.2.0
    csiplugin/csi-neonsan-centos:v1.2.0
    csiplugin/csi-provisioner:v1.5.0
    csiplugin/csi-attacher:v2.1.1
    csiplugin/csi-resizer:v0.4.0
    csiplugin/csi-snapshotter:v2.0.1
    csiplugin/csi-node-driver-registrar:v1.2.0
    csiplugin/csi-qingcloud:v1.2.0

## 官网链接 ##

[https://kubesphere.com.cn/docs/installing-on-kubernetes/on-prem-kubernetes/install-ks-on-linux-airgapped/][https_kubesphere.com.cn_docs_installing-on-kubernetes_on-prem-kubernetes_install-ks-on-linux-airgapped]

[Link 1]: https://kubesphere.com.cn/docs/installing-on-kubernetes/introduction/prerequisites/
[Link 2]: https://docs.docker.com/registry/insecure/#use-self-signed-certificates
[34130e432cda60d4ba4490ca62023df9.png]: https://img-blog.csdnimg.cn/img_convert/34130e432cda60d4ba4490ca62023df9.png
[fdisk]: https://www.computerhope.com/unix/fdisk.htm
[Link 3]: https://kubesphere.com.cn/docs/installing-on-kubernetes/on-prem-kubernetes/install-ks-on-linux-airgapped/#kubesphere-v300-%E9%95%9C%E5%83%8F%E6%B8%85%E5%8D%95
[Link 4]: https://kubesphere.com.cn/docs/pluggable-components/
[kubesphere]: https://img-blog.csdnimg.cn/img_convert/6d6a5483b3df32e7bcb9dd32178ae244.png
[https_kubesphere.com.cn_docs_installing-on-kubernetes_on-prem-kubernetes_install-ks-on-linux-airgapped]: https://kubesphere.com.cn/docs/installing-on-kubernetes/on-prem-kubernetes/install-ks-on-linux-airgapped/