Jenkins—— Jenkins+Docker+SpringCloud微服务持续集成项目优化和集群

素颜马尾好姑娘i 2023-01-20 08:11 662阅读 0赞

### Jenkins+Docker+SpringCloud微服务持续集成项目的优化 ###

*  前言
 *  Jenkins+Docker+SpringCloud集群部署流程优化
 *   *  修改所有微服务的配置
     *   *  修改eruka的配置
         *  修改zuul、admin\_service、gathering的配置
     *  设计Jenkins集群项目的构建参数
     *  编写多选项遍历Jenkins脚本
     *   *  多选项进行代码审查
         *  完成多选项微服务构建、上传镜像
         *  完成微服务多服务器远程部署
         *  总结错误
         *  将剩下三个微服务同时部署到两个服务器上
     *  Nginx+Zuul集群实现高可用网关

# 前言 #

这篇笔记是作为[上一章][Link 1]项目进行的优化

优化方案：

1.  在一个Jenkins工程中可以选择多个微服务同时发布
2.  在一个Jenkins工程中可以选择多台生产服务器同时部署
3.  每个微服务都是以集群高可用形式部署

# Jenkins+Docker+SpringCloud集群部署流程优化 #

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70_pic_center]

*  部署服务的时候不再手动一个一个去构建，通过循环一次构建
 *  通过集群的方式实现负载均衡

## 修改所有微服务的配置 ##

### 修改eruka的配置 ###

需要实现一个相互注册的功能  
修改eureka\_server的配置

spring:
      application:
        name: EUREKA-HA
    
    ---
    server:
      port: 10086
    spring:
      # 指定profile=eureka-server1
      profiles: eureka-server1
    eureka:
      instance:
        # 指定当profile=eureka-server1时，主机名是eureka-server1
        hostname: 47.108.189.123
      client:
        service-url:
          # 将自己注册到eureka-server1、eureka-server2这个Eureka上面去
          defaultZone: http://47.108.189.123:10086/eureka/,http://47.108.190.228:10086/eureka/
    
    ---
    server:
      port: 10086
    spring:
      profiles: eureka-server2
    eureka:
      instance:
        hostname: 47.108.190.228
      client:
        service-url:
          defaultZone: http://47.108.189.123:10086/eureka/,http://47.108.190.228:10086/eureka/

在启动微服务的时候，加入参数: `spring.profiles.active` 来读取对应的配置

然后其他服务只需更改注册地址

### 修改zuul、admin\_service、gathering的配置 ###

就是在配置里由原先一台增加到两台服务器的地址

http://47.108.189.123:10086/eureka/,http://47.108.190.228:10086/eureka/

将修改的文件上传仓库  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70]

## 设计Jenkins集群项目的构建参数 ##

创建流水线项目(集群版)  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 1]

选择SCM  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 2]  
因为要进行多项选择，所以需要插件`Extended Choice Parameter`  
安装`Extended Choice Parameter`插件

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 3]

进入流水线项目  
先添加一个普通的字符串参数  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 4]  
再添加多选参数

![在这里插入图片描述][20210512170633245.png]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 5]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 6]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 7]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 8]  
点击保存之后去构建项目  
这里出现了可以多选择的效果  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 9]

## 编写多选项遍历Jenkins脚本 ##

### 多选项进行代码审查 ###

其实改变的地方就是

*  使用`split(“,”)`分隔项目名称（因为是以,号分隔的）
 *  代码审查里面，需要使用遍历循环去检测每个服务的代码
 *  for循环遍历多选的服务，`lenght`获取长度
 *  因为项目名称@端口，所以需要分别获取名称和端口，用于sonarqube进入相应的空间

上传jenkinsfile到仓库之后通过多选构建项目

先进行两个项目的测试  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 10]  
进行eruka的审查  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 11]  
进行了zuul的审查  
![在这里插入图片描述][2021051217341069.png]  
因为只是为了测试遍历选项是否成功，后面会构建失败，所以不用担心

### 完成多选项微服务构建、上传镜像 ###

这一步进行镜像的构建和上传，因为可以先把部署应用的代码注释

// git凭证ID
    def git_auth = "41580d48-d4c3-4116-9a71-4d4d777c5753"
    // git的url地址
    def git_url = "git@192.168.188.110:maomao_group/tensquare_back.git"
    // 镜像的版本号
    def tag = "latest"
    // Harbor的url地址
    def harbor_url = "192.168.188.115:85"
    // 镜像库项目名称
    def harbor_project = "tensquare"
    // Harbor的登录凭据ID
    def harbor_auth = "c0e6642d-bab9-4978-be45-955e5130fae2"
    
    node {
        
        // 获取当前选择的项目名称
        def selectedProjectNames = "${project_name}".split(",")
    
       stage('拉取代码') {
        
          checkout([$class: 'GitSCM', branches: [[name: "*/${branch}"]], extensions: [], userRemoteConfigs: [[credentialsId: "${git_auth}", url: "${git_url}"]]])
       }
       stage('代码审查') {
        
            for(int i=0;i<selectedProjectNames.length;i++){
        
                // tensquare_eureka_server@10086
                def  projectInfo = selectedProjectNames[i];
                // 当前遍历的项目名称
                def currentProjectName = "${projectInfo}".split("@")[0]
                // 当前遍历的项目端口
                def currentProjectPort = "${projectInfo}".split("@")[1]
    
                //定义了当前Jenkins的SonarQubeScanner工具环境     在全局工具配置里查看
                def scannerHome = tool 'sonar-scanner'
                //引用当前JenkinsSonarQube环境    在系统配置里查看
                withSonarQubeEnv('sonarqube') {
        
                     sh """
                           cd ${currentProjectName}
                           ${scannerHome}/bin/sonar-scanner
                     """
                }
            }
       }
       stage('编译，安装公共子工程') {
        
            sh "mvn -f tensquare_common clean install"
       }
       stage('编译，安装公共子工程，上传镜像') {
        
            for(int i=0;i<selectedProjectNames.length;i++){
        
                 // tensquare_eureka_server@10086
                 def  projectInfo = selectedProjectNames[i];
                 // 当前遍历的项目名称
                 def currentProjectName = "${projectInfo}".split("@")[0]
                 // 当前遍历的项目端口
                 def currentProjectPort = "${projectInfo}".split("@")[1]
    
                 sh "mvn -f ${currentProjectName} clean package dockerfile:build"
    
                 //定义镜像名称
                 def imageName = "${currentProjectName}:${tag}"
    
                 //对镜像打上标签
                 sh "docker tag ${imageName} ${harbor_url}/${harbor_project}/${imageName}"
    
                 //把镜像推送到Harbor
                 withCredentials([usernamePassword(credentialsId: "${harbor_auth}", passwordVariable: 'password', usernameVariable: 'username')]) {
        
                 // 登录到Harbor
                 sh "docker login -u ${username} -p ${password} ${harbor_url}"
    
                 // 镜像上传
                 sh "docker push ${harbor_url}/${harbor_project}/${imageName}"
    
                 sh "echo 镜像上传成功啦"
                 }
    
             // 部署项目
             // sshPublisher(publishers: [sshPublisherDesc(configName: 'tomcat_server', transfers: [sshTransfer(cleanRemote: false, excludes: '', execCommand: "/opt/jenkins_shell/deploy.sh $harbor_url $harbor_project $project_name $tag $port", execTimeout: 120000, flatten: false, makeEmptyDirs: false, noDefaultExcludes: false, patternSeparator: '[, ]+', remoteDirectory: '', remoteDirectorySDF: false, removePrefix: '', sourceFiles: '')], usePromotionTimestamp: false, useWorkspaceInPromotion: false, verbose: false)])
            }
    
       }
    
    }

*  可以将代码审查的循环直接拿到构建镜像那里使用
 *  修改项目名称为变量就行了

进行测试  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 12]  
成功了，说明循环遍历没问题  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 13]

### 完成微服务多服务器远程部署 ###

这时候，我们需要添加第二台远程tomcat服务器

进入jenkins系统配置，找到Publish over SSH，新增一台SSH Server

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 14]

拷贝公钥到远程服务器
    ssh-copy-id 192.168.188.114

点击测试连接，显示Success表示远程连接成功![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 15]

vim /etc/docker/daemon.json
    
    {
        
    "registry-mirrors": ["https://zydiol88.mirror.aliyuncs.com"],
    "insecure-registries": ["192.168.188.115:85"]
    }
    
    systemctl restart docker

在流水线项目里添加多选参数  
![在这里插入图片描述][20210512180258677.png]  
和之前一样，因此不在多做描述  
![在这里插入图片描述][20210512180450898.png]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 16]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 17]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 18]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 19]  
保存之后，进行Jenkinsfile的编写

// git凭证ID
    def git_auth = "41580d48-d4c3-4116-9a71-4d4d777c5753"
    // git的url地址
    def git_url = "git@192.168.188.110:maomao_group/tensquare_back.git"
    // 镜像的版本号
    def tag = "latest"
    // Harbor的url地址
    def harbor_url = "192.168.188.115:85"
    // 镜像库项目名称
    def harbor_project = "tensquare"
    // Harbor的登录凭据ID
    def harbor_auth = "c0e6642d-bab9-4978-be45-955e5130fae2"
    
    node {
        
        // 获取当前选择的项目名称
        def selectedProjectNames = "${project_name}".split(",")
        // 获取当前选择的服务器名称
        def selectedServers = "${publish_server}".split(",")
    
       stage('拉取代码') {
        
          checkout([$class: 'GitSCM', branches: [[name: "*/${branch}"]], extensions: [], userRemoteConfigs: [[credentialsId: "${git_auth}", url: "${git_url}"]]])
       }
       stage('代码审查') {
        
            for(int i=0;i<selectedProjectNames.length;i++){
        
                // tensquare_eureka_server@10086
                def  projectInfo = selectedProjectNames[i];
                // 当前遍历的项目名称
                def currentProjectName = "${projectInfo}".split("@")[0]
                // 当前遍历的项目端口
                def currentProjectPort = "${projectInfo}".split("@")[1]
    
                //定义了当前Jenkins的SonarQubeScanner工具环境     在全局工具配置里查看
                def scannerHome = tool 'sonar-scanner'
                //引用当前JenkinsSonarQube环境    在系统配置里查看
                withSonarQubeEnv('sonarqube') {
        
                     sh """
                           cd ${currentProjectName}
                           ${scannerHome}/bin/sonar-scanner
                     """
                }
            }
       }
       stage('编译，安装公共子工程') {
        
            sh "mvn -f tensquare_common clean install"
       }
       stage('编译，安装公共子工程，上传镜像') {
        
            for(int i=0;i<selectedProjectNames.length;i++){
        
                 // tensquare_eureka_server@10086
                 def  projectInfo = selectedProjectNames[i];
                 // 当前遍历的项目名称
                 def currentProjectName = "${projectInfo}".split("@")[0]
                 // 当前遍历的项目端口
                 def currentProjectPort = "${projectInfo}".split("@")[1]
    
                 sh "mvn -f ${currentProjectName} clean package dockerfile:build"
    
                 //定义镜像名称
                 def imageName = "${currentProjectName}:${tag}"
    
                 //对镜像打上标签
                 sh "docker tag ${imageName} ${harbor_url}/${harbor_project}/${imageName}"
    
                 //把镜像推送到Harbor
                 withCredentials([usernamePassword(credentialsId: "${harbor_auth}", passwordVariable: 'password', usernameVariable: 'username')]) {
        
                 // 登录到Harbor
                 sh "docker login -u ${username} -p ${password} ${harbor_url}"
    
                 // 镜像上传
                 sh "docker push ${harbor_url}/${harbor_project}/${imageName}"
    
                 sh "echo 镜像上传成功啦"
                 }
    
             // 遍历所有服务器，分别部署
             for(int j=0;j<selectedServers.length;j++) {
        
                    // 获取当前遍历的服务器名称
                    def currentServerName = selectedServers[j]
    
                    // 加上的参数格式: --spring.profiles.active=eureka-server1/eureka-server2
                    def activeProfile = "--spring.profiles.active="
    
                    // 根据不同的服务名称来读取不同的Eureka配置信息
                   if(currentServerName=="tomcat_server") {
        
                        activeProfile = activeProfile+"eureka-server1"
                   }else if(currentServerName=="tompig_server"){
        
                        activeProfile = activeProfile+"eureka-server2"
                   }
    
                    // 部署项目
                    sshPublisher(publishers: [sshPublisherDesc(configName: "${currentServerName}", transfers: [sshTransfer(cleanRemote: false, excludes: '', execCommand: "/opt/jenkins_shell/deployCluster.sh $harbor_url $harbor_project $currentProjectName $tag $currentProjectPort $activeProfile", execTimeout: 120000, flatten: false, makeEmptyDirs: false, noDefaultExcludes: false, patternSeparator: '[, ]+', remoteDirectory: '', remoteDirectorySDF: false, removePrefix: '', sourceFiles: '')], usePromotionTimestamp: false, useWorkspaceInPromotion: false, verbose: false)])
    
             }
                    echo "${currentProjectName}完成编译，构建镜像"
    
           }
    
       }
    
    }

在之前deploy.sh的基础上再写一个deployCluster.sh脚本

#! /bin/bash
    #接收外部参数
    harbor_url=$1
    harbor_project=$2
    project_name=$3
    tag=$4
    port=$5
    profile=$6
    
    imageName=$harbor_url/$harbor_project/$project_name:$tag
    
    echo "$imageName"
    
    #查询容器是否存在，存在则删除
    containerId=`docker ps -a | grep -w ${
         project_name}:${
         tag}  | awk '{print $1}'`
    if [ "$containerId" !=  "" ] ; then
        #停掉容器
        docker stop $containerId
    
        #删除容器
        docker rm $containerId
    
            echo "成功删除容器"
    fi
    
    #查询镜像是否存在，存在则删除
    imageId=`docker images | grep -w $project_name  | awk '{print $3}'`
    
    if [ "$imageId" !=  "" ] ; then
    
        #删除镜像
        docker rmi -f $imageId
    
            echo "成功删除镜像"
    fi
    
    # 登录Harbor
    docker login -u maomao -p Xiaotian123 $harbor_url
    
    # 下载镜像
    docker pull $imageName
    
    # 启动容器
    docker run -di -p $port:$port $imageName $profile
    
    echo "容器启动成功"

*  只需要再增加一个变量profile 用来存储新增的位置变量activeProfile
 *  在启动容器的时候选择不同的eruka配置

写完之后将脚本传到另一台服务器上

scp deployCluster.sh root@192.168.188.114:/opt/jenkins_shell/
    
    chown +x deployCluster.sh

进行项目的部署，看看能否将两个eruka部署到两台服务器上  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 20]  
构建成功，分别在tomcat和tompig服务器上部署了eruka集群  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 21]  
![在这里插入图片描述][20210512190832483.png]  
![在这里插入图片描述][20210512190841788.png]  
打开浏览器查看集群，分别有两个实例  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 22]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 23]

### 总结错误 ###

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 24]

*  引用变量必须使用" " 我有个变量外边加的’ ’ 导致错误  
    ![在这里插入图片描述][2021051219181464.png]
 *  花括号一定是有开有关，如果少了关也会错  
    ![在这里插入图片描述][20210512191925868.png]
 *  jenkins里流水线配置的变量名和脚本里变量名一定要统一  
    我把流水线变量名改成publish\_server了，结果脚本里没改，导致错误  
    ![在这里插入图片描述][2021051219201637.png]

### 将剩下三个微服务同时部署到两个服务器上 ###

这里就简单了，因为前面已经将所有错都排除了  
只需要构建除eruka之外的其他三个微服务  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 25]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 26]  
所有微服务都部署在两台服务器上了，形成了微服务集群  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 27]

## Nginx+Zuul集群实现高可用网关 ##

这时候需要考虑前端网站怎对接两个网关  
需要通过nginx做负载均衡  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 28]

配置nginx

*  配置负载均衡池，里面地址就是zuul网关地址
 *  proxy\_pass 选择不同的zuulServer

upstream zuulServer{
        
            server 192.168.188.113:10020 weight=1;
            server 192.168.188.114:10020 weight=1;
     }
    server {
        
            listen       85 default_server;
            listen       [::]:85 default_server;
            server_name  _;
            root         /usr/share/nginx/html;
    
            include /etc/nginx/default.d/*.conf;
    
            location / {
        
               proxy_pass http://zuulServer/;
            }

重启Nginx

systemctl restart nginx

修改前端Nginx的访问地址

*  将前端访问地址改成负载均衡器的地址

'use strict'
    module.exports = {
        
      NODE_ENV: '"production"',
      // BASE_API: '"http://192.168.207.131:7300/mock/5c0b42c85b4c7508d4dc568c/1024"'
      BASE_API: '"http://47.108.190.228:85"' // 管理员的网关
    }

修改之后提交代码到仓库  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 29]  
![在这里插入图片描述][20210512205241881.png]  
访问  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 30]

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 31]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 32]  
NICE！ 项目部署成功，前后端能共同工作。  
大功告成！

[Link 1]: https://blog.csdn.net/Cantevenl/article/details/116597423
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70_pic_center]: /images/20221021/c580071de90443e5944927e15709ca1c.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70]: /images/20221021/75f6a2bc8a7e4d67a905413db2592e38.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 1]: /images/20221021/ebf0dbfbdec24822b6435a3fa954dabf.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 2]: /images/20221021/8ad5662916b94f2b889c1927ad0b7f59.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 3]: /images/20221021/921fa0b35c5b4b2f8f92879e943f04fb.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 4]: /images/20221021/4b9db606515641008f26665db0f3b967.png
[20210512170633245.png]: /images/20221021/916db7c799374d04bceb367b4ba55a75.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 5]: /images/20221021/04582af9f454499c811465d23c2eb35f.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 6]: /images/20221021/e59db144934047859e6c3d19e4220165.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 7]: /images/20221021/25d5902a3d1641888e6045f80ff1f49a.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 8]: /images/20221021/d60a88f46c0d4516b671db0b92b8e692.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 9]: /images/20221021/15ff11ecfa304003bdb5a5fe7a31a2b0.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 10]: /images/20221021/e673c71d9c364c6da301e72c4b11db98.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 11]: /images/20221021/a67fcc20e6aa4289a10a29ad73d90e09.png
[2021051217341069.png]: /images/20221021/78ff2ecee17e4da086a988dd17034fff.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 12]: /images/20221021/e7dc9a351fdc43e2abea757407831de2.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 13]: /images/20221021/292fd56097f4483bb946d86b6cf68d74.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 14]: /images/20221021/0361b2c30fd04a57891b04b509aac4b3.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 15]: /images/20221021/620d94383eb94363829c26c486b04577.png
[20210512180258677.png]: /images/20221021/1fba5471fb36459886d31d2ba3d6a615.png
[20210512180450898.png]: /images/20221021/84141585321243e48bd5193027a88a77.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 16]: /images/20221021/a230fd8fd7f64983aad9da7b045abfed.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 17]: /images/20221021/6d6afcb76d6b4655ac6b1cd3a1b405b4.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 18]: /images/20221021/58ba06e924b142ab876f0ec42bfea770.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 19]: /images/20221021/93112e8ce81348608115928e5739caf1.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 20]: /images/20221021/8c903d697f724d7eaef2b5c94392280c.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 21]: /images/20221021/5f945baaf2ac43ea97f9499942c4e688.png
[20210512190832483.png]: /images/20221021/79e4056f4e8149699cb05c60418dd1c9.png
[20210512190841788.png]: /images/20221021/d69e6020e0bd450898f8d8994d6ecd09.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 22]: /images/20221021/8f807e5564344928ba66648949a77efa.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 23]: /images/20221021/a438cd877ea24a8e82b2deb643634edb.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 24]: /images/20221021/284d6848adc24de19846d633bdf68812.png
[2021051219181464.png]: /images/20221021/1102cfab7a594b99b21838a6ccbd5633.png
[20210512191925868.png]: /images/20221021/be2ab6be5eba42e3b3c9f304e1d09b14.png
[2021051219201637.png]: /images/20221021/06aaf58cc8b6407983f9b6a8167279c8.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 25]: /images/20221021/7d71a7da30c048d18c86915f107654af.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 26]: /images/20221021/a8b1af092326465e81e3abde09371a70.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 27]: /images/20221021/c6abc2687e974f1e92a4b947773f2011.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 28]: /images/20221021/21fc130d74444239a58afa822f54e224.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 29]: /images/20221021/b801a4a8206a43cd8b068a69c2e9c6b1.png
[20210512205241881.png]: /images/20221021/0dafed66d0914badbab82d39a35713f7.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 30]: /images/20221021/777e73b1ed104551b4d1df76758e61de.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 31]: /images/20221021/00271d2926c64ff68c8bfdae9cdd2e8c.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhbnRldmVubA_size_16_color_FFFFFF_t_70 32]: /images/20221021/64e2029f4661448fb1bd4224a41055dd.png