基于Keepalived的二层负载均衡架构（3）——优化第二层lnmp架构，添加memcache与openresty加快服务器响应速率

偏执的太偏执、 2023-07-07 11:14 9阅读 0赞

### 文章目录 ###

*   *  一、前言
     *   *   *  实验思想
             *  实验环境
     *  二、添加memcache缓存优化
     *   *   *  测试
     *  三、添加openresty，实现缓存前移
     *   *   *  测试

## 一、前言 ##

#### 实验思想 ####

上一篇部署了Keepalived两台主备模式主机构成第一层负载均衡架构，第二层web服务器nginx负载均衡架构，轮询提供服务并将web服务器配置成lnmp架构，本次实验将添加memcache缓存，加速客户读访问响应速度并配置openresty实现缓存前移，使服务器性能更高。

#### 实验环境 ####

<table> 
 <thead> 
  <tr> 
   <th>主机名</th> 
   <th>ip</th> 
   <th>服务</th> 
   <th>版本</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>server1</td> 
   <td>172.25.1.101</td> 
   <td>nginx</td> 
   <td>rhel6.5</td> 
  </tr> 
  <tr> 
   <td>server2</td> 
   <td>172.25.1.102</td> 
   <td>nginx</td> 
   <td>rhel6.5</td> 
  </tr> 
  <tr> 
   <td>server3</td> 
   <td>172.25.1.1</td> 
   <td>keepalived主</td> 
   <td>rhel7.3</td> 
  </tr> 
  <tr> 
   <td>server4</td> 
   <td>172.25.1.2</td> 
   <td>keepalived备</td> 
   <td>rhel7.3</td> 
  </tr> 
  <tr> 
   <td>真机</td> 
   <td>172.25.1.250</td> 
   <td>客户端，测试用</td> 
   <td>rhel7.3</td> 
  </tr> 
 </tbody> 
</table>

## 二、添加memcache缓存优化 ##

在server1上：  
步骤一：在网上下载memcache安装包，并解压

tar zxf memcache-2.2.5.tgz

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70]  
步骤二：将之前PHP编译完成的二进制命令加入到环境变量中，可以直接调用PHP命令

vim ~/.bash_profile 
    PATH=$PATH:$HOME/bin:/usr/local/lnmp/mysql/bin:/usr/local/lnmp/php/bin
    
    source ~/.bash_profile

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 1]  
步骤三：创建编译环境

memcache目录中本来没有configure文件，所以没法编译，执行phpize，生成configure文件后就可以编译了。

*  phpize是用来扩展php扩展模块的，通过phpize可以建立php的外挂模块，比如你想在原来编译好的php中加入memcached或者ImageMagick等扩展模块，可以使用phpize。或者说，phpize的作用可以这样理解：侦测环境(phpize工具是在php安装目录下,基于这点phpize对应了当时的php环境，所以是要根据该php的配置情况生成对应的configure文件)，建立一个configure文件。必须在一个目录下去运行phpize。那么phpize就知道你的的环境是哪个目录，并且configure文件建立在该目录下。

cd memcache-2.2.5
    phpize

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 2]  
步骤四：编译安装

./configure 
    make && make install

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 3]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 4]  
步骤五：更改php主配置文件，增加memcache模块

vim /usr/local/lnmp/php/etc/php.ini
     874 extension=memcache.so  #手动添加
    /etc/init.d/php-fpm reload

![在这里插入图片描述][20200218113829639.png]![在这里插入图片描述][20200218113900379.png]  
步骤六：查看php中是否加入memcache模块

php -m | grep memcache

![在这里插入图片描述][20200218113920813.png]  
步骤七：安装memcache工具，开启memcache服务

yum install -y memcached  #安装这个服务，提供接口11211客户才能用（之前只是一个模块）
    vim /etc/sysconfig/memcached
    #如果在配置文件最后一行加入：-l 127.0.0.1则表示监听本机11211端口，不加对所有
    /etc/init.d/memcached start   #开启memcache
    netstat -antuple  #可以看到11211端口开启

![在这里插入图片描述][20200218113945651.png]![在这里插入图片描述][20200218114036529.png]![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 5]![在这里插入图片描述][20200218114207997.png]

步骤八：拷贝memcache.php和example.php页面到nginx默认发布目录下，并做修改

example.php 文件不做修改，是客户端访问时查询缓存的策略文件

cp memcache.php example.php /usr/local/lnmp/nginx/html/
    cd /usr/local/lnmp/nginx/html/
    vim memcache.php 
     22 define('ADMIN_USERNAME','memcache');    // Admin Username（自定义）
     23 define('ADMIN_PASSWORD','redhat');      // Admin Password（自定义）
    
     28 $MEMCACHE_SERVERS[] = '172.25.1.101:11211'; // add more as an array
     29 $MEMCACHE_SERVERS[] = '172.25.1.102:11211'; // add more as an array
    
    ##添加两台主机，可以同时监控两台主机缓存情况。memcache没有转发或负载均衡机制，只能一个一个添加

![在这里插入图片描述][20200218115002343.png]![在这里插入图片描述][20200222202236972.png]  
在真机（客户端）上：  
浏览器搜索http://172.25.1.100/memcache.php，可以查看memcache命中率  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 6]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 7]![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 8]在server2上：  
步骤一：在网上下载memcache安装包，并解压

tar zxf memcache-2.2.5.tgz

![在这里插入图片描述][20200222202756377.png]  
步骤二：将之前PHP编译完成的二进制命令加入到环境变量中，可以直接调用PHP命令

vim ~/.bash_profile 
    PATH=$PATH:$HOME/bin:/usr/local/lnmp/mysql/bin:/usr/local/lnmp/php/bin
    
    source ~/.bash_profile

![在这里插入图片描述][20200222202820821.png]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 1]  
步骤三：创建编译环境

cd memcache-2.2.5
    phpize

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 9]  
步骤四：编译安装

./configure 
    make && make install

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 10]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 11]  
步骤五：更改php主配置文件，增加memcache模块

vim /usr/local/lnmp/php/etc/php.ini
     874 extension=memcache.so  #手动添加
    /etc/init.d/php-fpm reload

![在这里插入图片描述][20200218113829639.png]![在这里插入图片描述][20200222203129547.png]  
步骤六：查看php中是否加入memcache模块

php -m | grep memcache

![在这里插入图片描述][20200222203134491.png]  
步骤七：安装memcache工具，开启memcache服务

![在这里插入图片描述][20200218113945651.png]![在这里插入图片描述][20200218114036529.png]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 12]  
![在这里插入图片描述][20200218114207997.png]

步骤八：拷贝memcache.php和example.php页面到nginx默认发布目录下，并做修改

example.php 文件不做修改，是客户端访问时查询缓存的策略文件

![在这里插入图片描述][20200222203252564.png]  
!\[在这![在这里插入图片描述][20200222202236972.png]

#### 测试 ####

在真机（客户端）上：  
刷新页面：  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 13]  
再打开一个页面访问http://172.25.1.101/example.php，这个就相当于客户访问nginx（web服务器）的资源  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 14]  
客户访问172.25.1.101/example.php一次，存入缓存中，172.25.1.100/memcache.php的显示的缓存命中就会随之增多  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 15]客户访问172.25.1.102/example.php  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 16]刷新172.25.1.100/memcache.php页面：  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 17]在server1上：  
添加index.php默认发布页面  
![在这里插入图片描述][20200222204510425.png]在server1上：  
添加index.php默认发布页面  
![在这里插入图片描述][20200222204516940.png]  
客户端压力测试：

ab -c 10 -n 5000 http://172.25.1.100/index.php #10个并发，5000个请求
    #很慢，因为没有缓存,去后端加载数据。而且failed比较多

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 18]

ab -c 10 -n 5000 http://172.25.1.100/example.php #10个并发，5000个请求
    #很快，因为访问缓存，而且没有failed

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 19]

## 三、添加openresty，实现缓存前移 ##

在server1上：  
步骤一：先关闭之前配置好的nginx，因为openresty是一个类似于nginx的服务，调用都是80端口

nginx -s stop
    netstat -antuple

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 20]  
步骤二：在网上下载openresty安装包

tar zxf openresty-1.13.6.1.tar.gz

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 21]  
步骤三：编译安装

cd openresty-1.13.6.1
    ./configure --prefix=/usr/local/openresty
    gmake && gmake install

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 22]![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 23]  
步骤四：拷贝memcache压缩包自带的php文件到openresty默认发布

cd /usr/local/openresty/nginx/html
    cp /usr/local/lnmp/nginx/html/index.php .
    cp /usr/local/lnmp/nginx/html/example.php .

![在这里插入图片描述][20200218152359658.png]  
步骤五：编辑openresty的nginx配置文件

注意：配置文件第一行，必须设置nginx用户

vim /usr/local/openresty/nginx/conf/nginx.conf
      2 user  nginx nginx;
      3 worker_processes  1;
    
    17  http {
        
    18         upstream memcache {
        
    19         server localhost:11211;
    20         keepalive 512;
    21         }
    22 	
    	#upstream属于handler，只是他不产生自己的内容，而是通过请求后端服务器得到内容，所以才称为upstream（上游）。请求并取得响应内容的整个过程已经被封装到nginx内部，所以upstream模块只需要开发若干回调函数，完成构造请求和解析响应等具体的工作。
    	# nginx将memcache缓存前移，客户端请求到来，先查看memcache缓存
    
    23     include       mime.types;
    24     default_type  application/octet-stream;
    
    69         location /memc {
        
    70                 internal;   # 只接收内部访问，不接受外部http访问。比较安全
    71                 memc_connect_timeout 100ms;
    72                 memc_send_timeout 100ms;  # 后端服务器数据回传时间
    73                 memc_read_timeout 100ms;  # 连接成功后，后端服务器响应时间
    74                 set $memc_key $query_string;  # 键值对的形式存储
    75                 set $memc_exptime 300;
    76                 memc_pass memcache;
    77         }
    78 
    79         location ~ \.php$ {
        
    80             set $key $uri$args; 
                  # http的GET方法表示get、PUT方法表示set
    81             srcache_fetch GET /memc $key;
    82             srcache_store PUT /memc $key;
    				# 这两个配置的作用是：请求php页面时，先会去memcache中找，如果没有，正常访问；访问结束后将结果存到memcache，下次访问时直接从缓存中
    83             root           html;
    84             fastcgi_pass   127.0.0.1:9000;
    85             fastcgi_index  index.php;
    86         #    fastcgi_param  SCRIPT_FILENAME  /scripts$fastcgi_script_name;
    87             include        fastcgi.conf;
    88         }

![在这里插入图片描述][20200222212505365.png]  
![在这里插入图片描述][20200218152414757.png]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 24]  
步骤六：检查语法规范并开启nginx服务

/usr/local/openresty/nginx/sbin/nginx -t
    /usr/local/openresty/nginx/sbin/nginx
    netstat -antuple

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 25]  
步骤七： 复制之前更改过的/usr/local/lnmp/nginx/html/memcache.php到/usr/local/openresty/nginx/html目录下

cp /usr/local/lnmp/nginx/html/memcache.php  /usr/local/openresty/nginx/html

![在这里插入图片描述][20200218152515307.png]在server2上：  
步骤一：先关闭之前配置好的nginx，因为openresty是一个类似于nginx的服务，调用都是80端口

nginx -s stop
    netstat -antuple

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 26]  
步骤二：在网上下载openresty安装包

tar zxf openresty-1.13.6.1.tar.gz

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 27]  
步骤三：编译安装

cd openresty-1.13.6.1
    ./configure --prefix=/usr/local/openresty
    gmake && gmake install

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 28]![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 29]  
步骤四：拷贝memcache压缩包自带的php文件到openresty默认发布

cd /usr/local/openresty/nginx/html
    cp /usr/local/lnmp/nginx/html/index.php .
    cp /usr/local/lnmp/nginx/html/example.php .

![在这里插入图片描述][20200222212923219.png]  
步骤五：编辑openresty的nginx配置文件

注意：配置文件第一行，必须设置nginx用户

/usr/local/openresty/nginx/sbin/nginx -t
    /usr/local/openresty/nginx/sbin/nginx
    netstat -antuple

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 30]  
步骤七： 复制之前更改过的/usr/local/lnmp/nginx/html/memcache.php到/usr/local/openresty/nginx/html目录下

cp /usr/local/lnmp/nginx/html/memcache.php  /usr/local/openresty/nginx/html

![在这里插入图片描述][20200222213057825.png]

#### 测试 ####

在真机上：  
打开浏览器访问http://172.25.1.100/memcache.php，可查看缓存命中率  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 31]

模拟5000请求量测试命中率和访问时间：

ab -c 10 -n 5000 http://172.25.1.100/index.php
    ab -c 10 -n 5000 http://172.25.1.100/example.php

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 32]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 33]  
可以看出访问的是openstry，且访问速度明显比memcache单独作用加快。index.php页面没有缓存，openstry去后端取数据，访问速度也比之前加快，并且失败访问减少了。

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70]: https://img-blog.csdnimg.cn/20200218113612491.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 1]: https://img-blog.csdnimg.cn/20200218113651765.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 2]: https://img-blog.csdnimg.cn/20200218113722393.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 3]: https://img-blog.csdnimg.cn/20200218113743234.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 4]: https://img-blog.csdnimg.cn/20200218113806621.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[20200218113829639.png]: https://img-blog.csdnimg.cn/20200218113829639.png
[20200218113900379.png]: https://img-blog.csdnimg.cn/20200218113900379.png
[20200218113920813.png]: https://img-blog.csdnimg.cn/20200218113920813.png
[20200218113945651.png]: https://img-blog.csdnimg.cn/20200218113945651.png
[20200218114036529.png]: https://img-blog.csdnimg.cn/20200218114036529.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 5]: https://img-blog.csdnimg.cn/20200218114131132.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[20200218114207997.png]: https://img-blog.csdnimg.cn/20200218114207997.png
[20200218115002343.png]: https://img-blog.csdnimg.cn/20200218115002343.png
[20200222202236972.png]: https://img-blog.csdnimg.cn/20200222202236972.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 6]: https://img-blog.csdnimg.cn/2020021811524355.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 7]: https://img-blog.csdnimg.cn/20200218115322585.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 8]: https://img-blog.csdnimg.cn/2020022220242234.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[20200222202756377.png]: https://img-blog.csdnimg.cn/20200222202756377.png
[20200222202820821.png]: https://img-blog.csdnimg.cn/20200222202820821.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 9]: https://img-blog.csdnimg.cn/20200222202941874.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 10]: https://img-blog.csdnimg.cn/20200222203026801.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 11]: https://img-blog.csdnimg.cn/20200222203108187.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[20200222203129547.png]: https://img-blog.csdnimg.cn/20200222203129547.png
[20200222203134491.png]: https://img-blog.csdnimg.cn/20200222203134491.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 12]: https://img-blog.csdnimg.cn/20200222203221819.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[20200222203252564.png]: https://img-blog.csdnimg.cn/20200222203252564.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 13]: https://img-blog.csdnimg.cn/20200222203441488.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 14]: https://img-blog.csdnimg.cn/20200218115419370.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 15]: https://img-blog.csdnimg.cn/20200222203524484.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 16]: https://img-blog.csdnimg.cn/20200222203729154.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 17]: https://img-blog.csdnimg.cn/20200222204353185.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[20200222204510425.png]: https://img-blog.csdnimg.cn/20200222204510425.png
[20200222204516940.png]: https://img-blog.csdnimg.cn/20200222204516940.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 18]: https://img-blog.csdnimg.cn/20200222204621817.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 19]: https://img-blog.csdnimg.cn/20200222204700475.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 20]: https://img-blog.csdnimg.cn/20200218152203346.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 21]: https://img-blog.csdnimg.cn/2020021815222830.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 22]: https://img-blog.csdnimg.cn/20200218152307491.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 23]: https://img-blog.csdnimg.cn/20200218152326213.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[20200218152359658.png]: https://img-blog.csdnimg.cn/20200218152359658.png
[20200222212505365.png]: https://img-blog.csdnimg.cn/20200222212505365.png
[20200218152414757.png]: https://img-blog.csdnimg.cn/20200218152414757.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 24]: https://img-blog.csdnimg.cn/2020021815241989.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 25]: https://img-blog.csdnimg.cn/20200218152448425.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[20200218152515307.png]: https://img-blog.csdnimg.cn/20200218152515307.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 26]: https://img-blog.csdnimg.cn/2020022221265996.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 27]: https://img-blog.csdnimg.cn/20200222212812109.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 28]: https://img-blog.csdnimg.cn/20200222212855784.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 29]: https://img-blog.csdnimg.cn/20200222212859145.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[20200222212923219.png]: https://img-blog.csdnimg.cn/20200222212923219.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 30]: https://img-blog.csdnimg.cn/20200222213026756.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[20200222213057825.png]: https://img-blog.csdnimg.cn/20200222213057825.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 31]: https://img-blog.csdnimg.cn/20200222213135494.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 32]: https://img-blog.csdnimg.cn/20200222214008134.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ_size_16_color_FFFFFF_t_70 33]: https://img-blog.csdnimg.cn/20200222213932114.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NhcGVqYXNtaW5lWQ==,size_16,color_FFFFFF,t_70