RHCS集群套件——ISCSI/SCSI实现存储共享、CLVM/GFS2集群文件系统部署

约定不等于承诺〃 2022-04-24 12:48 310阅读 0赞

此次环境还是基于上篇博客：[RHCS集群套件——Luci/Ricci实现Web高可用集群][RHCS_Luci_Ricci_Web]

### 一、搭建环境 ###

三台redht6.5的虚拟机。

> server1 配置luci集群管理界面，用来配置和管理集群。  
> server1、server2 集群节点，配置ricci。  
> server3 配置共享存储

### 二、搭建步骤 ###

1、server3上安装共享存储所需要的软件（高级yum源）

yum install scsi-* -y

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70]  
server3添加一块新的硬盘设备，用于共享  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 1]

fdisk -l

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 2]  
2、在server1、server2上安装客户端iscsi

yum install iscsi-* -y

server1  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 3]  
server2  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 4]  
3、在server3上配置共享策略，开启服务，查看

vim /etc/tgt/targets.conf 
    
    <target iqn.2019-04.com.example:server.target1>
        backing-store /dev/vdb		#确定共享的磁盘
    </target>

![在这里插入图片描述][20190425113729149.png]

/etc/init.d/tgtd start	#启动服务

![在这里插入图片描述][20190425113826556.png]

tgt-admin -s

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 5]  
4、在server1、server2上查看并激活共享的存储

iscsiadm -m discovery -t st -p 172.25.70.3		#查看共享存储
    iscsiadm -m node -l			#激活共享存储
    fdisk -l

server1  
![在这里插入图片描述][20190425122945793.png]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 6]  
server2  
![在这里插入图片描述][20190425123118854.png]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 7]  
5、在server1、server2上下载mysql

[root@server1 ~]# yum install mysql-server -y
    [root@server2 ~]# yum install mysql-server -y

server1  
![在这里插入图片描述][20190425123534258.png]  
server2  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 8]  
6、格式化共享设备（只在一台设备上操作）

[root@server1 ~]# mkfs.ext4 /dev/sdb

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 9]  
7、在server1、server2上更改mysql目录的权限

server1:

[root@server1 ~]# mount /dev/sdb /var/lib/mysql/
    [root@server1 ~]# ll -d /var/lib/mysql/
    drwxr-xr-x 3 root root 4096 Apr 22 14:20 /var/lib/mysql/
    [root@server1 ~]# chown mysql.mysql /var/lib/mysql/
    [root@server1 ~]# ll -d /var/lib/mysql/
    drwxr-xr-x 3 mysql mysql 4096 Apr 22 14:20 /var/lib/mysql/
    [root@server1 ~]#

server1  
![在这里插入图片描述][20190425123917679.png]  
server2  
![在这里插入图片描述][20190425123925654.png]  
8、检测服务能否正常开启

[root@server1 ~]# /etc/init.d/mysqld start
    [root@server1 ~]# /etc/init.d/mysqld stop
    [root@server1 ~]# umount /dev/sdb

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 10]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 11]  
9、将apache的单线程关掉，并且把apache服务组资源停掉

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 12]  
将Run Exclusive的勾去掉，并且重新submit。  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 13]  
Disabled service Apache  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 14]  
也可以用命令：

clusvcadm -d Apache

10、浏览器配置（先ip后挂载再httpd服务）  
1、在Failover Domains中添加dbfail  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 15]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 16]  
2、在Resources中添加IP Address,File System,Script资源。

IP Address

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 17]  
File System  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 18]  
Script  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 19]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 20]  
3、在Service Groups中添加sql服务组  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 21]

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 22]  
4、开启sql  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 23]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 24]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 25]  
11、测试

[root@server2 ~]# mysql -p
    ===========================
    mysql> SHOW DATABASES;
    mysql> QUIT
    Bye

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 26]

clusvcadm -e Apache		#启动Apache服务组
    clusvcadm -r Apache -m server2	#将Apache服务组切到server2
    clusvcadm -d Apache		#关闭Apache服务组

### 三、CLVM/GFS2集群文件系统部署 ###

前言：

首先将上个实验的apache、sql服务组的资源停掉

clusvcadm -d Apache
    clusvcadm -d sql
    clustat

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 27]  
1、设置CLVM服务开机自启动

lvmconf --enable-cluster
    cat /etc/lvm/lvm.conf | grep locking_type		#为3则自启动

![在这里插入图片描述][20190425131505776.png]  
2、划分物理卷、逻辑卷组、逻辑卷

pvcreate /dev/sdb
    vgcreate clustervg /dev/sdb
    lvcreate -L 4G -n demo clustervg
    lvs

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 28]  
3、格式化逻辑卷为GFS2集群文件系统

[root@server1 ~]# mkfs.gfs2 -t HA:mygfs2 -p lock_dlm -j 2 /dev/clustervg/demo 
    ==============================================================================
    This will destroy any data on /dev/clustervg/demo.
    It appears to contain: symbolic link to `../dm-2'
    
    Are you sure you want to proceed? [y/n] y

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 29]

mkfs.gfs2 
     	-j #: 指定日志区域的个数，有几个就能够被几个节点所挂载； 
     	-J #: 指定日志区域的大小，默认为128MB; 
     	-p { lock_dlm|lock_nolock}：所使用的锁协议名称，集群需要使用lock_dlm； 
     	-t <name>: 锁表的名称
     			   格式为clustername:fsname, clustername为当前节点所在的集群的名称
     			   这也是为什么要使用RHCS；fsname文件系统名称，自定义，要在当前集群惟一，这也叫锁表名称，表明是分布式锁的范围。

gfs2_tool sb /dev/clustervg/demo all

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 30]  
4、挂载设备，更改目录的权限

mount /dev/clustervg/demo /var/lib/mysql/
    ll -d /var/lib/mysql/
    chown mysql.mysql /var/lib/mysql/
    ll -d /var/lib/mysql/
    blkid

![在这里插入图片描述][20190425132723948.png]  
![在这里插入图片描述][20190425132739785.png]  
5、测试多点挂载  
server1：

mount /dev/clustervg/demo /var/lib/mysql/
    [root@server1 mysql]# pwd
    /var/lib/mysql
    [root@server1 mysql]# cp /etc/passwd .
    [root@server1 mysql]# ls
    passwd
    [root@server1 mysql]#

![在这里插入图片描述][20190425133127355.png]  
server2:

[root@server2 ~]# cd /var/lib/mysql/
    [root@server2 mysql]# ls
    passwd
    [root@server2 mysql]#

![在这里插入图片描述][20190425133635682.png]  
![在这里插入图片描述][20190425133847702.png]  
6、将组文件永久挂载在/var/lib/mysql

vim /etc/fstab
    ===============
    UUID="7c3da294-a84f-2f87-3592-c04263b70fa2"     /var/lib/mysql  gfs2    _netdev 0 0		#UUID可以通过blkid查看
    ====================================================================================
    mount -a

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 31]  
7、更改浏览器设置

server1、server2：

更改之前先卸载逻辑卷：

umount /dev/clustervg/demo

先在Service Groups—sql中删除 Filesystem：

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 32]  
修改完，submit，很重要！！

2、删除集群资源中的dbdata![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 33]  
3、重新添加集群资源  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 34]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 35]  
4、在Service Groups——sql中添加更改后的gfs2的dbdata：![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 36]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 37]  
修改完，submit，很重要！！

8、测试

启动sql服务组  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 38]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 39]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 40]

[RHCS_Luci_Ricci_Web]: https://blog.csdn.net/qq_43570369/article/details/89503704
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70]: /images/20220215/6b40aca566844f52b1af9754cf96c898.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 1]: /images/20220215/bca5b320d0634cd1a3c9330878036165.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 2]: /images/20220215/70096587a63a440994270efa0fe2565a.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 3]: /images/20220215/75819d8871da46a3bfd087af1c3cca6a.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 4]: /images/20220215/2cd1ab65425146e7bcf0cd2f52cd28c4.png
[20190425113729149.png]: /images/20220215/9b91d93ac03648c0af16bb432382c00b.png
[20190425113826556.png]: /images/20220215/623add2455674d8cb047dd2d6e5a790c.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 5]: /images/20220215/79463654b01e4d3cbd5d4fb33864221b.png
[20190425122945793.png]: /images/20220215/74706992f52645328435a503308be60c.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 6]: /images/20220215/9bae511ad3114848a7a2d97b1039b21f.png
[20190425123118854.png]: /images/20220215/bc7c919e242c41eda5d30f01dbe524e2.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 7]: /images/20220215/f026e966b3a643a79c69efd215443180.png
[20190425123534258.png]: /images/20220215/289d4cd3973f4a528151c364c1bb3cff.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 8]: /images/20220215/02e6293fb1e1415a91f939fd751e970b.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 9]: /images/20220215/294cbeb4b2c64aa3a6fbac5374b3ae64.png
[20190425123917679.png]: /images/20220215/58c025a7f3354a478cc41bc26cc30b3e.png
[20190425123925654.png]: /images/20220215/2db20103ea5c47ce98ecdf64a2fb52ff.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 10]: /images/20220215/1f35de944bbb44e4a257d7648df272bd.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 11]: /images/20220215/9a8656e1803c46b597a555df0c00472b.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 12]: /images/20220215/fe4f3a9cf4744dab94d5859221dab8ea.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 13]: /images/20220215/54b7eb98ac6342ad9a786e1fcca1b8b2.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 14]: /images/20220215/22d7a422f7a04e7680f9132f60f35d24.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 15]: /images/20220215/d2d9f0e557e54ad994ead224730a4da3.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 16]: /images/20220215/774b7b64e5714675ada00983e035f786.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 17]: /images/20220215/7099d379350e40c5bc933acff8bea951.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 18]: /images/20220215/f4f23f3f760b4fbc89d9cfceb61c14d6.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 19]: /images/20220215/c0639b40564444b3b4fed7dec8cb7001.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 20]: /images/20220215/84221ec048af4a20a460e3f098937628.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 21]: /images/20220215/5049b61c8ad64df08d6ddda49c66fd0f.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 22]: /images/20220215/7551c10a85cf4420a598dac75619d4e7.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 23]: /images/20220215/407f0a4e887e4e4d8dc5138b9c9b9363.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 24]: /images/20220215/4cae4883e53c40a8ace95cd94359a0df.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 25]: /images/20220215/9f2fc9b851be4947883eec58495e55b8.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 26]: /images/20220215/c24112a5c64341509b8259198bb24e58.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 27]: /images/20220215/fe4ed0730eb1469f965f64c431141aef.png
[20190425131505776.png]: /images/20220215/8d1dd36531224d42822edd7b8596bc05.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 28]: /images/20220215/5f44bd45c1bb43dd814f9321c36f6def.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 29]: /images/20220215/e2d6e271608149478c65abf963b65c39.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 30]: /images/20220215/8c44e3c7464b4362a65b4c509400b77c.png
[20190425132723948.png]: /images/20220215/46d5a81a817d4291930f475769dc42df.png
[20190425132739785.png]: /images/20220215/601274f9f5c24febae8897fb898c4f25.png
[20190425133127355.png]: /images/20220215/4b9fac9be79b4d8d879e96c928a32b71.png
[20190425133635682.png]: /images/20220215/e8ddbba88b1c4987b0b31d38f2c0a768.png
[20190425133847702.png]: /images/20220215/bded509aa4894d39a43b3bf8b68e5b22.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 31]: /images/20220215/e37b99779b3e47f58f9ab6a819824080.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 32]: /images/20220215/b2085b0d73024193a3845fbbda196db4.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 33]: /images/20220215/a5d92a8d0dcf441291a027811327e7d9.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 34]: /images/20220215/3376dd2bd8b04e498b2780e7ccf1d827.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 35]: /images/20220215/1622e47c139c40c6b12a42ea16213b8a.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 36]: /images/20220215/2433ccec808d45eab7f221a366d9c545.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 37]: /images/20220215/fcb3ab799eee41779d645ce5ab1d7825.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 38]: /images/20220215/91cc9bef2d524db59eaa9c4ef1572df8.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 39]: /images/20220215/f7fe9862a62a4ff5a2f53403413839f4.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQzNTcwMzY5_size_16_color_FFFFFF_t_70 40]: /images/20220215/893f08ad26294c77a6f623bf1badad74.png