【巨杉数据库SequoiaDB】巨杉 Tech | 几分钟实现巨杉数据库容器化部署

Love The Way You Lie 2023-07-11 15:14 50阅读 0赞

随着业务负载的不断加重，容器化、虚拟化也成为各类在线应用必须要具备的能力。对于分布式数据库，容器化也是提升快速部署、提高运维效率的一个很好的路径。

我们重新优化了 Docker部署的方式，帮助大家更快的上手SequoiaDB集群，本文就将介绍基于 Docker 的SequoiaDB分布式集群快速部署。

**1.集群配置**

--------------------

我们将在六个容器中部署一个多节点，高度可用的 SequoiaDB 集群，如下所示:

（本文以 SequoiaDB v3.2.3 版本为例）

![format_png][]

该集群包括一个协调器节点、一个目录节点、三个数据组，每个数据组有三个副本数据节点和一个 MySQL 实例节点。

**2. 环境**

OS :  Ubuntu 18Docker Version : 18.09.7Docker Compose Version: 1.25.3Database Version : SequoiaDB 3.2.3MySql Client: Sequoiasql-mysqlCluster Deployment : 1 coordinator, 1 catalog, 3 data nodes, and 1 MySQL instance

**2.1 Docker安装**

**2.1.1 Docker**

对于在不同平台上的 Docker 安装，用户可以参阅 Docker 安装指南。

sudo apt-get install -y docker.io

**2.1.2 Docker-compose**

Docker compose是一个用于定义和部署在YAML文件中定义的多容器泊坞应用程序的工具(i.e: docker-compose.yaml)。

sudo curl -L "https://github.com/docker/compose/releases/download/1.25.3/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-composesudo chmod +x /usr/local/bin/docker-composesudo ln -s /usr/local/bin/docker-compose /usr/bin/docker-compose

**2.1.3 MySQL 客户端**

安装 MySQL 客户端（如果尚未安装)

sudo apt install mysql-client-core-5.7

**3. SequoiaDB分布式集群部署**

--------------------

定义 SequoiaDB 集群配置 "sequoiadb\_containers/docker-compose.yaml"，用户有两个选项可以下载所需的软件包。

选项1：克隆repo地址

（点击文末【阅读原文】前往获取软件包）

选项2：手动下载（保留相同的目录结构)

（点击文末【阅读原文】前往获取软件包）

**3.1 部署 SequoiaDB 集群**

docker-compose up 命令将:

- 如果没有在本地找到，可前往dockerhub下载镜像

- 创建所需的容器

- 启动容器

- 初始化 SequoiaDB 集群和 MySQL 实例

1）部署集群

cd sequoiadb_containers  （或者到docker-compose的目录。yaml文件下载)sudo docker-compose up -d

2）检查集群的状态

$ sudo docker-compose ps                Name                         Command               State           Ports                  --------------------------------------------------------------------------------------------         sequoiadb_containers_catalog_1   sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_coord_1     sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_data1_1     sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_data2_1     sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_data3_1     sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_mysql_1     sh -c chmod +x /startup.sh ...   Up      0.0.0.0:3310->3310/tcp

3）等待集群被部署和 MySQL 连接到协调器节点，用户可以按如下方式检查集群状态。

# 检查 coordinator 日志         $ sudo docker-compose logs coord         ...         ...         coord_1    | ************ Deploy SequoiaDB ************************         coord_1    | Create catalog: catalog:11800         coord_1    | Create coord:   coord:11810         coord_1    | Create data:    data1:11820         coord_1    | Create data:    data2:11820         coord_1    | Create data:    data3:11820         coord_1    | Create data:    data1:11830         coord_1    | Create data:    data2:11830         coord_1    | Create data:    data3:11830         coord_1    | Create data:    data1:11840         coord_1    | Create data:    data2:11840         coord_1    | Create data:    data3:11840         coord_1    | SDB Cluster successfully created.
             # 检查mysql日志         $ sudo docker-compose logs mysql         ...         ...         mysql_1    | >>> Waiting for COORD node to come up at (coord:11810)...         mysql_1    | >>> Waiting for COORD node to come up at (coord:11810)...         mysql_1    | >>> Waiting for COORD node to come up at (coord:11810)...         mysql_1    | Successfully reached COORD node at (coord:11810)         mysql_1    | COMMAND: /init.sh --port=3310 --coord=coord:11810         mysql_1    | Creating SequoiaSQL instance: MySQLInstance         mysql_1    | Modify configuration file and restart the instance: MySQLInstance         mysql_1    | Restarting instance: MySQLInstance         mysql_1    | Opening remote access to user root         mysql_1    | Restarting instance: MySQLInstance         mysql_1    | Instance MySQLInstance is created on port 3310, default user is root         mysql_1    | Init command returned: 0

**3.2 验证MySQL连接**

$ mysql -h 127.0.0.1 -P 3310 -u root

Welcome to the MySQL monitor.  Commands end with ; or \g.         Your MySQL connection id is 4         Server version: 5.7.25 Source distribution
             Copyright (c) 2000, 2020, Oracle and/or its affiliates. All rights reserved.
             Oracle is a registered trademark of Oracle Corporation and/or its         affiliates. Other names may be trademarks of their respective         owners.
             Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
             mysql>

验证SequoiaDB配置:

mysql> show variables like 'sequoiadb%';         +---------------------------------------+-------------+         | Variable_name                         | Value       |         +---------------------------------------+-------------+         | sequoiadb_bulk_insert_size            | 2000        |         | sequoiadb_conn_addr                   | coord:11810 |         | sequoiadb_debug_log                   | OFF         |         | sequoiadb_execute_only_in_mysql       | OFF         |         | sequoiadb_optimizer_select_count      | ON          |         | sequoiadb_password                    |             |         | sequoiadb_replica_size                | 1           |         | sequoiadb_selector_pushdown_threshold | 30          |         | sequoiadb_use_autocommit              | ON          |         | sequoiadb_use_bulk_insert             | ON          |         | sequoiadb_use_partition               | ON          |         | sequoiadb_user                        |             |         +---------------------------------------+-------------+         12 rows in set (0.01 sec)
    
             mysql> show storage engines;         +--------------------+---------+----------------------------------------------------------------------------------+--------------+------+------------+         | Engine             | Support | Comment                                                                          | Transactions | XA   | Savepoints |         +--------------------+---------+----------------------------------------------------------------------------------+--------------+------+------------+         | SequoiaDB          | DEFAULT | SequoiaDB storage engine(Community). Plugin: eebcb4f, Driver: 3.2.3, BuildTime:  | YES          | NO   | NO         |         | MRG_MYISAM         | YES     | Collection of identical MyISAM tables                                            | NO           | NO   | NO         |         | PERFORMANCE_SCHEMA | YES     | Performance Schema                                                               | NO           | NO   | NO         |         | BLACKHOLE          | YES     | /dev/null storage engine (anything you write to it disappears)                   | NO           | NO   | NO         |         | MyISAM             | YES     | MyISAM storage engine                                                            | NO           | NO   | NO         |         | CSV                | YES     | CSV storage engine                                                               | NO           | NO   | NO         |         | ARCHIVE            | YES     | Archive storage engine                                                           | NO           | NO   | NO         |         | InnoDB             | YES     | Supports transactions, row-level locking, and foreign keys                       | YES          | YES  | YES        |         | FEDERATED          | NO      | Federated MySQL storage engine                                                   | NULL         | NULL | NULL       |         | MEMORY             | YES     | Hash based, stored in memory, useful for temporary tables                        | NO           | NO   | NO         |         +--------------------+---------+----------------------------------------------------------------------------------+--------------+------+------------+         10 rows in set (0.00 sec)

**3.3 测试**

用户可以使用 MySQL 命令创建数据库和表：

**4. 集群管理**

--------------------

**4.1 stop/start cluster**

使用up命令创建 SequoiaDB 集群后，它可以停止并按如下方式启动。

> Note:            
> 
> "stop"命令不会删除容器，因此不会丢失任何数据。

**4.1.1 stop 命令**

$ sudo docker-compose stop         Stopping sequoiadb_containers_mysql_1   ... done         Stopping sequoiadb_containers_coord_1   ... done         Stopping sequoiadb_containers_data2_1   ... done         Stopping sequoiadb_containers_data1_1   ... done         Stopping sequoiadb_containers_catalog_1 ... done         Stopping sequoiadb_containers_data3_1   ... done
    
             $ sudo docker-compose ps                    Name                         Command                State     Ports         ------------------------------------------------------------------------------         sequoiadb_containers_catalog_1   sh -c chmod +x /startup.sh ...   Exit 137                 sequoiadb_containers_coord_1     sh -c chmod +x /startup.sh ...   Exit 137                 sequoiadb_containers_data1_1     sh -c chmod +x /startup.sh ...   Exit 137                 sequoiadb_containers_data2_1     sh -c chmod +x /startup.sh ...   Exit 137                 sequoiadb_containers_data3_1     sh -c chmod +x /startup.sh ...   Exit 137                 sequoiadb_containers_mysql_1     sh -c chmod +x /startup.sh ...   Exit 137

**4.1.2 start 命令  ****   **

$ sudo docker-compose start         Starting catalog ... done         Starting data1   ... done         Starting data2   ... done         Starting data3   ... done         Starting coord   ... done         Starting mysql   ... done
    
             $ sudo docker-compose ps                    Name                         Command               State           Ports                  --------------------------------------------------------------------------------------------         sequoiadb_containers_catalog_1   sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_coord_1     sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_data1_1     sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_data2_1     sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_data3_1     sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_mysql_1     sh -c chmod +x /startup.sh ...   Up      0.0.0.0:3310->3310/tcp
             # Verity mysql client is up         $ sudo docker-compose logs mysql         Attaching to sequoiadb_containers_mysql_1         mysql_1    | Starting service sequoiasql-mysql ...         mysql_1    | ok. (PID: 38)         ...         mysql_1    | MySql instance is started

**4.2 down/up Cluster**

**4.2.1 down命令**

down 命令将停止并删除SequoiaDB集群部署的容器。

> Note：            
> 
> down命令应该谨慎执行，因为当容器被破坏时无法回滚/恢复。

$ sudo docker-compose down         Stopping sequoiadb_containers_mysql_1   ... done         Stopping sequoiadb_containers_coord_1   ... done         Stopping sequoiadb_containers_data2_1   ... done         Stopping sequoiadb_containers_data1_1   ... done         Stopping sequoiadb_containers_catalog_1 ... done         Stopping sequoiadb_containers_data3_1   ... done         Removing sequoiadb_containers_mysql_1   ... done         Removing sequoiadb_containers_coord_1   ... done         Removing sequoiadb_containers_data2_1   ... done         Removing sequoiadb_containers_data1_1   ... done         Removing sequoiadb_containers_catalog_1 ... done         Removing sequoiadb_containers_data3_1   ... done         Removing network sequoiadb_containers_sequoiadb_net
             $ sudo docker-compose ps         Name   Command   State   Ports         ------------------------------

**4.2.2 up命令**

up命令将创建并启动为sequoiadb cluser定义的服务（容器，网络）。

$ sudo docker-compose up -d          Creating network "sequoiadb_containers_sequoiadb_net" with the default driver         Creating sequoiadb_containers_data2_1   ... done         Creating sequoiadb_containers_data3_1   ... done         Creating sequoiadb_containers_catalog_1 ... done         Creating sequoiadb_containers_data1_1   ... done         Creating sequoiadb_containers_coord_1   ... done         Creating sequoiadb_containers_mysql_1   ... done
             $ sudo docker-compose ps                    Name                         Command               State           Ports                  --------------------------------------------------------------------------------------------         sequoiadb_containers_catalog_1   sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_coord_1     sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_data1_1     sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_data2_1     sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_data3_1     sh -c chmod +x /startup.sh ...   Up                                     sequoiadb_containers_mysql_1     sh -c chmod +x /startup.sh ...   Up      0.0.0.0:3310->3310/tcp
             # 验证MySQL连接         $ mysql -h 127.0.0.1  -P 3310 -u root         Welcome to the MySQL monitor.  Commands end with ; or \g.         Your MySQL connection id is 2         Server version: 5.7.25 Source distribution
             Copyright (c) 2000, 2020, Oracle and/or its affiliates. All rights reserved.
             Oracle is a registered trademark of Oracle Corporation and/or its         affiliates. Other names may be trademarks of their respective         owners.
             Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
             mysql> show storage engines;         +--------------------+---------+----------------------------------------------------------------------------------+--------------+------+------------+         | Engine             | Support | Comment                                                                          | Transactions | XA   | Savepoints |         +--------------------+---------+----------------------------------------------------------------------------------+--------------+------+------------+         | SequoiaDB          | DEFAULT | SequoiaDB storage engine(Community). Plugin: eebcb4f, Driver: 3.2.3, BuildTime:  | YES          | NO   | NO         |         | MRG_MYISAM         | YES     | Collection of identical MyISAM tables                                            | NO           | NO   | NO         |         | PERFORMANCE_SCHEMA | YES     | Performance Schema                                                               | NO           | NO   | NO         |         | BLACKHOLE          | YES     | /dev/null storage engine (anything you write to it disappears)                   | NO           | NO   | NO         |         | MyISAM             | YES     | MyISAM storage engine                                                            | NO           | NO   | NO         |         | CSV                | YES     | CSV storage engine                                                               | NO           | NO   | NO         |         | ARCHIVE            | YES     | Archive storage engine                                                           | NO           | NO   | NO         |         | InnoDB             | YES     | Supports transactions, row-level locking, and foreign keys                       | YES          | YES  | YES        |         | FEDERATED          | NO      | Federated MySQL storage engine                                                   | NULL         | NULL | NULL       |         | MEMORY             | YES     | Hash based, stored in memory, useful for temporary tables                        | NO           | NO   | NO         |         +--------------------+---------+----------------------------------------------------------------------------------+--------------+------+------------+

不知道您是否已经动手操作了呢？

SequoiaDB后续也将持续推出系列技术教程，帮助大家更快上手分布式数据库，同时更好的理解分布式数据库的原理，大家敬请期待！

[format_png]: https://imgconvert.csdnimg.cn/aHR0cHM6Ly9tbWJpei5xcGljLmNuL3N6X21tYml6X3BuZy9xYTBEcVBTbzliYndjaWJiREtvRDBpY0JpYVlpY3lSblJwbVFmTnNhVmZQRVFqcElUSVIxRUVOU1h3b0tLQ3Nkd2dhbm1HWFpXdFZCbTlqaWJMSExqSUEwRXJ3LzY0MA?x-oss-process=image/format,png