普罗米修斯监控mysql与邮件告警

淩亂°似流年 2022-10-05 11:47 356阅读 0赞

首先需要安装mysql，mysql的安装参考https://morris131.blog.csdn.net/article/details/107742395

# mysqld\_exporter的安装 #

1.  下载mysqld\_exporter，下载地址：[**https://github.com/prometheus/mysqld\_exporter/releases**][https_github.com_prometheus_mysqld_exporter_releases]

这里下载的是：[**https://github.com/prometheus/mysqld\_exporter/releases/download/v0.13.0/mysqld\_exporter-0.13.0.linux-amd64.tar.gz**][https_github.com_prometheus_mysqld_exporter_releases_download_v0.13.0_mysqld_exporter-0.13.0.linux-amd64.tar.gz]

1.  上传至/usr/local目录下并解压
2.  安装为系统服务

# cat /etc/systemd/system/mysqld_exporter.service 
    [Unit]
    Description=mysqld-exporter
    
    [Service]
    Type=simple
    Restart=on-failure
    RestartSec=5
    ExecStart=/usr/local/mysqld_exporter-0.13.0.linux-amd64/mysqld_exporter --config.my-cnf=/usr/local/mysqld_exporter-0.13.0.linux-amd64/.my.cnf
    
    [Install]
    WantedBy=multi-user.target

1.  新增配置文件.my.cnf

# cat /usr/local/mysqld_exporter-0.13.0.linux-amd64/.my.cnf 
    [client]
    user=prometheus
    password=Prometheus@1

1.  启动mysqld\_exporter

# systemctl start mysqld_exporter
    # systemctl status mysqld_exporter
    # systemctl enable mysqld_exporter

1.  验证，浏览器输入：[**http://192.168.0.208:9104/**][http_192.168.0.208_9104]  
    ![在这里插入图片描述][20210608214036674.png]
2.  grafana使用模板7362显示监控数据，[**http://192.168.0.207:3000/dashboard/import**][http_192.168.0.207_3000_dashboard_import]

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 1]

最后效果如下：

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 2]

# 配置prometheus #

/usr/local/prometheus-2.27.1.linux-amd64/prometheus.yml增加如下内容：

- job_name: 'mysql'
        static_configs:
        - targets: ['192.168.0.208:9104']

重启prometheus。

打开[**http://192.168.0.207:9090/targets**][http_192.168.0.207_9090_targets]，发现mysql已经开始被监控了。

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 3]

# 邮件告警 #

邮件告警需要安装alertmanager

1.  下载alertmanager，下载地址：[**https://github.com/prometheus/alertmanager/releases**][https_github.com_prometheus_alertmanager_releases]

这里下载的是：[**https://github.com/prometheus/alertmanager/releases/download/v0.22.2/alertmanager-0.22.2.linux-amd64.tar.gz**][https_github.com_prometheus_alertmanager_releases_download_v0.22.2_alertmanager-0.22.2.linux-amd64.tar.gz]

1.  上传至/usr/local目录下并解压
2.  安装为系统服务

# cat /etc/systemd/system/alertmanager.service 
    [Unit]
    Description=Alertmanage
    
    [Service]
    Type=simple
    Restart=on-failure
    RestartSec=5
    ExecStart=/usr/local/alertmanager-0.22.2.linux-amd64/alertmanager --config.file=/usr/local/alertmanager-0.22.2.linux-amd64/alertmanager.yml
    
    [Install]
    WantedBy=multi-user.target

1.  新增配置文件alertmanager.yml

# cat /usr/local/alertmanager-0.22.2.linux-amd64/alertmanager.yml
    global:
      resolve_timeout: 5m
      # smtp配置
      smtp_from: "morris131@163.com"
      smtp_smarthost: 'smtp.163.com:25'
      smtp_auth_username: "morris131@163.com"
      smtp_auth_password: "xxxxxx"
      smtp_require_tls: false
    
    route:
      group_by: ['alertname']
      group_wait: 10s
      group_interval: 10s
      repeat_interval: 1h
      receiver: 'email'
    receivers:
    - name: 'email'
      email_configs:
      - to: '1508787838@qq.com'

1.  启动alertmanager

# systemctl start alertmanager
    # systemctl status alertmanager
    # systemctl enable alertmanager

1.  验证，浏览器输入：[**http://192.168.0.207:9093/**][http_192.168.0.207_9093]

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 4]

1.  修改prometheus.yml配置文件

alerting:
      alertmanagers:
      - static_configs:
        - targets:
          - 192.168.0.207:9093
    
    # Load rules once and periodically evaluate them according to the global 'evaluation_interval'.
    rule_files:
      - "rule/*.yml"
      # - "second_rules.yml"

1.  编写规则文件

# cat general.yml 
    groups:
    - name: general.rules
      rules:
    
      # Alert for any instance that is unreachable for >5 minutes.
      - alert: InstanceDown
        expr: up == 0
        for: 1m
        labels:
          severity: error
        annotations:
          summary: "Instance { { $labels.instance }} 停止工作"
          description: "{ { $labels.instance }} of job { { $labels.job }} 已停止1分钟>以上"

1.  重启prometheus
2.  打开[**http://192.168.0.207:9090/alerts**][http_192.168.0.207_9090_alerts]，能看到告警规则。

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 5]

1.  停止mysqld\_exporter，prometheus后台能看到告警信息。

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 6]

邮箱也收到了对应的邮件。

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 7]

# 遇到的问题 #

1.  一切配置正常，就是邮件发不出去，报错email.loginAuth auth: 550 User has no permission

开启smtp，然后会得到一个授权码，将这个授权码作为邮箱的登录密码即可。

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 8]

[https_github.com_prometheus_mysqld_exporter_releases]: https://github.com/prometheus/mysqld_exporter/releases
[https_github.com_prometheus_mysqld_exporter_releases_download_v0.13.0_mysqld_exporter-0.13.0.linux-amd64.tar.gz]: https://github.com/prometheus/mysqld_exporter/releases/download/v0.13.0/mysqld_exporter-0.13.0.linux-amd64.tar.gz
[http_192.168.0.208_9104]: http://192.168.0.208:9104/
[20210608214036674.png]: /images/20221005/401c93ad4b1d4b4faee6665a1d96aa49.png
[http_192.168.0.207_3000_dashboard_import]: http://192.168.0.207:3000/dashboard/import
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70]: /images/20221005/a0bb7ec1f3704ea5a4ab328742230aab.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 1]: /images/20221005/8b5bcbdb35674202bd1708af1c6c7206.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 2]: /images/20221005/ed38a2c3f5b843888e666b7bc2a82879.png
[http_192.168.0.207_9090_targets]: http://192.168.0.207:9090/targets
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 3]: /images/20221005/f1a4a0794f84479c887d78ca51a3d88a.png
[https_github.com_prometheus_alertmanager_releases]: https://github.com/prometheus/alertmanager/releases
[https_github.com_prometheus_alertmanager_releases_download_v0.22.2_alertmanager-0.22.2.linux-amd64.tar.gz]: https://github.com/prometheus/alertmanager/releases/download/v0.22.2/alertmanager-0.22.2.linux-amd64.tar.gz
[http_192.168.0.207_9093]: http://192.168.0.207:9093/
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 4]: /images/20221005/5625ea57294843148e3dde86654ff1a2.png
[http_192.168.0.207_9090_alerts]: http://192.168.0.207:9090/alerts
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 5]: /images/20221005/23892c0a554441aeb9c5dadc50805e1f.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 6]: /images/20221005/0de37d08b4ae46d09d9b6974a40011c7.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 7]: /images/20221005/40842a476c204770aafa80f2124c6b7c.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMjI4MTI4NDk_size_16_color_FFFFFF_t_70 8]: /images/20221005/d7e4ac4045e34955a7a7dfe10b0f1184.png