Prometheus 监控 Java JAR 方式启动的实例状态

àì夳堔傛蜴生んèń 2023-03-04 10:26 41阅读 0赞

1、使用 jmx\_exporter 监控 java jar 方式启动的实例状态，前提条件是同一台主机的每个实例要分配独立的 jmx 端口

2、准备要发布的 jar 程序包，下载 jmx\_exporter 安装包和 jmx\_exporter tomcat 配置文件，其中tomcat配置修文件内容需要修改

[https://repo1.maven.org/maven2/io/prometheus/jmx/jmx\_prometheus\_javaagent/0.9/jmx\_prometheus\_javaagent-0.9.jar][https_repo1.maven.org_maven2_io_prometheus_jmx_jmx_prometheus_javaagent_0.9_jmx_prometheus_javaagent-0.9.jar]

[https://repo1.maven.org/maven2/io/prometheus/jmx/jmx\_prometheus\_javaagent/0.13.0/jmx\_prometheus\_javaagent-0.13.0.jar][https_repo1.maven.org_maven2_io_prometheus_jmx_jmx_prometheus_javaagent_0.13.0_jmx_prometheus_javaagent-0.13.0.jar]

[https://github.com/prometheus/jmx\_exporter/tree/master/example\_configs/tomcat.yml][https_github.com_prometheus_jmx_exporter_tree_master_example_configs_tomcat.yml]

// 要发布的 jar 程序包
    # ls /home/jar包名称.jar
    /home/jar包名称.jar
    
    // 下载地址：https://repo1.maven.org/maven2/io/prometheus/jmx/jmx_prometheus_javaagent/0.9/jmx_prometheus_javaagent-0.9.jar
    # ls /home/jmx_prometheus_javaagent-0.9.jar 
    /home/jmx_prometheus_javaagent-0.9.jar
    
    // jmx_exporter tomcat 配置文件下载地址：https://github.com/prometheus/jmx_exporter/tree/master/example_configs
    # ls /home/tomcat.yaml 
    /home/tomcat.yaml

3、配置 jmx exporter

# mkdir -p /home/jmx_prometheus/
    # cp /home/src/jmx_prometheus_javaagent-0.3.1.jar /home/jmx_prometheus/
    // 下载地址：https://github.com/prometheus/jmx_exporter/tree/master/example_configs/tomcat.yml
    # cp /home/tomcat.yaml /home/jmx_prometheus/jar_config.yaml

配置文件内容如下（将模板文件中的Catalina全部替换成Tomcat）

# cat jar_config.yml 
    ---   
    lowercaseOutputLabelNames: true
    lowercaseOutputName: true
    rules:
    - pattern: 'Tomcat<type=GlobalRequestProcessor, name=\"(\w+-\w+)-(\d+)\"><>(\w+):'
      name: tomcat_$3_total
      labels:
        port: "$2"
        protocol: "$1"
      help: Tomcat global $3
      type: COUNTER
    - pattern: 'Tomcat<j2eeType=Servlet, WebModule=//([-a-zA-Z0-9+&@#/%?=~_|!:.,;]*[-a-zA-Z0-9+&@#/%=~_|]), name=([-a-zA-Z0-9+/$%~_-|!.]*), J2EEApplication=none, J2EEServer=none><>(requestCount|maxTime|processingTime|errorCount):'
      name: tomcat_servlet_$3_total
      labels:
        module: "$1"
        servlet: "$2"
      help: Tomcat servlet $3 total
      type: COUNTER
    - pattern: 'Tomcat<type=ThreadPool, name="(\w+-\w+)-(\d+)"><>(currentThreadCount|currentThreadsBusy|keepAliveCount|pollerThreadCount|connectionCount):'
      name: tomcat_threadpool_$3
      labels:
        port: "$2"
        protocol: "$1"
      help: Tomcat threadpool $3
      type: GAUGE
    - pattern: 'Tomcat<type=Manager, host=([-a-zA-Z0-9+&@#/%?=~_|!:.,;]*[-a-zA-Z0-9+&@#/%=~_|]), context=([-a-zA-Z0-9+/$%~_-|!.]*)><>(processingTime|sessionCounter|rejectedSessions|expiredSessions):'
      name: tomcat_session_$3_total
      labels:
        context: "$2"
        host: "$1"
      help: Tomcat session $3 total
      type: COUNTER

4、让 jmx\_exporter 跟 jar 实例一起启动

[root@ip-10-2-2-12 jmx_prometheus]# cat /usr/lib/systemd/system/jar服务名称.service 
    [Unit]
    Description=jar服务名称
    After=network.target
    
    [Service]
    Type=simple
    StandardOutput=syslog
    StandardError=syslog
    SyslogIdentifier=jar服务名称
    User=root
    WorkingDirectory=/home/jar服务名称/
    ExecStart=/home/java8/bin/java -javaagent:/home/jmx_prometheus/jmx_prometheus_javaagent-0.9.jar=30011:/home/jmx_prometheus/jar_config.yml -Dspring.config.location=/homejar服务名称/conf/ -jar /homejar服务名称/jar服务名称-0.0.1-SNAPSHOT.jar
    KillMode=process
    TimeoutStopSec=60
    Restart=on-failure
    RestartSec=5
    RemainAfterExit=no
    
    [Install]
    WantedBy=multi-user.target

常见启动参数配置如下

java -Xms400m -Xmx400m -XX:PermSize=128m -XX:MaxPermSize=256m -XX:MaxNewSize=512m -javaagent:/home/gridcloud/jmx_prometheus/jmx_prometheus_javaagent-0.13.0.jar=30021:/home/gridcloud/jmx_prometheus/jar_config.yml -Dspring.config.location=/home/conf/ -jar /home/包名.jar

5、重启jar程序

6、查询我们的监控jmx\_prometheus是否启动

[root@ip-10-2-2-12 jmx_prometheus]# netstat -atnpu | grep 30011
    tcp6       0      0 :::30011                :::*                    LISTEN      6382/java

7、开启防火墙并在pormetheus端配置jvm——dashboard

切换到import界面，输入8563，然后点击load

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2JhaWR1XzM4NDMyNzMy_size_16_color_FFFFFF_t_70][]

然后得到如下界面

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2JhaWR1XzM4NDMyNzMy_size_16_color_FFFFFF_t_70 1][]

其中略做修改添加appname应用名称变量

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2JhaWR1XzM4NDMyNzMy_size_16_color_FFFFFF_t_70 2][]

修改优先级顺序如下

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2JhaWR1XzM4NDMyNzMy_size_16_color_FFFFFF_t_70 3][]

8、在prometheus端添加配置

- job_name: 'java'
        scrape_interval: 10s
        static_configs:
          - targets: ['10.2.2.12:30011']
            labels:
              instance: 'openApi'

此时我们就可以看到我们的jvm\_dashboard

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2JhaWR1XzM4NDMyNzMy_size_16_color_FFFFFF_t_70 4][]

[https_repo1.maven.org_maven2_io_prometheus_jmx_jmx_prometheus_javaagent_0.9_jmx_prometheus_javaagent-0.9.jar]: https://repo1.maven.org/maven2/io/prometheus/jmx/jmx_prometheus_javaagent/0.9/jmx_prometheus_javaagent-0.9.jar
[https_repo1.maven.org_maven2_io_prometheus_jmx_jmx_prometheus_javaagent_0.13.0_jmx_prometheus_javaagent-0.13.0.jar]: https://repo1.maven.org/maven2/io/prometheus/jmx/jmx_prometheus_javaagent/0.13.0/jmx_prometheus_javaagent-0.13.0.jar
[https_github.com_prometheus_jmx_exporter_tree_master_example_configs_tomcat.yml]: https://github.com/prometheus/jmx_exporter/tree/master/example_configs/tomcat.yml
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2JhaWR1XzM4NDMyNzMy_size_16_color_FFFFFF_t_70]: /images/20230208/19a12ec968ad443e84ee623317e2187b.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2JhaWR1XzM4NDMyNzMy_size_16_color_FFFFFF_t_70 1]: /images/20230208/433fd99932374722a5355f27e877bf6e.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2JhaWR1XzM4NDMyNzMy_size_16_color_FFFFFF_t_70 2]: /images/20230208/c0a64524a2804e748d83f57709254ae9.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2JhaWR1XzM4NDMyNzMy_size_16_color_FFFFFF_t_70 3]: /images/20230208/ef5c68d21a5f46668b39718e4be43757.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2JhaWR1XzM4NDMyNzMy_size_16_color_FFFFFF_t_70 4]: /images/20230208/3277ad8ac90a41859d374ca6a466e8e2.png