metricbeat收集http指标

╰+攻爆jí腚メ 2023-02-22 12:18 2阅读 0赞

**背景：在 [metricbeat收集redis日志以及系统日志][metricbeat_redis]、[python接收请求参数][python] 基础上进行，部分简单内容省略**

### **一、查看容器ip** ###

docker inspect metricbeat | egrep IPAddress

![20200703163527944.png][]

### **二、**编辑metricbeat.yml配置文件 ###

**1. 新增http模块的配置**

#--------------------------------- HTTP Module ---------------------------------
      - module: http
        metricsets:
          - json  # As client
        period: 100s
        hosts: ["192.168.1.110:8001"]
        namespace: "json_namespace"
        path: "/api"
        #body: ""
        #method: "GET"
        #username: "user"
        #password: "secret"
        #request.enabled: false
        #response.enabled: false
        #json.is_array: false
        #dedot.enabled: false
        processors:
          - add_fields:
              target: ''
              fields:
                from: http
    
      - module: http
        metricsets: ["server"]  # As a server，only accept post requests
        host: "172.18.0.2" # If using metricbeat container, here is the container ip
        port: "8002"
        server.paths:
          - path: "/api"
            namespace: "server_namespace"
            fields: # added to the the response in root. overwrites existing fields
              env: "test"
        processors:
          - add_fields:
              target: ''
              fields:
                from: http

### 三、启动[python接收请求参数][python]中的脚本 ###

E:\Python\Python38\python3.exe F:/IdeaProjects/my-jooq/my-python/receive_data.py
     * Serving Flask app "receive_data" (lazy loading)
     * Environment: production
       WARNING: This is a development server. Do not use it in a production deployment.
       Use a production WSGI server instead.
     * Debug mode: on
     * Restarting with stat
     * Debugger is active!
     * Debugger PIN: 936-026-506
     * Running on http://0.0.0.0:8001/ (Press CTRL+C to quit)

### 四、添加容器对外暴露端口 ###

services:
      metricbeat:
        image: elastic/metricbeat:7.7.0
        user: root
        container_name: metricbeat
        command: ["--strict.perms=false"]
        volumes:
          - ${PWD}/config/metricbeat.yml:/usr/share/metricbeat/metricbeat.yml
          - /var/run/docker.sock:/var/run/docker.sock:ro
          - /sys/fs/cgroup:/hostfs/sys/fs/cgroup:ro
          - /proc:/hostfs/proc:ro
          - /:/hostfs:ro
          - /etc/timezone:/etc/timezone:ro
          - /etc/localtime:/etc/localtime:ro
        ports:
          - "8002:8002"
        networks:
          - shared

###  五、重新加载容器 ###

docker-compose up -d

![20200703144259390.png][]

### 六、查看作为客户端的结果 ###

**1. 查看作为http客户端发送的请求结果**

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz_size_16_color_FFFFFF_t_70][]

**2. 查看收集到的指标监控日志 **

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz_size_16_color_FFFFFF_t_70 1][]

### 七、查看作为服务端的结果  ###

**1. 发送请求**

curl --header "Content-Type:application/json" -X POST --data '{"logLevel":"ERROR", "msg":"hello world"}' http://localhost:8002/api

**1.1 下图为通过容器启动metricbeat的操作结果 **

![20200703164453192.png][]

**1.2 下图为直接在主机启动metricbeat的操作结果 **

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz_size_16_color_FFFFFF_t_70 2][]

**注： 从以上操作结果可以看出，如果配置的host是ip地址，那么不能使用localhost替代，同理配置的是localhost，也不能使用ip地址替换**

**2. 查看收集到的指标监控日志**

**2.1 下图为通过容器启动metricbeat的操作结果 **

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz_size_16_color_FFFFFF_t_70 3][]

**2.2 下图为直接在主机启动metricbeat的操作结果 **

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz_size_16_color_FFFFFF_t_70 4][]

**到此http指标收集成功**

[metricbeat_redis]: https://blog.csdn.net/zsx18273117003/article/details/106769334
[python]: https://blog.csdn.net/zsx18273117003/article/details/107019452
[20200703163527944.png]: https://img-blog.csdnimg.cn/20200703163527944.png
[20200703144259390.png]: https://img-blog.csdnimg.cn/20200703144259390.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz_size_16_color_FFFFFF_t_70]: https://img-blog.csdnimg.cn/20200703144358652.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz_size_16_color_FFFFFF_t_70 1]: https://img-blog.csdnimg.cn/20200703144913459.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz,size_16,color_FFFFFF,t_70
[20200703164453192.png]: https://img-blog.csdnimg.cn/20200703164453192.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz_size_16_color_FFFFFF_t_70 2]: https://img-blog.csdnimg.cn/20200703151946495.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz_size_16_color_FFFFFF_t_70 3]: https://img-blog.csdnimg.cn/20200703164925467.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz_size_16_color_FFFFFF_t_70 4]: https://img-blog.csdnimg.cn/20200703152531742.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pzeDE4MjczMTE3MDAz,size_16,color_FFFFFF,t_70