Spring集成Rabbitmq收集Logback日志，利用进行Logstash数据整理存储到Elasticsearch中

落日映苍穹つ 2022-05-17 06:48 233阅读 0赞

项目中我们常用的是把Logback打印的日志存储到文件中保存到硬盘上，这样不利于日志的收集和分析。

以下演示在SpringBoot中通过rabbitmq收集logback日志存储到Elasticsearch中。

环境准备：安装RabbitMQ，安装Elasticsearch和Elasticsearch-Head(可视化插件)，安装Logstash.====》之前博客已经介绍过了。

## pom.xml ##

引入spring-amqp

<dependency>
    	<groupId>org.springframework.amqp</groupId>
    	<artifactId>spring-rabbit</artifactId>
    </dependency>
    <dependency>
    	<groupId>org.springframework.boot</groupId>
    	<artifactId>spring-boot-starter-amqp</artifactId>
    </dependency>

## logback-spring.xml ##

<appender name="RabbitMq"
    		class="org.springframework.amqp.rabbit.logback.AmqpAppender">
    		<layout>
    			<pattern><![CDATA[ %d %p %t [%c] - <%m>%n ]]></pattern>
    		</layout>
    		
    		<addresses>localhost:5672</addresses>
    		<abbreviation>36</abbreviation>
    		<includeCallerData>true</includeCallerData>
    		<applicationId>bootsis</applicationId>
    		<username>springcloud</username>
    		<password>123456</password>
    		
    		
    		
    		
    		<routingKeyPattern>bootsis</routingKeyPattern>
    		<generateId>true</generateId>
    		<charset>UTF-8</charset>
    		<durable>true</durable>
    		<deliveryMode>NON_PERSISTENT</deliveryMode>
    		<declareExchange>true</declareExchange>
    		<autoDelete>false</autoDelete>
    	</appender>

## Logstash配置 ##

在logstash安装目录的bin目录下新建

logstash-rabbitmq.conf   ====>从消息队列读日志

配置如下，logstash整合rabbitmq详细配置见[https://www.elastic.co/guide/en/logstash/current/plugins-inputs-rabbitmq.html][https_www.elastic.co_guide_en_logstash_current_plugins-inputs-rabbitmq.html]

input { 
       rabbitmq {
           type =>"all"
           durable => true
           exchange => "logs"
    	   exchange_type => "topic"
    	   key => "bootsis"
    	   host => "localhost"
    	   port => 5672
    	   user => "springcloud"
    	   password => "123456"
    	   queue => "boot-sis-mq"
           auto_delete => false
        
      }	
     }
    
    output {
      elasticsearch { 
           hosts => ["localhost:9200"] 
    	   index => "bootsis_log_mq"
    	   }
    }

额外：从文件目录读日志

input { 
       file {
         type => "server"
         path  =>["E:\home\logs\boot\info.log","E:\home\logs\boot\error.log","E:\home\logs\boot\trace.log","E:\home\logs\boot\warn.log"]
      }
     }
    
    output {
      elasticsearch { 
           hosts => ["localhost:9200"] 
    	   index => "bootsis_log"
    	   }
    }

以上配置完成，启动rabbitmq,logstash(logstash -f logstash-rabbitmq.conf),elasticsearch,elasticsearch-head,springboot项目。

控制台一直在打印日志

![70][]

访问[http://localhost:9100/][http_localhost_9100]

![70 1][]

rabbitmq消息状态

![70 2][]

后期也可以整合Kinbana

![70 3][]

**微信公众号**               ![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L25pdWdhbmcwOTIw_size_16_color_FFFFFF_t_70][]

[https_www.elastic.co_guide_en_logstash_current_plugins-inputs-rabbitmq.html]: https://www.elastic.co/guide/en/logstash/current/plugins-inputs-rabbitmq.html
[70]: /images/20220517/d30199de18824993b44ba094d482eefc.png
[http_localhost_9100]: http://localhost:9100/
[70 1]: /images/20220517/3ee1b8b906bd4923a33438adcb0d865b.png
[70 2]: /images/20220517/1f758e10957c4f2ba0f75e495ed4e715.png
[70 3]: /images/20220517/e6434762dc2b41978a1a1a449769226c.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L25pdWdhbmcwOTIw_size_16_color_FFFFFF_t_70]: /images/20220517/bbc5ebbefb3d452390030c83612f90aa.png