grafana 安装和 Nginx 、EL 联调

水深无声 2022-05-21 11:49 223阅读 0赞

# grafana 安装 和 Nginx 、EL 联调 #

1、grafana 安装  
wget https://s3-us-west-2.amazonaws.com/grafana-releases/release/grafana-4.6.2-1.x86\_64.rpm  
为了使用yum方便，直接下载阿里的yum源  
\[root@hadoop001 yum.repos.d\]\# wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-6.repo  
\[root@hadoop001 elk\]\# yum install initscripts fontconfig  
  
\[root@hadoop001 elk\]\# rpm -Uvh grafana-4.6.2-1.x86\_64.rpm   
warning: grafana-4.6.2-1.x86\_64.rpm: Header V4 RSA/SHA1 Signature, key ID 24098cb6: NOKEY  
error: Failed dependencies:  
        urw-fonts is needed by grafana-4.6.2-1.x86\_64  
\[root@hadoop001 elk\]\# yum install -y urw-fonts  
\[root@hadoop001 elk\]\# rpm -Uvh grafana-4.6.2-1.x86\_64.rpm   
warning: grafana-4.6.2-1.x86\_64.rpm: Header V4 RSA/SHA1 Signature, key ID 24098cb6: NOKEY  
Preparing...                \#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\# \[100%\]  
   1:grafana                \#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\# \[100%\]  
\#\#\# NOT starting grafana-server by default on bootup, please execute  
 sudo /sbin/chkconfig --add grafana-server  
\#\#\# In order to start grafana-server, execute  
 sudo service grafana-server start  
POSTTRANS: Running script  
  
启动  
\[root@hadoop001 elk\]\# service grafana-server start   
Starting Grafana Server: ... \[  OK  \]  
  
添加自启动  
\[root@hadoop001 elk\]\# /sbin/chkconfig --add grafana-server  
  
\[root@hadoop001 elk\]\# ps -ef | grep grafana  
grafana   25478      1  0 16:32 ?        00:00:00 /usr/sbin/grafana-server --pidfile=/var/run/grafana-server.pid --config=/etc/grafana/grafana.ini cfg:default.paths.data=/var/lib/grafana cfg:default.paths.logs=/var/log/grafana cfg:default.paths.plugins=/var/lib/grafana/plugins  
root      25502  24192  0 16:33 pts/3    00:00:00 grep grafana  
\[root@hadoop001 elk\]\#   
\[root@hadoop001 elk\]\#   
\[root@hadoop001 elk\]\#   
\[root@hadoop001 elk\]\# netstat -nlp | grep 25478  
tcp        0      0 :::3000                     :::\*                        LISTEN      25478/grafana-serve   
  
打开网页：  
admin / admin  
  
2、简单使用   
这里我们是和 nginx es logstash 联用。  
打开这个网页 https://grafana.com/dashboards/2292   
这是一个做好的dashboard ，按照上面对 nginx access 配置  
  
2.1配置 nginx access log format  
找到配置log\_format 的地方  
log\_format main   '\{"@timestamp":"$time\_iso8601",'  
                        '"@source":"$server\_addr",'  
                        '"hostname":"$hostname",'  
                        '"ip":"$http\_x\_forwarded\_for",'  
                        '"client":"$remote\_addr",'  
                        '"request\_method":"$request\_method",'  
                        '"scheme":"$scheme",'  
                        '"domain":"$server\_name",'  
                        '"referer":"$http\_referer",'  
                        '"request":"$request\_uri",'  
                        '"args":"$args",'  
                        '"size":$body\_bytes\_sent,'  
                        '"status": $status,'  
                        '"responsetime":$request\_time,'  
                        '"upstreamtime":"$upstream\_response\_time",'  
                        '"upstreamaddr":"$upstream\_addr",'  
                        '"http\_user\_agent":"$http\_user\_agent",'  
                        '"https":"$https"'  
                        '\}';  
重启 nginx   
\[root@hadoop001 nginx\]\# sbin/nginx -s reload   
  
查看日志  
\[root@hadoop001 nginx\]\# tail -f logs/access.log   
刷新nginx 网页，发现生成新的记录。  
\{"@timestamp":"2017-12-03T16:40:36+08:00","@source":"192.168.137.11","hostname":"hadoop001","ip":"-","client":"192.168.137.1","request\_method":"GET","scheme":"http","domain":"192.168.137.11","referer":"-","request":"/","args":"-","size":0,"status": 304,"responsetime":0.000,"upstreamtime":"-","upstreamaddr":"-","http\_user\_agent":"Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:57.0) Gecko/20100101 Firefox/57.0","https":""\}  
  
nginx 配置完成  
  
2.2 配置 Logstash nginx\_access.conf  
\[root@hadoop001 nginx\]\# cd /opt/software/elk/logstash-6.0.0/  
\[root@hadoop001 logstash-6.0.0\]\# vi logstash-nginx-access-log.conf   
input \{  
    file \{  
        \#这里根据自己日志命名使用正则匹配所有域名访问日志  
        path => \[ "/usr/local/nginx/logs/access.log" \]  
        ignore\_older => 0  
    codec => json  
    \}  
\}  
  
  
filter \{  
    mutate \{  
      convert => \[ "status","integer" \]  
      convert => \[ "size","integer" \]  
      convert => \[ "upstreatime","float" \]  
      remove\_field => "message"  
    \}  
    geoip \{  
        source => "ip"  
    \}  
\}  
output \{  
    elasticsearch \{  
        hosts => "192.168.137.11:9200"  
        index => "logstash-nginx-access-log"  
    \}  
\#    stdout \{codec => rubydebug\}  
\}  
  
  
重启 logstash   
kill -9 $(pgrep -f logstash)  
\[root@hadoop001 logstash-6.0.0\]\# kill -9 $(pgrep -f logstash)  
\[root@hadoop001 logstash-6.0.0\]\# nohup bin/logstash -f logstash-nginx-access-log.conf &  
  
刷新网页，查看 nohup 和 es 中数据  
注意：如果es 中原来有数据，最好清除掉，否则可能会像这样报错  
\[2017-12-03T16:50:57,757\]\[WARN \]\[logstash.outputs.elasticsearch\] Could not index event to Elasticsearch. \{:status=>400, :action=>\["index", \{:\_id=>nil, :\_index=>"logstash-nginx-access-log", :\_type=>"doc", :\_routing=>nil\}, \#<LogStash::Event:0x7664ee1b>\], :response=>\{"index"=>\{"\_index"=>"logstash-nginx-access-log", "\_type"=>"doc", "\_id"=>"\_rqSG2ABfyb-pkaaQGEt", "status"=>400, "error"=>\{"type"=>"illegal\_argument\_exception", "reason"=>"Rejecting mapping update to \[logstash-nginx-access-log\] as the final mapping would have more than 1 type: \[doc, nginx\_access\]"\}\}\}\}  
  
3、add data source

![Center][]

添加完成后点击测试

![Center 1][]

返回主界面

![Center 2][]

4、new dashboard

这里我们手动添加一个dashboard，选择graph，就可以获得展示了，在右上角可以进行时间轴调整。

![Center 3][]

5、导入别人做好的比较美观的 dashboard

![Center 4][]

拷贝 序号码或者下载 json

![Center 5][]

由于我们联网了，可以直接填入 ID

![Center 6][]

进行一些配置

![Center 7][]

完成，由于测试环境，所以很多展示都没法展示。

![Center 8][]

结尾：

很好的可视化平台，需要深入研究各个功能的调整，可做监控大屏

[Center]: /images/20220521/0caf1da7a531412b803463e0dd359c06.png
[Center 1]: /images/20220521/aeb2ec8e3fdf4be99b0e849d1016d946.png
[Center 2]: /images/20220521/9af6b70054794c1190582eccc7e22347.png
[Center 3]: /images/20220521/932699d9d00e447993454ffa450f6092.png
[Center 4]: /images/20220521/a6b9a3c307924e61b5523fbbc2547d07.png
[Center 5]: /images/20220521/6b96ba16e42a432b9d843122ac2e334c.png
[Center 6]: /images/20220521/8cb69adb3da94b78996b2e57b6caf5e8.png
[Center 7]: /images/20220521/2ee3583e7d8646008e107edcf023c959.png
[Center 8]: /images/20220521/9fe28359a55e453c835f302679766e1d.png