kubernetes之hyperkube方式安装文档-部署k8s集群监控prometheus-operator(五)

￡神魔★判官ぃ 2022-05-22 09:21 269阅读 0赞

在上一编文章[部署kubernetes][kubernetes]集群成功之后，接下来就是部署监控系统了，本编博客主要是基于coreos开源的prometheus-operator监控系统，该监控系统比较全面，主要是已经搞定了grafana的监控模版，废话不多说，接下来就进入正题:

下载[v0.16.0.tar.gz][] release版本的prometheus-operator,然后解压(也可以下载源码自行编译)

wget https://github.com/coreos/prometheus-operator/archive/v0.16.0.tar.gz
    tar -zvxf v0.16.0.tar.gz
    
    [root@master-27 prometheus]# ls -l
    total 5968
    drwxrwxr-x 13 root root    4096 Jan 12 21:41 prometheus-operator-0.16.0
    -rw-r--r--  1 root root    2068 Jun 20 19:37 prometheus.yaml
    -rwxr-xr-x  1 root root 6102555 Jun 20 20:03 v0.16.0.tar.gz

部署prometheus-operator的deployment

//用到的镜像是
     - --config-reloader-image=quay.io/coreos/configmap-reload:v0.0.1
            image: quay.io/coreos/prometheus-operator:v0.16.0
    
    kubectl create -f bundle.yaml

部署成功查看

[root@master-27 prometheus-operator-0.16.0]# kubectl get deployment 
    NAME                  DESIRED   CURRENT   UP-TO-DATE   AVAILABLE   AGE
    prometheus-operator   1         1         1            1           13h
    
    [root@master-27 prometheus-operator-0.16.0]# kubectl get pod 
    NAME                                   READY     STATUS    RESTARTS   AGE
    prometheus-operator-1084866340-sfpl3   1/1       Running   0          13h

部署grafana alternanager kube-status-meric

[root@master-27 prometheus-operator-0.16.0]# cd contrib/kube-prometheus/
    [root@master-27 kube-prometheus]# pwd
    /root/prometheus/prometheus-operator-0.16.0/contrib/kube-prometheus
    ./hack/cluster-monitoring/deploy
    
    [root@master-27 kube-prometheus]# ./hack/cluster-monitoring/deploy 
    namespace "monitoring" created
    Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply
    clusterrolebinding.rbac.authorization.k8s.io "prometheus-operator" configured
    Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply
    clusterrole.rbac.authorization.k8s.io "prometheus-operator" configured
    serviceaccount "prometheus-operator" created
    service "prometheus-operator" created
    deployment.extensions "prometheus-operator" created
    Waiting for Operator to register custom resource definitions...done!
    daemonset.extensions "node-exporter" created
    serviceaccount "node-exporter" created
    service "node-exporter" created
    unable to recognize "manifests/node-exporter/node-exporter-cluster-role-binding.yaml": no matches for kind "ClusterRoleBinding" in version "rbac.authorization.k8s.io/v1"
    unable to recognize "manifests/node-exporter/node-exporter-cluster-role.yaml": no matches for kind "ClusterRole" in version "rbac.authorization.k8s.io/v1"
    clusterrolebinding.rbac.authorization.k8s.io "kube-state-metrics" created
    clusterrole.rbac.authorization.k8s.io "kube-state-metrics" created
    deployment.extensions "kube-state-metrics" created
    rolebinding.rbac.authorization.k8s.io "kube-state-metrics" created
    role.rbac.authorization.k8s.io "kube-state-metrics-resizer" created
    serviceaccount "kube-state-metrics" created
    service "kube-state-metrics" created
    secret "grafana-credentials" created
    secret "grafana-credentials" unchanged
    configmap "grafana-dashboards-0" created
    deployment.apps "grafana" created
    service "grafana" created
    servicemonitor.monitoring.coreos.com "prometheus-operator" created
    serviceaccount "prometheus-k8s" created
    servicemonitor.monitoring.coreos.com "kube-controller-manager" created
    servicemonitor.monitoring.coreos.com "node-exporter" created
    servicemonitor.monitoring.coreos.com "prometheus" created
    prometheus.monitoring.coreos.com "k8s" created
    servicemonitor.monitoring.coreos.com "kube-state-metrics" created
    servicemonitor.monitoring.coreos.com "alertmanager" created
    servicemonitor.monitoring.coreos.com "kubelet" created
    servicemonitor.monitoring.coreos.com "kube-scheduler" created
    configmap "prometheus-k8s-rules" created
    service "prometheus-k8s" created
    servicemonitor.monitoring.coreos.com "kube-apiserver" created
    role.rbac.authorization.k8s.io "prometheus-k8s" created
    role.rbac.authorization.k8s.io "prometheus-k8s" created
    role.rbac.authorization.k8s.io "prometheus-k8s" created
    clusterrole.rbac.authorization.k8s.io "prometheus-k8s" created
    rolebinding.rbac.authorization.k8s.io "prometheus-k8s" created
    rolebinding.rbac.authorization.k8s.io "prometheus-k8s" created
    rolebinding.rbac.authorization.k8s.io "prometheus-k8s" created
    clusterrolebinding.rbac.authorization.k8s.io "prometheus-k8s" created
    secret "alertmanager-main" created
    service "alertmanager-main" created
    alertmanager.monitoring.coreos.com "main" created

用到的镜像好多,这里就不多说了，主要是有个镜像是谷歌的需要翻墙，可以自行翻墙下载，其他镜像都是`quay.io/coreos`，这个特别的镜像是

gcr.io/google_containers/addon-resizer:1.0

查看结果

[root@master-27 kube-prometheus]# kubectl get deployment -n monitoring 
    NAME                  DESIRED   CURRENT   UP-TO-DATE   AVAILABLE   AGE
    grafana               1         1         1            1           13h
    kube-state-metrics    1         1         1            1           13h
    prometheus-operator   1         1         1            1           13h
    
    [root@master-27 kube-prometheus]# kubectl get pods -n monitoring 
    NAME                                   READY     STATUS    RESTARTS   AGE
    alertmanager-main-0                    2/2       Running   0          13h
    alertmanager-main-1                    2/2       Running   0          13h
    alertmanager-main-2                    2/2       Running   0          13h
    grafana-2315080943-nzl62               2/2       Running   0          12h
    kube-state-metrics-2381097451-06789    4/4       Running   0          40s
    node-exporter-2s6bm                    2/2       Running   0          13h
    node-exporter-q79n2                    2/2       Running   0          13h
    node-exporter-r4dqt                    2/2       Running   0          13h
    prometheus-k8s-0                       2/2       Running   0          13h
    prometheus-k8s-1                       2/2       Running   0          13h
    prometheus-operator-1084866340-ljvfm   1/1       Running   0          13h

[root@master-27 kube-prometheus]# kubectl get svc -n monitoring 
    NAME                    TYPE        CLUSTER-IP     EXTERNAL-IP   PORT(S)             AGE
    alertmanager-main       NodePort    10.12.192.98   <none>        9093:30903/TCP      13h
    alertmanager-operated   ClusterIP   None           <none>        9093/TCP,6783/TCP   13h
    grafana                 NodePort    10.0.122.89    <none>        3000:30902/TCP      13h
    kube-state-metrics      ClusterIP   None           <none>        8443/TCP,9443/TCP   13h
    node-exporter           ClusterIP   None           <none>        9100/TCP            13h
    prometheus-k8s          NodePort    10.3.237.34    <none>        9090:30900/TCP      13h
    prometheus-operated     ClusterIP   None           <none>        9090/TCP            13h
    prometheus-operator     ClusterIP   10.10.228.57   <none>        8080/TCP            13h

访问grafana的页面`master-ip:/30902`,  
![grafana][]  
访问prometheus的页面`master-ip:/30900`  
![111][]

访问alertmanager 告警页面`master-ip:/30903`  
![1al][]  
到此为止，已经成功部署了k8s集群监控prometheus-operator

参考:  
[Kubernetes监控(coreos/prometheus-operator)][Kubernetes_coreos_prometheus-operator]  
[官方网站][Link 1]

[kubernetes]: https://blog.csdn.net/qq_21816375/article/details/80712873
[v0.16.0.tar.gz]: https://github.com/coreos/prometheus-operator/archive/v0.16.0.tar.gz
[grafana]: /images/20220522/7f841abc5dbb49e5adf72d56b17996bc.png
[111]: /images/20220522/bd99abbe6a664b43977b3187f716a8a3.png
[1al]: /images/20220522/94ce6a741a0845d584b3b2b785aab420.png
[Kubernetes_coreos_prometheus-operator]: https://www.jianshu.com/p/5e5b64390db4
[Link 1]: https://github.com/coreos/prometheus-operator/tree/v0.17.0