elastic+kibana安装记录(ELK)

Love The Way You Lie 2023-03-13 06:56 3阅读 0赞

### 安装elasticsearch ###

> 由于使用elastic apm需要依赖elasticsearch和kibana，这里先把这两个组件安装一下。

### ELK安装参考的博客地址 ###

https://blog.csdn.net/tanqian351/article/details/83827583

### 官网下载地址 ###

https://www.elastic.co/cn/downloads/elasticsearch

[elasticsearch-7.6.2-linux-x86\_64.tar.gz下载地址][elasticsearch-7.6.2-linux-x86_64.tar.gz]

网上说启动elastic需要使用elsearch用户和elsearch用户组，如果使用root启动不了或者启动有问题可以新建一个elsearch用户来试试。

### 解压、修改配置文件 ###

[elsearch@host01 elk]$ tar -zxvf elasticsearch-7.6.2-linux-x86_64.tar.gz

### 进入解压后的config目录修改配置文件 ###

[elsearch@host01 config]$ cat elasticsearch.yml 
    # ======================== Elasticsearch Configuration =========================
    #
    # NOTE: Elasticsearch comes with reasonable defaults for most settings.
    # Before you set out to tweak and tune the configuration, make sure you
    # understand what are you trying to accomplish and the consequences.
    #
    # The primary way of configuring a node is via this file. This template lists
    # the most important settings you may want to configure for a production cluster.
    #
    # Please consult the documentation for further information on configuration options:
    # https://www.elastic.co/guide/en/elasticsearch/reference/index.html
    #
    # ---------------------------------- Cluster -----------------------------------
    #
    # Use a descriptive name for your cluster:
    #
    #cluster.name: my-application
    #
    # ------------------------------------ Node ------------------------------------
    #
    # Use a descriptive name for the node:
    #
    node.name: master
    #
    # Add custom attributes to the node:
    #
    #node.attr.rack: r1
    #
    # ----------------------------------- Paths ------------------------------------
    #
    # Path to directory where to store the data (separate multiple locations by comma):
    #
    #path.data: /path/to/data
    #
    # Path to log files:
    #
    #path.logs: /path/to/logs
    #
    # ----------------------------------- Memory -----------------------------------
    #
    # Lock the memory on startup:
    #
    #bootstrap.memory_lock: true
    #
    # Make sure that the heap size is set to about half the memory available
    # on the system and that the owner of the process is allowed to use this
    # limit.
    #
    # Elasticsearch performs poorly when the system is swapping the memory.
    #
    # ---------------------------------- Network -----------------------------------
    #
    # Set the bind address to a specific IP (IPv4 or IPv6):
    #
    network.host: 192.168.1.78
    #
    # Set a custom port for HTTP:
    #
    http.port: 9200
    #
    # For more information, consult the network module documentation.
    #
    # --------------------------------- Discovery ----------------------------------
    #
    # Pass an initial list of hosts to perform discovery when this node is started:
    # The default list of hosts is ["127.0.0.1", "[::1]"]
    #
    discovery.seed_hosts: ["192.168.1.78"]
    #
    # Bootstrap the cluster using an initial set of master-eligible nodes:
    #
    #cluster.initial_master_nodes: ["node-1", "node-2"]
    cluster.initial_master_nodes: ["master"]
    #
    # For more information, consult the discovery and cluster formation module documentation.
    #
    # ---------------------------------- Gateway -----------------------------------
    #
    # Block initial recovery after a full cluster restart until N nodes are started:
    #
    #gateway.recover_after_nodes: 3
    #
    # For more information, consult the gateway module documentation.
    #
    # ---------------------------------- Various -----------------------------------
    #
    # Require explicit names when deleting indices:
    #
    #action.destructive_requires_name: true
    #network.host: 192.168.1.78
    #http.port: 9200
    http.cors.enabled: true
    http.cors.allow-origin: "*"

**其实只修改了这几个属性**

节点的名字
    node.name: master
    机器的IP
    network.host: 192.168.1.78
    通信的端口
    http.port: 9200
    集群地址列表，这里单机，配置一个就行
    discovery.seed_hosts: ["192.168.1.78"]
    初始化节点，这里的名字要和上面的名字一样，因为是单节点
    cluster.initial_master_nodes: ["master"]
    下面这个两个属性好像没什么用
    http.cors.enabled: true
    http.cors.allow-origin: "*"

### 启动elasticsearch就可以了 ###

[getting-started-install.html][]

[elsearch@host01 bin]$ sh elasticsearch

### 测试es ###

cs默认启动的端口是9200，访问ip+端口，有返回json串就算启动成功了。

http://192.168.11.18:9200/  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMTAzMTYxODg_size_16_color_FFFFFF_t_70]

#### 安装elasticsearch遇到的两个问题 ####

[1]: max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
    [2]: the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_master_nodes] must be configured

[问题一解决方案][Link 1]  
[问题二解决方案][Link 2]

### 安装kibana ###

[kibana官网地址网页][kibana]  
[kibana下载地址][kibana 1]  
[Install Kibana from archive on Linux or MacOS][]  
**官网的下载代码，直接执行就可以**

curl -O https://artifacts.elastic.co/downloads/kibana/kibana-7.6.2-linux-x86_64.tar.gz
    curl https://artifacts.elastic.co/downloads/kibana/kibana-7.6.2-linux-x86_64.tar.gz.sha512 | shasum -a 512 -c - 
    tar -xzf kibana-7.6.2-linux-x86_64.tar.gz
    cd kibana-7.6.2-linux-x86_64/

### 解压后修改配置文件 ###

# Kibana is served by a back end server. This setting specifies the port to use.
    server.port: 5601
    
    # Specifies the address to which the Kibana server will bind. IP addresses and host names are both valid values.
    # The default is 'localhost', which usually means remote machines will not be able to connect.
    # To allow connections from remote users, set this parameter to a non-loopback address.
    server.host: "192.168.1.78"
    
    # Enables you to specify a path to mount Kibana at if you are running behind a proxy.
    # Use the `server.rewriteBasePath` setting to tell Kibana if it should remove the basePath
    # from requests it receives, and to prevent a deprecation warning at startup.
    # This setting cannot end in a slash.
    #server.basePath: ""
    
    # Specifies whether Kibana should rewrite requests that are prefixed with
    # `server.basePath` or require that they are rewritten by your reverse proxy.
    # This setting was effectively always `false` before Kibana 6.3 and will
    # default to `true` starting in Kibana 7.0.
    #server.rewriteBasePath: false
    
    # The maximum payload size in bytes for incoming server requests.
    #server.maxPayloadBytes: 1048576
    
    # The Kibana server's name. This is used for display purposes.
    #server.name: "your-hostname"
    
    # The URLs of the Elasticsearch instances to use for all your queries.
    elasticsearch.hosts: ["http://192.168.1.78:9200"]
    
    # When this setting's value is true Kibana uses the hostname specified in the server.host
    # setting. When the value of this setting is false, Kibana uses the hostname of the host
    # that connects to this Kibana instance.
    #elasticsearch.preserveHost: true
    
    # Kibana uses an index in Elasticsearch to store saved searches, visualizations and
    # dashboards. Kibana creates a new index if the index doesn't already exist.
    #kibana.index: ".kibana"
    
    # The default application to load.
    #kibana.defaultAppId: "home"
    
    # If your Elasticsearch is protected with basic authentication, these settings provide
    # the username and password that the Kibana server uses to perform maintenance on the Kibana
    # index at startup. Your Kibana users still need to authenticate with Elasticsearch, which
    # is proxied through the Kibana server.
    #elasticsearch.username: "kibana"
    #elasticsearch.password: "pass"
    
    # Enables SSL and paths to the PEM-format SSL certificate and SSL key files, respectively.
    # These settings enable SSL for outgoing requests from the Kibana server to the browser.
    #server.ssl.enabled: false
    #server.ssl.certificate: /path/to/your/server.crt
    #server.ssl.key: /path/to/your/server.key
    
    # Optional settings that provide the paths to the PEM-format SSL certificate and key files.
    # These files are used to verify the identity of Kibana to Elasticsearch and are required when
    # xpack.security.http.ssl.client_authentication in Elasticsearch is set to required.
    #elasticsearch.ssl.certificate: /path/to/your/client.crt
    #elasticsearch.ssl.key: /path/to/your/client.key
    
    # Optional setting that enables you to specify a path to the PEM file for the certificate
    # authority for your Elasticsearch instance.
    #elasticsearch.ssl.certificateAuthorities: [ "/path/to/your/CA.pem" ]
    
    # To disregard the validity of SSL certificates, change this setting's value to 'none'.
    #elasticsearch.ssl.verificationMode: full
    
    # Time in milliseconds to wait for Elasticsearch to respond to pings. Defaults to the value of
    # the elasticsearch.requestTimeout setting.
    #elasticsearch.pingTimeout: 1500
    
    # Time in milliseconds to wait for responses from the back end or Elasticsearch. This value
    # must be a positive integer.
    #elasticsearch.requestTimeout: 30000
    
    # List of Kibana client-side headers to send to Elasticsearch. To send *no* client-side
    # headers, set this value to [] (an empty list).
    #elasticsearch.requestHeadersWhitelist: [ authorization ]
    
    # Header names and values that are sent to Elasticsearch. Any custom headers cannot be overwritten
    # by client-side headers, regardless of the elasticsearch.requestHeadersWhitelist configuration.
    #elasticsearch.customHeaders: {}
    
    # Time in milliseconds for Elasticsearch to wait for responses from shards. Set to 0 to disable.
    #elasticsearch.shardTimeout: 30000
    
    # Time in milliseconds to wait for Elasticsearch at Kibana startup before retrying.
    #elasticsearch.startupTimeout: 5000
    
    # Logs queries sent to Elasticsearch. Requires logging.verbose set to true.
    #elasticsearch.logQueries: false
    
    # Specifies the path where Kibana creates the process ID file.
    #pid.file: /var/run/kibana.pid
    
    # Enables you specify a file where Kibana stores log output.
    #logging.dest: stdout
    
    # Set the value of this setting to true to suppress all logging output.
    #logging.silent: false
    
    # Set the value of this setting to true to suppress all logging output other than error messages.
    #logging.quiet: false
    
    # Set the value of this setting to true to log all events, including system usage information
    # and all requests.
    #logging.verbose: false
    
    # Set the interval in milliseconds to sample system and process performance
    # metrics. Minimum is 100ms. Defaults to 5000.
    #ops.interval: 5000
    
    # Specifies locale to be used for all localizable strings, dates and number formats.
    # Supported languages are the following: English - en , by default , Chinese - zh-CN .
    i18n.locale: "zh-CN"
    #server.port: 5601
    #server.host: "192.168.1.78"
    #elasticsearch.host: "http://192.168.1.78:9200"
    #kibana.index:".kibana"

### 主要修改这几个选项 ###

设置端口
    server.port: 5601
    当前机器ID
    server.host: "192.168.1.78"
    设置es的访问地址
    elasticsearch.hosts: ["http://192.168.1.78:9200"]
    设置中文
    i18n.locale: "zh-CN"

### 启动 ###

如果启动日志里面有`warn`警告的话一定要仔细看，开始我看启动没有报错，但是打印很多警告就没有在意，后面使用的时候一直查询不出来数据，最后定位到`kibana`链接`es`存在问题。

[elsearch@host01 bin]$ ./kibana

### 访问 ###

http://192.168.1.78:5601/app/kibana#/home

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMTAzMTYxODg_size_16_color_FFFFFF_t_70 1]

### 结论 ###

ELK安装的博客也比较多，官网的说明也很明确，不同的版本可能配置会有一些些的差异，开始我也是直接拷贝的别人的配置，发现启动有问题，估计的版本问题，安装的时候注意一下版本号，然后需要看启动的日志，特别注意`warn`之类的。

[elasticsearch-7.6.2-linux-x86_64.tar.gz]: https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.6.2-linux-x86_64.tar.gz
[getting-started-install.html]: https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started-install.html
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMTAzMTYxODg_size_16_color_FFFFFF_t_70]: /images/20230312/0c0f4a920a704a4d8e4efd381369741a.png
[Link 1]: https://blog.csdn.net/jiankunking/article/details/65448030
[Link 2]: https://blog.csdn.net/happyzxs/article/details/89156068
[kibana]: https://www.elastic.co/cn/downloads/kibana
[kibana 1]: https://artifacts.elastic.co/downloads/kibana/kibana-7.6.2-linux-x86_64.tar.gz
[Install Kibana from archive on Linux or MacOS]: https://www.elastic.co/guide/en/kibana/current/targz.html
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3UwMTAzMTYxODg_size_16_color_FFFFFF_t_70 1]: /images/20230312/bea3eb9096534a11aed0490580d0efbe.png