1. 程式人生 > >使用Docker快速部署ELK環境(最新5.5.1版本)

使用Docker快速部署ELK環境(最新5.5.1版本)

在Linux伺服器上安裝Docker以後,Pull相關的官方Docker映象:

docker pull docker.elastic.co/elasticsearch/elasticsearch:5.5.1
docker pull docker.elastic.co/kibana/kibana:5.5.1
docker pull docker.elastic.co/logstash/logstash:5.5.1

啟動Elastic Search容器:

docker run -p 9200:9200 -e "http.host=0.0.0.0" -e "transport.host=127.0.0.1" \
--
name my-elastic -d docker.elastic.co/elasticsearch/elasticsearch:5.5.1

啟動Kibana容器:

docker run -p 5601:5601 -e "ELASTICSEARCH_URL=http://localhost:9200" --name my-kibana \
--network host -d docker.elastic.co/kibana/kibana:5.5.1

建立logstash/logstash.yml,配置xpack對於logstash的監控:

http.host: "0.0.0.0"
path.config: /usr/share/logstash/pipeline
xpack.monitoring.elasticsearch.url: http://localhost:9200 xpack.monitoring.elasticsearch.username: elastic xpack.monitoring.elasticsearch.password: changeme

建立logstash/conf.d/logstash.conf,配置logstash的輸入輸出:

input {
  file {
    path => "/tmp/access_log"
    start_position => "beginning"
  }
}
output {
  elasticsearch {
    hosts => ["localhost:9200"
] user => "elastic" password => "changeme" } }

啟動Logstash容器:

docker run -v /home/ubuntu/logstash/conf.d:/usr/share/logstash/pipeline/:ro -v /tmp:/tmp:ro \
-v /home/ubuntu/logstash/logstash.yml:/usr/share/logstash/config/logstash.yml:ro --name my-logstash \
--network host -d docker.elastic.co/logstash/logstash:5.5.1

測試一下,在/tmp/access.log中新增兩行資訊:

echo "Hello World!" >> /tmp/access_log
echo "Hello ELK!" >> /tmp/access_log

開啟kibana的連結http://yourhost:5601,使用使用者名稱/密碼: elastic/changeme登入。在”Configure an index pattern”頁面點選Create按鈕。點選選單Monitor即可檢視ELK節點的狀態
Kibana Monitor
在Kibana點選Discover選單,可以看到相關的日誌資訊:
Kibana Discover

使用Elastic Search叢集部署

Elastic官方提供了用docker-compose啟動Elastic Search叢集的方法,首先安裝docker-compose

curl -L https://github.com/docker/compose/releases/download/1.15.0/docker-compose-Linux-x86_64 \
> /usr/local/bin/docker-compose
sudo chmod +x /usr/local/bin/docker-compose
docker-compose --version

建立一個elasticsearch/docker-compose.yml檔案:

version: '2'
services:
  elasticsearch1:
    image: docker.elastic.co/elasticsearch/elasticsearch:5.5.1
    container_name: elasticsearch1
    environment:
      - cluster.name=docker-cluster
      - bootstrap.memory_lock=true
      - "ES_JAVA_OPTS=-Xms512m -Xmx512m"
    ulimits:
      memlock:
        soft: -1
        hard: -1
    mem_limit: 1g
    volumes:
      - esdata1:/usr/share/elasticsearch/data
    ports:
      - 9200:9200
    networks:
      - esnet
  elasticsearch2:
    image: docker.elastic.co/elasticsearch/elasticsearch:5.5.1
    environment:
      - cluster.name=docker-cluster
      - bootstrap.memory_lock=true
      - "ES_JAVA_OPTS=-Xms512m -Xmx512m"
      - "discovery.zen.ping.unicast.hosts=elasticsearch1"
    ulimits:
      memlock:
        soft: -1
        hard: -1
    mem_limit: 1g
    volumes:
      - esdata2:/usr/share/elasticsearch/data
    networks:
      - esnet

volumes:
  esdata1:
    driver: local
  esdata2:
    driver: local

networks:
  esnet:

在/etc/sysctl.conf檔案中追加一行

vm.max_map_count = 262144

執行命令應用變更:

sudo sysctl -p

在docker-compose.yml所在的目錄執行以下命令,啟動elastic search叢集:

docker stop my-elastic && docker rm my-elastic
docker-compose up &

在Kibana中Monitor選單中可以看到,Elastic Search叢集已經正常工作:
Elastic Cluster

修改預設密碼

Elastic Docker Images的預設賬號密碼是elastic/changeme,使用預設密碼是不安全的,假設要把密碼改為elastic0。在Docker所在伺服器上執行命令,修改使用者elastic的密碼:

curl -XPUT -u elastic 'localhost:9200/_xpack/security/user/elastic/_password' -H "Content-Type: application/json" \
-d '{
  "password" : "elastic0"
}'

設定密碼,重啟Kibana:

docker stop my-kibana && docker rm my-kibana
docker run -p 5601:5601 -e "ELASTICSEARCH_URL=http://localhost:9200" -e "ELASTICSEARCH_PASSWORD=elastic0"  \
--name my-kibana --network host -d docker.elastic.co/kibana/kibana:5.5.1

修改logstash/logstash.yml,logstash/conf.d/logstash.conf中的密碼,然後重啟logstash服務

docker restart my-logstash

測試一下,在/tmp/access.log中新增兩行資訊:

echo "Hello World!" >> /tmp/access_log
echo "Hello ELK!" >> /tmp/access_log

開啟kibana的連結http://yourhost:5601,使用使用者名稱/密碼: elastic/elastic0登入。在”Configure an index pattern”頁面點選Create按鈕。點選選單Monitor即可檢視ELK節點的狀態,預設密碼已經修改成功。