使用Docker快速部署ELK環境(最新5.5.1版本)
在Linux伺服器上安裝Docker以後,Pull相關的官方Docker映象:
docker pull docker.elastic.co/elasticsearch/elasticsearch:5.5.1
docker pull docker.elastic.co/kibana/kibana:5.5.1
docker pull docker.elastic.co/logstash/logstash:5.5.1
啟動Elastic Search容器:
docker run -p 9200:9200 -e "http.host=0.0.0.0" -e "transport.host=127.0.0.1" \
-- name my-elastic -d docker.elastic.co/elasticsearch/elasticsearch:5.5.1
啟動Kibana容器:
docker run -p 5601:5601 -e "ELASTICSEARCH_URL=http://localhost:9200" --name my-kibana \
--network host -d docker.elastic.co/kibana/kibana:5.5.1
建立logstash/logstash.yml,配置xpack對於logstash的監控:
http.host: "0.0.0.0"
path.config: /usr/share/logstash/pipeline
xpack.monitoring.elasticsearch.url: http://localhost:9200
xpack.monitoring.elasticsearch.username: elastic
xpack.monitoring.elasticsearch.password: changeme
建立logstash/conf.d/logstash.conf,配置logstash的輸入輸出:
input {
file {
path => "/tmp/access_log"
start_position => "beginning"
}
}
output {
elasticsearch {
hosts => ["localhost:9200" ]
user => "elastic"
password => "changeme"
}
}
啟動Logstash容器:
docker run -v /home/ubuntu/logstash/conf.d:/usr/share/logstash/pipeline/:ro -v /tmp:/tmp:ro \
-v /home/ubuntu/logstash/logstash.yml:/usr/share/logstash/config/logstash.yml:ro --name my-logstash \
--network host -d docker.elastic.co/logstash/logstash:5.5.1
測試一下,在/tmp/access.log中新增兩行資訊:
echo "Hello World!" >> /tmp/access_log
echo "Hello ELK!" >> /tmp/access_log
開啟kibana的連結http://yourhost:5601,使用使用者名稱/密碼: elastic/changeme登入。在”Configure an index pattern”頁面點選Create按鈕。點選選單Monitor即可檢視ELK節點的狀態
在Kibana點選Discover選單,可以看到相關的日誌資訊:
使用Elastic Search叢集部署
Elastic官方提供了用docker-compose啟動Elastic Search叢集的方法,首先安裝docker-compose
curl -L https://github.com/docker/compose/releases/download/1.15.0/docker-compose-Linux-x86_64 \
> /usr/local/bin/docker-compose
sudo chmod +x /usr/local/bin/docker-compose
docker-compose --version
建立一個elasticsearch/docker-compose.yml檔案:
version: '2'
services:
elasticsearch1:
image: docker.elastic.co/elasticsearch/elasticsearch:5.5.1
container_name: elasticsearch1
environment:
- cluster.name=docker-cluster
- bootstrap.memory_lock=true
- "ES_JAVA_OPTS=-Xms512m -Xmx512m"
ulimits:
memlock:
soft: -1
hard: -1
mem_limit: 1g
volumes:
- esdata1:/usr/share/elasticsearch/data
ports:
- 9200:9200
networks:
- esnet
elasticsearch2:
image: docker.elastic.co/elasticsearch/elasticsearch:5.5.1
environment:
- cluster.name=docker-cluster
- bootstrap.memory_lock=true
- "ES_JAVA_OPTS=-Xms512m -Xmx512m"
- "discovery.zen.ping.unicast.hosts=elasticsearch1"
ulimits:
memlock:
soft: -1
hard: -1
mem_limit: 1g
volumes:
- esdata2:/usr/share/elasticsearch/data
networks:
- esnet
volumes:
esdata1:
driver: local
esdata2:
driver: local
networks:
esnet:
在/etc/sysctl.conf檔案中追加一行
vm.max_map_count = 262144
執行命令應用變更:
sudo sysctl -p
在docker-compose.yml所在的目錄執行以下命令,啟動elastic search叢集:
docker stop my-elastic && docker rm my-elastic
docker-compose up &
在Kibana中Monitor選單中可以看到,Elastic Search叢集已經正常工作:
修改預設密碼
Elastic Docker Images的預設賬號密碼是elastic/changeme,使用預設密碼是不安全的,假設要把密碼改為elastic0。在Docker所在伺服器上執行命令,修改使用者elastic的密碼:
curl -XPUT -u elastic 'localhost:9200/_xpack/security/user/elastic/_password' -H "Content-Type: application/json" \
-d '{
"password" : "elastic0"
}'
設定密碼,重啟Kibana:
docker stop my-kibana && docker rm my-kibana
docker run -p 5601:5601 -e "ELASTICSEARCH_URL=http://localhost:9200" -e "ELASTICSEARCH_PASSWORD=elastic0" \
--name my-kibana --network host -d docker.elastic.co/kibana/kibana:5.5.1
修改logstash/logstash.yml,logstash/conf.d/logstash.conf中的密碼,然後重啟logstash服務
docker restart my-logstash
測試一下,在/tmp/access.log中新增兩行資訊:
echo "Hello World!" >> /tmp/access_log
echo "Hello ELK!" >> /tmp/access_log
開啟kibana的連結http://yourhost:5601,使用使用者名稱/密碼: elastic/elastic0登入。在”Configure an index pattern”頁面點選Create按鈕。點選選單Monitor即可檢視ELK節點的狀態,預設密碼已經修改成功。