1. 程式人生 > >三、ElasticSearch6 叢集安裝

三、ElasticSearch6 叢集安裝

一、停止ElasticSearch

[[email protected] elasticsearch-6.2.4]$ jps
29963 Jps
29196 Elasticsearch
[[email protected] elasticsearch-6.2.4]$ kill -9 29196
[[email protected] elasticsearch-6.2.4]$ 
[[email protected] elasticsearch-6.2.4]$ jps
29978 Jps

二、清除資料

注:如果不清楚、叢集搭建好之後會報錯的

[[email protected]
elasticsearch-6.2.4]$ pwd /home/payment/elasticSearch/elasticsearch-6.2.4 [[email protected] elasticsearch-6.2.4]$ ll 總用量 240 drwxr-xr-x. 2 payment payment 4096 6月 5 21:16 bin drwxr-xr-x. 3 payment payment 4096 6月 6 13:08 config drwxrwxr-x. 2 payment payment 4096 6月 6 14:12 data drwxr-xr-x. 2 payment payment 4096 4月 13 04:39 lib -rw-r--r--. 1 payment payment 11358 4月 13 04:33 LICENSE.txt drwxr-xr-x. 2 payment payment 4096 6月 6 10:21 logs drwxr-xr-x. 16 payment payment 4096 4月 13 04:39 modules -rw-r--r--. 1 payment payment 191887 4月 13 04:38 NOTICE.txt drwxr-xr-x. 3 payment payment 4096 6月 6 13:08 plugins -rw-r--r--. 1 payment payment 9268 4月 13 04:33 README.textile [
[email protected]
elasticsearch-6.2.4]$ rm -rf data/* logs/*

三、拷貝ElasticSearch

[[email protected] elasticsearch-6.2.4]$ cd ..
[[email protected] elasticSearch]$ ll
總用量 28380
drwxr-xr-x. 9 payment payment     4096 6月   6 10:21 elasticsearch-6.2.4
-rw-rw-r--. 1 payment payment 29056810 5月  15 12:56 elasticsearch-6.2.4.tar.gz
[
[email protected]
elasticSearch]$ [[email protected] elasticSearch]$ cp -r elasticsearch-6.2.4 elasticsearch-6.2.4-2 [[email protected] elasticSearch]$ cp -r elasticsearch-6.2.4 elasticsearch-6.2.4-3 [[email protected] elasticSearch]$ mv elasticsearch-6.2.4 elasticsearch-6.2.4-1 [[email protected] elasticSearch]$ ll 總用量 28388 drwxr-xr-x. 9 payment payment 4096 6月 6 10:21 elasticsearch-6.2.4-1 drwxr-xr-x. 9 payment payment 4096 6月 6 14:13 elasticsearch-6.2.4-2 drwxr-xr-x. 9 payment payment 4096 6月 6 14:13 elasticsearch-6.2.4-3

四、修改配置檔案

分別修改3個節點的配置檔案

[[email protected] ~]$ grep '^[a-z]'  elasticSearch/elasticsearch-6.2.4-1/config/elasticsearch.yml
cluster.name: dev_elastic_cluster
node.name: node-1
node.master: true
node.data: true
bootstrap.memory_lock: false
bootstrap.system_call_filter: false
network.host: 172.17.63.15
http.port: 9200
transport.tcp.port: 9300
http.cors.enabled: true
http.cors.allow-origin: "*"
discovery.zen.ping.unicast.hosts: ["172.17.63.15:9300", "172.17.63.15:9301", "172.17.63.15:9302"]
[[email protected] ~]$ grep '^[a-z]'  elasticSearch/elasticsearch-6.2.4-2/config/elasticsearch.yml
cluster.name: dev_elastic_cluster
node.name: node-2
node.master: true
node.data: true
bootstrap.memory_lock: false
bootstrap.system_call_filter: false
network.host: 172.17.63.15
http.port: 9201
transport.tcp.port: 9301
http.cors.enabled: true
http.cors.allow-origin: "*"
discovery.zen.ping.unicast.hosts: ["172.17.63.15:9300", "172.17.63.15:9301", "172.17.63.15:9302"]
[[email protected] ~]$ grep '^[a-z]'  elasticSearch/elasticsearch-6.2.4-3/config/elasticsearch.yml
cluster.name: dev_elastic_cluster
node.name: node-3
node.master: true
node.data: true
bootstrap.memory_lock: false
bootstrap.system_call_filter: false
network.host: 172.17.63.15
http.port: 9202
transport.tcp.port: 9302
http.cors.enabled: true
http.cors.allow-origin: "*"
discovery.zen.ping.unicast.hosts: ["172.17.63.15:9300", "172.17.63.15:9301", "172.17.63.15:9302"]

五、啟動叢集

1、啟動三個節點

  /home/payment/elasticSearch/elasticsearch-6.2.4-1/bin/elasticsearch -d
  /home/payment/elasticSearch/elasticsearch-6.2.4-2/bin/elasticsearch -d
  /home/payment/elasticSearch/elasticsearch-6.2.4-3/bin/elasticsearch -d

2、監聽日誌:

監聽elasticSearch安裝目錄下logs資料夾下的日誌檔案(叢集名.log)

[[email protected] logs]$ tail -f ~/elasticSearch/elasticsearch-6.2.4-1/logs/dev_elastic_cluster.log 
[2018-06-06T14:23:58,818][INFO ][o.e.n.Node               ] [node-1] initializing ...
[2018-06-06T14:23:58,986][INFO ][o.e.e.NodeEnvironment    ] [node-1] using [1] data paths, mounts [[/ (rootfs)]], net usable_space [402.7gb], net total_space [442.7gb], types [rootfs]
[2018-06-06T14:23:58,986][INFO ][o.e.e.NodeEnvironment    ] [node-1] heap size [990.7mb], compressed ordinary object pointers [true]
[2018-06-06T14:23:58,987][INFO ][o.e.n.Node               ] [node-1] node name [node-1], node ID [QCOxIqY7Tua3gFpNeUiupA]
[2018-06-06T14:23:58,988][INFO ][o.e.n.Node               ] [node-1] version[6.2.4], pid[30202], build[ccec39f/2018-04-12T20:37:28.497551Z], OS[Linux/2.6.32-696.28.1.el6.x86_64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_161/25.161-b12]
[2018-06-06T14:23:58,988][INFO ][o.e.n.Node               ] [node-1] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.RExwmCgI, -XX:+HeapDumpOnOutOfMemoryError, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:logs/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/home/payment/elasticSearch/elasticsearch-6.2.4-1, -Des.path.conf=/home/payment/elasticSearch/elasticsearch-6.2.4-1/config]
[2018-06-06T14:23:59,596][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [aggs-matrix-stats]
[2018-06-06T14:23:59,596][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [analysis-common]
[2018-06-06T14:23:59,596][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [ingest-common]
[2018-06-06T14:23:59,596][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [lang-expression]
[2018-06-06T14:23:59,596][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [lang-mustache]
[2018-06-06T14:23:59,596][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [lang-painless]
[2018-06-06T14:23:59,596][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [mapper-extras]
[2018-06-06T14:23:59,596][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [parent-join]
[2018-06-06T14:23:59,596][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [percolator]
[2018-06-06T14:23:59,596][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [rank-eval]
[2018-06-06T14:23:59,596][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [reindex]
[2018-06-06T14:23:59,596][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [repository-url]
[2018-06-06T14:23:59,597][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [transport-netty4]
[2018-06-06T14:23:59,597][INFO ][o.e.p.PluginsService     ] [node-1] loaded module [tribe]
[2018-06-06T14:23:59,597][INFO ][o.e.p.PluginsService     ] [node-1] loaded plugin [analysis-ik]
[2018-06-06T14:24:02,376][INFO ][o.e.d.DiscoveryModule    ] [node-1] using discovery type [zen]
[2018-06-06T14:24:02,907][INFO ][o.e.n.Node               ] [node-1] initialized
[2018-06-06T14:24:02,907][INFO ][o.e.n.Node               ] [node-1] starting ...
[2018-06-06T14:24:03,150][INFO ][o.e.t.TransportService   ] [node-1] publish_address {172.17.63.15:9300}, bound_addresses {172.17.63.15:9300}
[2018-06-06T14:24:03,158][INFO ][o.e.b.BootstrapChecks    ] [node-1] bound or publishing to a non-loopback address, enforcing bootstrap checks
[2018-06-06T14:24:06,235][INFO ][o.e.c.s.MasterService    ] [node-1] zen-disco-elected-as-master ([0] nodes joined), reason: new_master {node-1}{QCOxIqY7Tua3gFpNeUiupA}{XNjZ-E_tQ--mPyFZi9E2eA}{172.17.63.15}{172.17.63.15:9300}
[2018-06-06T14:24:06,240][INFO ][o.e.c.s.ClusterApplierService] [node-1] new_master {node-1}{QCOxIqY7Tua3gFpNeUiupA}{XNjZ-E_tQ--mPyFZi9E2eA}{172.17.63.15}{172.17.63.15:9300}, reason: apply cluster state (from master [master {node-1}{QCOxIqY7Tua3gFpNeUiupA}{XNjZ-E_tQ--mPyFZi9E2eA}{172.17.63.15}{172.17.63.15:9300} committed version [1] source [zen-disco-elected-as-master ([0] nodes joined)]])
[2018-06-06T14:24:06,273][INFO ][o.e.h.n.Netty4HttpServerTransport] [node-1] publish_address {172.17.63.15:9200}, bound_addresses {172.17.63.15:9200}
[2018-06-06T14:24:06,273][INFO ][o.e.n.Node               ] [node-1] started
[2018-06-06T14:24:06,395][INFO ][o.e.g.GatewayService     ] [node-1] recovered [0] indices into cluster_state
[2018-06-06T14:24:11,182][INFO ][o.e.c.s.MasterService    ] [node-1] zen-disco-node-join[{node-2}{Q3m2buqsQ7O3RDOabPng6g}{v8PAwZFjT-OGbCbdsazLpA}{172.17.63.15}{172.17.63.15:9301}], reason: added {{node-2}{Q3m2buqsQ7O3RDOabPng6g}{v8PAwZFjT-OGbCbdsazLpA}{172.17.63.15}{172.17.63.15:9301},}
[2018-06-06T14:24:11,381][INFO ][o.e.c.s.ClusterApplierService] [node-1] added {{node-2}{Q3m2buqsQ7O3RDOabPng6g}{v8PAwZFjT-OGbCbdsazLpA}{172.17.63.15}{172.17.63.15:9301},}, reason: apply cluster state (from master [master {node-1}{QCOxIqY7Tua3gFpNeUiupA}{XNjZ-E_tQ--mPyFZi9E2eA}{172.17.63.15}{172.17.63.15:9300} committed version [3] source [zen-disco-node-join[{node-2}{Q3m2buqsQ7O3RDOabPng6g}{v8PAwZFjT-OGbCbdsazLpA}{172.17.63.15}{172.17.63.15:9301}]]])
[2018-06-06T14:24:11,385][WARN ][o.e.d.z.ElectMasterService] [node-1] value for setting "discovery.zen.minimum_master_nodes" is too low. This can result in data loss! Please set it to at least a quorum of master-eligible nodes (current value: [-1], total number of master-eligible nodes used for publishing in this round: [2])
[2018-06-06T14:24:14,698][INFO ][o.e.c.s.MasterService    ] [node-1] zen-disco-node-join[{node-3}{WdB0vdTWTK2Xb_-Ixl6R0Q}{JXU3ZRdWTdSaVN_LDgmj_w}{172.17.63.15}{172.17.63.15:9302}], reason: added {{node-3}{WdB0vdTWTK2Xb_-Ixl6R0Q}{JXU3ZRdWTdSaVN_LDgmj_w}{172.17.63.15}{172.17.63.15:9302},}
[2018-06-06T14:24:14,904][INFO ][o.e.c.s.ClusterApplierService] [node-1] added {{node-3}{WdB0vdTWTK2Xb_-Ixl6R0Q}{JXU3ZRdWTdSaVN_LDgmj_w}{172.17.63.15}{172.17.63.15:9302},}, reason: apply cluster state (from master [master {node-1}{QCOxIqY7Tua3gFpNeUiupA}{XNjZ-E_tQ--mPyFZi9E2eA}{172.17.63.15}{172.17.63.15:9300} committed version [4] source [zen-disco-node-join[{node-3}{WdB0vdTWTK2Xb_-Ixl6R0Q}{JXU3ZRdWTdSaVN_LDgmj_w}{172.17.63.15}{172.17.63.15:9302}]]])

上面日誌中 看到 

zen-disco-node-join[{node-2}{Q3m2buqsQ7O3RDOabPng6g}{v8PAwZFjT-OGbCbdsazLpA}{172.17.63.15}{172.17.63.15:9301}], reason: added {{node-2}{Q3m2buqsQ7O3RDOabPng6g}{v8PAwZFjT-OGbCbdsazLpA}{172.17.63.15}{172.17.63.15:9301},}
表示叢集中加入了節點、如果沒有自動加入節點、請檢查es目錄下data中是否清空 不清空會無法加入

3、檢測每個節點的啟動狀態
[[email protected] logs]$ curl "172.17.63.15:9200"
{
  "name" : "node-1",
  "cluster_name" : "dev_elastic_cluster",
  "cluster_uuid" : "_iUYTJZpQUGDadjbiDtzaw",
  "version" : {
    "number" : "6.2.4",
    "build_hash" : "ccec39f",
    "build_date" : "2018-04-12T20:37:28.497551Z",
    "build_snapshot" : false,
    "lucene_version" : "7.2.1",
    "minimum_wire_compatibility_version" : "5.6.0",
    "minimum_index_compatibility_version" : "5.0.0"
  },
  "tagline" : "You Know, for Search"
}
[[email protected] logs]$ curl "172.17.63.15:9201"
{
  "name" : "node-2",
  "cluster_name" : "dev_elastic_cluster",
  "cluster_uuid" : "_iUYTJZpQUGDadjbiDtzaw",
  "version" : {
    "number" : "6.2.4",
    "build_hash" : "ccec39f",
    "build_date" : "2018-04-12T20:37:28.497551Z",
    "build_snapshot" : false,
    "lucene_version" : "7.2.1",
    "minimum_wire_compatibility_version" : "5.6.0",
    "minimum_index_compatibility_version" : "5.0.0"
  },
  "tagline" : "You Know, for Search"
}
[[email protected] logs]$ curl "172.17.63.15:9202"
{
  "name" : "node-3",
  "cluster_name" : "dev_elastic_cluster",
  "cluster_uuid" : "_iUYTJZpQUGDadjbiDtzaw",
  "version" : {
    "number" : "6.2.4",
    "build_hash" : "ccec39f",
    "build_date" : "2018-04-12T20:37:28.497551Z",
    "build_snapshot" : false,
    "lucene_version" : "7.2.1",
    "minimum_wire_compatibility_version" : "5.6.0",
    "minimum_index_compatibility_version" : "5.0.0"
  },
  "tagline" : "You Know, for Search"
}
[[email protected] logs]$ 

4、檢視叢集狀態

[[email protected] logs]$ curl "172.17.63.15:9200/_cat/health?v"
epoch      timestamp cluster             status node.total node.data shards pri relo init unassign pending_tasks max_task_wait_time active_shards_percent
1528502937 08:08:57  dev_elastic_cluster green           3         3     0   0    0    0        0             0                  -                100.0%
能看到 node.total 和 node.data 的數量OK即叢集配置OK

相關推薦

ElasticSearch6 叢集安裝

一、停止ElasticSearch[[email protected] elasticsearch-6.2.4]$ jps 29963 Jps 29196 Elasticsearch [[email protected] elasticsearch-6.2

Storm學習記錄(Storm叢集搭建)

一、單機搭建 1.上傳並解壓jar包 2.在storm目錄下建立logs目錄,以儲存程式執行時的資訊 mkdir logs 3.在bin目錄下執行命令,啟動zookeeper ./storm dev-zookeeper >> ../logs/dev-zookeeper

spark學習記錄(spark叢集搭建)

一、安裝spark 1.上傳壓縮包並解壓 2.在conf目錄下配置slaves cp slaves.template slaves //在master機上配置worker節點 hadoop2 hadoop3 3.配置spark-env.sh cp spark-env.sh.t

window上安裝MySQL服務端

                               一、下載服務端 1、下載社群版本的服務端 如果下載慢的話,我還提供了網盤下載: 連結:https://pan.baidu.com/s/1lbjFZt5yAUnkC4kCjsevRQ 密碼:46

安裝Centos7 Mysql8 叢集,實現讀寫分離 高可用()-- 主從設定

零、寫在前面    為了嘗試新技術和業務需要,因此打算搞一套這樣的環境玩兒一下    作業系統及資料庫的安裝請見前兩篇一、理論依據    不再贅述我的硬體規劃等細節    這次僅用到兩臺虛擬機器,一主一

hbase安裝模式,本地安裝偽分佈安裝叢集模式安裝

<property>         <name>hbase.rootdir</name>         <value>hdfs://namenode.example.org:8020/hbase</value> <

Apache hadoop叢集安裝種方式:本地偽分佈完全分佈

四 Hadoop執行模式1)官方網址(1)官方網站:(2)各個版本歸檔庫地址 (3)hadoop2.7.2版本詳情介紹2)Hadoop執行模式(1)本地模式(預設模式):不需要啟用單獨程序,直接可以執行,測試和開發時使用。(2)偽分散式模式:等同於完全分散式,只有一個節點。(

環境搭建 之 Windows10 安裝 Apache2.4.23

地址 管理員 解壓 技術 項目 可能 配置 httpd 安裝步驟 操作系統:Windows10 家庭中文版 Apache版本:2.4.23 下載地址:http://pan.baidu.com/s/1nuB6cjf 參考文檔:win7(64位)php5.5-Apache2.4

安裝並配置Kubernetes Node節點

vim rgs conf clu leg -a 管理系 redhat pri 1. 安裝並配置Kubernetes Node節點 1.1 安裝Kubernetes Node節點所需服務 yum -y install kubernetes ? 通過yum安裝kubernete

安裝軟件包的種方法yumrpm源碼安裝

rpm yum 一、軟件安裝方法1.rpm安裝rpm安裝軟件時不會自動安裝依賴2.yum安裝yum安裝軟件時會自動安裝軟件所需的依賴3.源碼安裝最難,需要編譯二、rpm介紹首先將之前的系統光驅掛載,mount /dev/cdrom /mnt/執行上面命令將iso掛載到/mnt/下ls /mnt/ c

kafka安裝配置

取數 自我保護 ash cti 條件 hostname 寫入 數據 這也 config/server.properties broker.id 0 每一個broker在集群中的唯一表示,要求是正數。當該服務器的IP地址發生改變時,broker.id沒有變化,則不會影響

北京快_源碼出售安裝配置常用命令

進程 viso 一個 文件備份 redirect 報錯 用法 管理工具 efault 在北京快_三源碼出售 Q1446595067 應用部署到線上後,需要保證應用一直處於運行狀態,在遇到程序異常、報錯等情況,導致 web 應用終止時,需要保證程序可以立刻重啟,繼續提供服務

OpenStack Pike Minimal安裝鏡像管理

sta yum token png int internal ble mage nec 1.創建服務憑據 #先使用腳本登陸admin [root@controller ~]# . admin-openstack.sh ①創建glance user openstack u

自制Hadoop偽分佈叢集安裝詳細過程(vmware)

Hadoop單機版、偽分佈、叢集安裝教程推薦連結: http://dblab.xmu.edu.cn/blog/page/2/?s=Hadoop 注:vmware6.5及以上,執行命令基本相同,除了編輯檔案時“vi”指令替換為“vim”指令 一、下載安裝所需檔案   

Spark的低成本安裝(win) and 節點叢集安裝(linux)

我這裡給出兩種安裝spark的方式,一種是在win上安裝另一種就是在linux叢集上安裝,前一種安裝方式是一種低成本的安裝沒有shell介面,非常適合入過門的小白練習自己對spark的業務處理能力,而且這種安裝方式能對電腦省去一大筆的cpu所以個人比較喜歡,第二種安裝方式就是和之前安裝hadoo

WAS叢集安裝<五>DMAppIHS整合叢集配置

簡介: 通過前面四章內容,已經完成了對環境的配置、DM、App、IHS的安裝和配置,本文就對DM、App、IHS進行一個整合配置,讓叢集環境執行起來 1、App節點中,命令模式新增App節點到DM管理中 1.1命令列模式新增節點,在App應用伺服器端執行命令,3個App

WAS叢集安裝<>App(Application Server)節點安裝配置

剛剛我們已經做好DM節點的配置了,現在我們來進行WAS的應用節點安裝配置 簡介: 文字對App節點進行安裝配置,App主要是負責管理應用,對安裝過程中的一些特殊點進行說明。 1、執行軟體,啟動WAS的安裝程式      安裝目錄在/o

搭建電影網站詳細教程——安裝蘋果CMS

之前已經把所需要的環境搭建好了,下面開始安裝CMS。 預設應該自動彈出安裝頁面的,如果沒有的話就輸入 http://您的域名/install.php進入安裝介面。 同意進入下一步 接著,進入環境模組檢測,系統會根據您的環境檢測是否能夠安裝,環境檢測沒有問題,點選下方的“進行

從0到1使用Kubernetes系列()——使用Ansible安裝Kubernetes叢集

上一篇文章《從0到1使用Kubernetes系列(二):安裝工具介紹》中,說到了Ansible的功能以及使用Ansible進行叢集部署的優勢,接下來將在本文中介紹如何通過Virtualbox + Vagrant啟動CentOS虛擬機器,並且使用ansible指令碼在虛擬機器中搭建kubern

Linux(centos7) Elasticsearch6.5叢集安裝與Kibana視覺化

必須要先安全JDK1.8或以上版本,記憶體配置1G以上,最好2G https://www.elastic.co/cn/downloads/elasticsearch#ga-release  官網下載tar 上傳到linux 解壓 tar -zxvf elasticsearch-