1. 程式人生 > >Greenplum環境安裝配置步驟

Greenplum環境安裝配置步驟

1、環境準備 伺服器分配 192.168.100.101--mdw 192.168.100.11--smdw 192.168.100.12--sdw1 192.168.100.13--sdw2 ms1與ms2之間的心跳ip配置 10.10.10.1--mdw 10.10.10.2--smdw 2、修改hosts檔案(所有主機hosts檔案必須全部修改) vi /etc/hosts 192.168.100.101 mdw 192.168.100.11 smdw 192.168.100.12 sdw1 192.168.100.13 sdw2 3、關閉iptables和selinux [[email protected] ~]# service iptables stop [[email protected] ~]# [[email protected] ~]# [[email protected] ~]# [[email protected] ~]# [[email protected] ~]# chkconfig iptables --list iptables        0:鍏抽棴        1:鍏抽棴        2:鍏抽棴        3:鍏抽棴        4:鍏抽棴        5:鍏抽棴        6:鍏抽棴 [
[email protected]
~]# export LANG=zh_CN [[email protected] ~]# chkconfig iptables --list iptables        0:關閉  1:關閉  2:關閉  3:關閉  4:關閉  5:關閉  6:關閉 [[email protected] ~]# cat /etc/selinux/config # This file controls the state of SELinux on the system. # SELINUX= can take one of these three values: #     enforcing - SELinux security policy is enforced. #     permissive - SELinux prints warnings instead of enforcing. #     disabled - No SELinux policy is loaded. SELINUX=disabled # SELINUXTYPE= can take one of these two values: #     targeted - Targeted processes are protected, #     mls - Multi Level Security protection. SELINUXTYPE=targeted [
[email protected]
~]# setenforce 0 4、修改系統引數 1)vi /etc/sysctl.conf [[email protected] ~]# sysctl -p net.ipv4.ip_forward = 0 net.ipv4.conf.default.rp_filter = 1 net.ipv4.conf.default.accept_source_route = 0 kernel.sysrq = 1 kernel.core_uses_pid = 1 net.ipv4.tcp_syncookies = 1 error: "net.bridge.bridge-nf-call-ip6tables" is an unknown key error: "net.bridge.bridge-nf-call-iptables" is an unknown key error: "net.bridge.bridge-nf-call-arptables" is an unknown key kernel.msgmnb = 65536 kernel.msgmax = 65536 kernel.shmmax = 68719476736 kernel.shmall = 4294967296 error: "kernel.msgmin" is an unknown key vm.overcommit_memory = 2 error: "net.ipv4.cp_tw_recycle" is an unknown key net.ipv4.tcp_max_syn_backlog = 4096 net.ipv4.conf.all.arp_filter = 1 error: "Invalid argument" setting key "net.ipv4.ip_local_port_range" net.core.netdev_max_backlog = 10000 error: "xfs_mount_options" is an unknown key kernel.shmmni = 4096 kernel.sem = 250 512000 100 2048 net.ipv4.tcp_tw_recycle = 1 net.ipv4.conf.default.arp_filter = 1 kernel.msgmni = 2048 2) vi /etc/security/limits.conf * soft nofile 65536 * hard nofile 65536 * soft nproc 131072 * hard nproc 131072 在RHEL6.x版本需要修改檔案 /etc/security/limits.d/90-nproc.conf,增加如下內容: * softnproc 131072        * hardnproc 131072 4、修改完系統引數後重啟伺服器 5、建立gpadmin使用者      useradd gpadmin 6、安裝GP  1) 上傳安裝檔案解壓縮    2)執行安裝檔案 [
[email protected]
GPDB]# ./greenplum-db-4.2.6.3-build-2-RHEL5-x86_64.bin I HAVE READ AND AGREE TO THE TERMS OF THE ABOVE EMC SOFTWARE LICENSE AGREEMENT. ******************************************************************************** Do you accept the EMC Database license agreement? [yes|no] ******************************************************************************** yes ******************************************************************************** Provide the installation path for Greenplum Database or press ENTER to accept the default installation path: /usr/local/greenplum-db-4.2.6.3 ******************************************************************************** /home/gpadmin/GPDB/install ******************************************************************************** Install Greenplum Database into </home/gpadmin/GPDB/install>? [yes|no] ******************************************************************************** yes ******************************************************************************** [Optional] Provide the path to a previous installation of Greenplum Database, or press ENTER to skip this step. e.g. /usr/local/greenplum-db-4.1.1.3 This installation step will migrate any Greenplum Database extensions from the provided path to the version currently being installed. This step is optional and can be run later with: gppkg --migrate <path_to_old_gphome> /home/gpadmin/GPDB/install ******************************************************************************** Extracting product to /home/gpadmin/GPDB/install Skipping migration of Greenplum Database extensions... *************************     ******************************************************* Installation complete. Greenplum Database is installed in /home/gpadmin/GPDB/install Greenplum Database documentation is available for download at http://powerlink.emc.com. ******************************************************************************** [[email protected] GPDB]# [[email protected] install]# source greenplum_path.sh [[email protected] install]# 3)準備allnotes檔案 [[email protected] install]# pwd /home/gpadmin/GPDB/install [[email protected] install]# [[email protected] install]# [[email protected] install]# [[email protected] install]# ls allnotes  bin  demo  docs  etc  ext  GPDB-LICENSE.txt  greenplum_path.sh  include  lib  LICENSE.thirdparty  sbin  share [[email protected] install]# cat allnotes sdw1 sdw2 smdw 4)建立多機互信 [[email protected] install]# gpssh-exkeys -f allnotes [STEP 1 of 5] create local ID and authorize on local host   ... /root/.ssh/id_rsa file exists ... key generation skipped [STEP 2 of 5] keyscan all hosts and update known_hosts file [STEP 3 of 5] authorize current user on remote hosts   ... send to sdw1   ... send to sdw2   ***   *** Enter password for sdw2:   ... send to smdw [STEP 4 of 5] determine common authentication file content [STEP 5 of 5] copy authentication files to all remote hosts   ... finished key exchange with sdw1 [ERROR] unable to copy authentication files to sdw2      lost connection [ERROR] unable to copy authentication files to smdw      lost connection 上述報錯解決辦法:刪除mdw /root/.ssh/目錄下的內容 重新執行gpssh-exkeys -f allnotes 5)建立存放資料的目錄 [[email protected] GPDB]# mkdir data [[email protected] GPDB]# mkdir data/master [[email protected] GPDB]# chown gpadmin:gpadmin data -R [[email protected] GPDB]# [[email protected] GPDB]# [[email protected] GPDB]# ll 鎬葷敤閲109588 drwxr-xr-x  3 gpadmin gpadmin     4096 2鏈 20 16:21 data lrwxrwxrwx  1 root    root           9 2鏈 20 16:02 greenplum-db -> ./install -rwxr-xr-x  1 root    root    56782500 10鏈 8 06:45 greenplum-db-4.2.6.3-build-2-RHEL5-x86_64.bin -rw-r--r--  1 root    root    55417563 11鏈25 11:44 greenplum-db-4.2.6.3-build-2-RHEL5-x86_64.zip drwxr-xr-x 11 root    root        4096 2鏈 20 16:04 install -r--r--r--  1 root    root        6935 10鏈 8 06:45 README_INSTALL [[email protected] GPDB]# 6)其他機器安裝GP     [[email protected] install]# cat allseg smdw sdw1 sdw2 使用gpseginstall安裝 [[email protected] install]# gpseginstall -f allseg -u gpadmin 20140220:16:28:05:003251 gpseginstall:mdw:root-[INFO]:-Installation Info: link_name greenplum-db binary_path /home/gpadmin/GPDB/install binary_dir_location /home/gpadmin/GPDB binary_dir_name install 20140220:16:28:05:003251 gpseginstall:mdw:root-[INFO]:-check cluster password access 20140220:16:28:06:003251 gpseginstall:mdw:root-[INFO]:-de-duplicate hostnames 20140220:16:28:06:003251 gpseginstall:mdw:root-[INFO]:-master hostname: mdw 20140220:16:28:07:003251 gpseginstall:mdw:root-[INFO]:-check for user gpadmin on cluster 20140220:16:28:07:003251 gpseginstall:mdw:root-[INFO]:-add user gpadmin on master 20140220:16:28:08:003251 gpseginstall:mdw:root-[INFO]:-add user gpadmin on cluster 20140220:16:28:08:003251 gpseginstall:mdw:root-[INFO]:-chown -R gpadmin:gpadmin /home/gpadmin/GPDB/greenplum-db 20140220:16:28:08:003251 gpseginstall:mdw:root-[INFO]:-chown -R gpadmin:gpadmin /home/gpadmin/GPDB/install 20140220:16:28:08:003251 gpseginstall:mdw:root-[INFO]:-rm -f /home/gpadmin/GPDB/install.tar; rm -f /home/gpadmin/GPDB/install.tar.gz 20140220:16:28:08:003251 gpseginstall:mdw:root-[INFO]:-cd /home/gpadmin/GPDB; tar cf install.tar install 20140220:16:28:09:003251 gpseginstall:mdw:root-[INFO]:-gzip /home/gpadmin/GPDB/install.tar 20140220:16:28:22:003251 gpseginstall:mdw:root-[INFO]:-remote command: mkdir -p /home/gpadmin/GPDB 20140220:16:28:22:003251 gpseginstall:mdw:root-[INFO]:-remote command: rm -rf /home/gpadmin/GPDB/install 20140220:16:28:23:003251 gpseginstall:mdw:root-[INFO]:-scp software to remote location 20140220:16:28:38:003251 gpseginstall:mdw:root-[INFO]:-remote command: gzip -f -d /home/gpadmin/GPDB/install.tar.gz 20140220:16:28:40:003251 gpseginstall:mdw:root-[INFO]:-md5 check on remote location 20140220:16:28:42:003251 gpseginstall:mdw:root-[INFO]:-remote command: cd /home/gpadmin/GPDB; tar xf install.tar 20140220:16:28:43:003251 gpseginstall:mdw:root-[INFO]:-remote command: rm -f /home/gpadmin/GPDB/install.tar 20140220:16:28:44:003251 gpseginstall:mdw:root-[INFO]:-remote command: cd /home/gpadmin/GPDB; rm -f greenplum-db; ln -fs install greenplum-db 20140220:16:28:44:003251 gpseginstall:mdw:root-[INFO]:-remote command: chown -R gpadmin:gpadmin /home/gpadmin/GPDB/greenplum-db 20140220:16:28:45:003251 gpseginstall:mdw:root-[INFO]:-remote command: chown -R gpadmin:gpadmin /home/gpadmin/GPDB/install 20140220:16:28:45:003251 gpseginstall:mdw:root-[INFO]:-rm -f /home/gpadmin/GPDB/install.tar.gz Please enter a password: Confirm password: 20140220:16:29:19:003251 gpseginstall:mdw:root-[INFO]:-Changing system passwords ... 20140220:16:29:20:003251 gpseginstall:mdw:root-[INFO]:-exchange ssh keys for user root 20140220:16:29:23:003251 gpseginstall:mdw:root-[INFO]:-exchange ssh keys for user gpadmin 20140220:16:29:24:003251 gpseginstall:mdw:root-[INFO]:-Exception running cmd: su gpadmin -c "gpssh-exkeys -f allseg" 20140220:16:29:24:003251 gpseginstall:mdw:root-[INFO]:-write() argument 2 must be string or buffer, not None 20140220:16:29:24:003251 gpseginstall:mdw:root-[INFO]:-gppsh-exkeys failed running from within pexpect ... now try outside of pexpect [STEP 1 of 5] create local ID and authorize on local host   ... /home/gpadmin/.ssh/id_rsa file exists ... key generation skipped [STEP 2 of 5] keyscan all hosts and update known_hosts file [STEP 3 of 5] authorize current user on remote hosts   ... send to smdw   ***   *** Enter password for smdw:   ... send to sdw1   ... send to sdw2 [STEP 4 of 5] determine common authentication file content [STEP 5 of 5] copy authentication files to all remote hosts   ... finished key exchange with smdw   ... finished key exchange with sdw1   ... finished key exchange with sdw2 [INFO] completed successfully 20140220:16:29:31:003251 gpseginstall:mdw:root-[INFO]:-/home/gpadmin/GPDB/greenplum-db/./sbin/gpfixuserlimts -f /etc/security/limits.conf -u gpadmin 20140220:16:29:31:003251 gpseginstall:mdw:root-[INFO]:-remote command: . /home/gpadmin/GPDB/greenplum-db/./greenplum_path.sh; /home/gpadmin/GPDB/greenplum-db/./sbin/gpfixuserlimts -f /etc/security/limits.conf -u gpadmin 20140220:16:29:32:003251 gpseginstall:mdw:root-[INFO]:-version string on master: gpssh version 4.2.6.3 build 2 20140220:16:29:32:003251 gpseginstall:mdw:root-[INFO]:-remote command: . /home/gpadmin/GPDB/greenplum-db/./greenplum_path.sh; /home/gpadmin/GPDB/greenplum-db/./bin/gpssh --version 20140220:16:29:33:003251 gpseginstall:mdw:root-[INFO]:-remote command: . /home/gpadmin/GPDB/install/greenplum_path.sh; /home/gpadmin/GPDB/install/bin/gpssh --version 20140220:16:29:39:003251 gpseginstall:mdw:root-[INFO]:-SUCCESS -- Requested commands completed [[email protected] greenplum-db-4.2.6.3]# gpssh -f allnotes mkdir -p /data/d1 /data/d2 /data/m1 /data/m2 [sdw1] [sdw2] [[email protected] greenplum-db-4.2.6.3]# gpssh -f allnotes chown gpadmin:gpadmin /data/d1 /data/d2 /data/m1 /data/m2 -R [sdw1] [sdw2] 安裝完成 7、資料庫初始化 1)建立資料節點檔案 [[email protected] install]# cat notes sdw1 sdw2 2) 建立初始化引數檔案 [[email protected] install]# cat gpinitsystem_config ARRAY_NAME="Greenplum" SEG_PREFIX=gpseg PORT_BASE=50000 declare -a DATA_DIRECTORY=(/home/gpadmin/GPDB/data/d1 /home/gpadmin/GPDB/data/d2) MASTER_HOSTNAME=mdw MASTER_DIRECTORY=/home/gpadmin/GPDB/data/master MASTER_PORT=5432 TRUSTED_SHELL=ssh CHECK_POINT_SEGMENTS=8 ENCODING=UNICODE MIRROR_PORT_BASE=60000 REPLICATION_PORT_BASE=41000 MIRROR_REPLICATION_PORT_BASE=51000 declare -a MIRROR_DATA_DIRECTORY=(/home/gpadmin/GPDB/data/m1 /home/gpadmin/GPDB/data/m2) 3) 資料初始化 su - gpadmin [[email protected] install]$ gpinitsystem -c gpinitsystem_config -h notes vi .bashrc #greenplum export MASTER_DATA_DIRECTORY=/data/master/gpseg-1 vi $MASTER_DATA_DIRECTORY/pg_hba.conf host all all 0/0 md5 3) 資料初始化 su - gpadmin [[email protected] install]$ gpinitsystem -c gpinitsystem_config -h notes

相關推薦

Greenplum環境安裝配置步驟

1、環境準備 伺服器分配 192.168.100.101--mdw 192.168.100.11--smdw 192.168.100.12--sdw1 192.168.100.13--sdw2 ms1與ms2之間的心跳ip配置 10.10.10.1--mdw 10.10.10.2--smdw 2、修改h

hadoop環境安裝配置步驟詳解

hadoop環境安裝配置步驟詳解 在上一篇的分享文章中我是給大家分享了執行部署hadoop的一些安裝準備工作,這篇接上一篇繼續為大家分享一些個人的學習經驗總結。我學習用的是大快發行版DKHadoop,所以所有的經驗分享都是以DKHadoop為基礎,這裡要先說明一下。個人覺得DKHadoop對

DKhadoop環境安裝配置步驟詳解

在上一篇的分享文章中我是給大家分享了執行部署hadoop的一些安裝準備工作,這篇接上一篇繼續為大家分享一些個人的學習經驗總結。我學習用的是大快發行版DKHadoop,所以所有的經驗分享都是以DKHadoop為基礎,這裡要先說明一下。個人覺得DKHadoop對新手還是算是很友好的了,新手朋友們可以大快搜索網站下

MonkeyRunner環境搭建配置步驟(1.安裝jdk,2.安裝python,3.安裝android sdk)

img ads 系統 windows info beans android-s monk bean 前言:需要安裝jdk、python、android sdk 第一步:JDk的安裝以及配置 jdk下載地址:http://www.oracle.com/technetwork/

Linux環境下Redis安裝配置步驟[轉]

http redis-cli ont == LV 成功 fcm space 執行 在LInux下安裝Redis的步驟如下: 1、首先下載一個Redis安裝包,官網下載地址為:https://redis.io/ 2、在Linux下解壓redis: tar -zxvf re

hadoop環境安裝配置介紹與步驟

關系 防止 shadow 設置 操作 data 環境 con 目的 在上一篇的分享文章中我是給大家分享了運行部署hadoop的一些安裝準備工作,這篇接上一篇繼續為大家分享一些個人的學習經驗總結。我學習用的是大快發行版DKHadoop,所以所有的經驗分享都是以DKHadoop

Linux環境下Redis安裝配置步驟

在LInux下安裝Redis的步驟如下: 2、在Linux下解壓redis: tar -zxvf redis-2.8.22.tar.gz 3、解壓完成之後,進入到解壓的目錄裡面“”redis-2.8

Windows環境下的NodeJS+NPM+GIT+Bower安裝配置步驟

Windows下的NodeJS安裝是比較方便的(v0.6.0版本之後,支援windows native),只需要登陸官網(http://nodejs.org/),便可以看到首頁的“INSTALL”按鈕,直接點選就會自動下載安裝。安裝過程基本直接“NEXT”就可以了。(W

Openfiler安裝配置步驟

openfiler第一步、下載系統Openfiler是開源免費程序可以到http://www.openfiler.com/community/download/下載第二步、安裝步驟選擇linux系統64位安裝步驟配置網卡IP地址登錄地址第三步、添加本地硬盤第四步、配置Openfiler本文出自 “馬廣傑——博

JavaFX開發環境安裝配置

target 開發工具 lips jdk env netbeans 如果 col 通過 JavaFX開發環境安裝配置 從Java8開始,JDK(Java開發工具包)包括了JavaFX庫。 因此,要運行JavaFX應用程序,您只需要在系統中安裝Java8或更高版本。 除此之外

appium+Linux環境安裝配置

全局 很多 -- 應該 下載 lis cnp rmi -a 背景:想要在Jenkins上跑appium的自動化測試,所以想要在Jenkins服務器(Linux遠程)上安裝appium服務,故而研究了一下appium+Linux下安裝。雖然有無數的前輩踩過坑,但自己還是吭

centeos7.4 nginx-1.9.9 環境 安裝 配置

來安 目錄 gre body eos rc.local fig sbin rep 安裝依賴環境 文章源於 安裝依賴包: yum install gcc-c++ pcre pcre-devel zlib zlib-devel openssl openssl-devel 安

FastDFS分布式文件系統&Nginx負載均衡最小環境安裝配置[超級詳解]

nbsp strong figure 分割 不能訪問 org 事先 zlib 編輯 1、背景 FastDFS 是一款開源的、分布式文件系統(Distributed File System),由淘寶開發平臺部資深架構師余慶開發。該開源項目的主頁是 http://code.go

lnmp環境安裝配置tomcat + jdk

lnmt安裝jdk的版本 1.8● 各種版本可在官網http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html 頁面下載● tar -zxvf jdk-8u171-linux-x64.tar.gz /

基於LNMP環境安裝配置phpMyAdmin4.8

LNMP PHP7 phpmyadmin nginx MySQL phpMyAdmin是一個以PHP為基礎、以Web-Base方式架構在網站主機上的、可以通過web方式管理和操作MySQL數據庫的管理工具。本文主要內容為基於LNMP環境安裝phpMyAdmin4.8。一、安裝環境1、主機I

Scala系統學習(二):Scala開發環境安裝配置

www 執行 posit 令行 完成後 version 繼續 environ ava Scala可以安裝在任何基於UNIX/Linux或基於Windows的系統上。在您的機器上開始安裝Scala之前,必須在計算機上安裝Java 1.8或更高版本。 下面請按照以下步驟安裝S

NodeJs、NPM安裝配置步驟(windows版本)

高效 node 管理 tar 學習 node.js tps .com 系統 Node.js 是一個基於 Chrome V8 引擎的 JavaScript 運行環境。Node.js 使用了一個事件驅動、非阻塞式 I/O 的模型,使其輕量又高效。 Node.

一:Greenplum5.10.2 生產環境安裝配置 (系統初始化、安裝準備)

添加 dead 有關 zlib 直接 dconf tables .rpm grub.conf 服務簡介: Greenplum Master Master只存儲系統元數據,業務數據全部分布在Segments上。其作為整個數據庫系統的入口,負責建立與客戶端的連接,SQL的解析並

【go 語言環境安裝】goland語言環境安裝配置詳解

1、下載go 下載地址: https://golang.google.cn/dl/ 開啟網址,由於我的電腦是win64,所以下載第一個。 2、安裝go 2.1、UNIX/Linux/Mac OS X, 和 FreeBSD 安裝 以下介紹了在UNIX/Linux/Mac OS

Windows環境安裝Django步驟

前提:已經安裝Python 1、先從Django官網下載壓縮包:https://www.djangoproject.com/download/ 2、解壓Django,如我解壓到 D:\Python\Django-2.1.3 3、開啟CMD,並cd到Django解壓的目錄 4、執行安裝命令