Oracle 11g rac 新增新節點測試
[轉]https://blog.csdn.net/shiyu1157758655/article/details/60877076
前期準備：
作業系統設定
OS版本必須相同，檢查核心引數，系統記憶體、CPU、檔案系統大小、swap空間等。
建立必要的使用者及組
使用者及使用者組UID及GID必須跟其他節點相同，同時對這些使用者環境變數進行設定。
網路配置
網路規劃，Public及private網路名稱必須相同。
共享儲存配置
對於共享儲存，必須保證在新的節點上是可以訪問的，而且對軟體安裝者必須有讀寫許可權。
建立相關目錄
這些目錄使用者存放GI及Oracle資料庫軟體，同時要保證使用者組及使用者對這些目錄的許可權。
配置RAC等效性
時間同步設定(CTSS )
配置系統引數、建立使用者、配置儲存等。
配置所有節點間grid、oracle使用者無密碼等價訪問
測試環境：
已有節點rac1、rac2，下面做的是新增節點rac3
rac3先安裝下cvuqdisk包
[[email protected] src]# rpm -ivh cvuqdisk-1.0.9-1.rpm
Preparing... ########################################### [100%]
package cvuqdisk-1.0.9-1.x86_64 is already installed
具體步驟：
1.rac3節點新增叢集軟體GI
①檢查rac3是否滿足rac安裝條件（在已經有節點下面用grid，oracle使用者執行）
[
ASM1:/home/[email protected]>cluvfy stage -prenodeadd -n rac3 -fixup -verbose
Performing pre-checks for node addition
Checking node reachability...
PRVF-6006 : Unable to reach any of thenodes
PRKN-1034 : Failed to retrieve IP addressof host "rac3"
Pre-check for node addition wasunsuccessful on all the nodes.
該報錯是由於節點直接沒有配置ssh 互信，具體配置請參考：http://blog.csdn.net/shiyu1157758655/article/details/56838603
配置好互信執行，再次執行：
+ASM1:/home/[email protected]>cluvfy stage -pre nodeadd -n rac3 -fixup -verbose
Performing pre-checks for node addition
Checking node reachability...
Check: Node reachability from node "rac1"
Destination Node Reachable?
------------------------------------ ------------------------
rac3 yes
Result: Node reachability check passed from node "rac1"
Checking user equivalence...
Check: User equivalence for user "grid"
Node Name Status
------------------------------------ ------------------------
rac3 passed
Result: User equivalence check passed for user "grid"
Checking CRS integrity...
Clusterware version consistency passed
The Oracle Clusterware is healthy on node "rac1"
The Oracle Clusterware is healthy on node "rac2"
CRS integrity check passed
Checking shared resources...
Checking CRS home location...
"/u01/app/11.2.0/grid_1" is shared
Result: Shared resources check for node addition passed
Checking node connectivity...
Checking hosts config file...
Node Name Status
------------------------------------ ------------------------
rac1 passed
rac2 passed
rac3 passed
Verification of the hosts config file successful
Interface information for node "rac1"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth0 192.168.180.2 192.168.180.0 0.0.0.0 192.168.180.1 00:50:56:8E:5F:E5 1500
eth0 192.168.180.4 192.168.180.0 0.0.0.0 192.168.180.1 00:50:56:8E:5F:E5 1500
eth0 192.168.180.6 192.168.180.0 0.0.0.0 192.168.180.1 00:50:56:8E:5F:E5 1500
eth1 10.10.10.2 10.10.10.0 0.0.0.0 192.168.180.1 00:50:56:8E:22:19 1500
eth1 169.254.145.157 169.254.0.0 0.0.0.0 192.168.180.1 00:50:56:8E:22:19 1500
Interface information for node "rac2"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth0 192.168.180.3 192.168.180.0 0.0.0.0 192.168.180.1 00:50:56:8E:3A:88 1500
eth0 192.168.180.5 192.168.180.0 0.0.0.0 192.168.180.1 00:50:56:8E:3A:88 1500
eth1 10.10.10.3 10.10.10.0 0.0.0.0 192.168.180.1 00:50:56:8E:0C:E6 1500
eth1 169.254.107.75 169.254.0.0 0.0.0.0 192.168.180.1 00:50:56:8E:0C:E6 1500
Interface information for node "rac3"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
eth0 192.168.180.10 192.168.180.0 0.0.0.0 192.168.180.1 00:50:56:8E:6B:4B 1500
eth1 10.10.10.10 10.10.10.0 0.0.0.0 192.168.180.1 00:50:56:8E:2C:7F 1500
Check: Node connectivity for interface "eth0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1[192.168.180.2] rac1[192.168.180.4] yes
rac1[192.168.180.2] rac1[192.168.180.6] yes
rac1[192.168.180.2] rac2[192.168.180.3] yes
rac1[192.168.180.2] rac2[192.168.180.5] yes
rac1[192.168.180.2] rac3[192.168.180.10] yes
rac1[192.168.180.4] rac1[192.168.180.6] yes
rac1[192.168.180.4] rac2[192.168.180.3] yes
rac1[192.168.180.4] rac2[192.168.180.5] yes
rac1[192.168.180.4] rac3[192.168.180.10] yes
rac1[192.168.180.6] rac2[192.168.180.3] yes
rac1[192.168.180.6] rac2[192.168.180.5] yes
rac1[192.168.180.6] rac3[192.168.180.10] yes
rac2[192.168.180.3] rac2[192.168.180.5] yes
rac2[192.168.180.3] rac3[192.168.180.10] yes
rac2[192.168.180.5] rac3[192.168.180.10] yes
Result: Node connectivity passed for interface "eth0"
Check: TCP connectivity of subnet "192.168.180.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1:192.168.180.2 rac1:192.168.180.4 passed
rac1:192.168.180.2 rac1:192.168.180.6 passed
rac1:192.168.180.2 rac2:192.168.180.3 passed
rac1:192.168.180.2 rac2:192.168.180.5 passed
rac1:192.168.180.2 rac3:192.168.180.10 passed
Result: TCP connectivity check passed for subnet "192.168.180.0"
Check: Node connectivity for interface "eth1"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1[10.10.10.2] rac2[10.10.10.3] yes
rac1[10.10.10.2] rac3[10.10.10.10] yes
rac2[10.10.10.3] rac3[10.10.10.10] yes
Result: Node connectivity passed for interface "eth1"
Check: TCP connectivity of subnet "10.10.10.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1:10.10.10.2 rac2:10.10.10.3 passed
rac1:10.10.10.2 rac3:10.10.10.10 passed
Result: TCP connectivity check passed for subnet "10.10.10.0"
Checking subnet mask consistency...
Subnet mask consistency check passed for subnet "192.168.180.0".
Subnet mask consistency check passed for subnet "10.10.10.0".
Subnet mask consistency check passed.
Result: Node connectivity check passed
Checking multicast communication...
Checking subnet "192.168.180.0" for multicast communication with multicast group "230.0.1.0"...
Check of subnet "192.168.180.0" for multicast communication with multicast group "230.0.1.0" passed.
Checking subnet "10.10.10.0" for multicast communication with multicast group "230.0.1.0"...
Check of subnet "10.10.10.0" for multicast communication with multicast group "230.0.1.0" passed.
Check of multicast communication passed.
Check: Total memory
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 1.8331GB (1922160.0KB) 1.5GB (1572864.0KB) passed
rac3 1.8331GB (1922160.0KB) 1.5GB (1572864.0KB) passed
Result: Total memory check passed
Check: Available memory
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 679.8359MB (696152.0KB) 50MB (51200.0KB) passed
rac3 1.623GB (1701816.0KB) 50MB (51200.0KB) passed
Result: Available memory check passed
Check: Swap space
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 3.9375GB (4128764.0KB) 2.7497GB (2883240.0KB) passed
rac3 3.9375GB (4128764.0KB) 2.7497GB (2883240.0KB) passed
Result: Swap space check passed
Check: Free disk space for "rac1:/u01/app/11.2.0/grid_1"
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/u01/app/11.2.0/grid_1 rac1 /u01 30.1475GB 5.5GB passed
Result: Free disk space check passed for "rac1:/u01/app/11.2.0/grid_1"
Check: Free disk space for "rac3:/u01/app/11.2.0/grid_1"
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/u01/app/11.2.0/grid_1 rac3 /u01 39.0029GB 5.5GB passed
Result: Free disk space check passed for "rac3:/u01/app/11.2.0/grid_1"
Check: Free disk space for "rac1:/var/tmp"
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/var/tmp rac1 / 30GB 1GB passed
Result: Free disk space check passed for "rac1:/var/tmp"
Check: Free disk space for "rac3:/var/tmp"
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/var/tmp rac3 / 28.9229GB 1GB passed
Result: Free disk space check passed for "rac3:/var/tmp"
Check: User existence for "grid"
Node Name Status Comment
------------ ------------------------ ------------------------
rac1 passed exists(1100)
rac3 passed exists(1100)
Checking for multiple users with UID value 1100
Result: Check for multiple users with UID value 1100 passed
Result: User existence check passed for "grid"
Check: Run level
Node Name run level Required Status
------------ ------------------------ ------------------------ ----------
rac1 5 3,5 passed
rac3 5 3,5 passed
Result: Run level check passed
Check: Hard limits for "maximum open file descriptors"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
rac1 hard 65536 65536 passed
rac3 hard 65536 65536 passed
Result: Hard limits check passed for "maximum open file descriptors"
Check: Soft limits for "maximum open file descriptors"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
rac1 soft 1024 1024 passed
rac3 soft 1024 1024 passed
Result: Soft limits check passed for "maximum open file descriptors"
Check: Hard limits for "maximum user processes"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
rac1 hard 16384 16384 passed
rac3 hard 16384 16384 passed
Result: Hard limits check passed for "maximum user processes"
Check: Soft limits for "maximum user processes"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
rac1 soft 2047 2047 passed
rac3 soft 2047 2047 passed
Result: Soft limits check passed for "maximum user processes"
Check: System architecture
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 x86_64 x86_64 passed
rac3 x86_64 x86_64 passed
Result: System architecture check passed
Check: Kernel version
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 2.6.32-642.el6.x86_64 2.6.9 passed
rac3 2.6.32-642.el6.x86_64 2.6.9 passed
Result: Kernel version check passed
Check: Kernel parameter for "semmsl"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 250 250 250 passed
rac3 250 250 250 passed
Result: Kernel parameter check passed for "semmsl"
Check: Kernel parameter for "semmns"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 32000 32000 32000 passed
rac3 32000 32000 32000 passed
Result: Kernel parameter check passed for "semmns"
Check: Kernel parameter for "semopm"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 100 100 100 passed
rac3 100 100 100 passed
Result: Kernel parameter check passed for "semopm"
Check: Kernel parameter for "semmni"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 128 128 128 passed
rac3 128 128 128 passed
Result: Kernel parameter check passed for "semmni"
Check: Kernel parameter for "shmmax"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 4294967295 4294967295 984145920 passed
rac3 4294967295 4294967295 984145920 passed
Result: Kernel parameter check passed for "shmmax"
Check: Kernel parameter for "shmmni"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 4096 4096 4096 passed
rac3 4096 4096 4096 passed
Result: Kernel parameter check passed for "shmmni"
Check: Kernel parameter for "shmall"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 2097152 2097152 2097152 passed
rac3 2097152 2097152 2097152 passed
Result: Kernel parameter check passed for "shmall"
Check: Kernel parameter for "file-max"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 6815744 6815744 6815744 passed
rac3 6815744 6815744 6815744 passed
Result: Kernel parameter check passed for "file-max"
Check: Kernel parameter for "ip_local_port_range"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 between 9000.0 & 65500.0 between 9000.0 & 65500.0 between 9000.0 & 65500.0 passed
rac3 between 9000.0 & 65500.0 between 9000.0 & 65500.0 between 9000.0 & 65500.0 passed
Result: Kernel parameter check passed for "ip_local_port_range"
Check: Kernel parameter for "rmem_default"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 262144 262144 262144 passed
rac3 262144 262144 262144 passed
Result: Kernel parameter check passed for "rmem_default"
Check: Kernel parameter for "rmem_max"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 4194304 4194304 4194304 passed
rac3 4194304 4194304 4194304 passed
Result: Kernel parameter check passed for "rmem_max"
Check: Kernel parameter for "wmem_default"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 262144 262144 262144 passed
rac3 262144 262144 262144 passed
Result: Kernel parameter check passed for "wmem_default"
Check: Kernel parameter for "wmem_max"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 1048576 1048576 1048576 passed
rac3 1048576 1048576 1048576 passed
Result: Kernel parameter check passed for "wmem_max"
Check: Kernel parameter for "aio-max-nr"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 1048576 1048576 1048576 passed
rac3 1048576 1048576 1048576 passed
Result: Kernel parameter check passed for "aio-max-nr"
Check: Package existence for "make"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 make-3.81-23.el6 make-3.80 passed
rac3 make-3.81-23.el6 make-3.80 passed
Result: Package existence check passed for "make"
Check: Package existence for "binutils"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 binutils-2.20.51.0.2-5.44.el6 binutils-2.15.92.0.2 passed
rac3 binutils-2.20.51.0.2-5.44.el6 binutils-2.15.92.0.2 passed
Result: Package existence check passed for "binutils"
Check: Package existence for "gcc(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 gcc(x86_64)-4.4.7-17.el6 gcc(x86_64)-3.4.6 passed
rac3 gcc(x86_64)-4.4.7-17.el6 gcc(x86_64)-3.4.6 passed
Result: Package existence check passed for "gcc(x86_64)"
Check: Package existence for "libaio(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 libaio(x86_64)-0.3.107-10.el6 libaio(x86_64)-0.3.105 passed
rac3 libaio(x86_64)-0.3.107-10.el6 libaio(x86_64)-0.3.105 passed
Result: Package existence check passed for "libaio(x86_64)"
Check: Package existence for "glibc(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 glibc(x86_64)-2.12-1.192.el6 glibc(x86_64)-2.3.4-2.41 passed
rac3 glibc(x86_64)-2.12-1.192.el6 glibc(x86_64)-2.3.4-2.41 passed
Result: Package existence check passed for "glibc(x86_64)"
Check: Package existence for "compat-libstdc++-33(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 compat-libstdc++-33(x86_64)-3.2.3-69.el6 compat-libstdc++-33(x86_64)-3.2.3 passed
rac3 compat-libstdc++-33(x86_64)-3.2.3-69.el6 compat-libstdc++-33(x86_64)-3.2.3 passed
Result: Package existence check passed for "compat-libstdc++-33(x86_64)"
Check: Package existence for "elfutils-libelf(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 elfutils-libelf(x86_64)-0.164-2.el6 elfutils-libelf(x86_64)-0.97 passed
rac3 elfutils-libelf(x86_64)-0.164-2.el6 elfutils-libelf(x86_64)-0.97 passed
Result: Package existence check passed for "elfutils-libelf(x86_64)"
Check: Package existence for "elfutils-libelf-devel"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 elfutils-libelf-devel-0.164-2.el6 elfutils-libelf-devel-0.97 passed
rac3 elfutils-libelf-devel-0.164-2.el6 elfutils-libelf-devel-0.97 passed
Result: Package existence check passed for "elfutils-libelf-devel"
Check: Package existence for "glibc-common"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 glibc-common-2.12-1.192.el6 glibc-common-2.3.4 passed
rac3 glibc-common-2.12-1.192.el6 glibc-common-2.3.4 passed
Result: Package existence check passed for "glibc-common"
Check: Package existence for "glibc-devel(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 glibc-devel(x86_64)-2.12-1.192.el6 glibc-devel(x86_64)-2.3.4 passed
rac3 glibc-devel(x86_64)-2.12-1.192.el6 glibc-devel(x86_64)-2.3.4 passed
Result: Package existence check passed for "glibc-devel(x86_64)"
Check: Package existence for "glibc-headers"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 glibc-headers-2.12-1.192.el6 glibc-headers-2.3.4 passed
rac3 glibc-headers-2.12-1.192.el6 glibc-headers-2.3.4 passed
Result: Package existence check passed for "glibc-headers"
Check: Package existence for "gcc-c++(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 gcc-c++(x86_64)-4.4.7-17.el6 gcc-c++(x86_64)-3.4.6 passed
rac3 gcc-c++(x86_64)-4.4.7-17.el6 gcc-c++(x86_64)-3.4.6 passed
Result: Package existence check passed for "gcc-c++(x86_64)"
Check: Package existence for "libaio-devel(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 libaio-devel(x86_64)-0.3.107-10.el6 libaio-devel(x86_64)-0.3.105 passed
rac3 libaio-devel(x86_64)-0.3.107-10.el6 libaio-devel(x86_64)-0.3.105 passed
Result: Package existence check passed for "libaio-devel(x86_64)"
Check: Package existence for "libgcc(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 libgcc(x86_64)-4.4.7-17.el6 libgcc(x86_64)-3.4.6 passed
rac3 libgcc(x86_64)-4.4.7-17.el6 libgcc(x86_64)-3.4.6 passed
Result: Package existence check passed for "libgcc(x86_64)"
Check: Package existence for "libstdc++(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 libstdc++(x86_64)-4.4.7-17.el6 libstdc++(x86_64)-3.4.6 passed
rac3 libstdc++(x86_64)-4.4.7-17.el6 libstdc++(x86_64)-3.4.6 passed
Result: Package existence check passed for "libstdc++(x86_64)"
Check: Package existence for "libstdc++-devel(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 libstdc++-devel(x86_64)-4.4.7-17.el6 libstdc++-devel(x86_64)-3.4.6 passed
rac3 libstdc++-devel(x86_64)-4.4.7-17.el6 libstdc++-devel(x86_64)-3.4.6 passed
Result: Package existence check passed for "libstdc++-devel(x86_64)"
Check: Package existence for "sysstat"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 sysstat-9.0.4-31.el6 sysstat-5.0.5 passed
rac3 sysstat-9.0.4-31.el6 sysstat-5.0.5 passed
Result: Package existence check passed for "sysstat"
Check: Package existence for "pdksh"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1 pdksh-5.2.14-37.el5_8.1 pdksh-5.2.14 passed
rac3 pdksh-5.2.14-37.el5_8.1 pdksh-5.2.14 passed
Result: Package existence check passed for "pdksh"
Check: Package existence for "expat(x86_64)"
Node Name Available Required St