oracle 11g 修改private ip， public ip， vip， scan ip
檢視當前系統資訊
[[email protected] ~]# crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.DATA.dg ora....up.type ONLINE ONLINE node1
ora.FLASH.dg ora....up.type ONLINE ONLINE node1
ora.GRIDDG.dg ora....up.type ONLINE ONLINE node1
ora....ER.lsnr ora....er.type ONLINE ONLINE node2
ora....N1.lsnr ora....er.type ONLINE ONLINE node1
ora.asm ora.asm.type ONLINE ONLINE node1
ora.cvu ora.cvu.type OFFLINE OFFLINE
ora.devdb.db ora....se.type ONLINE ONLINE node2
ora....ce1.svc ora....ce.type ONLINE ONLINE node2
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE node1
ora....SM1.asm application ONLINE ONLINE node1
ora....E1.lsnr application ONLINE OFFLINE
ora.node1.gsd application OFFLINE OFFLINE
ora.node1.ons application ONLINE ONLINE node1
ora....SM2.asm application ONLINE ONLINE node2
ora....E2.lsnr application ONLINE ONLINE node2
ora.node2.gsd application OFFLINE OFFLINE
ora.node2.ons application ONLINE ONLINE node2
ora.node2.vip ora....t1.type ONLINE ONLINE node2
ora.oc4j ora.oc4j.type ONLINE ONLINE node1
ora.ons ora.ons.type ONLINE ONLINE node1
ora.scan1.vip ora....ip.type ONLINE ONLINE node1
[[email protected] ~]# srvctl status database -ddevdb
Instance devdb1 is running on node node1
Instance devdb2 is running on node node2
[[email protected] ~]#
節點一資訊：
[[email protected] ~]# ifconfig -a
eth0 Link encap:Ethernet HWaddr00:0C:29:E7:7F:E8
inet addr:192.168.40.191 Bcast:192.168.40.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fee7:7fe8/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1455 errors:0 dropped:0 overruns:0 frame:0
TX packets:1069 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:173021 (168.9 KiB) TXbytes:173124 (169.0 KiB)
Interrupt:16 Base address:0x2400
eth0:1 Link encap:Ethernet HWaddr00:0C:29:E7:7F:E8
inet addr:192.168.40.203 Bcast:192.168.40.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
Interrupt:16 Base address:0x2400
eth1 Link encap:Ethernet HWaddr00:0C:29:E7:7F:DE
inet addr:192.168.94.11 Bcast:192.168.94.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fee7:7fde/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:25939 errors:0 dropped:0 overruns:0 frame:0
TX packets:36179 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:13458788 (12.8 MiB) TXbytes:27208084 (25.9 MiB)
eth1:1 Link encap:Ethernet HWaddr00:0C:29:E7:7F:DE
inet addr:169.254.180.168 Bcast:169.254.255.255 Mask:255.255.0.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:14222 errors:0 dropped:0 overruns:0 frame:0
TX packets:14222 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:8493677 (8.1 MiB) TXbytes:8493677 (8.1 MiB)
[[email protected] ~]#
節點二資訊：
[[email protected] ~]# ifconfig -a
eth0 Link encap:Ethernet HWaddr00:0C:29:B6:6C:0D
inet addr:192.168.40.192 Bcast:192.168.40.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:feb6:6c0d/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:679 errors:0 dropped:0 overruns:0 frame:0
TX packets:412 errors:0 dropped:0overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:104501 (102.0 KiB) TXbytes:100249 (97.8 KiB)
eth0:1 Link encap:Ethernet HWaddr00:0C:29:B6:6C:0D
inet addr:192.168.40.194 Bcast:192.168.40.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
eth1 Link encap:Ethernet HWaddr00:0C:29:B6:6C:17
inet addr:192.168.94.12 Bcast:192.168.94.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:feb6:6c17/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:37358 errors:0 dropped:0 overruns:0 frame:0
TX packets:26614 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:27634538 (26.3 MiB) TXbytes:14210502 (13.5 MiB)
eth1:1 Link encap:Ethernet HWaddr00:0C:29:B6:6C:17
inet addr:169.254.150.48 Bcast:169.254.255.255 Mask:255.255.0.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:9867 errors:0 dropped:0 overruns:0 frame:0
TX packets:9867 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:5692086 (5.4 MiB) TXbytes:5692086 (5.4 MiB)
[[email protected] ~]#
節點一hosts
[email protected] ~]# cat /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
# node1
192.168.40.191 node1.localdomain node1
192.168.40.193 node1-vip.localdomain node1-vip
192.168.94.11 node1-priv.localdomain node1-priv
# node2
192.168.40.192 node2.localdomain node2
192.168.40.194 node2-vip.localdomain node2-vip
192.168.94.12 node2-priv.localdomain node2-priv
# scan-ip
192.168.40.203 scan-cluster.localdomain scan-cluster
[[email protected] ~]#
節點二hosts
[[email protected] ~]# cat /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
# node1
192.168.40.191 node1.localdomain node1
192.168.40.193 node1-vip.localdomain node1-vip
192.168.94.11 node1-priv.localdomain node1-priv
# node2
192.168.40.192 node2.localdomain node2
192.168.40.194 node2-vip.localdomain node2-vip
192.168.94.12 node2-priv.localdomain node2-priv
# scan-ip
192.168.40.203 scan-cluster.localdomain scan-cluster
[[email protected] ~]#
修改public ip、private ip、scan ip
1、現ip地址和修改之後的對比
修改前的ip
# node1
192.168.40.191 node1.localdomain node1
192.168.40.193 node1-vip.localdomain node1-vip
192.168.94.11 node1-priv.localdomain node1-priv
# node2
192.168.40.192 node2.localdomain node2
192.168.40.194 node2-vip.localdomain node2-vip
192.168.94.12 node2-priv.localdomain node2-priv
# scan-ip
192.168.40.203 scan-cluster.localdomain scan-cluster
修改後的ip
# node1
192.168.41.191 node1.localdomain node1
192.168.41.193 node1-vip.localdomain node1-vip
192.168.95.11 node1-priv.localdomain node1-priv
# node2
192.168.41.192 node2.localdomain node2
192.168.41.194 node2-vip.localdomain node2-vip
192.168.95.12 node2-priv.localdomain node2-priv
# scan-ip
192.168.41.203 scan-cluster.localdomain scan-cluster
2、首先停止叢集服務
--停資料庫
[[email protected] script]#srvctl stop listener-l listener
[[email protected] script]#srvctl stop database -d devdb -o immediate
[[email protected]]#srvctl stop asm -n node1
[[email protected]]#srvctl stop asm -n node2
注：這兩步11g中，需要和crs關閉一起，不能單獨執行，否則報下面的錯誤
[[email protected] script]#srvctl stop asm -n node1
PRCR-1014 : Failed tostop resource ora.asm
PRCR-1065 : Failed tostop resource ora.asm
CRS-2529: Unable toact on 'ora.asm' because that would require stopping or relocating'ora.DATA.dg', but the force option was not specified
[[email protected] script]#srvctl stop vip -n node1
[[email protected] script]# srvctl stop vip -n node2
[[email protected] script]# srvctl stopscan_listener
[[email protected] script]#srvctl stop scan
[[email protected] script]#srvctl stop nodeapps -n node1
[[email protected] script]#srvctl stop nodeapps -n node2
[[email protected] script]# ./crs_stat.sh
Name Target State Host
------------------------------ ------------------- -------
ora.DATA.dg ONLINE ONLINE node1
ora.FLASH.dg ONLINE ONLINE node1
ora.GRIDDG.dg ONLINE ONLINE node1
ora.LISTENER.lsnr ONLINE ONLINE node2
ora.LISTENER_SCAN1.lsnr ONLINE ONLINE node1
ora.asm ONLINE ONLINE node1
ora.cvu OFFLINE OFFLINE
ora.devdb.db ONLINE ONLINE node2
ora.devdb.service1.svc ONLINE ONLINE node2
ora.gsd OFFLINE OFFLINE
ora.net1.network ONLINE ONLINE node1
ora.node1.ASM1.asm ONLINE ONLINE node1
ora.node1.LISTENER_NODE1.lsnr ONLINE OFFLINE
ora.node1.gsd OFFLINE OFFLINE
ora.node1.ons ONLINE ONLINE node1
ora.node2.ASM2.asm ONLINE ONLINE node2
ora.node2.LISTENER_NODE2.lsnr ONLINE ONLINE node2
ora.node2.gsd OFFLINE OFFLINE
ora.node2.ons ONLINE ONLINE node2
ora.node2.vip ONLINE ONLINE node2
ora.oc4j ONLINE ONLINE node1
ora.ons ONLINE ONLINE node1
ora.scan1.vip ONLINE ONLINE node1
[[email protected] script]# srvctl stopdatabase -d devdb -o immediate
[[email protected] script]# ./crs_stat.sh
Name Target State Host
------------------------------ ------------------- -------
ora.DATA.dg ONLINE ONLINE node1
ora.FLASH.dg ONLINE ONLINE node1
ora.GRIDDG.dg ONLINE ONLINE node1
ora.LISTENER.lsnr ONLINE ONLINE node2
ora.LISTENER_SCAN1.lsnr ONLINE ONLINE node1
ora.asm ONLINE ONLINE node1
ora.cvu OFFLINE OFFLINE
ora.devdb.db OFFLINE OFFLINE
ora.devdb.service1.svc OFFLINE OFFLINE
ora.gsd OFFLINE OFFLINE
ora.net1.network ONLINE ONLINE node1
ora.node1.ASM1.asm ONLINE ONLINE node1
ora.node1.LISTENER_NODE1.lsnr ONLINE OFFLINE
ora.node1.gsd OFFLINE OFFLINE
ora.node1.ons ONLINE ONLINE node1
ora.node2.ASM2.asm ONLINE ONLINE node2
ora.node2.LISTENER_NODE2.lsnr ONLINE ONLINE node2
ora.node2.gsd OFFLINE OFFLINE
ora.node2.ons ONLINE ONLINE node2
ora.node2.vip ONLINE ONLINE node2
ora.oc4j ONLINE ONLINE node1
ora.ons ONLINE ONLINE node1
ora.scan1.vip ONLINE ONLINE node1
[[email protected] script]#
切換到grid
[[email protected] ~]$ srvctl stop listener -l listener
[[email protected] ~]$ srvctl stop scan_listener
[[email protected] ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.DATA.dg ora....up.type ONLINE ONLINE node1
ora.FLASH.dg ora....up.type ONLINE ONLINE node1
ora.GRIDDG.dg ora....up.type ONLINE ONLINE node1
ora....ER.lsnr ora....er.type OFFLINE OFFLINE
ora....N1.lsnr ora....er.type OFFLINE OFFLINE
ora.asm ora.asm.type ONLINE ONLINE node1
ora.cvu ora.cvu.type OFFLINE OFFLINE
ora.devdb.db ora....se.type OFFLINE OFFLINE
ora....ce1.svc ora....ce.type OFFLINE OFFLINE
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE node1
ora....SM1.asm application ONLINE ONLINE node1
ora....E1.lsnr application OFFLINE OFFLINE
ora.node1.gsd application OFFLINE OFFLINE
ora.node1.ons application OFFLINE OFFLINE
ora....SM2.asm application ONLINE ONLINE node2
ora....E2.lsnr application OFFLINE OFFLINE
ora.node2.gsd application OFFLINE OFFLINE
ora.node2.ons application ONLINE ONLINE node2
ora.node2.vip ora....t1.type ONLINE ONLINE node2
ora.oc4j ora.oc4j.type ONLINE ONLINE node1
ora.ons ora.ons.type ONLINE ONLINE node2
ora.scan1.vip ora....ip.type ONLINE ONLINE node1
[[email protected] ~]$ srvctl stop scan
[[email protected] ~]$
[[email protected] ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.DATA.dg ora....up.type ONLINE ONLINE node1
ora.FLASH.dg ora....up.type ONLINE ONLINE node1
ora.GRIDDG.dg ora....up.type ONLINE ONLINE node1
ora....ER.lsnr ora....er.type OFFLINE OFFLINE
ora....N1.lsnr ora....er.type OFFLINE OFFLINE
ora.asm ora.asm.type ONLINE ONLINE node1
ora.cvu ora.cvu.type OFFLINE OFFLINE
ora.devdb.db ora....se.type OFFLINE OFFLINE
ora....ce1.svc ora....ce.type OFFLINE OFFLINE
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE node1
ora....SM1.asm application ONLINE ONLINE node1
ora....E1.lsnr application OFFLINE OFFLINE
ora.node1.gsd application OFFLINE OFFLINE
ora.node1.ons application OFFLINE OFFLINE
ora....SM2.asm application ONLINE ONLINE node2
ora....E2.lsnr application OFFLINE OFFLINE
ora.node2.gsd application OFFLINE OFFLINE
ora.node2.ons application ONLINE ONLINE node2
ora.node2.vip ora....t1.type ONLINE ONLINE node2
ora.oc4j ora.oc4j.type ONLINE ONLINE node1
ora.ons ora.ons.type ONLINE ONLINE node2
ora.scan1.vip ora....ip.typeOFFLINE OFFLINE
[[email protected] ~]$ srvctl stop nodeapps -nnode1
PRKO-2439 : VIP does not exist.
PRCR-1014 : Failed to stop resourceora.net1.network
PRCR-1065 : Failed to stop resourceora.net1.network
CRS-2529: Unable to act on 'ora.net1.network'because that would require stopping or relocating 'ora.scan1.vip', but theforce option was not specified[[email protected] ~]$ srvctl stop nodeapps -n node2
[[email protected] ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.DATA.dg ora....up.type ONLINE ONLINE node1
ora.FLASH.dg ora....up.type ONLINE ONLINE node1
ora.GRIDDG.dg ora....up.type ONLINE ONLINE node1
ora....ER.lsnr ora....er.type OFFLINE OFFLINE
ora....N1.lsnr ora....er.type OFFLINE OFFLINE
ora.asm ora.asm.type ONLINE ONLINE node1
ora.cvu ora.cvu.type OFFLINE OFFLINE
ora.devdb.db ora....se.type OFFLINE OFFLINE
ora....ce1.svc ora....ce.type OFFLINE OFFLINE
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE node1
ora....SM1.asm application ONLINE ONLINE node1
ora....E1.lsnr application OFFLINE OFFLINE
ora.node1.gsd application OFFLINE OFFLINE
ora.node1.ons application OFFLINE OFFLINE
ora....SM2.asm application ONLINE ONLINE node2
ora....E2.lsnr application OFFLINE OFFLINE
ora.node2.gsd application OFFLINE OFFLINE
ora.node2.ons application OFFLINE OFFLINE
ora.node2.vip ora....t1.type OFFLINE OFFLINE
ora.oc4j ora.oc4j.type ONLINE ONLINE node1
ora.ons ora.ons.type OFFLINE OFFLINE
ora.scan1.vip ora....ip.type OFFLINE OFFLINE
[[email protected] ~]$
--停crs服務
[[email protected] ~]#./crsctl stop crs
[[email protected] ~]#./crsctl stop crs
兩個節點都停
節點一資訊
[[email protected] ~]# crsctl stop crs
CRS-2791: Starting shutdown of Oracle HighAvailability Services-managed resources on 'node1'
CRS-2673: Attempting to stop 'ora.crsd' on 'node1'
CRS-2790: Starting shutdown of ClusterReady Services-managed resources on 'node1'
CRS-2673: Attempting to stop 'ora.oc4j' on'node1'
CRS-2673: Attempting to stop'ora.GRIDDG.dg' on 'node1'
CRS-2673: Attempting to stop 'ora.DATA.dg'on 'node1'
CRS-2673: Attempting to stop 'ora.FLASH.dg'on 'node1'
CRS-2677: Stop of 'ora.DATA.dg' on 'node1'succeeded
CRS-2677: Stop of 'ora.FLASH.dg' on 'node1'succeeded
CRS-2677: Stop of 'ora.oc4j' on 'node1'succeeded
CRS-2672: Attempting to start 'ora.oc4j' on'node2'
CRS-2676: Start of 'ora.oc4j' on 'node2'succeeded
CRS-2677: Stop of 'ora.GRIDDG.dg' on'node1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on'node1'
CRS-2677: Stop of 'ora.asm' on 'node1'succeeded
CRS-2673: Attempting to stop'ora.net1.network' on 'node1'
CRS-2677: Stop of 'ora.net1.network' on'node1' succeeded
CRS-2792: Shutdown of Cluster ReadyServices-managed resources on 'node1' has completed
CRS-2677: Stop of 'ora.crsd' on 'node1'succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on'node1'
CRS-2673: Attempting to stop 'ora.evmd' on'node1'
CRS-2673: Attempting to stop 'ora.asm' on'node1'
CRS-2673: Attempting to stop 'ora.mdnsd' on'node1'
CRS-2677: Stop of 'ora.evmd' on 'node1'succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'node1' succeeded
CRS-2677: Stop of 'ora.asm' on 'node1'succeeded
CRS-2673: Attempting to stop'ora.cluster_interconnect.haip' on 'node1'
CRS-2677: Stop of'ora.cluster_interconnect.haip' on 'node1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'node1'succeeded
CRS-2673: Attempting to stop 'ora.cssd' on'node1'
CRS-2677: Stop of 'ora.cssd' on 'node1'succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on'node1'
CRS-2677: Stop of 'ora.gipcd' on 'node1'succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on'node1'
CRS-2677: Stop of 'ora.gpnpd' on 'node1'succeeded
CRS-2793: Shutdown of Oracle HighAvailability Services-managed resources on 'node1' has completed
CRS-4133: Oracle High Availability Serviceshas been stopped.
[[email protected] ~]#
節點二資訊
[[email protected] ~]# crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.DATA.dg ora....up.type ONLINE ONLINE node2
ora.FLASH.dg ora....up.type ONLINE ONLINE node2
ora.GRIDDG.dg ora....up.type ONLINE ONLINE node2
ora....ER.lsnr ora....er.type OFFLINE OFFLINE
ora....N1.lsnr ora....er.type OFFLINE OFFLINE
ora.asm ora.asm.type ONLINE ONLINE node2
ora.cvu ora.cvu.type OFFLINE OFFLINE
ora.devdb.db ora....se.type OFFLINE OFFLINE
ora....ce1.svc ora....ce.type OFFLINE OFFLINE
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE OFFLINE
ora....SM2.asm application ONLINE ONLINE node2
ora....E2.lsnr application OFFLINE OFFLINE
ora.node2.gsd application OFFLINE OFFLINE
ora.node2.ons application OFFLINE OFFLINE
ora.node2.vip ora....t1.type OFFLINE OFFLINE
ora.oc4j ora.oc4j.type ONLINE ONLINE node2
ora.ons ora.ons.type OFFLINE OFFLINE
ora.scan1.vip ora....ip.type OFFLINE OFFLINE
[[email protected] ~]# crsctl stop crs
CRS-2791: Starting shutdown of Oracle HighAvailability Services-managed resources on 'node2'
CRS-2673: Attempting to stop 'ora.crsd' on'node2'
CRS-2790: Starting shutdown of Cluster ReadyServices-managed resources on 'node2'
CRS-2673: Attempting to stop'ora.GRIDDG.dg' on 'node2'
CRS-2673: Attempting to stop 'ora.DATA.dg'on 'node2'
CRS-2673: Attempting to stop 'ora.FLASH.dg'on 'node2'
CRS-2673: Attempting to stop 'ora.oc4j' on'node2'
CRS-2677: Stop of 'ora.DATA.dg' on 'node2'succeeded
CRS-2677: Stop of 'ora.FLASH.dg' on 'node2'succeeded
CRS-2677: Stop of 'ora.oc4j' on 'node2'succeeded
CRS-2677: Stop of 'ora.GRIDDG.dg' on'node2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on'node2'
CRS-2677: Stop of 'ora.asm' on 'node2'succeeded
CRS-2792: Shutdown of Cluster ReadyServices-managed resources on 'node2' has completed
CRS-2677: Stop of 'ora.crsd' on 'node2'succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on'node2'
CRS-2673: Attempting to stop 'ora.evmd' on'node2'
CRS-2673: Attempting to stop 'ora.asm' on'node2'
CRS-2673: Attempting to stop 'ora.mdnsd' on'node2'
CRS-2673: Attempting to stop'ora.drivers.acfs' on 'node2'
CRS-2677: Stop of 'ora.ctssd' on 'node2'succeeded
CRS-2677: Stop of 'ora.evmd' on 'node2'succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'node2'succeeded
CRS-2677: Stop of 'ora.asm' on 'node2'succeeded
CRS-2673: Attempting to stop'ora.cluster_interconnect.haip' on 'node2'
CRS-2677: Stop of 'ora.cluster_interconnect.haip'on 'node2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on'node2'
CRS-2677: Stop of 'ora.drivers.acfs' on'node2' succeeded
CRS-2677: Stop of 'ora.cssd' on 'node2'succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on'node2'
CRS-2677: Stop of 'ora.gipcd' on 'node2'succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on'node2'
CRS-2677: Stop of 'ora.gpnpd' on 'node2'succeeded
CRS-2793: Shutdown of Oracle HighAvailability Services-managed resources on 'node2' has completed
CRS-4133: Oracle High Availability Serviceshas been stopped.
[[email protected] ~]#
3、修改主機ip地址
兩個節點都要做
節點一
[[email protected] ~]# vi /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
# node1
192.168.41.191 node1.localdomain node1
192.168.41.193 node1-vip.localdomain node1-vip
192.168.95.11 node1-priv.localdomain node1-priv
# node2
192.168.41.192 node2.localdomain node2
192.168.41.194 node2-vip.localdomain node2-vip
192.168.95.12 node2-priv.localdomain node2-priv
# scan-ip
192.168.41.203 scan-cluster.localdomain scan-cluster
--編輯網絡卡檔案
[[email protected] ~]# vi/etc/sysconfig/network-scripts/ifcfg-eth0
[[email protected] ~]# vi/etc/sysconfig/network-scripts/ifcfg-eth1
是public網絡卡，eth1是私網
按照自己配置的ip資訊寫好！
這一步要注意，兩個節點都要做
--重啟網絡卡服務（這步不要做，不然會出現我下面遇到的問題）
(修改完hosts和ifcfg檔案之後，不要直接重啟network服務，這個時候可以啟動crs，啟動crs之後，修改private ip 和public ip，改成想要修改的ip，其實只要private ip和主機配置的一樣之後，就可以啟動crs，修改完成private ip和public ip之後，重啟network服務，這個時候，crs還是活動的，然後再改其他vip，scan ip即可，最後修改完之後，啟動叢集其他所有資源即可。)
[[email protected] ~]# service network restart
Shutting down interface eth0:
Connection closed by foreign host.
Disconnected from remotehost(192.168.40.191) at 11:22:07.
Type `help' to learn how to use Xshellprompt.
--重啟之後，第三方客戶端會失去連線，需要重新用新地址連線
如果用的是vmware虛擬機器的話，網絡卡需要重新配置
--重新連線之後
[[email protected] ~]# ifconfig -a
eth0 Link encap:Ethernet HWaddr00:0C:29:E7:7F:E8
inet addr:192.168.41.191 Bcast:192.168.41.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fee7:7fe8/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:5379 errors:0 dropped:0 overruns:0 frame:0
TX packets:3529 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:529386 (516.9 KiB) TXbytes:589411 (575.5 KiB)
Interrupt:16 Base address:0x2400
eth1 Link encap:Ethernet HWaddr00:0C:29:E7:7F:DE
inet addr:192.168.95.11 Bcast:192.168.95.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fee7:7fde/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:81275 errors:0 dropped:0 overruns:0 frame:0
TX packets:85345 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:48422935 (46.1 MiB) TXbytes:54772644 (52.2 MiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:30567 errors:0 dropped:0 overruns:0 frame:0
TX packets:30567 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:14887939 (14.1 MiB) TXbytes:14887939 (14.1 MiB)
節點二
[[email protected] ~]# vi /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
# node1
192.168.41.191 node1.localdomain node1
192.168.41.193 node1-vip.localdomain node1-vip
192.168.95.11 node1-priv.localdomain node1-priv
# node2
192.168.41.192 node2.localdomain node2
192.168.41.194 node2-vip.localdomain node2-vip
192.168.95.12 node2-priv.localdomain node2-priv
# scan-ip
192.168.41.203 scan-cluster.localdomain scan-cluster
--編輯網絡卡檔案
[[email protected] ~]# vi/etc/sysconfig/network-scripts/ifcfg-eth0
[[email protected] ~]# vi /etc/sysconfig/network-scripts/ifcfg-eth1
[[email protected] ~]#
[[email protected] ~]#
[[email protected] ~]# cat/etc/sysconfig/network-scripts/ifcfg-eth0
GATEWAY=192.168.41.1
NETMASK=255.255.255.0
IPADDR=192.168.41.192
DEVICE=eth0
HWADDR=00:0C:29:B6:6C:0D
TYPE=Ethernet
UUID=c14d4003-083d-4cb4-be03-9f076d949608
ONBOOT=yes
NM_CONTROLLED=yes
BOOTPROTO=static
是public網絡卡，eth1是私網
按照自己配置的ip資訊寫好！
這一步要注意，兩個節點都要做
--重啟網絡卡服務
(修改完hosts和ifcfg檔案之後，不要直接重啟network服務，這個時候可以啟動crs，啟動crs之後，修改private ip 和public ip，改成想要修改的ip，其實只要private ip和主機配置的一樣之後，就可以啟動crs，修改完成private ip和public ip之後，重啟network服務，這個時候，crs還是活動的，然後再改其他vip，scan ip即可，最後修改完之後，啟動叢集其他所有資源即可。)
[[email protected] ~]# service network restart
Shutting down interface eth0:
Connection closed by foreign host.
Disconnected from remotehost(192.168.40.192) at 11:24:07.
Type `help' to learn how to use Xshellprompt.
--重啟之後，第三方客戶端會失去連線，需要重新用新地址連線
如果用的是vmware虛擬機器的話，網絡卡需要重新配置
--重新連線之後
[[email protected] ~]# ifconfig -a
eth0 Link encap:Ethernet HWaddr00:0C:29:B6:6C:0D
inet addr:192.168.41.192 Bcast:192.168.41.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:feb6:6c0d/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:2150 errors:0 dropped:0overruns:0 frame:0
TX packets:1509 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:255529 (249.5 KiB) TXbytes:220147 (214.9 KiB)
eth1 Link encap:Ethernet HWaddr00:0C:29:B6:6C:17
inet addr:192.168.95.12 Bcast:192.168.95.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:feb6:6c17/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:86513 errors:0 dropped:0 overruns:0 frame:0
TX packets:80078 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:54878309 (52.3 MiB) TXbytes:48314875 (46.0 MiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:25201 errors:0 dropped:0 overruns:0 frame:0
TX packets:25201 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:11156820 (10.6 MiB) TXbytes:11156820 (10.6 MiB)
4、修改RAC public IP
[[email protected] ~]#./crsctl start crs
[[email protected] ~]#./
[[email protected] ~]#./oifcfg delif -global eth0
[[email protected] ~]#./oifcfg setif -global eth0/192.168.41.0:public
--啟動crs
[[email protected] ~]# crsctl start crs
CRS-4123: Oracle High Availability Serviceshas been started.
[[email protected] ~]#
--這裡遇到一個問題
（如果修改完hosts和和ifcfg檔案之後，不重啟network，此問題可以避免的哦，修改完hosts之後，就用oifcfg命令修改private地址，修改完private之後，在重啟network服務，這個時候crs服務就可以啟動了，就可以避免下面的錯誤，因為在主機層面修改ip地址，並重啟之後，和ocr記錄的記錄的ip，subnet與實際中的不一致，導致crs服務啟動不了）
[[email protected] ~]# oifcfg iflist
eth1 192.168.95.0
eth0 192.168.41.0
[[email protected] ~]#
[[email protected] ~]# oifcfg getif
PRIF-10: failed toinitialize the cluster registry
[[email protected] ~]#
[[email protected] ~]# oifcfg getif
PRIF-10: failed to initialize the clusterregistry
[[email protected] ~]# oifcfg delif -global eth0
PRIF-10: failed toinitialize the cluster registry
[[email protected] ~]# oifcfg setif -globaleth0/192.168.41.0:public
PRIF-10: failed to initialize the clusterregistry
--後臺日誌為
[ohasd(7176)]CRS-2765:Resource 'ora.crsd'has failed on server 'node1'.
2016-07-08 19:35:32.085
[crsd(7952)]CRS-0804:Cluster Ready Serviceaborted due to Oracle Cluster Registry error [PROC-44: Error in network addressand interface operations Network address and interface operations error [7]].Details at (:CRSD00111:) in /u01/app/11.2.0/grid/log/node1/crsd/crsd.log.
2016-07-08 19:35:32.865
[ohasd(7176)]CRS-2765:Resource 'ora.crsd'has failed on server 'node1'.
[crsd(8023)]CRS-0804:Cluster Ready Serviceaborted due to Oracle Cluster Registry error [PROC-44: Error in network addressand interface operations Network address and interface operations error [7]].Details at (:CRSD00111:) in /u01/app/11.2.0/grid/log/node1/crsd/crsd.log.
2016-07-08 19:35:41.039
[ohasd(7176)]CRS-2765:Resource 'ora.crsd'has failed on server 'node1'.
2016-07-08 19:35:41.039
[ohasd(7176)]CRS-2771:Maximum restartattempts reached for resource 'ora.crsd'; will not restart.
--問題分析
因為在主機層面修改ip地址，並重啟之後，和ocr記錄的記錄的ip，subnet與實際中的不一致，導致crs服務啟動不了。
--處理方法(網上查到方法)
可以使用gpnptool命令處理以上問題。GPNPD（Greater Pittsburgh Nonprofit Partnership）
程序的主要的作用是在叢集各個節點中同步GPnP profile檔案，在Clusterware中，CSS、GPnP
等服務的啟動都需要依賴於GPnP profile檔案。而GPnPprofile檔案是一個xml檔案，它存
儲的 位 置 是 在 ： $GRID_HOME/gpnp/profile/peer/profile.xml，
$GRID_HOME/gpnp/profile/peer/profile.xml（全域性備份，最原始的配置資訊）。GPnPD程序寫
的trace檔案會存放在$GRID_HOME/log/gpnpd/gpnpd.log。
有幾個重要的資訊儲存在GPnP profile檔案:
網路介面和IP地址(公網和私網)
ASM diskstring和spfile資訊
GPnP profile儲存的是RAC的配置資訊，包括叢集名稱、網路型別資訊（public/private）、
ASM和CSS的儲存資訊、安全的數字簽名，以及ASM例項的SPFILE檔案位置。當叢集配置
發生變化時，所有節點的該檔案會被自動更新。在安裝、系統引導或者當使用標準的叢集工
具更新期間，這些活動包括：oifcfg 改變網路資訊、crsctl 改變css裝置、ASM額外的儲存
等，會通過gpdpd程序複製GPnP profile到所有的其他節點。
當叢集啟動的時候，ClusterSynchronization Services (CSS)將掃描所有的ASM disks，它利
用的是GPnP profile檔案中的ASM discovery string。如下所示:
egistry.253.790450611"/>
這裡可以看到spfile檔案是存放在ASM卷組+DATA中的。但是有一個需要注意到事情是
我們啟動ASM的時候，需要spfile檔案，Oracle從GPnP profile中知道spfile的路徑，然後
它就會從底層磁碟中直接讀取spfile標識，啟動asm例項。
如果GPnP出現問題，可以使用cluvfy comp gpnp元件驗證命令檢查在叢集中所有節點
網格即插即用的完整性：cluvfy comp gpnp [-n node_list] [-verbose]
最後，注意Oracle不支援手動修改profile.xml檔案，直接對它的修改可能導致無法修復
的問題，最終導致在所有節點重建Clusterware。
2.1 以排他模式和不啟動crsd程序的方式啟動crs
# crsctl start crs -excl –nocrs
[[email protected] ~]# crsctl start crs -excl-nocrs
CRS-4123: Oracle High Availability Serviceshas been started.
CRS-2672: Attempting to start 'ora.mdnsd'on 'node1'
CRS-2676: Start of 'ora.mdnsd' on 'node1'succeeded
CRS-2672: Attempting to start 'ora.gpnpd'on 'node1'
CRS-2676: Start of 'ora.gpnpd' on 'node1'succeeded
CRS-2672: Attempting to start'ora.cssdmonitor' on 'node1'
CRS-2672: Attempting to start 'ora.gipcd'on 'node1'
CRS-2676: Start of 'ora.cssdmonitor' on'node1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'node1'succeeded
CRS-2672: Attempting to start 'ora.cssd' on'node1'
CRS-2672: Attempting to start 'ora.diskmon'on 'node1'
CRS-2676: Start of 'ora.diskmon' on 'node1'succeeded
CRS-2676: Start of 'ora.cssd' on 'node1'succeeded
CRS-2679: Attempting to clean'ora.cluster_interconnect.haip' on 'node1'
CRS-2672: Attempting to start 'ora.ctssd'on 'node1'
CRS-2681: Clean of'ora.cluster_interconnect.haip' on 'node1' succeeded
CRS-2672: Attempting to start'ora.cluster_interconnect.haip' on 'node1'
CRS-2676: Start of 'ora.ctssd' on 'node1'succeeded
CRS-5017: The resource action"ora.cluster_interconnect.haip start" encountered the followingerror:
Start action for HAIP aborted. For detailsrefer to "(:CLSN00107:)" in"/u01/app/11.2.0/grid/log/node1/agent/ohasd/orarootagent_root/orarootagent_root.log".
CRS-2674: Start of'ora.cluster_interconnect.haip' on 'node1' failed
CRS-2679: Attempting to clean'ora.cluster_interconnect.haip' on 'node1'
CRS-2681: Clean of'ora.cluster_interconnect.haip' on 'node1' succeeded
CRS-2672: Attempting to start 'ora.asm' on'node1'
CRS-2676: Start of 'ora.asm' on 'node1'succeeded
[[email protected] ~]#
2.2 備份crs配置資訊
[[email protected] ~]# mkdir /u01/gpnp
mkdir: cannot create directory `/u01/gpnp':File exists
[[email protected] ~]# gpnptool get-o=/u01/gpnp/profile.xml
Resulting profile written to"/u01/gpnp/profile.xml".
Success.
[[email protected] ~]#
[[email protected] ~]# more /u01/gpnp/profile.xml
<?xml version="1.0"encoding="UTF-8"?><gpnp:GPnP-Profile Version="1.0"xmlns="http://www.grid-pnp.org/2005/11/gpnp-profile"xmlns:gpnp="http://www.grid-pnp.org/2005/11/
gpnp-profile"xmlns:orcl="http://www.oracle.com/gpnp/2005/11/gpnp-profile"xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"xsi:schemaLocation="http://www.grid-pnp
.org/2005/11/gpnp-profilegpnp-profile.xsd" ProfileSequence="6"ClusterUId="3236a9ede6925f3bbf93a5b1f366ed11"ClusterName="scan-cluster"PALocation=""><gpnp:Network-Pro
file><gpnp:HostNetworkid="gen" HostName="*"><gpnp:Networkid="net1" IP="192.168.94.0"Adapter="eth1"Use="cluster_interconnect"/><gpnp:Network id="net2"IP="192.168.40
.0" Adapter="eth0"Use="public"/></gpnp:HostNetwork></gpnp:Network-Profile><orcl:CSS-Profileid="css" DiscoveryString="+asm" LeaseDuration="400"/><orcl:ASM-Profileid="
asm" DiscoveryString=""SPFile="+GRIDDG/scan-cluster/asmparameterfile/registry.253.913494821"/><ds:Signaturexmlns:ds="http://www.w3.org/2000/09/xmldsig#"><ds:SignedInf
o><ds:CanonicalizationMethodAlgorithm="http://www.w3.org/2001/10/xml-exc-c14n#"/><ds:SignatureMethodAlgorithm="http://www.w3.org/2000/09/xmldsig#rsa-sha1"/><ds:Refere
nceURI=""><ds:Transforms><ds:TransformAlgorithm="http://www.w3.org/2000/09/xmldsig#enveloped-signature"/><ds:TransformAlgorithm="http://www.w3.org/2001/10/xml-exc-c1
4n#"> <InclusiveNamespacesxmlns="http://www.w3.org/2001/10/xml-exc-c14n#" PrefixList="gpnporclxsi"/></ds:Transform></ds:Transforms><ds:DigestMethodAlgorithm="http:/
/www.w3.org/2000/09/xmldsig#sha1"/><ds:DigestValue>wp3L2kQv2+FWjS55HTv0nFoOykw=</ds:DigestValue></ds:Reference></ds:SignedInfo><ds:SignatureValue>ZOb+OsVU3bug/UO1dT/stc
a66voRtEArFwI4SZC5flUM93p0gZraQGF294seZ+kBYqbaXIp9NdqmxFq6Enf5pbY8F+KmAK/668RsBuMqdBZonzix+PhvxWssDWmejINXs1PlzPjLj0O3ya/8Ld3oisEUtbTFJXGkYcRDrTtmliU=</ds:SignatureValu
e></ds:Signature></gpnp:GPnP-Profile>
通過上面的資訊可以看到，profile裡面的eth0，eth1都是舊的ip地址
檢視CRS的配置資訊：
[[email protected] ~]# gpnptool get
Warning: some command line parameters weredefaulted. Resulting command line:
/u01/app/11.2.0/grid/bin/gpnptool.binget -o-
<?xml version="1.0"encoding="UTF-8"?><gpnp:GPnP-Profile Version="1.0"xmlns="http://www.grid-pnp.org/2005/11/gpnp-profile"xmlns:gpnp="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:orcl="http://www.oracle.com/gpnp/2005/11/gpnp-profile"xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"xsi:schemaLocation="http://www.grid-pnp.org/2005/11/gpnp-profilegpnp-profile.xsd" ProfileSequence="6" ClusterUId="3236a9ede6925f3bbf93a5b1f366ed11"ClusterName="scan-cluster"PALocation=""><gpnp:Network-Profile><gpnp:HostNetworkid="gen" HostName="*"><gpnp:Networkid="net1" IP="192.168.94.0" Adapter="eth1"Use="cluster_interconnect"/><gpnp:Network id="net2"IP="192.168.40.0" Adapter="eth0"Use="public"/></gpnp:HostNetwork></gpnp:Network-Profile><orcl:CSS-Profileid="css" DiscoveryString="+asm"LeaseDuration="400"/><orcl:ASM-Profile id="asm"DiscoveryString="" SPFile="+GRIDDG/scan-cluster/asmparameterfile/registry.253.913494821"/><ds:Signaturexmlns:ds="http://www.w3.org/2000/09/xmldsig#"><ds:SignedInfo><ds:CanonicalizationMethodAlgorithm="http://www.w3.org/2001/10/xml-exc-c14n#"/><ds:SignatureMethodAlgorithm="http://www.w3.org/2000/09/xmldsig#rsa-sha1"/><ds:ReferenceURI=""><ds:Transforms><ds:Transform Algorithm="http://www.w3.org/2000/09/xmldsig#enveloped-signature"/><ds:TransformAlgorithm="http://www.w3.org/2001/10/xml-exc-c14n#"><InclusiveNamespacesxmlns="http://www.w3.org/2001/10/xml-exc-c14n#" PrefixList="gpnporcl xsi"/></ds:Transform></ds:Transforms><ds:DigestMethodAlgorithm="http://www.w3.org/2000/09/xmldsig#sha1"/><ds:DigestValue>wp3L2kQv2+FWjS55HTv0nFoOykw=</ds:DigestVa