Oracle Study之--Oracle 11g RAC添加节点错误

秒速五厘米 2022-08-05 02:51 356阅读 0赞

Oracle Study之—Oracle 11g RAC添加节点错误

系统环境：

操作系统：RedHat EL5

Cluster： Oracle 11gR2 Grid

Oracle： Oracle 11gR2

故障一：新节点和原节点时间不同步，添加节点失败

1、在新节点执行“root.sh”

  1. [root@wqy3 install]# /u01/11.2.0/grid/root.sh
  2. Running Oracle 11g root.sh script...
  5. The following environment variables are set as:
  6.     ORACLE_OWNER= grid
  7.     ORACLE_HOME=  /u01/11.2.0/grid
  10. Enter the full pathname of the local bin directory: [/usr/local/bin]: 
  11. The file "dbhome" already exists in /usr/local/bin.  Overwrite it? (y/n) 
  12. [n]: y
  13.    Copying dbhome to /usr/local/bin ...
  14. The file "oraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) 
  15. [n]: y
  16.    Copying oraenv to /usr/local/bin ...
  17. The file "coraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) 
  18. [n]: y
  19.    Copying coraenv to /usr/local/bin ...
  22. Entries will be added to the /etc/oratab file as needed by
  23. Database Configuration Assistant when a database is created
  24. Finished running generic part of root.sh script.
  25. Now product-specific root actions will be performed.
  26. 2015-06-03 14:05:38: Parsing the host name
  27. 2015-06-03 14:05:38: Checking for super user privileges
  28. 2015-06-03 14:05:38: User has super user privileges
  29. Using configuration parameter file: /u01/11.2.0/grid/crs/install/crsconfig_params
  30. LOCAL ADD MODE 
  31. Creating OCR keys for user 'root', privgrp 'root'..
  32. Operation successful.
  33. Adding daemon to inittab
  34. CRS-4123: Oracle High Availability Services has been started.
  35. ohasd is starting
  36. CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node wqy2, number 2, and is terminating
  37. An active cluster was found during exclusive startup, restarting to join the cluster
  38. CRS-2672: Attempting to start 'ora.mdnsd' on 'wqy3'
  39. CRS-2676: Start of 'ora.mdnsd' on 'wqy3' succeeded
  40. CRS-2672: Attempting to start 'ora.gipcd' on 'wqy3'
  41. CRS-2676: Start of 'ora.gipcd' on 'wqy3' succeeded
  42. CRS-2672: Attempting to start 'ora.gpnpd' on 'wqy3'
  43. CRS-2676: Start of 'ora.gpnpd' on 'wqy3' succeeded
  44. CRS-2672: Attempting to start 'ora.cssdmonitor' on 'wqy3'
  45. CRS-2676: Start of 'ora.cssdmonitor' on 'wqy3' succeeded
  46. CRS-2672: Attempting to start 'ora.cssd' on 'wqy3'
  47. CRS-2672: Attempting to start 'ora.diskmon' on 'wqy3'
  48. CRS-2676: Start of 'ora.diskmon' on 'wqy3' succeeded
  49. CRS-2676: Start of 'ora.cssd' on 'wqy3' succeeded
  50. CRS-2672: Attempting to start 'ora.ctssd' on 'wqy3'
  51. CRS-2674: Start of 'ora.ctssd' on 'wqy3' failed
  52. CRS-4000: Command Start failed, or completed with errors.
  53. Command return code of 1 (256) from command: /u01/11.2.0/grid/bin/crsctl start resource ora.ctssd -init -env USR_ORA_ENV=CTSS_REBOOT=TRUE
  54. Start of resource "ora.ctssd -init -env USR_ORA_ENV=CTSS_REBOOT=TRUE" failed
  55. Failed to start CTSS
  56. Failed to start Oracle Clusterware stack

--启动ctssd进程失败

查看告警日志：
[root@wqy3 ctssd]# tail -f octssd.log 

  1. 2015-06-03 12:00:50.644: [    CTSS][2988764048]ctssslave_meh1: Master private node name [wqy1]
  2. 2015-06-03 12:00:50.644: [    CTSS][2988764048]ctssslave_msh: Connect String is (ADDRESS=(PROTOCOL=tcp)(HOST=wqy1)(PORT=14631))
  3. 2015-06-03 12:00:50.644: [    CTSS][2988764048]ctssslave_msh: Forming connection with CTSS master node [1]
  4. 2015-06-03 12:00:50.645: [    CTSS][2988764048]ctssslave_msh: Successfully connected to master [1]
  5. 2015-06-03 12:00:50.645: [    CTSS][2988764048]ctssslave_swm: The magnitude [7198995297417 usec] of the offset [7198995297417 usec] is larger than [86400000000 usec] sec which is the CTSS limit.
  6. 2015-06-03 12:00:50.645: [    CTSS][2988764048]ctsselect_mmg9_3: Failed in clsctsselect_select_mode [12]: Time offset is too much to be corrected
  7. 2015-06-03 12:00:51.552: [    CTSS][2978274192]ctss_checkcb: clsdm requested check alive. Returns [40000050]
  8. 2015-06-03 12:00:51.552: [    CTSS][2988764048]ctsselect_mmg: CTSS daemon exiting [12].
  9. 2015-06-03 12:00:51.552: [    CTSS][2988764048]CTSS daemon aborting
  10. 2015-06-03 12:00:51.552: [    CTSS][3046532800]ctss_init: Spawn completed. Waiting for threads to join
  11. 2015-06-03 14:07:28.085: [    CTSS][3046586048]Oracle Database CTSS Release 11.2.0.1.0 Production Copyright 2006, 2007 Oracle.  All rights reserved.
  12. 2015-06-03 14:07:28.085: [    CTSS][3046586048]ctss_scls_init: SCLs Context is 0x99bd618
  13. 2015-06-03 14:07:28.098: [    CTSS][3046586048]ctss_css_init: CSS Context is 0x99bd6c0
  14. 2015-06-03 14:07:28.099: [    CTSS][3046586048]ctss_clsc_init: CLSC Context is 0x99be000
  15. 2015-06-03 14:07:28.099: [    CTSS][3046586048]ctss_init: CTSS production mode
  16. 2015-06-03 14:07:28.099: [    CTSS][3046586048]ctss_init: CTSS_REBOOT=TRUE. Overriding 'reboot' argument as if 'octssd reboot' is executed. Turn on start up step sync.
  17. 2015-06-03 14:07:28.099: [    CTSS][3046586048]sclsctss_gvss2: NTP default pid file not found
  18. 2015-06-03 14:07:28.099: [    CTSS][3046586048]sclsctss_gvss8: Return [0] and NTP status [1].
  19. 2015-06-03 14:07:28.099: [    CTSS][3046586048]ctss_check_vendor_sw: Vendor time sync software is not detected. status [1].
  20. 2015-06-03 14:07:28.099: [    CTSS][3046586048]ctsscomm_init: The Socket name is [(ADDRESS=(PROTOCOL=tcp)(HOST=wqy3))]
  21. 2015-06-03 14:07:28.101: [    CTSS][3046586048]ctsscomm_init: Successful completion.
  22. 2015-06-03 14:07:28.101: [    CTSS][3046586048]ctsscomm_init: PORT = 18607
  23. 2015-06-03 14:07:28.102: [    CTSS][3020286864]CTSS connection handler started
  24. [    CTSS][3009797008]clsctsselect_mm: Master Monitor thread started
  25. [    CTSS][2999307152]ctsselect_msm: Slave Monitor thread started
  26. 2015-06-03 14:07:28.102: [    CTSS][2988817296]ctsselect_mmg: The local nodenum is 4
  27. 2015-06-03 14:07:28.103: [    CTSS][2988817296]ctsselect_mmg2_5: Pub data for member [1]. {Version [1] Node [1] Priv node name [wqy1] Port num [14631] SW version [186646784] Mode [0x40]}
  28. 2015-06-03 14:07:28.104: [    CTSS][2988817296]ctsselect_mmg2_5: Pub data for member [2]. {Version [1] Node [2] Priv node name [wqy2] Port num [42486] SW version [186646784] Mode [0x40]}
  29. 2015-06-03 14:07:28.106: [    CTSS][2988817296]ctsselect_mmg4: Successfully registered with [CTSSMASTER]
  30. 2015-06-03 14:07:28.107: [    CTSS][2988817296]ctsselect_mmg6: Receive reconfig event. Inc num[9] New master [3] members count[1]
  31. 2015-06-03 14:07:28.107: [    CTSS][2988817296]ctsselect_mmg8: Host [wqy1] Node num [1] is the master
  32. 2015-06-03 14:07:28.107: [    CTSS][2988817296]ctsselect_sm2: Node [1] is the CTSS master
  33. 2015-06-03 14:07:28.107: [    CTSS][2988817296]ctssslave_meh1: Master private node name [wqy1]
  34. 2015-06-03 14:07:28.108: [    CTSS][2988817296]ctssslave_msh: Connect String is (ADDRESS=(PROTOCOL=tcp)(HOST=wqy1)(PORT=14631))
  35. [  clsdmt][2978327440]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=wqy3DBG_CTSSD))
  36. 2015-06-03 14:07:28.108: [  clsdmt][2978327440]PID for the Process [4654], connkey 11 
  37. 2015-06-03 14:07:28.108: [  clsdmt][2978327440]Creating PID [4654] file for home /u01/11.2.0/grid host wqy3 bin ctss to /u01/11.2.0/grid/ctss/init/
  38. 2015-06-03 14:07:28.108: [  clsdmt][2978327440]Writing PID [4654] to the file [/u01/11.2.0/grid/ctss/init/wqy3.pid] 
  39. 2015-06-03 14:07:28.109: [    CTSS][2988817296]ctssslave_msh: Forming connection with CTSS master node [1]
  40. 2015-06-03 14:07:28.110: [    CTSS][2988817296]ctssslave_msh: Successfully connected to master [1]
  41. 2015-06-03 14:07:28.110: [    CTSS][2988817296]ctssslave_swm: The magnitude [7198995304656 usec] of the offset [7198995304656 usec] is larger than [86400000000 usec] sec which is the CTSS limit.
  42. 2015-06-03 14:07:28.110: [    CTSS][2988817296]ctsselect_mmg9_3: Failed in clsctsselect_select_mode [12]: Time offset is too much to be corrected
  43. 2015-06-03 14:07:29.019: [    CTSS][2978327440]ctss_checkcb: clsdm requested check alive. Returns [40000050]
  44. 2015-06-03 14:07:29.019: [    CTSS][2988817296]ctsselect_mmg: CTSS daemon exiting [12].
  45. 2015-06-03 14:07:29.019: [    CTSS][2988817296]CTSS daemon aborting
  46. 2015-06-03 14:07:29.020: [    CTSS][3046586048]ctss_init: Spawn completed. Waiting for threads to join

查看新节点时间：

[root@wqy3 install]# date
Wed Jun 3 14:09:38 CST 2015

其他节点时间：

[root@wqy1 ~]# date
Thu Mar 12 06:28:57 CST 2015

[root@wqy2 ~]# date
Thu Mar 12 06:29:31 CST 2015

—-新节点时间和原节点严重不同步

2、调整新节点时间

[root@wqy3 install]# date 031206292015
Thu Mar 12 06:29:00 CST 2015

**[root@wqy3 install]# date
Thu Mar 12 06:29:01 CST 2015
[root@wqy3 install]#

[root@wqy1 ~]# date
Thu Mar 12 06:28:57 CST 2015**

[root@wqy2 ~]# date
Thu Mar 12 06:29:31 CST 2015

4、清除CRS配置，重新运行root.sh

[root@wqy3 install]# perl rootcrs.pl -deconfig -force 

  1. 2015-06-03 14:08:35: Parsing the host name
  2. 2015-06-03 14:08:35: Checking for super user privileges
  3. 2015-06-03 14:08:35: User has super user privileges
  4. Using configuration parameter file: ./crsconfig_params
  5. PRCR-1035 : Failed to look up CRS resource ora.cluster_vip.type for 1
  6. PRCR-1068 : Failed to query resources
  7. Cannot communicate with crsd
  8. PRCR-1070 : Failed to check if resource ora.gsd is registered
  9. Cannot communicate with crsd
  10. PRCR-1070 : Failed to check if resource ora.ons is registered
  11. Cannot communicate with crsd
  12. PRCR-1070 : Failed to check if resource ora.eons is registered
  13. Cannot communicate with crsd
  14. ACFS-9200: Supported
  15. CRS-4535: Cannot communicate with Cluster Ready Services
  16. CRS-4000: Command Stop failed, or completed with errors.
  17. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'wqy3'
  18. CRS-2673: Attempting to stop 'ora.mdnsd' on 'wqy3'
  19. CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'wqy3'
  20. CRS-2677: Stop of 'ora.cssdmonitor' on 'wqy3' succeeded
  21. CRS-2673: Attempting to stop 'ora.cssd' on 'wqy3'
  22. CRS-2677: Stop of 'ora.cssd' on 'wqy3' succeeded
  23. CRS-2673: Attempting to stop 'ora.gpnpd' on 'wqy3'
  24. CRS-2673: Attempting to stop 'ora.diskmon' on 'wqy3'
  25. CRS-2677: Stop of 'ora.mdnsd' on 'wqy3' succeeded
  26. CRS-2677: Stop of 'ora.gpnpd' on 'wqy3' succeeded
  27. CRS-2673: Attempting to stop 'ora.gipcd' on 'wqy3'
  28. CRS-2677: Stop of 'ora.gipcd' on 'wqy3' succeeded
  29. CRS-2677: Stop of 'ora.diskmon' on 'wqy3' succeeded
  30. CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'wqy3' has completed
  31. CRS-4133: Oracle High Availability Services has been stopped.
  32. error: package cvuqdisk is not installed
  33. Successfully deconfigured Oracle clusterware stack on this node

重新运行root.sh

[root@wqy3 install]# /u01/11.2.0/grid/root.sh 

  1. Running Oracle 11g root.sh script...
  4. The following environment variables are set as:
  5.     ORACLE_OWNER= grid
  6.     ORACLE_HOME=  /u01/11.2.0/grid
  9. Enter the full pathname of the local bin directory: [/usr/local/bin]: 
  10. The file "dbhome" already exists in /usr/local/bin.  Overwrite it? (y/n) 
  11. [n]: y
  12.    Copying dbhome to /usr/local/bin ...
  13. The file "oraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) 
  14. [n]: y
  15.    Copying oraenv to /usr/local/bin ...
  16. The file "coraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) 
  17. [n]: y
  18.    Copying coraenv to /usr/local/bin ...
  21. Entries will be added to the /etc/oratab file as needed by
  22. Database Configuration Assistant when a database is created
  23. Finished running generic part of root.sh script.
  24. Now product-specific root actions will be performed.
  25. 2015-03-12 06:30:01: Parsing the host name
  26. 2015-03-12 06:30:01: Checking for super user privileges
  27. 2015-03-12 06:30:01: User has super user privileges
  28. Using configuration parameter file: /u01/11.2.0/grid/crs/install/crsconfig_params
  29. LOCAL ADD MODE 
  30. Creating OCR keys for user 'root', privgrp 'root'..
  31. Operation successful.
  32. Adding daemon to inittab
  33. CRS-4123: Oracle High Availability Services has been started.
  34. ohasd is starting
  35. CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node wqy1, number 1, and is terminating
  36. An active cluster was found during exclusive startup, restarting to join the cluster
  37. CRS-2672: Attempting to start 'ora.mdnsd' on 'wqy3'
  38. CRS-2676: Start of 'ora.mdnsd' on 'wqy3' succeeded
  39. CRS-2672: Attempting to start 'ora.gipcd' on 'wqy3'
  40. CRS-2676: Start of 'ora.gipcd' on 'wqy3' succeeded
  41. CRS-2672: Attempting to start 'ora.gpnpd' on 'wqy3'
  42. CRS-2676: Start of 'ora.gpnpd' on 'wqy3' succeeded
  43. CRS-2672: Attempting to start 'ora.cssdmonitor' on 'wqy3'
  44. CRS-2676: Start of 'ora.cssdmonitor' on 'wqy3' succeeded
  45. CRS-2672: Attempting to start 'ora.cssd' on 'wqy3'
  46. CRS-2672: Attempting to start 'ora.diskmon' on 'wqy3'
  47. CRS-2676: Start of 'ora.diskmon' on 'wqy3' succeeded
  48. CRS-2676: Start of 'ora.cssd' on 'wqy3' succeeded
  49. CRS-2672: Attempting to start 'ora.ctssd' on 'wqy3'
  50. CRS-2676: Start of 'ora.ctssd' on 'wqy3' succeeded
  51. CRS-2672: Attempting to start 'ora.drivers.acfs' on 'wqy3'
  52. CRS-2676: Start of 'ora.drivers.acfs' on 'wqy3' succeeded
  53. CRS-2672: Attempting to start 'ora.asm' on 'wqy3'
  54. CRS-2676: Start of 'ora.asm' on 'wqy3' succeeded
  55. CRS-2672: Attempting to start 'ora.crsd' on 'wqy3'
  56. CRS-2676: Start of 'ora.crsd' on 'wqy3' succeeded
  57. CRS-2672: Attempting to start 'ora.evmd' on 'wqy3'
  58. CRS-2676: Start of 'ora.evmd' on 'wqy3' succeeded
  59. clscfg: EXISTING configuration version 5 detected.
  60. clscfg: version 5 is 11g Release 2.
  61. Successfully accumulated necessary OCR keys.
  62. Creating OCR keys for user 'root', privgrp 'root'..
  63. Operation successful.
  64. PRKC-1024 : Invalid netmask: eth0
  65. add nodeapps on node=wqy3 ... failed
  66. Preparing packages for installation...
  67. cvuqdisk-1.0.7-1
  68. Configure Oracle Grid Infrastructure for a Cluster ... failed
  69. Updating inventory properties for clusterware
  72. Error in writing to directory /u01/tmp. Oracle Universal Installer needs you to have permission in this area to install. Installation cannot continue. Please make sure TEMP is set to a valid writable directory.
  73. : Permission denied
  74. Starting Oracle Universal Installer...

—运行失败，提示在”/u01”下建立tmp目录

故障二：新节点环境变量和原节点不同，运行”root.sh“失败

1、查看原节点环境变量
[grid@wqy1 ~]$ env |grep tmp
TMPDIR=/u01/tmp
TMP=/u01/tmp

[root@wqy3 install]# mkdir /u01/tmp
[root@wqy3 install]# chmod 1777 /u01/tmp
[root@wqy3 install]# ls -l /u01
total 28
drwxr-xr-x 3 grid oinstall 4096 Jun 3 2015 11.2.0
drwxr-xr-x 4 root root 4096 Jun 3 2015 app
drwx——— 2 root root 16384 Jun 3 2015 lost+found
drwxrwxrwt 2 root root 4096 Mar 12 06:37 tmp

**2、清除CRS配置

[root@wqy3 install]# perl rootcrs.pl -deconfig -force** 

  1. 2015-03-12 06:34:59: Parsing the host name
  2. 2015-03-12 06:34:59: Checking for super user privileges
  3. 2015-03-12 06:34:59: User has super user privileges
  4. Using configuration parameter file: ./crsconfig_params
  5. VIP exists.:wqy1
  6. VIP exists.: /wqy1-vip/192.168.8.23/255.255.255.0/eth0
  7. VIP exists.:wqy2
  8. VIP exists.: /wqy2-vip/192.168.8.24/255.255.255.0/eth0
  9. GSD exists.
  10. ONS daemon exists. Local port 6100, remote port 6200
  11. eONS daemon exists. Multicast port 18447, multicast IP address 234.140.234.80, listening port 2016
  12. PRKO-2439 : VIP does not exist.
  15. PRKO-2313 : VIP wqy3 does not exist.
  16. ACFS-9200: Supported
  17. CRS-2673: Attempting to stop 'ora.registry.acfs' on 'wqy3'
  18. CRS-2677: Stop of 'ora.registry.acfs' on 'wqy3' succeeded
  19. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'wqy3'
  20. CRS-2673: Attempting to stop 'ora.crsd' on 'wqy3'
  21. CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'wqy3'
  22. CRS-2673: Attempting to stop 'ora.OCR_VOTE.dg' on 'wqy3'
  23. CRS-2677: Stop of 'ora.OCR_VOTE.dg' on 'wqy3' succeeded
  24. CRS-2673: Attempting to stop 'ora.asm' on 'wqy3'
  25. CRS-2677: Stop of 'ora.asm' on 'wqy3' succeeded
  26. CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'wqy3' has completed
  27. CRS-2677: Stop of 'ora.crsd' on 'wqy3' succeeded
  28. CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'wqy3'
  29. CRS-2673: Attempting to stop 'ora.ctssd' on 'wqy3'
  30. CRS-2673: Attempting to stop 'ora.evmd' on 'wqy3'
  31. CRS-2673: Attempting to stop 'ora.asm' on 'wqy3'
  32. CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'wqy3'
  33. CRS-2673: Attempting to stop 'ora.mdnsd' on 'wqy3'
  34. CRS-2677: Stop of 'ora.cssdmonitor' on 'wqy3' succeeded
  35. CRS-2677: Stop of 'ora.evmd' on 'wqy3' succeeded
  36. CRS-2677: Stop of 'ora.mdnsd' on 'wqy3' succeeded
  37. CRS-2677: Stop of 'ora.asm' on 'wqy3' succeeded
  38. CRS-2677: Stop of 'ora.drivers.acfs' on 'wqy3' succeeded
  39. CRS-2677: Stop of 'ora.ctssd' on 'wqy3' succeeded
  40. CRS-2673: Attempting to stop 'ora.cssd' on 'wqy3'
  41. CRS-2677: Stop of 'ora.cssd' on 'wqy3' succeeded
  42. CRS-2673: Attempting to stop 'ora.gpnpd' on 'wqy3'
  43. CRS-2673: Attempting to stop 'ora.diskmon' on 'wqy3'
  44. CRS-2677: Stop of 'ora.gpnpd' on 'wqy3' succeeded
  45. CRS-2673: Attempting to stop 'ora.gipcd' on 'wqy3'
  46. CRS-2677: Stop of 'ora.gipcd' on 'wqy3' succeeded
  47. CRS-2677: Stop of 'ora.diskmon' on 'wqy3' succeeded
  48. CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'wqy3' has completed
  49. CRS-4133: Oracle High Availability Services has been stopped.
  50. Successfully deconfigured Oracle clusterware stack on this node

3、重新运行root.sh script

[root@wqy3 install]# /u01/11.2.0/grid/root.sh 

  1. Running Oracle 11g root.sh script...
  4. The following environment variables are set as:
  5.     ORACLE_OWNER= grid
  6.     ORACLE_HOME=  /u01/11.2.0/grid
  9. Enter the full pathname of the local bin directory: [/usr/local/bin]: 
  10. The file "dbhome" already exists in /usr/local/bin.  Overwrite it? (y/n) 
  11. [n]: y
  12.    Copying dbhome to /usr/local/bin ...
  13. The file "oraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) 
  14. [n]: y
  15.    Copying oraenv to /usr/local/bin ...
  16. The file "coraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) 
  17. [n]: y
  18.    Copying coraenv to /usr/local/bin ...
  21. Entries will be added to the /etc/oratab file as needed by
  22. Database Configuration Assistant when a database is created
  23. Finished running generic part of root.sh script.
  24. Now product-specific root actions will be performed.
  25. 2015-03-12 06:38:57: Parsing the host name
  26. 2015-03-12 06:38:57: Checking for super user privileges
  27. 2015-03-12 06:38:57: User has super user privileges
  28. Using configuration parameter file: /u01/11.2.0/grid/crs/install/crsconfig_params
  29. LOCAL ADD MODE 
  30. Creating OCR keys for user 'root', privgrp 'root'..
  31. Operation successful.
  32. Adding daemon to inittab
  33. CRS-4123: Oracle High Availability Services has been started.
  34. ohasd is starting
  35. CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node wqy1, number 1, and is terminating
  36. An active cluster was found during exclusive startup, restarting to join the cluster
  37. CRS-2672: Attempting to start 'ora.mdnsd' on 'wqy3'
  38. CRS-2676: Start of 'ora.mdnsd' on 'wqy3' succeeded
  39. CRS-2672: Attempting to start 'ora.gipcd' on 'wqy3'
  40. CRS-2676: Start of 'ora.gipcd' on 'wqy3' succeeded
  41. CRS-2672: Attempting to start 'ora.gpnpd' on 'wqy3'
  42. CRS-2676: Start of 'ora.gpnpd' on 'wqy3' succeeded
  43. CRS-2672: Attempting to start 'ora.cssdmonitor' on 'wqy3'
  44. CRS-2676: Start of 'ora.cssdmonitor' on 'wqy3' succeeded
  45. CRS-2672: Attempting to start 'ora.cssd' on 'wqy3'
  46. CRS-2672: Attempting to start 'ora.diskmon' on 'wqy3'
  47. CRS-2676: Start of 'ora.diskmon' on 'wqy3' succeeded
  48. CRS-2676: Start of 'ora.cssd' on 'wqy3' succeeded
  49. CRS-2672: Attempting to start 'ora.ctssd' on 'wqy3'
  50. CRS-2676: Start of 'ora.ctssd' on 'wqy3' succeeded
  51. CRS-2672: Attempting to start 'ora.drivers.acfs' on 'wqy3'
  52. CRS-2676: Start of 'ora.drivers.acfs' on 'wqy3' succeeded
  53. CRS-2672: Attempting to start 'ora.asm' on 'wqy3'
  54. CRS-2676: Start of 'ora.asm' on 'wqy3' succeeded
  55. CRS-2672: Attempting to start 'ora.crsd' on 'wqy3'
  56. CRS-2676: Start of 'ora.crsd' on 'wqy3' succeeded
  57. CRS-2672: Attempting to start 'ora.evmd' on 'wqy3'
  58. CRS-2676: Start of 'ora.evmd' on 'wqy3' succeeded
  59. clscfg: EXISTING configuration version 5 detected.
  60. clscfg: version 5 is 11g Release 2.
  61. Successfully accumulated necessary OCR keys.
  62. Creating OCR keys for user 'root', privgrp 'root'..
  63. Operation successful.
  64. PRKC-1024 : Invalid netmask: eth0
  65. add nodeapps on node=wqy3 ... failed
  66. Preparing packages for installation...
  67. cvuqdisk-1.0.7-1
  68. Configure Oracle Grid Infrastructure for a Cluster ... failed
  69. Updating inventory properties for clusterware
  70. Starting Oracle Universal Installer...
  73. Checking swap space: must be greater than 500 MB.   Actual 2047 MB    Passed
  74. The inventory pointer is located at /etc/oraInst.loc
  75. The inventory is located at /u01/app/oraInventory
  76. 'UpdateNodeList' was successful.

**—-脚本运行成功！

4、验证**

[root@wqy3 install]# crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
[root@wqy3 install]# crs_stat -t 

  1. Name           Type           Target    State     Host        
  2. ------------------------------------------------------------
  3. ora.DATA.dg    ora....up.type ONLINE    ONLINE    wqy1        
  4. ora....ER.lsnr ora....er.type ONLINE    ONLINE    wqy1        
  5. ora....N1.lsnr ora....er.type ONLINE    ONLINE    wqy1        
  6. ora....VOTE.dg ora....up.type ONLINE    ONLINE    wqy1        
  7. ora.RCV.dg     ora....up.type ONLINE    ONLINE    wqy1        
  8. ora.asm        ora.asm.type   ONLINE    ONLINE    wqy1        
  9. ora.eons       ora.eons.type  ONLINE    ONLINE    wqy1        
  10. ora.gsd        ora.gsd.type   OFFLINE   OFFLINE               
  11. ora....network ora....rk.type ONLINE    ONLINE    wqy1        
  12. ora.oc4j       ora.oc4j.type  OFFLINE   OFFLINE               
  13. ora.ons        ora.ons.type   ONLINE    ONLINE    wqy1        
  14. ora.racdb.db   ora....se.type ONLINE    ONLINE    wqy1        
  15. ora....ry.acfs ora....fs.type ONLINE    ONLINE    wqy1        
  16. ora.scan1.vip  ora....ip.type ONLINE    ONLINE    wqy1        
  17. ora....SM1.asm application    ONLINE    ONLINE    wqy1        
  18. ora....Y1.lsnr application    ONLINE    ONLINE    wqy1        
  19. ora.wqy1.gsd   application    OFFLINE   OFFLINE               
  20. ora.wqy1.ons   application    ONLINE    ONLINE    wqy1        
  21. ora.wqy1.vip   ora....t1.type ONLINE    ONLINE    wqy1        
  22. ora....SM2.asm application    ONLINE    ONLINE    wqy2        
  23. ora....Y2.lsnr application    ONLINE    ONLINE    wqy2        
  24. ora.wqy2.gsd   application    OFFLINE   OFFLINE               
  25. ora.wqy2.ons   application    ONLINE    ONLINE    wqy2        
  26. ora.wqy2.vip   ora....t1.type ONLINE    ONLINE    wqy2        
  27. ora....SM4.asm application    ONLINE    ONLINE    wqy3        
  28. ora....Y3.lsnr application    OFFLINE   OFFLINE               
  29. ora.wqy3.gsd   application    OFFLINE   OFFLINE               
  30. ora.wqy3.ons   application    ONLINE    ONLINE    wqy3

**故障三：新节点缺失vip service

1、查看新节点 Service**

[root@wqy3 install]# crs_stat -t 

  1. Name           Type           Target    State     Host        
  2. ------------------------------------------------------------
  3. ora.DATA.dg    ora....up.type ONLINE    ONLINE    wqy1        
  4. ora....ER.lsnr ora....er.type ONLINE    ONLINE    wqy1        
  5. ora....N1.lsnr ora....er.type ONLINE    ONLINE    wqy1        
  6. ora....VOTE.dg ora....up.type ONLINE    ONLINE    wqy1        
  7. ora.RCV.dg     ora....up.type ONLINE    ONLINE    wqy1        
  8. ora.asm        ora.asm.type   ONLINE    ONLINE    wqy1        
  9. ora.eons       ora.eons.type  ONLINE    ONLINE    wqy1        
  10. ora.gsd        ora.gsd.type   OFFLINE   OFFLINE               
  11. ora....network ora....rk.type ONLINE    ONLINE    wqy1        
  12. ora.oc4j       ora.oc4j.type  OFFLINE   OFFLINE               
  13. ora.ons        ora.ons.type   ONLINE    ONLINE    wqy1        
  14. ora.racdb.db   ora....se.type ONLINE    ONLINE    wqy1        
  15. ora....ry.acfs ora....fs.type ONLINE    ONLINE    wqy1        
  16. ora.scan1.vip  ora....ip.type ONLINE    ONLINE    wqy1        
  17. ora....SM1.asm application    ONLINE    ONLINE    wqy1        
  18. ora....Y1.lsnr application    ONLINE    ONLINE    wqy1        
  19. ora.wqy1.gsd   application    OFFLINE   OFFLINE               
  20. ora.wqy1.ons   application    ONLINE    ONLINE    wqy1        
  21. ora.wqy1.vip   ora....t1.type ONLINE    ONLINE    wqy1        
  22. ora....SM2.asm application    ONLINE    ONLINE    wqy2        
  23. ora....Y2.lsnr application    ONLINE    ONLINE    wqy2        
  24. ora.wqy2.gsd   application    OFFLINE   OFFLINE               
  25. ora.wqy2.ons   application    ONLINE    ONLINE    wqy2        
  26. ora.wqy2.vip   ora....t1.type ONLINE    ONLINE    wqy2        
  27. ora....SM4.asm application    ONLINE    ONLINE    wqy3        
  28. ora....Y3.lsnr application    OFFLINE   OFFLINE               
  29. ora.wqy3.gsd   application    OFFLINE   OFFLINE               
  30. ora.wqy3.ons   application    ONLINE    ONLINE    wqy3

[root@wqy3 install]# crs_stat |grep vip
NAME=ora.scan1.vip
TYPE=ora.scan_vip.type
NAME=ora.wqy1.vip
TYPE=ora.cluster_vip_net1.type
NAME=ora.wqy2.vip
TYPE=ora.cluster_vip_net1.type

—-缺失node3的vip service

2、添加新节点的vip service

[root@wqy3 install]# srvctl add nodeapps -h 

  1. Adds node application configuration to the specified node.
  4. Usage: srvctl add nodeapps { { -n <node_name> -A <name|ip>/<netmask>/[if1[|if2...]] } | { -S <subnet>/<netmask>/[if1[|if2...]] } } [-p <portnum>] [-m <multicast-ip-address>] [-e <eons-listen-port>] [-l <ons-local-port>]  [-r <ons-remote-port>] [-t <host>[:<port>][,<host>[:<port>]...]] [-v]
  5.     -n <node_name>           Node name
  6.     -A <vip_name|ip>/<netmask>/[if1[|if2...]]  VIP address spec for node applications
  7.     -S <subnet>/<netmask>/[if1[|if2...]]  NET address spec for network
  8.     -m <multicast-ip-address>   The multicast IP address for eONS
  9.     -p <multicast-portnum>    The port number for eONS
  10.     -e <eons-listen-port>     Local listen port for eONS daemon (Default port number is 2016)
  11.     -l <ons-local-port>      ONS listening port for local client connections
  12.     -r <ons-remote-port>     ONS listening port for connections from remote hosts
  13.     -t <host>[:<port>][,<host>[:<port>]...]  List of remote host/port pairs for ONS daemons outside this cluster
  14.     -h                       Print usage
  15.     -v                       Verbose output

[root@wqy3 install]# srvctl add nodeapps -A 192.168.8.27/255.255.255.0/eth0 -n wqy3

[root@wqy3 install]# crs_stat |grep vip
NAME=ora.scan1.vip
TYPE=ora.scan_vip.type
NAME=ora.wqy1.vip
TYPE=ora.cluster_vip_net1.type
NAME=ora.wqy2.vip
TYPE=ora.cluster_vip_net1.type
NAME=ora.wqy3.vip
TYPE=ora.cluster_vip_net1.type

启动vip service：
[root@wqy3 install]# crs_start -f ora.wqy3.vip
Attempting to start `ora.wqy3.vip` on member `wqy3`
Start of `ora.wqy3.vip` on member `wqy3` succeeded.

[root@wqy3 install]# ip ad sh 

  1. 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue 
  2.     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
  3.     inet 127.0.0.1/8 scope host lo
  4.     inet6 ::1/128 scope host 
  5.        valid_lft forever preferred_lft forever
  6. 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000
  7.     link/ether 08:00:27:70:1d:15 brd ff:ff:ff:ff:ff:ff
  8.     inet 192.168.8.26/24 brd 192.168.8.255 scope global eth0
  9.     inet 192.168.8.27/24 brd 192.168.8.255 scope global secondary eth0:1
  10.     inet6 fe80::a00:27ff:fe70:1d15/64 scope link 
  11.        valid_lft forever preferred_lft forever
  12. 3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000
  13.     link/ether 08:00:27:60:ee:a3 brd ff:ff:ff:ff:ff:ff
  14.     inet 10.10.10.103/24 brd 10.10.10.255 scope global eth1
  15.     inet6 fe80::a00:27ff:fe60:eea3/64 scope link 
  16.        valid_lft forever preferred_lft forever
  17. 4: sit0: <NOARP> mtu 1480 qdisc noop 
  18.     link/sit 0.0.0.0 brd 0.0.0.0

启动新节点Listener：
[root@wqy3 install]# crs_stat |grep lsn
NAME=ora.LISTENER.lsnr
NAME=ora.LISTENER_SCAN1.lsnr
NAME=ora.wqy1.LISTENER_WQY1.lsnr
NAME=ora.wqy2.LISTENER_WQY2.lsnr
NAME=ora.wqy3.LISTENER_WQY3.lsnr

[root@wqy3 install]# crs_start -f ora.wqy3.LISTENER_WQY3.lsnr
Attempting to start `ora.LISTENER.lsnr` on member `wqy3`
Start of `ora.LISTENER.lsnr` on member `wqy3` succeeded.

[root@wqy3 install]# crs_stat -t 

  1. Name           Type           Target    State     Host        
  2. ------------------------------------------------------------
  3. ora.DATA.dg    ora....up.type ONLINE    ONLINE    wqy1        
  4. ora....ER.lsnr ora....er.type ONLINE    ONLINE    wqy1        
  5. ora....N1.lsnr ora....er.type ONLINE    ONLINE    wqy1        
  6. ora....VOTE.dg ora....up.type ONLINE    ONLINE    wqy1        
  7. ora.RCV.dg     ora....up.type ONLINE    ONLINE    wqy1        
  8. ora.asm        ora.asm.type   ONLINE    ONLINE    wqy1        
  9. ora.eons       ora.eons.type  ONLINE    ONLINE    wqy1        
  10. ora.gsd        ora.gsd.type   OFFLINE   OFFLINE               
  11. ora....network ora....rk.type ONLINE    ONLINE    wqy1        
  12. ora.oc4j       ora.oc4j.type  OFFLINE   OFFLINE               
  13. ora.ons        ora.ons.type   ONLINE    ONLINE    wqy1        
  14. ora.racdb.db   ora....se.type ONLINE    ONLINE    wqy1        
  15. ora....ry.acfs ora....fs.type ONLINE    ONLINE    wqy1        
  16. ora.scan1.vip  ora....ip.type ONLINE    ONLINE    wqy1        
  17. ora....SM1.asm application    ONLINE    ONLINE    wqy1        
  18. ora....Y1.lsnr application    ONLINE    ONLINE    wqy1        
  19. ora.wqy1.gsd   application    OFFLINE   OFFLINE               
  20. ora.wqy1.ons   application    ONLINE    ONLINE    wqy1        
  21. ora.wqy1.vip   ora....t1.type ONLINE    ONLINE    wqy1        
  22. ora....SM2.asm application    ONLINE    ONLINE    wqy2        
  23. ora....Y2.lsnr application    ONLINE    ONLINE    wqy2        
  24. ora.wqy2.gsd   application    OFFLINE   OFFLINE               
  25. ora.wqy2.ons   application    ONLINE    ONLINE    wqy2        
  26. ora.wqy2.vip   ora....t1.type ONLINE    ONLINE    wqy2        
  27. ora....SM4.asm application    ONLINE    ONLINE    wqy3        
  28. ora....Y3.lsnr application    ONLINE    ONLINE    wqy3        
  29. ora.wqy3.gsd   application    OFFLINE   OFFLINE               
  30. ora.wqy3.ons   application    ONLINE    ONLINE    wqy3        
  31. ora.wqy3.vip   ora....t1.type ONLINE    ONLINE    wqy3

—-至此，新节点添加成功！

发表评论

表情：
评论列表 （有 0 条评论，356人围观）

还没有评论，来说两句吧...

相关阅读