第一个问题是没有配置private网卡导致的。
由于对11.2的安装不是很熟悉，看了半天的文档，似乎Oracle可以自动设置vip、private ip，因此在第一次安装过程中，就可以处理这块。
安装到最后执行root.sh时报错：
# /data/grid/root.sh
Running Oracle 11g root.sh script...
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /data/grid
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /var/opt/oracle/oratab file...
Entries will be added to the /var/opt/oracle/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2010-12-10 17:35:55: Parsing the host name
2010-12-10 17:35:55: Checking for super user privileges
2010-12-10 17:35:55: User has super user privileges
Using configuration parameter file: /data/grid/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
root wallet
root wallet cert
root cert export
peer wallet
profile reader wallet
pa wallet
peer wallet keys
pa wallet keys
peer cert request
pa cert request
peer cert
pa cert
peer root cert TP
profile reader root cert TP
pa root cert TP
peer pa cert TP
pa peer cert TP
profile reader pa cert TP
profile reader peer cert TP
peer user cert
pa user cert
Adding daemon to inittab
CRS-4123: Oracle High Availability Services has been started.
ohasd is starting
CRS-2672: 尝试启动 'ora.gipcd' (在 'racnode1' 上)
CRS-2672: 尝试启动 'ora.mdnsd' (在 'racnode1' 上)
CRS-2676: 成功启动 'ora.gipcd' (在 'racnode1' 上)
CRS-2676: 成功启动 'ora.mdnsd' (在 'racnode1' 上)
CRS-2672: 尝试启动 'ora.gpnpd' (在 'racnode1' 上)
CRS-2676: 成功启动 'ora.gpnpd' (在 'racnode1' 上)
CRS-2672: 尝试启动 'ora.cssdmonitor' (在 'racnode1' 上)
CRS-2676: 成功启动 'ora.cssdmonitor' (在 'racnode1' 上)
CRS-2672: 尝试启动 'ora.cssd' (在 'racnode1' 上)
CRS-2672: 尝试启动 'ora.diskmon' (在 'racnode1' 上)
CRS-2676: 成功启动 'ora.diskmon' (在 'racnode1' 上)
CRS-2676: 成功启动 'ora.cssd' (在 'racnode1' 上)
CRS-2672: 尝试启动 'ora.ctssd' (在 'racnode1' 上)
Start action for daemon aborted
CRS-2674: 未能启动 'ora.ctssd' (在 'racnode1' 上)
CRS-2679: 尝试清除 'ora.ctssd' (在 'racnode1' 上)
CRS-2681: 成功清除 'ora.ctssd' (在 'racnode1' 上)
CRS-4000: Command Start failed, or completed with errors.
Command return code of 1 (256) from command: /data/grid/bin/crsctl start resource ora.ctssd -init
Start of resource 'ora.ctssd -init' failed
Clusterware exclusive mode start of resource ora.ctssd failed
CRS-2500: 由于资源 'ora.crsd' 未运行, 无法停止该资源
CRS-4000: Command Stop failed, or completed with errors.
Command return code of 1 (256) from command: /data/grid/bin/crsctl stop resource ora.crsd -init
Stop of resource 'ora.crsd -init' failed
Failed to stop CRSD
CRS-2500: 由于资源 'ora.asm' 未运行, 无法停止该资源
CRS-4000: Command Stop failed, or completed with errors.
Command return code of 1 (256) from command: /data/grid/bin/crsctl stop resource ora.asm -init
Stop of resource 'ora.asm -init' failed
Failed to stop ASM
CRS-2673: 尝试停止 'ora.cssdmonitor' (在 'racnode1' 上)
CRS-2677: 成功停止 'ora.cssdmonitor' (在 'racnode1' 上)
CRS-2673: 尝试停止 'ora.cssd' (在 'racnode1' 上)
CRS-2677: 成功停止 'ora.cssd' (在 'racnode1' 上)
CRS-2673: 尝试停止 'ora.gpnpd' (在 'racnode1' 上)
CRS-2677: 成功停止 'ora.gpnpd' (在 'racnode1' 上)
CRS-2673: 尝试停止 'ora.gipcd' (在 'racnode1' 上)
CRS-2677: 成功停止 'ora.gipcd' (在 'racnode1' 上)
CRS-2673: 尝试停止 'ora.mdnsd' (在 'racnode1' 上)
CRS-2677: 成功停止 'ora.mdnsd' (在 'racnode1' 上)
Initial cluster configuration failed. See /data/grid/cfgtoollogs/crsconfig/rootcrs_racnode1.log for details
检查对应的trace文件：
2010-12-10 17:38:43: CRS-2676: 成功启动 'ora.cssd' (在 'racnode1' 上)
2010-12-10 17:38:43: Querying for existing CSS voting disks
2010-12-10 17:38:43: Performing initial configuration for cluster
2010-12-10 17:48:50: Command return code of 1 (256) from command: /data/grid/bin/crsctl start resource ora.ctssd -init
2010-12-10 17:48:50: Start of resource 'ora.ctssd -init' failed
2010-12-10 17:48:50: Clusterware exclusive mode start of resource ora.ctssd failed
2010-12-10 17:48:50: Exiting exclusive mode
2010-12-10 17:48:50: Command return code of 1 (256) from command: /data/grid/bin/crsctl stop resource ora.crsd -init
2010-12-10 17:48:50: Stop of resource 'ora.crsd -init' failed
2010-12-10 17:48:50: Failed to stop CRSD
2010-12-10 17:48:51: Command return code of 1 (256) from command: /data/grid/bin/crsctl stop resource ora.asm -init
2010-12-10 17:48:51: Stop of resource 'ora.asm -init' failed
2010-12-10 17:48:51: Failed to stop ASM
2010-12-10 17:49:03: Initial cluster configuration failed. See /data/grid/cfgtoollogs/crsconfig/rootcrs_racnode1.log for details
文件的最后包含下列的信息。
虽然Oracle可以自动配置private ip，但是由于Private ip所使用的网卡根本没有加载，Oracle显然不会自动进行这个操作，导致安装报错。
节点1上启用第二网卡：
bash-3.00# ifconfig ce1 plumb
bash-3.00# ifconfig ce1 10.0.0.1 netmask 255.255.255.0 broadcast 10.0.0.255 up
# vi /etc/hostname.ce1
racnode1-priv
在节点2上启用第二网卡：
# ifconfig ce1 plumb
# ifconfig ce1 10.0.0.2 netmask 255.255.255.0 broadcast 10.0.0.255 up
# vi /etc/hostname.ce1
racnode2-priv
并将第二网卡的配置信息添加到/etc/hosts文件中：
10.0.0.1 racnode1-priv
10.0.0.2 racnode2-priv
删除两个节点上的ocr配置：
# rm /var/opt/oracle/ocr.loc
删除/data/grid目录下所有对象，将/data/grid目录修改为oracle所有：
# rm -rf /data/grid
# chown -R oracle:oinstall /data
删除产品信息目录：
$ rm -rf /data/oraInventory
清除两个节点上启动的cluster相关进程：
# ps -ef|grep grid
root 11584 11567 0 09:41:14 pts/1 0:00 grep grid
root 4027 1 0 12月 10 ? 13:02 /data/grid/bin/ohasd.bin reboot
# kill -9 4027
清除两个节点上/var/opt/oracle目录下的配置信息：
# rm -rf /var/opt/oracle/*
重新启动cluster安装程序，问题消失。
联系客服
