Oracle RAC (11.2.0.4 version) For AIX 6.1 installation manual

Some cite document revisions, the actual after installation verification document]

Oracle Rac 11GR2(11.2.0.4)

The For AIX6.1+ASM installation manual

Some screenshots used online pictures of others as well as part of the chapter

2 installation environment description

Node
Node name	The instance name	The database name	Processor	RAM	Operating system
Rac1	rac1	Rac	4 – cpu*8 *4228Mhz	32GB	AIX6.1
Rac2	rac2		4 – cpu*8 *4228Mhz	32GB	AIX6.1
Network configuration
Node name	Public IP address	Dedicated IP address	Virtual IP address	The SCAN name	SCAN IP address
Rac1	172.1.1.204	192.168.0.204	172.1.1.206	Scan-ip	172.1.1.208
Rac2	172.1.1.205	192.168.0.205	172.1.1.207
Oracle software component
Software components	Operating system user	The main group	Assisted group	The main directory	Oracle base directory /Oracle home directory
Grid Infra	grid	oinstall	asmadmin, asmdba, asmoper, oinstall	/home/grid	/u01/app/grid
					/u01/app/11.2/grid
Oracle RAC	oracle	oinstall	dba, oper, asmdba, oinstall	/home/oracle	/u01/app /oracle
					/u01/app/oracle/product/11.2.0/db_1
Storage component
Storage component	The file system	Volume size	ASM volume group name	ASM redundancy	The device name
OCR/VOTING	ASM	50G	CRSDG	normal	/dev/rhdisk4-6
Data	ASM	600G	DATA	normal	/dev/rhdisk7-9
Recovery area	ASM	100G	FRA_ARCHIVE	Normal	/dev/rhdisk10-12

#

#

#

#

#

#

#

#

#

#

#

#

#

#

#

#

#

In the Oracle RAC architecture, a total of four IP, are Public IP, Private IP, VIP, SCAN IP. Following their role:

Private IP: Private IP for synchronization between the nodes of the heart, for user level, can ignore, simple to understand, the IP is used to ensure the two servers for data synchronization.

Public IP: The public IP is generally used for the administrators, to ensure that can operate to the correct machine, also called the real IP.

VIP: Virtual IP for the client application, general VIP is floating in the configuration of the Public IP address on the card. VIP support failover, popular said is the node failure configuration of the VIP, a host node will automatically take over the VIP, and the client does not have any feeling. This is one of the reasons why the use of RAC, another reason, I think that is load balancing. The client in the tnsnames.ora configuration, there are situations is to use VIP, but in some cases it is necessary to use Public IP. For example, when you are in the position of a database of deadlock, using the Public IP, can ensure that even you want to processing machine. In contrast when using VIP, there will be uncertainty, because the server is on by default load balancing, it is possible you want to even A machine, system has assigned you to a B machine.

SCAN IP: In the Oracle before 11gR2, if the database uses the RAC framework, in the client tnsnames, connection information to configure multiple nodes, so as to realize such as load balancing, characteristics of failover and RAC. Therefore, when the database RAC clusters need to add or delete nodes, the need for timely on the client machine TNS is updated, so as to avoid the potential safety hazard. In 11gR2, In order to simplify the configuration, The introduction of the SCAN (Single ClientAccess Name) characteristics, The characteristic advantage, In between the database and the client, Add a layer of virtual service layer, The so-called SCAN IP and SCAN IP Listener, In the client only needs to configure SCAN IP TNS information, By SCAN IPListener, With the background cluster database. So, no matter whether the cluster database add or delete node operation, do not affect client.

The two RAC node planning:

Gateway: 10.1.0.254

Host name	Host name	Type	IP address	Analytical methods
rac1	rac1	Public	172.1.1.204/255.255.255.0	host
rac1-vip	rac1-vip	Virtual	172.1.1.206/255.255.255.0	host
rac1-priv	rac1-priv	Private	192.168.0.204/255.255.255.0	host
rac2	rac2	Public	172.1.1.205/255.255.255.0	host
rac2-vip	rac2-vip	Virtual	172.1.1.207/255.255.255.0	host
rac2-priv	rac2-priv	Private	192.168.0.205/255.255.255.0	host
Scan-ip	Scan-ip	Virtual	172.1.1.208/255.255.255.0	host

The 2.4 storage disc planning

Disk name	Size	Use
hdisk 4	50GB	CRSDG
hdisk 5	51GB
hdisk 6	52GB
hdisk 7	600GB	DATA
hdisk 8	601GB
hdisk 9	602GB
hdisk10	100GB	FRA_ARCHIVE
hdisk11	101GB
hdisk12	102GB

2.5 safety information database

Project name	User name	Password or an instance of
Operating system user	root
Database grid users	Grid
Database users	oracle
The cluster instance name	rac
ASM management	Sys
Database management	sys/system
Audit the user	rac_vault

2.6 installation directory planning

The installation directory planning principles: The establishment of /u01 file system, datbase program is used to install grid. Programs are installed below the /u01/app, for grid and database were built in different directory permissions, assign a different. The ORACLE_BASE and ORACLE_HOME grid suggest installation in different directories, specific plan is as follows:

The new 70G LV: oralv

The new file system, mount point: /u01

Grid base directory: /u01/app/grid #Grid user ORACLE_BASE

The grid ASM installation directory: /u01/app/11.2/grid #Grid user ORACLE_HOME, also is the installation of software location

Oracle base directory: /u01/app/oracle #oracle user ORACLE_BASE

Note: this plan for later concluded, the installation and the slight discrepancy. Grid user ORACLE_BASE, ORACLE_HOME need to manually create. Oracle users to create ORACLE_BASE directory.

3 pre installation inspection configuration task list

Explain: Check the configuration tasks listed below, the default need to be executed on all RAC nodes, a few steps only can be executed in a node, these steps will be explained in one one, should pay attention to check the configuration.

3.1 check the host hardware configuration

Host hardware including: check available memory, page swap space, available hard disk space, /tmp directory available space.

1 use the following command to view the host memory and swap space of at least 2.5G, memory, swap space should be 2 times the physical memory available.

/usr/sbin/lsattr -HE -l sys0 -a realmem

attribute value description user_settable

realmem 32243712 Amount of usable physical memory in Kbytes False

/usr/sbin/lsps -a

2 check the hardware architectures: #/usr/bin/getconf HARDWARE_BITMODE, 64 bit hardware architecture.

3 check the cluster software and database software installation directory with at least 6.5GB of free space, the /tmp directory with at least 1GB of free space: #df -h.

4.View the host information

prtconf

System Model: IBM,8231-E1D

Machine SerialNumber:

Processor Type:PowerPC_POWER7

ProcessorImplementation Mode: POWER 7

Processor Version:PV_7_Compat

Number OfProcessors: 8

Processor ClockSpeed: 4228 MHz

CPU Type: 64-bit

Kernel Type: 64-bit

LPAR Info: 106-E80AT

Memory Size: 31488MB

Good Memory Size:31488 MB

Platform Firmwarelevel: AL770_052

Firmware Version:IBM,AL770_052

Console Login:enable

Auto Restart: true

Full Core: false

Network Information

Host Name: rac1

IP Address: 172.1.1.204

Sub Netmask: 255.255.255.0

Gateway: 10.1.0.254

Name Server:

Domain Name:

Paging SpaceInformation

Total Paging Space: 9216MB

Percent Used: 1%

Volume GroupsInformation

==============================================================================

Active VGs

==============================================================================

rootvg:

PV_NAME PV STATE TOTAL PPs FREE PPs FREE DISTRIBUTION

hdisk0 active 558 304 111..80..00..01..112

hdisk1 active 558 450 111..86..30..111..112

INSTALLED RESOURCELIST

The followingresources are installed on the machine.

+/- = Added ordeleted from Resource List.

• = Diagnostic support not available.

Model Architecture: chrp

Model Implementation: Multiple Processor, PCIbus

• sys0 System Object

• sysplanar0 SystemPlanar

• vio0 Virtual I/O Bus

• vsa1 U78AB.001.WZSKA2R-P1-T2 LPARVirtual Serial Adapter

• vty1 U78AB.001.WZSKA2R-P1-T2-L0 AsynchronousTerminal

• vsa0 U78AB.001.WZSKA2R-P1-T1 LPARVirtual Serial Adapter

• vty0 U78AB.001.WZSKA2R-P1-T1-L0 AsynchronousTerminal

• pci8 U78AB.001.WZSKA2R-P1 PCIExpress Bus

• sissas2 U78AB.001.WZSKA2R-P1-C6-T1 PCI Expressx8 Ext Dual-x4 3Gb SAS Adapter

• sas2 U78AB.001.WZSKA2R-P1-C6-T1 ControllerSAS Protocol

• sfwcomm6 SAS Storage Framework Comm

• sata2 U78AB.001.WZSKA2R-P1-C6-T1 ControllerSATA Protocol

• pci7 U78AB.001.WZSKA2R-P1 PCIExpress Bus

• ent6 U78AB.001.WZSKA2R-P1-C5-T1 2-Port Gigabit Ethernet-SX PCI-ExpressAdapter (14103f03)

• ent7 U78AB.001.WZSKA2R-P1-C5-T2 2-PortGigabit Ethernet-SX PCI-Express Adapter (14103f03)

• pci6 U78AB.001.WZSKA2R-P1 PCI Express Bus

• ent4 U78AB.001.WZSKA2R-P1-C4-T1 2-PortGigabit Ethernet-SX PCI-Express Adapter (14103f03)

• ent5 U78AB.001.WZSKA2R-P1-C4-T2 2-Port Gigabit Ethernet-SX PCI-ExpressAdapter (14103f03)

• pci5 U78AB.001.WZSKA2R-P1 PCIExpress Bus

• fcs2 U78AB.001.WZSKA2R-P1-C3-T1 8Gb PCIExpress Dual Port FC Adapter (df1000f114108a03)

• fcnet2 U78AB.001.WZSKA2R-P1-C3-T1 FibreChannel Network Protocol Device

• fscsi2 U78AB.001.WZSKA2R-P1-C3-T1 FC SCSI I/OController Protocol Device

• sfwcomm2 U78AB.001.WZSKA2R-P1-C3-T1-W0-L0 Fibre ChannelStorage Framework Comm

• fcs3 U78AB.001.WZSKA2R-P1-C3-T2 8Gb PCIExpress Dual Port FC Adapter (df1000f114108a03)

• fcnet3 U78AB.001.WZSKA2R-P1-C3-T2 FibreChannel Network Protocol Device

• fscsi3 U78AB.001.WZSKA2R-P1-C3-T2 FC SCSI I/OController Protocol Device

• sfwcomm3 U78AB.001.WZSKA2R-P1-C3-T2-W0-L0 Fibre ChannelStorage Framework Comm

• pci4 U78AB.001.WZSKA2R-P1 PCIExpress Bus

• fcs0 U78AB.001.WZSKA2R-P1-C2-T1 8Gb PCI ExpressDual Port FC Adapter (df1000f114108a03)

• fcnet0 U78AB.001.WZSKA2R-P1-C2-T1 FibreChannel Network Protocol Device

• fscsi0 U78AB.001.WZSKA2R-P1-C2-T1 FC SCSI I/OController Protocol Device

• hdisk8 U78AB.001.WZSKA2R-P1-C2-T1-W5000D3100070E30C-L5000000000000 Compellent FC SCSI Disk Drive

• hdisk9 U78AB.001.WZSKA2R-P1-C2-T1-W5000D3100070E30C-L6000000000000 Compellent FC SCSI Disk Drive

• sfwcomm0 U78AB.001.WZSKA2R-P1-C2-T1-W0-L0 Fibre ChannelStorage Framework Comm

• fcs1 U78AB.001.WZSKA2R-P1-C2-T2 8Gb PCIExpress Dual Port FC Adapter (df1000f114108a03)

• fcnet1 U78AB.001.WZSKA2R-P1-C2-T2 FibreChannel Network Protocol Device

• fscsi1 U78AB.001.WZSKA2R-P1-C2-T2 FC SCSI I/OController Protocol Device

• hdisk4 U78AB.001.WZSKA2R-P1-C2-T2-W5000D3100070E30A-L1000000000000 Compellent FC SCSI Disk Drive

*hdisk5 U78AB.001.WZSKA2R-P1-C2-T2-W5000D3100070E30A-L2000000000000 Compellent FC SCSI Disk Drive

*hdisk6 U78AB.001.WZSKA2R-P1-C2-T2-W5000D3100070E30A-L3000000000000 Compellent FC SCSI Disk Drive

*hdisk7 U78AB.001.WZSKA2R-P1-C2-T2-W5000D3100070E30A-L4000000000000 Compellent FC SCSI Disk Drive

• sfwcomm1 U78AB.001.WZSKA2R-P1-C2-T2-W0-L0 Fibre Channel StorageFramework Comm

• pci3 U78AB.001.WZSKA2R-P1 PCIExpress Bus

• ent0 U78AB.001.WZSKA2R-P1-C7-T1 4-PortGigabit Ethernet PCI-Express Adapter (e414571614102004)

• ent1 U78AB.001.WZSKA2R-P1-C7-T2 4-PortGigabit Ethernet PCI-Express Adapter (e414571614102004)

• ent2 U78AB.001.WZSKA2R-P1-C7-T3 4-Port Gigabit Ethernet PCI-ExpressAdapter (e414571614102004)

• ent3 U78AB.001.WZSKA2R-P1-C7-T4 4-PortGigabit Ethernet PCI-Express Adapter (e414571614102004)

• pci2 U78AB.001.WZSKA2R-P1 PCI ExpressBus

• sissas1 U78AB.001.WZSKA2R-P1-C18-T1 PCIe x4Internal 3Gb SAS RAID Adapter

• sas1 U78AB.001.WZSKA2R-P1-C18-T1 ControllerSAS Protocol

• sfwcomm5 SAS Storage Framework Comm

• ses0 U78AB.001.WZSKA2R-P2-Y2 SASEnclosure Services Device

• ses1 U78AB.001.WZSKA2R-P2-Y1 SASEnclosure Services Device

• tmscsi1 U78AB.001.WZSKA2R-P1-C18-T1-LFE0000-L0 SAS I/O ControllerInitiator Device

• sata1 U78AB.001.WZSKA2R-P1-C18-T1 Controller SATAProtocol

• pci1 U78AB.001.WZSKA2R-P1 PCIExpress Bus

• pci9 U78AB.001.WZSKA2R-P1 PCIBus

• usbhc0 U78AB.001.WZSKA2R-P1 USBHost Controller (33103500)

• usbhc1 U78AB.001.WZSKA2R-P1 USBHost Controller (33103500)

• usbhc2 U78AB.001.WZSKA2R-P1 USB Enhanced HostController (3310e000)

• pci0 U78AB.001.WZSKA2R-P1 PCIExpress Bus

• sissas0 U78AB.001.WZSKA2R-P1-T9 PCIe x4Planar 3Gb SAS RAID Adapter

• sas0 U78AB.001.WZSKA2R-P1-T9 Controller SAS Protocol

• sfwcomm4 SAS StorageFramework Comm

• hdisk0 U78AB.001.WZSKA2R-P3-D1 SAS DiskDrive (300000 MB)

• hdisk1 U78AB.001.WZSKA2R-P3-D2 SAS DiskDrive (300000 MB)

• hdisk2 U78AB.001.WZSKA2R-P3-D3 SAS Disk Drive (300000 MB)

• hdisk3 U78AB.001.WZSKA2R-P3-D4 SAS DiskDrive (300000 MB)

• ses2 U78AB.001.WZSKA2R-P2-Y1 SASEnclosure Services Device

• tmscsi0 U78AB.001.WZSKA2R-P1-T9-LFE0000-L0 SAS I/O ControllerInitiator Device

• sata0 U78AB.001.WZSKA2R-P1-T9 Controller SATA Protocol

• cd0 U78AB.001.WZSKA2R-P3-D7 SATADVD-RAM Drive

• L2cache0 L2 Cache

• mem0 Memory

• proc0 Processor

• proc4 Processor

• proc8 Processor

• proc12 Processor

• proc16 Processor

• proc20 Processor

• proc24 Processor

• proc28 Processor

3.2 host network configuration

Host network settings check: hosts file system modifications, IP network card configuration.

1 to edit the hosts file, add the following to the hosts file, specify the Public IP, VIP, Private IP.

public

172.1.1.204 rac1

172.1.1.205 rac2

private

192.168.0.204 rac1-priv

192.168.0.205 rac2-priv

virtual

172.1.1.206 rac1-vip

172.1.1.207 rac2-vip

scan

172.1.1.208 scan-ip

2 network card IP address is already in the system installation process configuration is complete, you can use the following command to check the IP configuration: #ifconfig–a.

3.3 check the host software configuration

The host software configuration check includes: operating system version, version of the kernel, the system must package installation.

1 check the version of the operating system: #oslevel -s, 6100-02-01 minimum requirements.

2 check the operating system kernel: #bootinfo -K, requires a 64 bit kernel.

3 detection of host SSH configuration: #lssrc -ssshd.

4 system must be installed as follows (or higher) software package:

bos.adt.base

bos.adt.lib

bos.adt.libm

bos.perf.libperfstat 6.1.2.1 or later

bos.perf.perfstat

bos.perf.proctools

xlC.aix61.rte. 10.1.0.0 or later

xlC.rte. 10.1.0.0or later

Gpfs.base 3.2.1.8or later (installation when using the GPFS file sharing system)

You can use the following command:

lslpp -l bos.adt.*

lslpp -l bos.perf.*

lslpp -l xlC.*

lslpp -l gpfs.*

Whether the system has been installed to view the corresponding software package. If the system is lack of the package or lower version, please use the system installation CD to install software package.

AIX 6.1 need to install the following software package:

bos.adt.base

bos.adt.lib

bos.adt.libm

bos.perf.libperfstat 6.1.2.1 or later

bos.perf.perfstat

bos.perf.proctools

rsct.basic.rte

rsct.compat.clients.rte

xlC.aix61.rte 10.1.0.0 (or later)

AIX 5.3 need to install the following software package:

bos.adt.base

bos.adt.lib

bos.adt.libm

bos.perf.libperfstat 5.3.9.0 or later

bos.perf.perfstat

bos.perf.proctools

rsct.basic.rte

rsct.compat.clients.rte

xlC.aix50.rte 10.1.0.0 (or later)

The filesets installation or use the command lslpp L check. The default installation is incomplete, need to manually add. At the same time the system disk version with the above also has difference, install attempt.

Other single patch requirements are as follows:

AIX 6L installations All AIX 6L 6.1 installations Authorized Problem Analysis

Reports (APARs) for AIX 5L v. 5.3 ML06, and the following AIX

fixes:

IZ41855

IZ51456

IZ52319

AIX 5L installations All AIX 5L 5.3 installations Authorized Problem Analysis

Reports (APARs) for AIX 5L v. 5.3 ML06, and the following AIX

fixes:

IZ42940

IZ49516

IZ52331

Verification: #/usr/sbin/instfix -i -k IZ41855

Install the patch:

Because the 6100-04 does not require any patch, so we will upgrade to 6100-04 (but when installing grid or 3 package is not installed prompt)

1, From IBM website 6100-04-00-0943

2, The patch file upload to /tmp/tools

3, smit update_all

Choose not to submit, save the overwritten files, you can roll back the operation, accept the license agreement

COMMIT software updates? No

SAVE replaced files? yes

ACCEPT new license agreements? Yes

After the upgrade:

oslevel -s

6100-04-01-0944

5 check the Java version: #java-version, 1.6 version 64.

3.4 create operating system groups and users

The establishment of user groups, users and directory (simple version, if it is more than 11.2.0.4, the rootpre.sh will require more detailed group, such as asmadmin and so on, specific reference document)

Create the corresponding operating system and user, create groups, and then create user:

Ø to root users use the following command to create a OS group for the grid and Oracle users:

mkgroup-'A' id='501' adms='root' oinstall

mkgroup-'A' id='502' adms='root' asmadmin

mkgroup-'A' id='503' adms='root' asmdba

mkgroup-'A' id='504' adms='root' asmoper

mkgroup-'A' id='505' adms='root' dba

mkgroup-'A' id='506' adms='root' oper

Ø create Oracle software owners:

#mkuser id='501' pgrp='oinstall'groups='dba,asmadmin,asmdba,asmoper' home='/home/grid' fsize=-1 cpu=-1 data=-1rss=-1 stack=-1 stack_hard=-1capabilities=CAP_NUMA_ATTACH,CAP_BYPASS_RAC_VMM,CAP_PROPAGATE grid

mkuser id='502' pgrp='oinstall'groups='dba,asmdba,oper' home='/home/oracle' fsize=-1 cpu=-1 data=-1 rss=-1stack=-1 stack_hard=-1capabilities=CAP_NUMA_ATTACH,CAP_BYPASS_RAC_VMM,CAP_PROPAGATE oracle

Two user Ø check created above:

id grid

id oracle

Ø to use the passwd command for grid (Code: grid) and Oracle (Code: Oracle) account password.

passwdgrid

passwdoracle

3.5 to create the software installation directory structure and change the permissions

Modify disk array is grid oinstall (if it is more than 11.2.0.4, according to the requirement, may require changes to the grid DBA, is a specific setting):

Create a directory structure, the Oracle software includes: GRID directory, RDBMS directory.

Note that the BASE directory and the HOME directory cannot be grid user has a parent-child relationship.

Ø to root users to create "Oracle inventory directory", and change the permissions:

mkdir-p /u01/app/oraInventory

chown-R grid:oinstall /u01/app/oraInventory

chmod-R 775 /u01/app/oraInventory

Ø to root users to create "Grid Infrastructure BASE directory"

mkdir-p /u01/app/grid

chowngrid:oinstall /u01/app/grid

chmod-R 775 /u01/app/grid

Ø to root users to create "Grid Infrastructure Home directory"

mkdir-p /u01/app/11.2.0/grid

chown-R grid:oinstall /u01/app/11.2.0/grid

chmod-R 775 /u01/app/11.2.0/grid

Ø to root users to create "Oracle Base directory"

mkdir-p /u01/app/oracle

mkdir/u01/app/oracle/cfgtoollogs

chown-R oracle:oinstall /u01/app/oracle

chmod-R 775 /u01/app/oracle

Ø to root users to create "Oracle RDBMS Home directory"

mkdir-p /u01/app/oracle/product/11.2.0/db_1

chown-R oracle:oinstall /u01/app/oracle/product/11.2.0/db_1

chmod-R 775 /u01/app/oracle/product/11.2.0/db_1

3.6 to modify the file the user environment parameters

If we modify the file parameter to Oracle and grid users, you can use the following command to modify its effect: $.profile. If you use the root user does not need to reload the configuration file.

1 grid users and Oracle in the Rac1 node on the environment variable parameters.

Ø grid users home directory: edit the.Profile file, add the following content:

umask 022

export ORACLE_BASE=/u01/app/grid

export ORACLE_HOME=/u01/app/11.2.0/grid

export ORACLE_SID=+ASM1

export ORACLE_HOSTNAME=rac1

export NLS_LANG=AMERICAN_AMERICA.AL32UTF8

export NLS_DATE_FORMAT="yyyy-mm-ddhh24:mi:ss"

export PATH=$PATH:$ORACLE_HOME/bin:$ORACLE_HOME/OPatch

Ø Oracle users home directory: edit the.Profile file, add the following content:

umask 022

export ORACLE_BASE=/u01/app/oracle

exportORACLE_HOME=/u01/app/oracle/product/11.2.0/db_1

export ORACLE_SID=rac1

export ORACLE_HOSTNAME=rac1

export ORACLE_UNQNAME=rac

export NLS_LANG=AMERICAN_AMERICA.AL32UTF8

export NLS_DATE_FORMAT="yyyy-mm-ddhh24:mi:ss"

export PATH=$PATH:$ORACLE_HOME/bin:$ORACLE_HOME/OPatch

2 grid users and Oracle in the Rac2 node on the environment variable parameters.

Ø grid users home directory: edit the.Profile file, add the following content:

umask 022

export ORACLE_BASE=/u01/app/grid

export ORACLE_HOME=/u01/app/11.2.0/grid

export ORACLE_SID=+ASM2

export ORACLE_HOSTNAME=rac2

export NLS_LANG=AMERICAN_AMERICA.AL32UTF8

export NLS_DATE_FORMAT="yyyy-mm-ddhh24:mi:ss"

export PATH=$PATH:$ORACLE_HOME/bin:$ORACLE_HOME/OPatch

Ø Oracle users home directory: edit the.Profile file, add the following content:

umask 022

exportORACLE_BASE=/u01/app/oracle

exportORACLE_HOME=/u01/app/oracle/product/11.2.0/db_1

export ORACLE_SID=rac2

export ORACLE_HOSTNAME=rac2

export ORACLE_UNQNAME=rac

export NLS_LANG=AMERICAN_AMERICA.AL32UTF8

export NLS_DATE_FORMAT="yyyy-mm-ddhh24:mi:ss"

export PATH=$PATH:$ORACLE_HOME/bin:$ORACLE_HOME/OPatch

Note: the environment variables should pay attention to whether or not contain spaces, while the installation can be normal, but after the installation command are not normal execution, such as you in the grid user asmcmd, into an empty instance, you can't manage the instance of ASM, so the problem of turning back to, so pay attention to check, even if the installation is finished, also need to reinstall.

To modify some parameters of 3.7 system

System parameter changes include: virtual memory management parameters, network parameters, system kernel parameters, asynchronous IO.

From the AIX 6.1, the subordinate value seems to be the default value, with Oracle installguide, so there is no need to modify the: vmo -p -o minperm%=3 vmo -p -o maxperm%=90 vmo -p -o maxclient%=90 vmo -p -o lru_file_repage=0 vmo -p -o strict_maxclient=1 vmo -p -o strict_maxperm=0

1 use the following command to check the virtual memory management parameters,

vmo -L minperm%

vmo -L maxperm%

vmo -L maxclient%

vmo -L lru_file_repage

vmo -L strict_maxclient

vmo -L strict_maxperm

If is not set properly, use the following command to modify:

vmo -p -o minperm%=3

vmo -p -o maxperm%=90

vmo -p -o maxclient%=90

vmo -p -o lru_file_repage=0

vmo -p -o strict_maxclient=1

vmo -p -o strict_maxperm=0

2 check the network parameters

Ø ephemeral parameters:

Use the command no -a |fgrep ephemeral, you can view the current system of ephemeral parameter setting, recommended parameter settings are as follows

tcp_ephemeral_high = 65500

tcp_ephemeral_low = 9000

udp_ephemeral_high= 65500

udp_ephemeral_low = 9000

If the system parameter setting and the values are not the same, modify command:

no -p -o tcp_ephemeral_low=9000 -o tcp_ephemeral_high=65500

no -p -o udp_ephemeral_low=9000 -o udp_ephemeral_high=65500

Ø use the following command to modify the network can adjust parameters:

no -r -o rfc1323=1

no -r -o ipqmaxlen=512

no -p -o sb_max=4194304

no -p -o tcp_recvspace=65536

no -p -o tcp_sendspace=65536

No -p -o udp_recvspace=1351680 the value is 10 times that of udp_sendspace, but must be less than sb_max

no -p -o udp_sendspace=135168

Note: -r reboot -p said after the entry into force, effective immediately

3 check the kernel parameter of maxuproc (16384) and ncargs (at least 128)

lsattr -E -l sys0 -a ncargs

lsattr -E -l sys0 -a maxuproc

If is not set properly use the following command to modify:

chdev -l sys0 -a ncargs=256

chdev -l sys0 -a maxuproc=16384

4 check the asynchronous IO is open, the AIX6.1 default system has been opened, use the following command to query:

ioo -a | More or #ioo -o aio_maxreqs

Note: AIX5.3 use the following command to view the Lsattr -El aio0 -a maxreqs

The 3.8 allocation of shared memory

The steps below are required inAll nodesExecution.

1 modify the physical volume owner and permissions:

chown grid:asmadmin /dev/rhdisk4

chown grid:asmadmin /dev/rhdisk5

chown grid:asmadmin /dev/rhdisk6

chown grid:asmadmin /dev/rhdisk7

chown grid:asmadmin /dev/rhdisk8

chown grid:asmadmin /dev/rhdisk9

chown grid:asmadmin /dev/rhdisk10

chown grid:asmadmin /dev/rhdisk11

chown grid:asmadmin /dev/rhdisk12

chmod 660 /dev/rhdisk4

chmod 660 /dev/rhdisk5

chmod 660 /dev/rhdisk6

chmod 660 /dev/rhdisk7

chmod 660 /dev/rhdisk8

chmod 660 /dev/rhdisk9

chmod 660 /dev/rhdisk10

chmod 660 /dev/rhdisk11

chmod 660 /dev/rhdisk12

2 modify the physical volume properties, sharing the reserve_policy attribute storage disks need to be no, use the following command to view:

lsattr -E -l hdisk4 | grep reserve_policy

lsattr -E -l hdisk5 | grep reserve_policy

lsattr -E -l hdisk6 | grep reserve_policy

lsattr -E -l hdisk7 | grep reserve_policy

lsattr -E -l hdisk8 | grep reserve_policy

lsattr -E -l hdisk9 | grep reserve_policy

lsattr -E -l hdisk10 | grepreserve_policy

lsattr -E -l hdisk11 | grepreserve_policy

lsattr -E -l hdisk12 | grepreserve_policy

If you need to modify the reserve_policy property, use the following command:

chdev -l hdisk4 -areserve_policy=no_reserve

chdev -l hdisk5 -areserve_policy=no_reserve

chdev -l hdisk6 -areserve_policy=no_reserve

chdev -l hdisk7 -areserve_policy=no_reserve

chdev -l hdisk8 -areserve_policy=no_reserve

chdev -l hdisk9 -areserve_policy=no_reserve

chdev -l hdisk10 -areserve_policy=no_reserve

chdev -l hdisk11 -areserve_policy=no_reserve

chdev -l hdisk12 -areserve_policy=no_reserve

3, Each host hard disk information

hdisk0 00f8e8092df611fa rootvg active

hdisk1 00f8e8082e4a46d5 rootvg active

hdisk2 00f8e80857a08edf appvg active

hdisk3 none None

The local disk, in which hdisk0 and hdisk1 made the system image, hdisk2 and hdisk3 into the mirror for application installation

hdisk4 none None

hdisk5 none None

hdisk6 none None

Oracle OCR and Voting disk, set to normal redundancy

hdisk7 none None

hdisk8 none None

hdisk9 none None

The data disk Oracle, normal redundancy.

hdisk10 none None

hdisk11 none None

hdisk12 none None

Oracle flashbacks and filing disk, normal redundancy.

3.8.1 clearancePVID

To view the LUN, if there is PVID, the need for clear.

chdev -l hdisk2 -a pv=clear

Repeat the same operation, clears all 2-6 LUN PVID

The 3.9 configuration NTPService (optional)

Oracle 11g R2 Cluster Time SynchronizationService (CTSS) cluster time synchronization service, in the absence of NTP, the function can ensure that all RAC nodes time consistency. ASM can be used as a unified storage to Oracle Cluster Registry (OCR) and Voting disks installed on a ASM disk, no longer need to install a separate cluster file system, 11g version second is no longer supported naked equipment (before you can set groupware is mounted to the bare equipment). There is also a function of SCAN (Single Client Access Name) is a single client access name and the function including the Failover fault automatic switching function, During a visit to cluster is to just write a SCAN name on it, Without all the nodes of the VIP written in the application configuration file inside before, This will greatly facilitate the client access to RAC system, But it needs the support of DNS server. SCAN configuration can also be used hosts file parsing.

If the system configuration of the NTP service, the CTSS service will be in observer mode, the configuration of NTP concrete steps can refer to the AIX service configuration.

The 3.10 configuration SSH

11.2,In the configuration, SSH needs to be set as follows: By default, OUI searches for SSH public keys in the directory /usr/local/etc/,and ssh-keygen binaries in /usr/local/bin. However, on AIX, SSH public keys typically are located in the path /etc/ssh, and ssh-keygen binaries are locatedin the path /usr/bin. To ensure that OUI can set up SSH, use the following commandto create soft links:

ln -s /etc/ssh /usr/local/etc

ln -s /usr/bin /usr/local/bin

Configure the root environment variable: ==================================================================== export ORACLE_BASE=/u01/app/grid export ORACLE_HOME=/u01/app/11.2.0/grid export PATH=$ORACLE_HOME/OPatch:$ORACLE_HOME/bin:$PATH

if [ -t 0 ]; then stty intr ^C fi

export AIXTHREAD_SCOPE=S

set -o vi alias ll="ls -lrt"

3.10.1 SSHThe trust relationship set (optional)

SSH trust can also choose automatic configuration in the grid installation.

Note: the Oracle11g R2 grid to automatically configure SSH on the AIX in the wrong, Because Oracle called command path and AIX system does not match the actual path command, You can modify the Oracle installer sshsetup.sh script, Or in accordance with the Oracle call path add program soft connection, The specific path installation process, Oracle will prompt.

3.10.1.1 first on two machines installedOpenSSH software,

The installation method of the office is not detailed, need to download the openssh, OpenSSL, installation is required to install OpenSSL, then install the openssh.

Can also through the AIX system of CD, Smitty install, select all the SSH package is installed.

Can be installed after the inspection:

lslpp -l | grep ssh

3.10.1.2 thenSelect the automatic configuration of SSH dual trust relationship in the grid installation

3.10.1.2.1 method 1

l Modify/etc/ssh/sshd_config

Will:

RSAAuthentication yes

PubkeyAuthentication yes

AuthorizedKeysFile .ssh/authorized_keys

In front of the comments removed.

l By using the command: ssh-keygen key

Select the default can be generated, private key and publicKey in the directory ~/.ssh

Note: In order to access passphrase behind, a password is set to null

l The 2 machines public key passed to each other

There could be several methods: FTP, RCP, SCP. Here we can through the FTP two node under ~/.ssh id_rsa, id_rsa.pub two files to copy down the other. Because of the same name, which will change it to id_rsa239, id_rsa239.pub, id_rsa237, id_rsa237.pub, in order to distinguish, followed by its IP identity.

L based authorized_keys file

Due to the above modified the sshd_config file, one behavior

AuthorizedKeysFile .ssh/authorized_keys

Read the file for certification

We take the default mode, touch ~/.ssh in an authorized_keys file

touch authorized_keys

The pub key content delivery over the other host, is appended to the file authorized_keys,

Node1(192.168.0.204):

bash-3.00# cat id_rsa204.pub > authorized_keys

node2(192.168.0.205):

cat id_rsa205.pub > authorized_keys

Test:

ssh 192.168.0.204

ssh 192.168.0.205

First login will be prompted, enter the yes not in the future

3.10.1.2.2 method 2

The following two node execution:

su – grid

$mkdir ~/.ssh

$chmod 700 ~/.ssh

$/usr/bin/ssh-keygen -t rsa

rac1:/home/grid$/usr/bin/ssh-keygen -t rsa

Generating public/private rsa key pair.

Enter file in which to save the key (/home/grid/.ssh/id_rsa):

Enter passphrase (empty for no passphrase):

Enter same passphrase again:

When prompted for a password, remain empty, directly enter.

The following only in node 1 executive:

$ touch ~/.ssh/authorized_keys

$ ssh rac1 cat ~/.ssh/id_rsa.pub>>~/.ssh/authorized_keys

$ ssh rac2 cat ~/.ssh/id_rsa.pub>>~/.ssh/authorized_keys

$ scp ~/.ssh/authorized_keys rac2:.ssh/authorized_keys

Is amended as follows:

$ touch ~/.ssh/authorized_keys

$ ssh rac1 cat ~/.ssh/id_rsa.pub>>~/.ssh/authorized_keys

$ ssh rac2 cat ~/.ssh/id_rsa.pub>>~/.ssh/authorized_keys

$ scp ~/.ssh/authorized_keys rac2:.ssh/authorized_keys

The following only in node 2 executive:

$ chmod 600 ~/.ssh/authorized_keys

After the configuration is complete according to method 1 testing method.

3.11 DNSConfiguration (to avoid grid final validation error, can be ignored)

[/]mv/usr/bin/nslookup /usr/bin/nslookup.org

[/]cat/usr/bin/nslookup

!/usr/bin/sh

HOSTNAME=${1}

if[[ $HOSTNAME = "rx-cluster-scan" ]]; then

echo "Server: 24.154.1.34"

echo "Address: 24.154.1.34#53"

echo "Non-authoritative answer:"

echo "Name: rx-cluster-scan"

echo "Address: 1.1.1.11" #Suppose that 1.1.1.1 is SCAN

else

/usr/bin/nslookup.org $HOSTNAME

fi

Be careful: if you need to modify your SQLNET.ORA, ensure thatEZCONNECT is in the list if you specify the order of the naming methods usedfor client name resolution lookups (11gRelease 2 default is NAMES.DIRECTORY_PATH=(tnsnames, ldap, ezconnect)).

3.12 prior to need to pay attention to matters

A, Install 11gR2 RAC to configure SSH users equivalence, previously configured RSH way cannot now through the installation inspection. The OUI provides automatic configure SSH users equivalence button, so there is no need to manually configure.

Note: this function for the development environment of Linux, and in the AIX environment, need to make the following operation:

ln -s /usr/bin/ksh/bin/bash

mkdir -p /usr/local/bin

ln -s /usr/bin/ssh-keygen/usr/local/bin/ssh-keygen

In the allocation of equivalence, OUI will use the default /bin/bash, but AIX is not bash, it needs to be KSH soft link to the bash (of course, you can also install the bash package).

Similarly, OUI will produce the equivalent key using the /usr/local/bin/ssh-keygen, and AIX in the installation of the OpenSSH, the ssh-keygen command default is stored in /usr/bin, so it need to do link.

B, After successfully install Grid Infrastructure, run the cluvf command may report errors.

cluvfy comp nodeapp -verbose

ERROR:

CRS is not installed on any of the nodes

Verification cannot proceed

And, after the encounter such errors, but also unable to install RAC, encountered the following error:

[INS-35354] The system on which you areattempting to install Oracle RAC is not part of a valid cluster.

It is both the cluvf command or OUI, that CRS is not installed on this machine, and not in a cluster environment. But in fact, run the crsctl check CRS command is completely normal.

The wrong solution can be found in MetalinkNote [ID 798203.1], generally is when installing Grid Infrastructure, the inventory.xml file lost CRS= "true", this is undoubtedly the setup of bug. The need for manual detachHome and attachHome.

4 installation of Oracle GridInfrastructure 11g R2

Preparation of Grid Infrastructure 4.1Install software

1 the downloaded p13390677_112040_AIX64-5L_3of7.zipCompressed package upload to the main directory of grid users.

2 will extract the p13390677_112040_AIX64-5L_3of7.zip to the current folder:

cd /home/grid

unzip p13390677_112040_AIX64-5L_3of7.zip

If unzip is not installed packages are also available with jar extract.

jar -xvfp13390677_112040_AIX64-5L_1of7.zip

The 3 amendment after decompression folder permissions for Grid:

chown -R grid:oinstall/home/grid/grid

4.2 using CVUCheck whether the system is installed to meet the demand of the script

Install the Oracle RAC environment requires multiple steps. Hardware, software, OS, cluster database software should be in accordance with the order to install. An important component of each step contains is successfully installed indispensable. Oracle provides a tool CVU (Cluster Verification Utility) is used to verify whether the system is installed to meet the demand in the process of installing Oracle in RAC.

1 by the grid user login system, make sure that the current directory for the grid home users, using the PWD command output results:

pwd //Command execution results"/home/grid/"

cd grid //To setup the root directory

2 execution of the CVU script check system, and will examine the results output text file into report.txt.

./runcluvfy.sh stage -precrsinst -n rac1,rac2 -fixup -verbose >report.txt

3 you can view the report.txt file using the following command:

cat report.txt|grep failed

4 installation media grid directory rootpre.sh copy to all the nodes in the grid user's home directory, root users to perform at the rootpre.shAll nodes:

scp -r /home/grid/grid/rootpre/root@192.168.0.205:/home/grid/rootpre/

./ rootpre.sh

4.3 start the Grid installation Infrastructure

1 first of all on the host to install the Xmanager software, and open a " on the host Xmanager – Passive" conversation process.

2 on the host SSH to grid users connect to remote Linux host, enter the following command: xclock graphical interface, verify whether normal in local display. If you can display a "watch" graphics (below), please continue to follow the steps, if not display properly, please check.

3 in a SSH session, switch to the grid installation directory, to perform the installation script on grid setup.

./runInstaller

su – grid

rac1:/home/grid$exportDISPLAY=172.1.165.172:0.0

rac1:/home/grid$/u01/soft/grid/runInstaller

********************************************************************************

Yourplatform requires the root user to perform certain pre-installation

OSpreparation. The root user should runthe shell script 'rootpre.sh' before

youproceed with Oracle installation. rootpre.sh can be found at the top level

ofthe CD or the stage area.

Answer'y' if root has run 'rootpre.sh' so you can proceed with Oracle

installation.

Answer'n' to abort installation and then ask root to run 'rootpre.sh'.

********************************************************************************

Has'rootpre.sh' been run by root on all nodes? [y/n] (n)

y

StartingOracle Universal Installer…

CheckingTemp space: must be greater than 190 MB. Actual 9516 MB Passed

Checkingswap space: must be greater than 150 MB. Actual 9216 MB Passed

Checkingmonitor: must be configured to display at least 256 colors. Actual 16

777216 Passed

Preparingto launch Oracle Universal Installer from /tmp/OraInstall2014-01-03_11-

05-23PM.Please wait …rac1:/home/grid$

4 – OUI main interface, select "Skipsoftware updates", click"Next".

5 select the "Install and Configure Oracle Grid Infrastructure for a Cluster", click"Next".

6 select the "Advanced Installation", click"Next".

7 choose the add "Simplified Chinese" to "Selected Langusges", click"Next".

8 enter configuration information, as shown in the diagram below, click"Next".

9 click on the "Add", adding a grid node Rac2, specific configuration information as below, click on "OK", then click "Next". If no configuration "SSH trust", can be in this step configuration.

10 OUI installer automatically distinguish between Public and Private network, click"Next".

11 select the "Oracle ASM" storage, click"Next".

12 the /dev/rhdisk2, /dev/rhdisk3, /dev/rhdisk4 to the disk group "OCR_VOTE", select "Normal" redundancy, AU size 1M, click"Next".

13 select the "Use same passwords for these accounts", "Abc560647", click the enter password"Next".

14 specifies the ASM management group information, click"Next".

15 specifies the Oracle base directory and software installation location, click"Next".

16 specifies the Oracle software installation list directory location, click"Next".

17 to perform the installation condition check.

18 installation condition inspection, pop-up configuration information, click"Install".

19 OUI grid infrastructure software to install.

20 installation process will pop up the following script prompt box, to root users in each node performs a prompt box script execution is completed, click"OK". Note: after the node Rac1 implementation, can be implemented in the Rac2 node.

The first node execution information is as follows:

/u01/app/oraInventory/orainstRoot.sh

Changing permissionsof /u01/app/oraInventory.

Adding read,writepermissions for group.

Removingread,write,execute permissions for world.

Changing groupnameof /u01/app/oraInventory to dba.

The execution of thescript is complete.

/u01/app/11.2/grid/root.sh

Performing root useroperation for Oracle 11g

The followingenvironment variables are set as:

ORACLE_OWNER= grid

ORACLE_HOME= /u01/app/11.2/grid

Enter the fullpathname of the local bin directory: [/usr/local/bin]:

The contents of"dbhome" have not changed. No need to overwrite.

The contents of"oraenv" have not changed. No need to overwrite.

The contents of"coraenv" have not changed. No need to overwrite.

Creating /etc/oratabfile…

Entries will beadded to the /etc/oratab file as needed by

DatabaseConfiguration Assistant when a database is created

Finished runninggeneric part of root script.

Now product-specificroot actions will be performed.

Using configurationparameter file: /u01/app/11.2/grid/crs/install/crsconfig_params

Creating trace directory

User ignoredPrerequisites during installation

Installing TraceFile Analyzer

User grid has therequired capabilities to run CSSD in realtime mode

OLR initialization -successful

root wallet

root wallet cert

root cert export

peer wallet

profile reader wallet

pa wallet

peer wallet keys

pa wallet keys

peer cert request

pa cert request

peer cert

pa cert

peer root cert TP

profile reader root cert TP

pa root cert TP

peer pa cert TP

pa peer cert TP

profile reader pa cert TP

profile reader peer cert TP

peer user cert

pa user cert

Adding Clusterwareentries to inittab

CRS-2672: Attemptingto start 'ora.mdnsd' on 'rac1'

CRS-2676: Start of'ora.mdnsd' on 'rac1' succeeded

CRS-2672: Attemptingto start 'ora.gpnpd' on 'rac1'

CRS-2676: Start of'ora.gpnpd' on 'rac1' succeeded

CRS-2672: Attemptingto start 'ora.cssdmonitor' on 'rac1'

CRS-2672: Attemptingto start 'ora.gipcd' on 'rac1'

CRS-2676: Start of'ora.cssdmonitor' on 'rac1' succeeded

CRS-2676: Start of'ora.gipcd' on 'rac1' succeeded

CRS-2672: Attemptingto start 'ora.cssd' on 'rac1'

CRS-2672: Attemptingto start 'ora.diskmon' on 'rac1'

CRS-2676: Start of'ora.diskmon' on 'rac1' succeeded

CRS-2676: Start of'ora.cssd' on 'rac1' succeeded

ASM created andstarted successfully.

Disk Group CRSDGcreated successfully.

clscfg: -installmode specified

Successfullyaccumulated necessary OCR keys.

Creating OCR keysfor user 'root', privgrp 'system'..

Operationsuccessful.

CRS-4256: Updatingthe profile

Successful additionof voting disk a58239b181b14f03bff383940a72cbe9.

Successful additionof voting disk 12931f422fe74fd6bf2721d63a02f639.

Successful additionof voting disk 6f7ee1cbbe6a4ff1bf3a1b097a00deb7.

Successfullyreplaced voting disk group with +CRSDG.

CRS-4256: Updating theprofile

CRS-4266: Votingfile(s) successfully replaced

STATE File Universal Id File Name Disk group

— —– —————– ——— ———

1. ONLINE a58239b181b14f03bff383940a72cbe9 (/dev/rhdisk4) [CRSDG]

1. ONLINE 12931f422fe74fd6bf2721d63a02f639 (/dev/rhdisk5) [CRSDG]

1. ONLINE 6f7ee1cbbe6a4ff1bf3a1b097a00deb7 (/dev/rhdisk6) [CRSDG]

Located 3 votingdisk(s).

CRS-2672: Attemptingto start 'ora.asm' on 'rac1'

CRS-2676: Start of'ora.asm' on 'rac1' succeeded

CRS-2672: Attemptingto start 'ora.CRSDG.dg' on 'rac1'

CRS-2676: Start of'ora.CRSDG.dg' on 'rac1' succeeded

Configure OracleGrid Infrastructure for a Cluster … succeeded

Second node execution information is as follows:

/u01/app/oraInventory/orainstRoot.sh

Changing permissionsof /u01/app/oraInventory.

Adding read,writepermissions for group.

Removingread,write,execute permissions for world.

Changing groupnameof /u01/app/oraInventory to dba.

The execution of thescript is complete.

/u01/app/11.2/grid/root.sh

Performing root useroperation for Oracle 11g

The followingenvironment variables are set as:

ORACLE_OWNER= grid

ORACLE_HOME= /u01/app/11.2/grid

Enter the fullpathname of the local bin directory: [/usr/local/bin]:

The contents of"dbhome" have not changed. No need to overwrite.

The contents of"oraenv" have not changed. No need to overwrite.

The contents of"coraenv" have not changed. No need to overwrite.

Creating /etc/oratabfile…

Entries will beadded to the /etc/oratab file as needed by

DatabaseConfiguration Assistant when a database is created

Finished runninggeneric part of root script.

Now product-specificroot actions will be performed.

Using configurationparameter file: /u01/app/11.2/grid/crs/install/crsconfig_params

Creating tracedirectory

User ignoredPrerequisites during installation

Installing TraceFile Analyzer

User grid has therequired capabilities to run CSSD in realtime mode

OLR initialization -successful

Adding Clusterwareentries to inittab

CRS-4402: The CSSdaemon was started in exclusive mode but found an active CSS daemon on node rac1,number 1, and is terminating

An active clusterwas found during exclusive startup, restarting to join the cluster

Configure OracleGrid Infrastructure for a Cluster … succeeded

21 installation process continue to complete the installation tasks, click"Close".

After the installation is complete with 22 grid users execute the following command check gridinfrastructure installation:

cluvfy stage -post crsinst -n rac1,rac2

Analysis of output results, have a look grid infrastructure is installed successfully.

23 to grid users execute the following command to view the current working state of gridinfrastructure:

[grid@rac1 ~]$ crsctl check crs //Check the CRS status

[grid@rac1 ~]$ crsctl check cluster -all //Check the CRS on each node of the state

[grid@rac1 ~]$ Crsctl stat res -t (or crs_stat -t -v [10g] command) // check the CRS status of resources

[grid@rac1 ~]$ olsnodes -n //Check the number of nodes in cluster

Install OracleDatabase 11g R2 5

Preparation of DataBase 5.1Install software

1 p13390677_112040_AIX64-5L_1of7.zip, p13390677_112040_AIX64-5L_2of7.zip upload to Oracle users home directory.

2 p13390677_112040_AIX64-5L_1of7.zip, p13390677_112040_AIX64-5L_2of7.zip decompression to the current folder (root users):

cd /home/oracle

unzip p13390677_112040_AIX64-5L_1of7.zip

unzip p13390677_112040_AIX64-5L_2of7.zip

The 3 amendment after decompression folder permissions for database:

#chown -R oracle:oinstall/home/oracle/database

5.2 using cluvfyCheck whether the system is installed to meet the demand of the script

Before installing the Oracle database, the cluvfy scripting tool is not installed, so Oracle users need to call the grid user directory under the cluvfy tool to verify, concrete steps are as follows:

1 by the Oracle user login system, switching the current directory/u01/11.2.0/grid/bin.

cd /u01/app/11.2.0/grid/bin

2 execution of the cluvfy script check system, and will examine the results output to the Oracle user's home directory in report.txt text file.

./cluvfy stage -pre dbinst -n rac1,rac2>/home/oracle/report.txt

The 3 switch back to the Oracle home directory and view the report.txt file with the following command:

cd //Switch back to the Oracle user home directory

cat report.txt|grep failed //Analysis of the content of the output check script

5.3 start the DataBase installation

1 by the Oracle user SSH login Rac1 node system, open a command line terminal, switch the current directory/home/oracle/database.

The 2 in command line terminal and enter the following command, open the Oracle database setup.

./runInstaller

3 – OUI setup, the abolition of the "security update notification configuration, click""Next".

4 then a pop-up error boxes, suggesting that you do not specify the account and email address, click "Yes" to ignore.

5 select the "Skip software updates", click"Next".

6 select the "Install database software only", click"Next".

7 select the following configuration, click"Next".

8 "Chinese support, click" add"Next".

9 choose the installation, click on the "Enterprise Edition""Next".

10 select the Oraac base directory and software installation location, click"Next".

11 select the operating system group, click"Next".

12 to perform the installation condition check.

The following figure errors may be 13 to perform the installation condition inspection:

[ERROR]An internal error occurred withincluster verification framework

Unable to obtain network interface list fromOracle ClusterwarePRCT-1011 : Failed to run "oifcfg". Detailed error:null

You can use the following methods to solve:

One, may be recorded in OCR network settings are not correct, it can refer to the following.

su – root

/u01/app/11.2.0/grid/bin/ocrdump/tmp/dump.ocr1

grep 'css.interfaces' /tmp/dump.ocr1 | awk-F ] '{print $1}' | awk -F . '{print $5}' | sort -u

/u01/app/11.2/grid/bin/oifcfg delif -globalen6 -force

/u01/app/11.2/grid/bin/oifcfg delif -globalen7 -force

su – grid

/u01/app/11.2/grid/bin/oifcfg iflist -p-n

$ /u01/app/11.2/grid/bin/oifcfg iflist -p-n

en8 10.1.0.0 PUBLIC 255.255.255.128

en9 192.168.0.0 PUBLIC 255.255.255.0

su – grid

/u01/app/11.2/grid/bin/oifcfg setif -globalen9/192.168.0.0:cluster_interconnect

/u01/app/11.2/grid/bin/oifcfg setif -globalen8/10.1.0.0:public

su – grid

/u01/app/11.2/grid/bin/oifcfg getif

$ /u01/app/11.2/grid/bin/oifcfg getif

en8 192.168.0.0 global cluster_interconnect

en9 10.1.0.0 global public

Two, because the environment variable problem:

su – oracle

$unset ORA_NLS10

Or modify the ORA_NLS10 variables correctly, pointing to export ORA_NLS10=$GRID_HOME/nls/data

This time to run/runInstaller

For this error, you can refer to the MOS article:

11gR2 OUI On AIX Pre-Requisite Check GivesError "Patch IZ97457, IZ89165 Are Missing" [ID 1439940.1]

The effect that in different TL levels, patch number will change. The article gives the corresponding IZ97457 and IZ89165 in each TL patch number, so, as long as you hit the corresponding patch, it can completely ignore the error

Below are the equivalent APAR's for eachspecific TL:

Patch IZ89165

6100-03 – use AIX APAR IZ89304

6100-04 – use AIX APAR IZ89302

6100-05 – use AIX APAR IZ89300

6100-06 – use AIX APAR IZ89514

7100-00 – use AIX APAR IZ89165

Patch IZ97457

5300-11 – use AIX APAR IZ98424

5300-12 – use AIX APAR IZ98126

6100-04 – use AIX APAR IZ97605

6100-05 – use AIX APAR IZ97457

6100-06 – use AIX APAR IZ96155

7100-00 – use AIX APAR IZ97035

View the current operating system version:

oslevel -s

6100-06-08-1216

#

See the patch application:

instfix -i -k IZ89514

All filesets for IZ89514 were found.

#

instfix -i -k IZ96155

All filesets for IZ96155 were found.

#

14 installation condition through displays summary information configuration, installation, click"Install".

15 OUI to install DataBase, as shown in Fig.

16 installation process will pop up the following script prompt box, to root users in each node performs a prompt box script execution is completed, click on "OK". Note: after the node RAC1 implementation, can be implemented in the RAC2 node.

17 click on the "Close", the end of the OracleDataBase software installation.

Create a Oracle RAC 6Cluster database

In this installation using the ASM database files in the configuration, due to the installation of grid infrastructure, have created a ASM disk group OCR_VOTE, here we create a new DATA disk group to store our database file. Oracle official recommended Oracle cluster file (OCR and voting_disk) and database files on a disk group. Using the flash recovery area and archive configuration is required in the production environment, so it needs to create a disk group FRA_ARCHIVE for fast recovery file and archive.

6.1 create ASMDisk group

1 by the grid user log in SSH Rac1 node, open a command line terminal, enter the asmca command.

2 pop up the following ASM administration interface, click on the "Create" button.

3 the new pop-up ASM disk group dialog box, enter as shown in the following image information, click"OK".

4 the moment will pop up the following successful dialog box, click"OK".

The 5 DATA disk group created after the success of the display interface as shown below, then created for FRA_ARCHIVE disk group the flash recovery area, click"Create".

6 the new pop-up ASM disk group dialog box, enter as shown in the following image information, click"OK".

7 the moment will pop up the following successful dialog box, click"OK".

The 8 FRA_ARCHIVE disk group created after the success of the display interface as shown below, click on "Exit", pop-up box, click"Yes".

6.2 using DBCACreate database RAC

1 by the Xbrower login Rac1 node Oracle user Xmanager, open a command line terminal, enter the DBCA command.

2 following up create database wizard, select the Oracle RAC database, click"Next".

Create a database of 3 options, click"Next".

4 select "custom database, click""Next".

5 enter the cluster database SID and global name, and choose to create the cluster database at all nodes, click"Next".

6 this step chose to create a DataBase Control, and enable the automatic management tasks, click"Next".

7 for all accounts using the same password: changanjie, click"Next".

8 choose the type of storage for ASM, data area for DATA disk group, click"Next".

In this step, if not found ASM disk Oracle users need to check, two node groups are the same.

9 at this time will pop up ASMSNMP management account password, the password is the password specified in step twelfth in Section 4.3: dragonsoft, Click"OK".

10 specifies the fast recovery area data storage area for FRA_ARCHIVE disk group, and enable the archive, click"Next".

11 select the default database components, no custom script, click"Next".

12 in this step to modify the character encoding, the process number is 500, the other tab parameters are the default, click"Next".

Details of 13 create data file, here can be modified online log group number, table space size parameters, click"Next".

Create database script 14 selection, click"Finish".

15 pop up a DBCA summary information, click"OK".

16 DBCA first generation database creation scripts and saved to the specified directory, successfully generated script, it will pop up a dialog box, click the "OK", you can start to create the database.

17 database creation process is shown in Figure.

18 after the database creation process is complete, will pop up the following password management interface, click "Exit" to exit.

19 so Oracle RAC cluster database created.

7 Oracle RACSimple management cluster database

Grid the user to view the number of cluster nodes:

olsnodes-n

Grid the user to view the cluster state:

Crsctlstat res -t (or crs_stat -t-v)

The Oracle user database closed:

sqlplus/ as sysdba

SQL>shutdownimmediate

SQL>exit

Srvctl stop database –d dbid

Root the user closes the cluster:

/u01/app/11.2.0/grid/bin/crsctlstop crs

crsctl stop cluster -all

Root the user closes the operating system:

shutdown-F

Root users start cluster:

/u01/app/11.2.0/grid/bin/crsctlstart crs

The Oracle user database:

sqlplus/ as sysdba

SQL>startup

SQL>exit

8 appendix

8.1Uninstall/Remove 11.2.0.2 Grid Infrastructure & Database inLinux

For research or testing purposes we may have installed 11gR2 GridInfrastructure and RACDatabase in the platform, Because of the special nature of the GI deployment we cannot delete CRS_HOME and some scripts to uninstall GI and RAC Database software, Fortunately, in the 11gR2 Oracle provides new features to uninstall the software: Deinstall, By executing the Deinstall scripts can easily remove the Oracle software products of all configuration files in the system.

Uninstall the specific steps are as follows:

1 the platform on the existing database migration or physical, logical backup, if the database has no value. Use DBCA to delete the database and related services.

Start the DBCA interface to the Oracle user login system, and select RACdatabase:

[oracle@rac2~]$ dbca

In the step 1 of 2: operations delete a Database and choose delete database

In the step 2 of 2: List of clusterdatabases is selected to remove database

One by one, delete the Database all in Cluster environment

2. Using the Oracle user loginAny nodeAnd the implementation of $ORACLE_HOME/deinstall directory under the deinstall script

SQL> select * from v$version; 

BANNER 
-------------------------------------------------------------------------------- 
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production 
PL/SQL Release 11.2.0.2.0 - Production 
CORE    11.2.0.2.0      Production 
TNS for Linux: Version 11.2.0.2.0 - Production 
NLSRTL Version 11.2.0.2.0 - Production 

SQL> select * from global_name; 

GLOBAL_NAME 
-------------------------------------------------------------------------------- 
www.oracledatabase12g.com 

[root@rac2 ~]# su - oracle 

[oracle@rac2 ~]$ cd $ORACLE_HOME/deinstall 

[oracle@rac2 deinstall]$ ./deinstall 

Checking for required files and bootstrapping ... 
Please wait ... 
Location of logs /g01/oraInventory/logs/ 

############ ORACLE DEINSTALL & DECONFIG TOOL START ############ 

######################### CHECK OPERATION START ######################### 
Install check configuration START 

Checking for existence of the Oracle home location /s01/orabase/product/11.2.0/dbhome_1 
Oracle Home type selected for de-install is: RACDB 
Oracle Base selected for de-install is: /s01/orabase 
Checking for existence of central inventory location /g01/oraInventory 
Checking for existence of the Oracle Grid Infrastructure home /g01/11.2.0/grid 
The following nodes are part of this cluster: rac1,rac2 

Install check configuration END 

Skipping Windows and .NET products configuration check 

Checking Windows and .NET products configuration END 

Network Configuration check config START 

Network de-configuration trace file location: 
/g01/oraInventory/logs/netdc_check2011-08-31_11-19-25-PM.log 

Specify all RAC listeners (do not include SCAN listener) that are to be de-configured [CRS_LISTENER]: 

Network Configuration check config END 

Database Check Configuration START 

Database de-configuration trace file location: /g01/oraInventory/logs/databasedc_check2011-08-31_11-19-39-PM.log 

Use comma as separator when specifying list of values as input 

Specify the list of database names that are configured in this Oracle home []: 
Database Check Configuration END 

Enterprise Manager Configuration Assistant START 

EMCA de-configuration trace file location: /g01/oraInventory/logs/emcadc_check2011-08-31_11-19-46-PM.log  

Enterprise Manager Configuration Assistant END 
Oracle Configuration Manager check START 
OCM check log file location : /g01/oraInventory/logs//ocm_check131.log 
Oracle Configuration Manager check END 

######################### CHECK OPERATION END ######################### 

####################### CHECK OPERATION SUMMARY ####################### 
Oracle Grid Infrastructure Home is: /g01/11.2.0/grid 
The cluster node(s) on which the Oracle home de-installation will be performed are:rac1,rac2 
Oracle Home selected for de-install is: /s01/orabase/product/11.2.0/dbhome_1 
Inventory Location where the Oracle home registered is: /g01/oraInventory 
Skipping Windows and .NET products configuration check 
Following RAC listener(s) will be de-configured: CRS_LISTENER 
No Enterprise Manager configuration to be updated for any database(s) 
No Enterprise Manager ASM targets to update 
No Enterprise Manager listener targets to migrate 
Checking the config status for CCR 
rac1 : Oracle Home exists with CCR directory, but CCR is not configured 
rac2 : Oracle Home exists with CCR directory, but CCR is not configured 
CCR check is finished 
Do you want to continue (y - yes, n - no)? [n]: y 
A log of this session will be written to: '/g01/oraInventory/logs/deinstall_deconfig2011-08-31_11-19-23-PM.out' 
Any error messages from this session will be written to: '/g01/oraInventory/logs/deinstall_deconfig2011-08-31_11-19-23-PM.err' 

######################## CLEAN OPERATION START ######################## 

Enterprise Manager Configuration Assistant START 

EMCA de-configuration trace file location: /g01/oraInventory/logs/emcadc_clean2011-08-31_11-19-46-PM.log  

Updating Enterprise Manager ASM targets (if any) 
Updating Enterprise Manager listener targets (if any) 
Enterprise Manager Configuration Assistant END 
Database de-configuration trace file location: /g01/oraInventory/logs/databasedc_clean2011-08-31_11-20-00-PM.log 

Network Configuration clean config START 

Network de-configuration trace file location: /g01/oraInventory/logs/netdc_clean2011-08-31_11-20-00-PM.log 

De-configuring RAC listener(s): CRS_LISTENER 

De-configuring listener: CRS_LISTENER 
    Stopping listener: CRS_LISTENER 
    Listener stopped successfully. 
    Unregistering listener: CRS_LISTENER 
    Listener unregistered successfully. 
Listener de-configured successfully. 

De-configuring Listener configuration file on all nodes... 
Listener configuration file de-configured successfully. 

De-configuring Naming Methods configuration file on all nodes... 
Naming Methods configuration file de-configured successfully. 

De-configuring Local Net Service Names configuration file on all nodes... 
Local Net Service Names configuration file de-configured successfully. 

De-configuring Directory Usage configuration file on all nodes... 
Directory Usage configuration file de-configured successfully. 

De-configuring backup files on all nodes... 
Backup files de-configured successfully. 

The network configuration has been cleaned up successfully. 

Network Configuration clean config END 

Oracle Configuration Manager clean START 
OCM clean log file location : /g01/oraInventory/logs//ocm_clean131.log 
Oracle Configuration Manager clean END 
Removing Windows and .NET products configuration END 
Oracle Universal Installer clean START 

Detach Oracle home '/s01/orabase/product/11.2.0/dbhome_1' from the central inventory on the local node : Done 

Delete directory '/s01/orabase/product/11.2.0/dbhome_1' on the local node : Done 

Delete directory '/s01/orabase' on the local node : Done 

Detach Oracle home '/s01/orabase/product/11.2.0/dbhome_1' from the central inventory on the remote nodes 'rac1' : Done 

Delete directory '/s01/orabase/product/11.2.0/dbhome_1' on the remote nodes 'rac1' : Done 

Delete directory '/s01/orabase' on the remote nodes 'rac1' : Done 

Oracle Universal Installer cleanup was successful. 

Oracle Universal Installer clean END 

Oracle install clean START 

Clean install operation removing temporary directory '/tmp/deinstall2011-08-31_11-19-18PM' on node 'rac2' 
Clean install operation removing temporary directory '/tmp/deinstall2011-08-31_11-19-18PM' on node 'rac1' 

Oracle install clean END 

######################### CLEAN OPERATION END ######################### 

####################### CLEAN OPERATION SUMMARY ####################### 
Following RAC listener(s) were de-configured successfully: CRS_LISTENER 
Cleaning the config for CCR 
As CCR is not configured, so skipping the cleaning of CCR configuration 
CCR clean is finished 
Skipping Windows and .NET products configuration clean 
Successfully detached Oracle home '/s01/orabase/product/11.2.0/dbhome_1' from the central inventory on the local node. 
Successfully deleted directory '/s01/orabase/product/11.2.0/dbhome_1' on the local node. 
Successfully deleted directory '/s01/orabase' on the local node. 
Successfully detached Oracle home '/s01/orabase/product/11.2.0/dbhome_1' from the central inventory on the remote nodes 'rac1'. 
Successfully deleted directory '/s01/orabase/product/11.2.0/dbhome_1' on the remote nodes 'rac1'. 
Successfully deleted directory '/s01/orabase' on the remote nodes 'rac1'. 
Oracle Universal Installer cleanup was successful. 

Oracle deinstall tool successfully cleaned up temporary directories. 
####################################################################### 

############# ORACLE DEINSTALL & DECONFIG TOOL END ############# 
The deinstall script will delete all nodes on the $ORACLE_HOME RDBMS software, and from the centralinventory, has been uninstalled RDBMS software registration, pay attention to this kind of operation is not reversible！ 
3. 
Using the root user login pay attention to "$ORA_CRS_HOME/crs/install/rootcrs.pl-verbose -deconfig -force" operation on all the nodes of the command, pay attention to run this command on the last node don't. For example if you have 2 nodes, as long as one node in the command to run:  
[root@rac1 ~]# $ORA_CRS_HOME/crs/install/rootcrs.pl -verbose -deconfig -force 

Using configuration parameter file: /g01/11.2.0/grid/crs/install/crsconfig_params 
Network exists: 1/172.1.1.0/255.255.255.0/eth0, type static 
VIP exists: /rac1-vip/172.1.1.206/172.1.1.0/255.255.255.0/eth0, hosting node rac1 
VIP exists: /rac2-vip/172.1.1.207/172.1.1.0/255.255.255.0/eth0, hosting node rac2 
GSD exists 
ONS exists: Local port 6100, remote port 6200, EM port 2016 
ACFS-9200: Supported 
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'rac1' 
CRS-2677: Stop of 'ora.registry.acfs' on 'rac1' succeeded 
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1' 
CRS-2673: Attempting to stop 'ora.crsd' on 'rac1' 
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac1' 
CRS-2673: Attempting to stop 'ora.oc4j' on 'rac1' 
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac1' 
CRS-2673: Attempting to stop 'ora.FRA.dg' on 'rac1' 
CRS-2673: Attempting to stop 'ora.SYSTEMDG.dg' on 'rac1' 
CRS-2677: Stop of 'ora.oc4j' on 'rac1' succeeded 
CRS-2672: Attempting to start 'ora.oc4j' on 'rac2' 
CRS-2676: Start of 'ora.oc4j' on 'rac2' succeeded 
CRS-2677: Stop of 'ora.DATA.dg' on 'rac1' succeeded 
CRS-2677: Stop of 'ora.SYSTEMDG.dg' on 'rac1' succeeded 
CRS-2677: Stop of 'ora.FRA.dg' on 'rac1' succeeded 
CRS-2673: Attempting to stop 'ora.asm' on 'rac1' 
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded 
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac1' has completed 
CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded 
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1' 
CRS-2673: Attempting to stop 'ora.evmd' on 'rac1' 
CRS-2673: Attempting to stop 'ora.asm' on 'rac1' 
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1' 
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'rac1' 
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded 
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1' 
CRS-2677: Stop of 'ora.drivers.acfs' on 'rac1' succeeded 
CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded 
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded 
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded 
CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded 
CRS-2673: Attempting to stop 'ora.cssd' on 'rac1' 
CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded 
CRS-2673: Attempting to stop 'ora.crf' on 'rac1' 
CRS-2673: Attempting to stop 'ora.diskmon' on 'rac1' 
CRS-2677: Stop of 'ora.diskmon' on 'rac1' succeeded 
CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded 
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1' 
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded 
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1' 
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded 
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed 
CRS-4133: Oracle High Availability Services has been stopped. 
Successfully deconfigured Oracle clusterware stack on this node 
In the last 4 node (lastnode) to root users to perform "$ORA_CRS_HOME/crs/install/rootcrs.pl-verbose -deconfig -force -lastnode" command, the command to clear the OCR and Votedisk : 
[root@rac2 ~]# $ORA_CRS_HOME/crs/install/rootcrs.pl -verbose -deconfig -force -lastnode 

Using configuration parameter file: /g01/11.2.0/grid/crs/install/crsconfig_params 
CRS resources for listeners are still configured 
Network exists: 1/172.1.1.0/255.255.255.0/eth0, type static 
VIP exists: /rac1-vip/172.1.1.206/172.1.1.0/255.255.255.0/eth0, hosting node rac1 
VIP exists: /rac2-vip/172.1.1.207/172.1.1.0/255.255.255.0/eth0, hosting node rac2 
GSD exists 
ONS exists: Local port 6100, remote port 6200, EM port 2016 
ACFS-9200: Supported 
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'rac2' 
CRS-2677: Stop of 'ora.registry.acfs' on 'rac2' succeeded 
CRS-2673: Attempting to stop 'ora.crsd' on 'rac2' 
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac2' 
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac2' 
CRS-2673: Attempting to stop 'ora.FRA.dg' on 'rac2' 
CRS-2673: Attempting to stop 'ora.SYSTEMDG.dg' on 'rac2' 
CRS-2673: Attempting to stop 'ora.oc4j' on 'rac2' 
CRS-2677: Stop of 'ora.oc4j' on 'rac2' succeeded 
CRS-2677: Stop of 'ora.DATA.dg' on 'rac2' succeeded 
CRS-2677: Stop of 'ora.SYSTEMDG.dg' on 'rac2' succeeded 
CRS-2677: Stop of 'ora.FRA.dg' on 'rac2' succeeded 
CRS-2673: Attempting to stop 'ora.asm' on 'rac2' 
CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded 
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac2' has completed 
CRS-2677: Stop of 'ora.crsd' on 'rac2' succeeded 
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac2' 
CRS-2673: Attempting to stop 'ora.evmd' on 'rac2' 
CRS-2673: Attempting to stop 'ora.asm' on 'rac2' 
CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded 
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac2' 
CRS-2677: Stop of 'ora.evmd' on 'rac2' succeeded 
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac2' succeeded 
CRS-2677: Stop of 'ora.ctssd' on 'rac2' succeeded 
CRS-2673: Attempting to stop 'ora.cssd' on 'rac2' 
CRS-2677: Stop of 'ora.cssd' on 'rac2' succeeded 
CRS-2673: Attempting to stop 'ora.diskmon' on 'rac2' 
CRS-2677: Stop of 'ora.diskmon' on 'rac2' succeeded 
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac2' 
CRS-2676: Start of 'ora.cssdmonitor' on 'rac2' succeeded 
CRS-2672: Attempting to start 'ora.cssd' on 'rac2' 
CRS-2672: Attempting to start 'ora.diskmon' on 'rac2' 
CRS-2676: Start of 'ora.diskmon' on 'rac2' succeeded 
CRS-2676: Start of 'ora.cssd' on 'rac2' succeeded 
CRS-4611: Successful deletion of voting disk +SYSTEMDG. 
ASM de-configuration trace file location: /tmp/asmcadc_clean2011-08-31_11-55-52-PM.log 
ASM Clean Configuration START 
ASM Clean Configuration END 

ASM with SID +ASM1 deleted successfully. Check /tmp/asmcadc_clean2011-08-31_11-55-52-PM.log for details. 

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac2' 
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac2' 
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac2' 
CRS-2673: Attempting to stop 'ora.asm' on 'rac2' 
CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded 
CRS-2677: Stop of 'ora.mdnsd' on 'rac2' succeeded 
CRS-2677: Stop of 'ora.ctssd' on 'rac2' succeeded 
CRS-2673: Attempting to stop 'ora.cssd' on 'rac2' 
CRS-2677: Stop of 'ora.cssd' on 'rac2' succeeded 
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac2' 
CRS-2673: Attempting to stop 'ora.diskmon' on 'rac2' 
CRS-2677: Stop of 'ora.gipcd' on 'rac2' succeeded 
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac2' 
CRS-2677: Stop of 'ora.diskmon' on 'rac2' succeeded 
CRS-2677: Stop of 'ora.gpnpd' on 'rac2' succeeded 
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac2' has completed 
CRS-4133: Oracle High Availability Services has been stopped. 
Successfully deconfigured Oracle clusterware stack on this node 
5 at any node to GridInfrastructure owners users to perform "$ORA_CRS_HOME/deinstall/deinstall" script: 
[root@rac1 ~]# su - grid 
[grid@rac1 ~]$ cd $ORA_CRS_HOME 
[grid@rac1 grid]$ cd deinstall/ 

[grid@rac1 deinstall]$ cat deinstall 
#!/bin/sh 
# 
# $Header: install/utl/scripts/db/deinstall /main/3 2010/05/28 20:12:57 ssampath Exp $ 
# 
# Copyright (c) 2005, 2010, Oracle and/or its affiliates. All rights reserved. 
# 
#    NAME 
#      deinstall - wrapper script that calls deinstall tool. 
# 
#    DESCRIPTION 
#      This script will set all the necessary variables and call the tools 
#      entry point. 
# 
#    NOTES 
# 
# 
#    MODIFIED   (MM/DD/YY) 
#    mwidjaja    04/29/10 - XbranchMerge mwidjaja_bug-9579184 from 
#                           st_install_11.2.0.1.0 
#    mwidjaja    04/15/10 - Added SHLIB_PATH for HP-PARISC 
#    mwidjaja    01/14/10 - XbranchMerge mwidjaja_bug-9269768 from 
#                           st_install_11.2.0.1.0 
#    mwidjaja    01/14/10 - Fix help message for params 
#    ssampath    12/24/09 - Fix for bug 9227535. Remove legacy version_check 
#                           function 
#    ssampath    12/01/09 - XbranchMerge ssampath_bug-9167533 from 
#                           st_install_11.2.0.1.0 
#    ssampath    11/30/09 - Set umask to 022. 
#    prsubram    10/12/09 - XbranchMerge prsubram_bug-9005648 from main 
#    prsubram    10/08/09 - Compute ARCHITECTURE_FLAG in the script 
#    prsubram    09/15/09 - Setting LIBPATH for AIX 
#    prsubram    09/10/09 - Add AIX specific code check java version 
#    prsubram    09/10/09 - Change TOOL_DIR to BOOTSTRAP_DIR in java cmd 
#                           invocation of bug#8874160 
#    prsubram    09/08/09 - Change the default shell to /usr/xpg4/bin/sh on 
#                           SunOS 
#    prsubram    09/03/09 - Removing -d64 for client32 homes for the bug8859294 
#    prsubram    06/22/09 - Resolve port specific id cmd issue 
#    ssampath    06/02/09 - Fix for bug 8566942 
#    ssampath    05/19/09 - Move removal of /tmp/deinstall to java 
#                           code. 
#    prsubram    04/30/09 - Fix for the bug#8474891 
#    mwidjaja    04/29/09 - Added user check between the user running the 
#                           script and inventory owner 
#    ssampath    04/29/09 - Changes to make error message better when deinstall 
#                           tool is invoked from inside ORACLE_HOME and -home 
#                           is passed. 
#    ssampath    04/15/09 - Fix for bug 8414555 
#    prsubram    04/09/09 - LD_LIBRARY_PATH is ported for sol,hp-ux & aix 
#    mwidjaja    03/26/09 - Disallow -home for running from OH 
#    ssampath    03/24/09 - Fix for bug 8339519 
#    wyou        02/25/09 - restructure the ohome check 
#    wyou        02/25/09 - change the error msg for directory existance check 
#    wyou        02/12/09 - add directory existance check 
#    wyou        02/09/09 - add the check for the writablity for the oracle 
#                           home passed-in 
#    ssampath    01/21/09 - Add oui/lib to LD_LIBRARY_PATH 
#    poosrini    01/07/09 - LOG related changes 
#    ssampath    11/24/08 - Create /main/osds/unix branch 
#    dchriste    10/30/08 - eliminate non-generic tools like 'cut' 
#    ssampath    08/18/08 - Pickup srvm.jar from JLIB directory. 
#    ssampath    07/30/08 - Add http_client.jar and OraCheckpoint.jar to 
#                           CLASSPATH 
#    ssampath    07/08/08 - assistantsCommon.jar and netca.jar location has 
#                           changed. 
#    ssampath    04/11/08 - If invoking the tool from installed home, JRE_HOME 
#                           should be set to $OH/jdk/jre. 
#    ssampath    04/09/08 - Add logic to instantiate ORA_CRS_HOME, JAVA_HOME 
#                           etc., 
#    ssampath    04/03/08 - Pick up ldapjclnt11.jar 
#    idai        04/03/08 - remove assistantsdc.jar and netcadc.jar 
#    bktripat    02/23/07 - 
#    khsingh     07/18/06 - add osdbagrp fix 
#    khsingh     07/07/06 - fix regression 
#    khsingh     06/20/06 - fix bug 5228203 
#    bktripat    06/12/06 - Fix for bug 5246802 
#    bktripat    05/08/06 - 
#    khsingh     05/08/06 - fix tool to run from any parent directory 
#    khsingh     05/08/06 - fix LD_LIBRARY_PATH to have abs. path 
#    ssampath    05/01/06 - Fix for bug 5198219 
#    bktripat    04/21/06 - Fix for bug 5074246 
#    khsingh     04/11/06 - fix bug 5151658 
#    khsingh     04/08/06 - Add WA for bugs 5006414 & 5093832 
#    bktripat    02/08/06 - Fix for bug 5024086 & 5024061 
#    bktripat    01/24/06 - 
#    mstalin     01/23/06 - Add lib to pick libOsUtils.so 
#    bktripat    01/19/06 - adding library changes 
#    rahgupta    01/19/06 - 
#    bktripat    01/19/06 - 
#    mstalin     01/17/06 - Modify the assistants deconfig jar file name 
#    rahgupta    01/17/06 - updating emcp classpath 
#    khsingh     01/17/06 - export ORACLE_HOME 
#    khsingh     01/17/06 - fix for CRS deconfig. 
#    hying       01/17/06 - netcadc.jar 
#    bktripat    01/16/06 - 
#    ssampath    01/16/06 - 
#    bktripat    01/11/06 - 
#    clo         01/10/06 - add EMCP entries 
#    hying       01/10/06 - netcaDeconfig.jar 
#    mstalin     01/09/06 - Add OraPrereqChecks.jar 
#    mstalin     01/09/06 - 
#    khsingh     01/09/06 - 
#    mstalin     01/09/06 - Add additional jars for assistants 
#    ssampath    01/09/06 - removing parseOracleHome temporarily 
#    ssampath    01/09/06 - 
#    khsingh     01/08/06 - fix for CRS deconfig 
#    ssampath    12/08/05 - added java version check 
#    ssampath    12/08/05 - initial run,minor bugs fixed 
#    ssampath    12/07/05 - Creation 
# 

#MACROS 

if [ -z "$UNAME" ]; then UNAME="/bin/uname"; fi 
if [ -z "$ECHO" ]; then ECHO="/bin/echo"; fi 
if [ -z "$AWK" ]; then AWK="/bin/awk"; fi 
if [ -z "$ID" ]; then ID="/usr/bin/id"; fi 
if [ -z "$DIRNAME" ]; then DIRNAME="/usr/bin/dirname"; fi 
if [ -z "$FILE" ]; then FILE="/usr/bin/file"; fi 

if [ "`$UNAME`" = "SunOS" ] 
then 
    if [ -z "${_xpg4ShAvbl_deconfig}" ] 
    then 
        _xpg4ShAvbl_deconfig=1 
        export _xpg4ShAvbl_deconfig 
        /usr/xpg4/bin/sh $0 "$@" 
        exit $? 
    fi 
        AWK="/usr/xpg4/bin/awk" 
fi  

# Set umask to 022 always. 
umask 022 

INSTALLED_VERSION_FLAG=true 
ARCHITECTURE_FLAG=64 

TOOL_ARGS=$* # initialize this always. 

# Since the OTN and the installed version of the tool is same, only way to 
# differentiate is through the instantated variable ORA_CRS_HOME.  If it is 
# NOT instantiated, then the tool is a downloaded version. 
# Set HOME_VER to true based on the value of $INSTALLED_VERSION_FLAG 
if [ x"$INSTALLED_VERSION_FLAG" = x"true" ] 
then 
   ORACLE_HOME=/g01/11.2.0/grid 
   HOME_VER=1     # HOME_VER 
   TOOL_ARGS="$ORACLE_HOME $TOOL_ARGS" 
else 
   HOME_VER=0 
fi 

# Save current working directory 
CURR_DIR=`pwd` 

# If CURR_DIR is different from TOOL_DIR get that location and cd into it. 
TOOL_REL_PATH=`$DIRNAME $0` 
cd $TOOL_REL_PATH 

DOT=`$ECHO $TOOL_REL_PATH | $AWK -F'/' '{ print $1}'` 

if [ "$DOT" = "." ]; 
then 
  TOOL_DIR=$CURR_DIR/$TOOL_REL_PATH 
elif [ `expr "$DOT" : '.*'` -gt 0 ]; 
then 
  TOOL_DIR=$CURR_DIR/$TOOL_REL_PATH 
else 
  TOOL_DIR=$TOOL_REL_PATH 
fi 

# Check if this script is run as root.  If so, then error out. 
# This is fix for bug 5024086. 

RUID=`$ID|$AWK -F( '{print $2}'|$AWK -F) '{print $1}'` 
if [ ${RUID} = "root" ];then 
 $ECHO "You must not be logged in as root to run $0." 
 $ECHO "Log in as Oracle user and rerun $0." 
 exit $ROOT_USER 
fi 

# DEFINE FUNCTIONS BELOW 
computeArchFlag() { 
   TOOL_HOME=$1 
   case `$UNAME` in 
      HP-UX) 
         if [ "`/usr/bin/file $TOOL_HOME/bin/kfod | $AWK -F: '{print $2}' | $AWK -F- '{print $2}' | $AWK '{print $1}'`" = "64" ];then 
            ARCHITECTURE_FLAG="-d64" 
         fi 
      ;; 
      AIX) 
         if [ "`/usr/bin/file $TOOL_HOME/bin/kfod | $AWK -F: '{print $2}' | $AWK '{print $1}' | $AWK -F- '{print $1}'`" = "64" ];then 
            ARCHITECTURE_FLAG="-d64" 
         fi 
      ;; 
      *) 
         if [ "`/usr/bin/file $TOOL_HOME/bin/kfod | $AWK -F: '{print $2}' | $AWK '{print $2}' | $AWK -F- '{print $1}'`" = "64" ];then 
            ARCHITECTURE_FLAG="-d64" 
         fi 
      ;; 
   esac 
} 

if [ $HOME_VER = 1 ]; 
then 
   $ECHO "Checking for required files and bootstrapping ..." 
   $ECHO "Please wait ..." 
   TEMP_LOC=`$ORACLE_HOME/perl/bin/perl $ORACLE_HOME/deinstall/bootstrap.pl $HOME_VER $TOOL_ARGS` 
   TOOL_DIR=$TEMP_LOC 
else 
   TEMP_LOC=`$TOOL_DIR/perl/bin/perl $TOOL_DIR/bootstrap.pl $HOME_VER $TOOL_ARGS` 
fi 

computeArchFlag $TOOL_DIR 

$TOOL_DIR/perl/bin/perl $TOOL_DIR/deinstall.pl $HOME_VER $TEMP_LOC $TOOL_DIR $ARCHITECTURE_FLAG $TOOL_ARGS 

[grid@rac1 deinstall]$ ./deinstall 

Checking for required files and bootstrapping ... 
Please wait ... 
Location of logs /tmp/deinstall2011-08-31_11-59-55PM/logs/ 

############ ORACLE DEINSTALL & DECONFIG TOOL START ############ 

######################### CHECK OPERATION START ######################### 
Install check configuration START 

Checking for existence of the Oracle home location /g01/11.2.0/grid 
Oracle Home type selected for de-install is: CRS 
Oracle Base selected for de-install is: /g01/orabase 
Checking for existence of central inventory location /g01/oraInventory 
Checking for existence of the Oracle Grid Infrastructure home /g01/11.2.0/grid 
The following nodes are part of this cluster: rac1,rac2 

Install check configuration END 

Skipping Windows and .NET products configuration check 

Checking Windows and .NET products configuration END 

Traces log file: /tmp/deinstall2011-08-31_11-59-55PM/logs//crsdc.log 
Enter an address or the name of the virtual IP used on node "rac1"[rac1-vip] 
 >  

The following information can be collected by running "/sbin/ifconfig -a" on node "rac1" 
Enter the IP netmask of Virtual IP "172.1.1.206" on node "rac1"[255.255.255.0] 
 >  

Enter the network interface name on which the virtual IP address "172.1.1.206" is active 
 >  

Enter an address or the name of the virtual IP used on node "rac2"[rac2-vip] 
 >  

The following information can be collected by running "/sbin/ifconfig -a" on node "rac2" 
Enter the IP netmask of Virtual IP "172.1.1.207" on node "rac2"[255.255.255.0] 
 >  

Enter the network interface name on which the virtual IP address "172.1.1.207" is active 
 >  

Enter an address or the name of the virtual IP used on node "rac2"[rac2-vip] 
 >  

The following information can be collected by running "/sbin/ifconfig -a" on node "rac1" 
Enter the IP netmask of Virtual IP "172.1.1.204" on node "rac3"[255.255.255.0] 
 >  

Enter the network interface name on which the virtual IP address "172.1.1.166" is active 
 >  

Enter an address or the name of the virtual IP[] 
 >  

Network Configuration check config START 

Network de-configuration trace file location: /tmp/deinstall2011-08-31_11-59-55PM/logs/ 
netdc_check2011-09-01_12-01-50-AM.log 

Specify all RAC listeners (do not include SCAN listener) that are to be de-configured [LISTENER,LISTENER_SCAN1]: 

Network Configuration check config END 

Asm Check Configuration START 

ASM de-configuration trace file location: /tmp/deinstall2011-08-31_11-59-55PM/logs/ 
asmcadc_check2011-09-01_12-01-51-AM.log 

ASM configuration was not detected in this Oracle home. Was ASM configured in this Oracle home (y|n) [n]: 
ASM was not detected in the Oracle Home 

######################### CHECK OPERATION END ######################### 

####################### CHECK OPERATION SUMMARY ####################### 
Oracle Grid Infrastructure Home is: /g01/11.2.0/grid 
The cluster node(s) on which the Oracle home de-installation will be performed are:rac1,rac2,rac3 
Oracle Home selected for de-install is: /g01/11.2.0/grid 
Inventory Location where the Oracle home registered is: /g01/oraInventory 
Skipping Windows and .NET products configuration check 
Following RAC listener(s) will be de-configured: LISTENER,LISTENER_SCAN1 
ASM was not detected in the Oracle Home 
Do you want to continue (y - yes, n - no)? [n]: y 
A log of this session will be written to: '/tmp/deinstall2011-08-31_11-59-55PM/logs/deinstall_deconfig2011-09-01_12-01-15-AM.out' 
Any error messages from this session will be written to: '/tmp/deinstall2011-08-31_11-59-55PM/logs/deinstall_deconfig2011-09-01_12-01-15-AM.err' 

######################## CLEAN OPERATION START ######################## 
ASM de-configuration trace file location: /tmp/deinstall2011-08-31_11-59-55PM/logs/asmcadc_clean2011-09-01_12-02-00-AM.log 
ASM Clean Configuration END 

Network Configuration clean config START 

Network de-configuration trace file location: /tmp/deinstall2011-08-31_11-59-55PM/logs/netdc_clean2011-09-01_12-02-00-AM.log 

De-configuring RAC listener(s): LISTENER,LISTENER_SCAN1 

De-configuring listener: LISTENER 
    Stopping listener: LISTENER 
    Warning: Failed to stop listener. Listener may not be running. 
Listener de-configured successfully. 

De-configuring listener: LISTENER_SCAN1 
    Stopping listener: LISTENER_SCAN1 
    Warning: Failed to stop listener. Listener may not be running. 
Listener de-configured successfully. 

De-configuring Naming Methods configuration file on all nodes... 
Naming Methods configuration file de-configured successfully. 

De-configuring Local Net Service Names configuration file on all nodes... 
Local Net Service Names configuration file de-configured successfully. 

De-configuring Directory Usage configuration file on all nodes... 
Directory Usage configuration file de-configured successfully. 

De-configuring backup files on all nodes... 
Backup files de-configured successfully. 

The network configuration has been cleaned up successfully. 

Network Configuration clean config END 

----------------------------------------> 

The deconfig command below can be executed in parallel on all the remote nodes. 
Execute the command on  the local node after the execution completes on all the remote nodes. 

Run the following command as the root user or the administrator on node "rac3". 

/tmp/deinstall2011-08-31_11-59-55PM/perl/bin/perl -I/tmp/deinstall2011-08-31_11-59-55PM/perl/lib 
-I/tmp/deinstall2011-08-31_11-59-55PM/crs/install /tmp/deinstall2011-08-31_11-59-55PM/crs/install/rootcrs.pl 
-force  -deconfig -paramfile "/tmp/deinstall2011-08-31_11-59-55PM/response/deinstall_Ora11g_gridinfrahome1.rsp" 

Run the following command as the root user or the administrator on node "rac2". 

/tmp/deinstall2011-08-31_11-59-55PM/perl/bin/perl -I/tmp/deinstall2011-08-31_11-59-55PM/perl/lib 
-I/tmp/deinstall2011-08-31_11-59-55PM/crs/install /tmp/deinstall2011-08-31_11-59-55PM/crs/install/rootcrs.pl -force 
-deconfig -paramfile "/tmp/deinstall2011-08-31_11-59-55PM/response/deinstall_Ora11g_gridinfrahome1.rsp" 

Run the following command as the root user or the administrator on node "rac1". 

/tmp/deinstall2011-08-31_11-59-55PM/perl/bin/perl -I/tmp/deinstall2011-08-31_11-59-55PM/perl/lib 
-I/tmp/deinstall2011-08-31_11-59-55PM/crs/install /tmp/deinstall2011-08-31_11-59-55PM/crs/install/rootcrs.pl 
-force  -deconfig -paramfile "/tmp/deinstall2011-08-31_11-59-55PM/response/deinstall_Ora11g_gridinfrahome1.rsp" 
-lastnode 

Press Enter after you finish running the above commands 

ExecutiondeinstallProcess will be required torootUsers to execute commands on all platforms 

su - root 

[root@rac3 ~]# /tmp/deinstall2011-08-31_11-59-55PM/perl/bin/perl -I/tmp/deinstall2011-08-31_11-59-55PM/perl/lib 
-I/tmp/deinstall2011-08-31_11-59-55PM/crs/install /tmp/deinstall2011-08-31_11-59-55PM/crs/install/rootcrs.pl -force 
-deconfig -paramfile "/tmp/deinstall2011-08-31_11-59-55PM/response/deinstall_Ora11g_gridinfrahome1.rsp" 
Using configuration parameter file: /tmp/deinstall2011-08-31_11-59-55PM/response/deinstall_Ora11g_gridinfrahome1.rsp 
PRCR-1119 : Failed to look up CRS resources of ora.cluster_vip_net1.type type 
PRCR-1068 : Failed to query resources 
Cannot communicate with crsd 
PRCR-1070 : Failed to check if resource ora.gsd is registered 
Cannot communicate with crsd 
PRCR-1070 : Failed to check if resource ora.ons is registered 
Cannot communicate with crsd 

ACFS-9200: Supported 
CRS-4535: Cannot communicate with Cluster Ready Services 
CRS-4000: Command Stop failed, or completed with errors. 
CRS-4544: Unable to connect to OHAS 
CRS-4000: Command Stop failed, or completed with errors. 
Successfully deconfigured Oracle clusterware stack on this node 

[root@rac2 ~]# /tmp/deinstall2011-08-31_11-59-55PM/perl/bin/perl -I/tmp/deinstall2011-08-31_11-59-55PM/perl/lib -I/tmp/deinstall2011-08-31_11-59-55PM/crs/install /tmp/deinstall2011-08-31_11-59-55PM/crs/install/rootcrs.pl -force  -deconfig -paramfile 
"/tmp/deinstall2011-08-31_11-59-55PM/response/deinstall_Ora11g_gridinfrahome1.rsp" 
Using configuration parameter file: /tmp/deinstall2011-08-31_11-59-55PM/response/deinstall_Ora11g_gridinfrahome1.rsp 
Usage: srvctl [command] [object] [] 
    commands: enable|disable|start|stop|status|add|remove|modify|getenv|setenv|unsetenv|config 
    objects: database|service|asm|diskgroup|listener|home|ons 
For detailed help on each command and object and its options use: 
  srvctl [command] -h or 
  srvctl [command] [object] -h 
PRKO-2012 : nodeapps object is not supported in Oracle Restart 
ACFS-9200: Supported 
CRS-4047: No Oracle Clusterware components configured. 
CRS-4000: Command Stop failed, or completed with errors. 
CRS-4047: No Oracle Clusterware components configured. 
CRS-4000: Command Stop failed, or completed with errors. 
You must kill crs processes or reboot the system to properly 
cleanup the processes started by Oracle clusterware 
ACFS-9313: No ADVM/ACFS installation detected. 
Either /etc/oracle/olr.loc does not exist or is not readable 
Make sure the file exists and it has read and execute access 
Failure in execution (rc=-1, 256, No such file or directory) for command 1 /etc/init.d/ohasd deinstall 
error: package cvuqdisk is not installed 
Successfully deconfigured Oracle clusterware stack on this node 

[root@rac1 ~]# /tmp/deinstall2011-08-31_11-59-55PM/perl/bin/perl -I/tmp/deinstall2011-08-31_11-59-55PM/perl/lib 
-I/tmp/deinstall2011-08-31_11-59-55PM/crs/install /tmp/deinstall2011-08-31_11-59-55PM/crs/install/rootcrs.pl -force 
-deconfig -paramfile "/tmp/deinstall2011-08-31_11-59-55PM/response/deinstall_Ora11g_gridinfrahome1.rsp" -lastnode 
Using configuration parameter file: /tmp/deinstall2011-08-31_11-59-55PM/response/deinstall_Ora11g_gridinfrahome1.rsp 
Adding daemon to inittab 
crsexcl failed to start 
Failed to start the Clusterware. Last 20 lines of the alert log follow: 
2011-08-31 23:36:55.813 
[ctssd(4067)]CRS-2408:The clock on host rac1 has been updated by the Cluster Time Synchronization Service to be synchronous with the mean cluster time. 
2011-08-31 23:38:23.855 
[ctssd(4067)]CRS-2408:The clock on host rac1 has been updated by the Cluster Time Synchronization Service to be synchronous with the mean cluster time. 
2011-08-31 23:39:03.873 
[ctssd(4067)]CRS-2408:The clock on host rac1 has been updated by the Cluster Time Synchronization Service to be synchronous with the mean cluster time. 
2011-08-31 23:39:11.707 
[/g01/11.2.0/grid/bin/orarootagent.bin(4559)]CRS-5822:Agent '/g01/11.2.0/grid/bin/orarootagent_root' 
disconnected from server. Details at (:CRSAGF00117:) {0:2:27} in 
/g01/11.2.0/grid/log/rac1/agent/crsd/orarootagent_root/orarootagent_root.log. 
2011-08-31 23:39:12.725 
[ctssd(4067)]CRS-2405:The Cluster Time Synchronization Service on host rac1 is shutdown by user 
2011-08-31 23:39:12.764 
[mdnsd(3868)]CRS-5602:mDNS service stopping by request. 
2011-08-31 23:39:13.987 
[/g01/11.2.0/grid/bin/orarootagent.bin(3892)]CRS-5016:Process "/g01/11.2.0/grid/bin/acfsload" 
spawned by agent "/g01/11.2.0/grid/bin/orarootagent.bin" for action "check" failed: 
details at "(:CLSN00010:)" in "/g01/11.2.0/grid/log/rac1/agent/ohasd/orarootagent_root/orarootagent_root.log" 
2011-08-31 23:39:27.121 
[cssd(3968)]CRS-1603:CSSD on node rac1 shutdown by user. 
2011-08-31 23:39:27.130 
[ohasd(3639)]CRS-2767:Resource state recovery not attempted for 'ora.cssdmonitor' as its target state is OFFLINE 
2011-08-31 23:39:31.926 
[gpnpd(3880)]CRS-2329:GPNPD on node rac1 shutdown.  

Usage: srvctl [command] [object] [] 
    commands: enable|disable|start|stop|status|add|remove|modify|getenv|setenv|unsetenv|config 
    objects: database|service|asm|diskgroup|listener|home|ons 
For detailed help on each command and object and its options use: 
  srvctl [command] -h or 
  srvctl [command] [object] -h 
PRKO-2012 : scan_listener object is not supported in Oracle Restart 
Usage: srvctl [command] [object] [] 
    commands: enable|disable|start|stop|status|add|remove|modify|getenv|setenv|unsetenv|config 
    objects: database|service|asm|diskgroup|listener|home|ons 
For detailed help on each command and object and its options use: 
  srvctl [command] -h or 
  srvctl [command] [object] -h 
PRKO-2012 : scan_listener object is not supported in Oracle Restart 
Usage: srvctl [command] [object] [] 
    commands: enable|disable|start|stop|status|add|remove|modify|getenv|setenv|unsetenv|config 
    objects: database|service|asm|diskgroup|listener|home|ons 
For detailed help on each command and object and its options use: 
  srvctl [command] -h or 
  srvctl [command] [object] -h 
PRKO-2012 : scan object is not supported in Oracle Restart 
Usage: srvctl [command] [object] [] 
    commands: enable|disable|start|stop|status|add|remove|modify|getenv|setenv|unsetenv|config 
    objects: database|service|asm|diskgroup|listener|home|ons 
For detailed help on each command and object and its options use: 
  srvctl [command] -h or 
  srvctl [command] [object] -h 
PRKO-2012 : scan object is not supported in Oracle Restart 
Usage: srvctl [command] [object] [] 
    commands: enable|disable|start|stop|status|add|remove|modify|getenv|setenv|unsetenv|config 
    objects: database|service|asm|diskgroup|listener|home|ons 
For detailed help on each command and object and its options use: 
  srvctl [command] -h or 
  srvctl [command] [object] -h 
PRKO-2012 : nodeapps object is not supported in Oracle Restart 
ACFS-9200: Supported 
CRS-4047: No Oracle Clusterware components configured. 
CRS-4000: Command Stop failed, or completed with errors. 
CRS-4047: No Oracle Clusterware components configured. 
CRS-4000: Command Delete failed, or completed with errors. 
CRS-4047: No Oracle Clusterware components configured. 
CRS-4000: Command Stop failed, or completed with errors. 
CRS-4047: No Oracle Clusterware components configured. 
CRS-4000: Command Modify failed, or completed with errors. 
Adding daemon to inittab 
crsexcl failed to start 
Failed to start the Clusterware. Last 20 lines of the alert log follow: 
[ctssd(4067)]CRS-2408:The clock on host rac1 has been updated by the Cluster Time 
Synchronization Service to be synchronous with the mean cluster time. 
2011-08-31 23:38:23.855 
[ctssd(4067)]CRS-2408:The clock on host rac1 has been updated by the Cluster Time 
Synchronization Service to be synchronous with the mean cluster time. 
2011-08-31 23:39:03.873 
[ctssd(4067)]CRS-2408:The clock on host rac1 has been updated by the Cluster Time 
Synchronization Service to be synchronous with the mean cluster time. 
2011-08-31 23:39:11.707 
[/g01/11.2.0/grid/bin/orarootagent.bin(4559)]CRS-5822:Agent '/g01/11.2.0/grid/bin/orarootagent_root' 
disconnected from server. Details at (:CRSAGF00117:) {0:2:27} in 
/g01/11.2.0/grid/log/rac1/agent/crsd/orarootagent_root/orarootagent_root.log. 
2011-08-31 23:39:12.725 
[ctssd(4067)]CRS-2405:The Cluster Time Synchronization Service on host rac1 is shutdown by user 
2011-08-31 23:39:12.764 
[mdnsd(3868)]CRS-5602:mDNS service stopping by request. 
2011-08-31 23:39:13.987 
[/g01/11.2.0/grid/bin/orarootagent.bin(3892)]CRS-5016:Process 
"/g01/11.2.0/grid/bin/acfsload" spawned by agent "/g01/11.2.0/grid/bin/orarootagent.bin" for action 
"check" failed: details at "(:CLSN00010:)" in 
"/g01/11.2.0/grid/log/rac1/agent/ohasd/orarootagent_root/orarootagent_root.log" 
2011-08-31 23:39:27.121 
[cssd(3968)]CRS-1603:CSSD on node rac1 shutdown by user. 
2011-08-31 23:39:27.130 
[ohasd(3639)]CRS-2767:Resource state recovery not attempted for 'ora.cssdmonitor' as its target state is OFFLINE 
2011-08-31 23:39:31.926 
[gpnpd(3880)]CRS-2329:GPNPD on node rac1 shutdown. 
[client(13099)]CRS-10001:01-Sep-11 00:11 ACFS-9200: Supported 

CRS-4047: No Oracle Clusterware components configured. 
CRS-4000: Command Delete failed, or completed with errors. 
crsctl delete for vds in SYSTEMDG ... failed 
CRS-4047: No Oracle Clusterware components configured. 
CRS-4000: Command Delete failed, or completed with errors. 
CRS-4047: No Oracle Clusterware components configured. 
CRS-4000: Command Stop failed, or completed with errors. 
ACFS-9313: No ADVM/ACFS installation detected. 
Either /etc/oracle/olr.loc does not exist or is not readable 
Make sure the file exists and it has read and execute access 
Failure in execution (rc=-1, 256, No such file or directory) for command 1 /etc/init.d/ohasd deinstall 
error: package cvuqdisk is not installed 
Successfully deconfigured Oracle clusterware stack on this node 

Terminal press to return to the first run deintall enter 

The deconfig command below can be executed in parallel on all the remote nodes. 
Execute the command on  the local node after the execution completes on all the remote nodes. 

Press Enter after you finish running the above commands 

<---------------------------------------- 

Removing Windows and .NET products configuration END 
Oracle Universal Installer clean START 

Detach Oracle home '/g01/11.2.0/grid' from the central inventory on the local node : Done 

Delete directory '/g01/11.2.0/grid' on the local node : Done 

Delete directory '/g01/oraInventory' on the local node : Done 

Delete directory '/g01/orabase' on the local node : Done 

Detach Oracle home '/g01/11.2.0/grid' from the central inventory on the remote nodes 'rac1,rac2' : Done 

Delete directory '/g01/11.2.0/grid' on the remote nodes 'rac1,rac2' : Done 

Delete directory '/g01/oraInventory' on the remote nodes 'rac1' : Done 

Delete directory '/g01/oraInventory' on the remote nodes 'rac2' : Failed <<<< 

The directory '/g01/oraInventory' could not be deleted on the nodes 'rac2'. 
Delete directory '/g01/orabase' on the remote nodes 'rac2' : Done 

Delete directory '/g01/orabase' on the remote nodes 'rac1' : Done 

Oracle Universal Installer cleanup completed with errors. 

Oracle Universal Installer clean END 

Oracle install clean START 

Clean install operation removing temporary directory '/tmp/deinstall2011-08-31_11-59-55PM' on node 'rac1' 
Clean install operation removing temporary directory '/tmp/deinstall2011-08-31_11-59-55PM' on node 'rac2' 

Oracle install clean END 

######################### CLEAN OPERATION END ######################### 

####################### CLEAN OPERATION SUMMARY ####################### 
Following RAC listener(s) were de-configured successfully: LISTENER,LISTENER_SCAN1 
Oracle Clusterware is stopped and successfully de-configured on node "rac3" 
Oracle Clusterware is stopped and successfully de-configured on node "rac2" 
Oracle Clusterware is stopped and successfully de-configured on node "rac1" 
Oracle Clusterware is stopped and de-configured successfully. 
Skipping Windows and .NET products configuration clean 
Successfully detached Oracle home '/g01/11.2.0/grid' from the central inventory on the local node. 
Successfully deleted directory '/g01/11.2.0/grid' on the local node. 
Successfully deleted directory '/g01/oraInventory' on the local node. 
Successfully deleted directory '/g01/orabase' on the local node. 
Successfully detached Oracle home '/g01/11.2.0/grid' from the central inventory on the remote nodes 'rac1,rac2'. 
Successfully deleted directory '/g01/11.2.0/grid' on the remote nodes 'rac2,rac3'. 
Successfully deleted directory '/g01/oraInventory' on the remote nodes 'rac3'. 
Failed to delete directory '/g01/oraInventory' on the remote nodes 'rac2'. 
Successfully deleted directory '/g01/orabase' on the remote nodes 'rac2'. 
Successfully deleted directory '/g01/orabase' on the remote nodes 'rac3'. 
Oracle Universal Installer cleanup completed with errors. 

Run 'rm -rf /etc/oraInst.loc' as root on node(s) 'rac1,rac2' at the end of the session. 

Run 'rm -rf /opt/ORCLfmap' as root on node(s) 'rac1 rac2 ' at the end of the session. 
Oracle deinstall tool successfully cleaned up temporary directories. 
####################################################################### 

############# ORACLE DEINSTALL & DECONFIG TOOL END ############# 
Deintall has finished running you will be prompted to run the "Rm-rf /etc/oraInst.loc" and "RM -rf /opt/ORCLfmap" in the necessary nodes, as do can. 
 The completion of the above script running on each node of the GI has been removed, and the /etc/inittab file has been reduced to a non GI version, CRS script under /etc/init.d has been deleted.  
8.2 when you create a database cannot find the disk group 
Create database DBCA cannot find the disk group needed, main and auxiliary group, please check the Oracle user is correct, the two machines are the same.  
 
 
Download the whole PDF document