Oracle Server – Enterprise Edition – Version: 11.2.0.2.0 and later [Release: 11.2 and later ]Information in this document applies to any platform.After updating the GLOBAL_NAME and setting it to NULL:
The database is not starting up:
The steps that can cause the error:
Steps to resolve the error:1) Mount the DB
- Find the PID of the Oracle process
- Here the PID is 4030 which we will use in the GDB
GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-32.el5_6.2)Copyright (C) 2009 Free Software Foundation, Inc.License GPLv3+: GNU GPL version 3 or laterThis is free software: you are free to change and redistribute it.There is NO WARRANTY, to the extent permitted by law. Type "show copying"and "show warranty" for details.This GDB was configured as "i386-redhat-linux-gnu".For bug reporting instructions, please see:…Reading symbols from /home/oracle/app/oracle/product/11.2.0/dbhome_2/bin/oracle…(no debugging symbols found)…done.Attaching to program: /home/oracle/app/oracle/product/11.2.0/dbhome_2/bin/oracle, process 4030warning: .dynamic section for "/lib/librt.so.1" is not at the expected addresswarning: difference appears to be caused by prelink, adjusting expectationsReading symbols from /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libodm11.so…(no debugging symbols found)…done.Loaded symbols for /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libodm11.soReading symbols from /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libcell11.so…(no debugging symbols found)…done.Loaded symbols for /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libcell11.soReading symbols from /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libskgxp11.so…(no debugging symbols found)…done.Loaded symbols for /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libskgxp11.soReading symbols from /lib/librt.so.1…(no debugging symbols found)…done.Loaded symbols for /lib/librt.so.1Reading symbols from /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libnnz11.so…(no debugging symbols found)…done.Loaded symbols for /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libnnz11.soReading symbols from /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libclsra11.so…(no debugging symbols found)…done.Loaded symbols for /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libclsra11.soReading symbols from /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libdbcfg11.so…(no debugging symbols found)…done.Loaded symbols for /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libdbcfg11.soReading symbols from /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libhasgen11.so…(no debugging symbols found)…done.Loaded symbols for /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libhasgen11.soReading symbols from /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libskgxn2.so…(no debugging symbols found)…done.Loaded symbols for /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libskgxn2.soReading symbols from /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libocr11.so…(no debugging symbols found)…done.Loaded symbols for /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libocr11.soReading symbols from /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libocrb11.so…(no debugging symbols found)…done.Loaded symbols for /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libocrb11.soReading symbols from /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libocrutl11.so…(no debugging symbols found)…done.Loaded symbols for /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libocrutl11.soReading symbols from /usr/lib/libaio.so.1…(no debugging symbols found)…done.Loaded symbols for /usr/lib/libaio.so.1Reading symbols from /lib/libdl.so.2…(no debugging symbols found)…done.Loaded symbols for /lib/libdl.so.2Reading symbols from /lib/libm.so.6…(no debugging symbols found)…done.Loaded symbols for /lib/libm.so.6Reading symbols from /lib/libpthread.so.0…(no debugging symbols found)…done.[Thread debugging using libthread_db enabled]Loaded symbols for /lib/libpthread.so.0Reading symbols from /lib/libnsl.so.1…(no debugging symbols found)…done.Loaded symbols for /lib/libnsl.so.1Reading symbols from /lib/libc.so.6…(no debugging symbols found)…done.Loaded symbols for /lib/libc.so.6Reading symbols from /lib/ld-linux.so.2…(no debugging symbols found)…done.Loaded symbols for /lib/ld-linux.so.2Reading symbols from /usr/lib/libnuma.so.1…(no debugging symbols found)…done.Loaded symbols for /usr/lib/libnuma.so.1Reading symbols from /lib/libnss_files.so.2…(no debugging symbols found)…done.Loaded symbols for /lib/libnss_files.so.2Reading symbols from /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libnque11.so…(no debugging symbols found)…done.Loaded symbols for /home/oracle/app/oracle/product/11.2.0/dbhome_2/lib/libnque11.so0x00d24402 in __kernel_vsyscall ()4) Insert a breakpoint at kokiasg
- Continue the debugging
- Open the DB
The hang will happen at the following point in the alert log due to the above break point
The gdb output will show:
- Open a new SQLPLUS session as the first one is currently hanging due to the break-point and restore the GLOBAL_NAME to its original value:
- In another session connect to SQLPLUS and check the GLOBAL_NAME:
- Kill the GDB session which is currently suspending the database OPEN:
At this moment, sqlplus will prompt:alter database open*ERROR at line 1 :ORA – 03113 : end – of – file on communication channel10) Restart the DB.
(gdb) break kokiasgBreakpoint 1 at 0x99f4d04(Gdb) continueContinuing.SQL> alter database openDatabase Characterset is WE8MSWIN1252Breakpoint 1 , 0x0a3d404d in kokiasg ()SQLPLUS / as sysdbaSQL> select status from v$instance;STATUS———–OPENSQL > update global_name set global_name = 'ORCL1.LOCALDOMAIN';1 row updated.SQL > commit;SQL> select * from global_name;GLOBAL_NAME———————-ORCL1.LOCALDOMAIN(Gdb) killKill the program being debugged? (y or n) y(Gdb) quitNOTE:166650.1– Working Effectively With Global Customer SupportIn this Document Symptoms Cause Solution References —
Applies to:
Symptoms
UPDATE GLOBAL_NAME SET GLOBAL_NAME = '';COMMIT;SQL> shutdown immediateDatabase closed.Database dismounted.ORACLE instance shut down.SQL> startupORACLE instance started.
Total System Global Area 422670336 bytesFixed Size 1344616 bytesVariable Size 318770072 bytesDatabase Buffers 96468992 bytesRedo Buffers 6086656 bytesDatabase mounted.ORA-01092: ORACLE instance terminated. Disconnection forcedORA-00600: internal error code, arguments: [18062], [], [], [], [], [], [], [],[], [], [], []Process ID: 3552Session ID: 1 Serial number: 5## Cause SQL> select * from global_name;
GLOBAL_NAME——————————————————————————–ORCL1.LOCALDOMAIN
SQL> UPDATE GLOBAL_NAME SET GLOBAL_NAME = '';
1 row updated.
SQL> commit;
Commit complete.
SQL> shutdown immediateDatabase closed.Database dismounted.ORACLE instance shut down.SQL> startupORACLE instance started.
Total System Global Area 422670336 bytesFixed Size 1344616 bytesVariable Size 318770072 bytesDatabase Buffers 96468992 bytesRedo Buffers 6086656 bytesDatabase mounted.ORA-01092: ORACLE instance terminated. Disconnection forcedORA-00600: internal error code, arguments: [18062], [], [], [], [], [], [], [],[], [], [], []Process ID: 3552Session ID: 1 Serial number: 5## Solution SQL> conn / as sysdbaConnected to an idle instance.SQL> startup mount;ORACLE instance started.Total System Global Area 422670336 bytesFixed Size 1344616 bytesVariable Size 318770072 bytesDatabase Buffers 96468992 bytesRedo Buffers 6086656 bytesDatabase mounted.oracle@localhost:[oracle@localhost ~]$ ps -ef | grep LOCAL | grep -v greporacle 4030 3417 0 11:51 ? 00:00:00 oracleorcl1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))oracle@localhost:[oracle@localhost ~]$ gdb $ORACLE_HOME/bin/oracle 4030## References