Email: service@parnassusdata.com 7 x 24 online support!
Oracle UNABLE TO OPEN DATABASE AFTER IT HAS CRASHED WITH ORA-600 [KCRATR_SCAN_AFN]
SMON crashed instance. Now they are unable to open the DB. When they try to
open the DB, it fails with the same error. This is a 6 node RAC cluster and
all are down.
Fri Apr 08 11:59:26 2011^M
Instance recovery: looking for dead threads^M
Beginning instance recovery of 1 threads^M
parallel recovery started with 15 processes^M
Started redo scan^M
Submitted all GCS remote-cache requests^M
Fri Apr 08 11:59:32 2011^M
Post SMON to start 1st pass IR^M
Fix write in gcs resources^M
Reconfiguration complete^M
Fri Apr 08 11:59:48 2011^M
Errors in file /oracle/diag/rdbms/edw2p/edw2p1/trace/edw2p1_smon_26602.trc
(inc
ident=95488):^M
ORA-600: internal error code, arguments: [kcratr_scan_afn], [10001],
[10000],
[], [], [], [], [], [], [], [], []^M
Incident details in:
/oracle/diag/rdbms/edw2p/edw2p1/incident/incdir_95488/edw2p
1_smon_26602_i95488.trc^M
Fri Apr 08 11:59:49 2011^M
Trace dumping is performing id=[cdmp_20110408115949]^M
Errors in file /oracle/diag/rdbms/edw2p/edw2p1/trace/edw2p1_smon_26602.trc:^M
ORA-600: internal error code, arguments: [kcratr_scan_afn], [10001],
[10000],
[], [], [], [], [], [], [], [], []^M
SMON (ospid: 26602): terminating the instance due to error 600^M
Fri Apr 08 11:59:52 2011^M
ORA-1092 : opitsk aborting process^M
Fri Apr 08 11:59:52 2011^M
License high water mark = 200^M
Instance terminated by SMON, pid = 26602^M
USER (ospid: 13684): terminating the instance^M
Instance terminated by USER, pid = 13684^M
DIAGNOSTIC ANALYSIS:
--------------------
Bug 9885981 which is a duplicate of 10205230 has similar stack trace.
I'm having the customer run rman or dbv to check for block corruption.
WORKAROUND:
-----------
No workaround. DB is down and they are unable to restart.
RELATED BUGS:
-------------
REPRODUCIBILITY:
----------------
TEST CASE:
----------
STACK TRACE:
------------
Dump continued from file:
/oracle/diag/rdbms/edw2p/edw2p1/trace/edw2p1_smon_2660
2.trc
ORA-600: internal error code, arguments: [kcratr_scan_afn], [10001],
[10000],
[], [], [], [], [], [], [], [], []
========= Dump for incident 95488 (ORA-600 [kcratr_scan_afn]) ========
*** 11:59:48.391
dbkedDefDump(): Starting incident default dumps (flags=0x2, level=3,
mask=0x0)
----- SQL Statement (None) -----
Current SQL information unavailable - no cursor.
----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
-------------------- -------- --------------------
----------------------------
skdstdst
ksedst1
ksedst
dbkedDefDump
ksedmp
ksfdmp
dbgexPhaseII
dbgexProcessError
dbgeExecuteForError
dbgePostErrorKGE
dbkePostKGE_kgsf
kgeadse
kgerinv_internal
kgerinv
kgesinv
ksesin
kcratr_scan
kcratr
kctrec