E-WL: WebLogic Crash With Error Message: Illegal memory access. [54] in JRockit Dump [ID 971488.1]
Increase the Thread Stack in following file:
/u01/home/dba/oracle/product/middleware/oms11g/user_projects/domains/GCDomain/bin/startEMServer.sh
OLD
USER_MEM_ARGS="-Xms256m -Xmx512m -XX:MaxPermSize=512m"
if [ "${JAVA_VENDOR}" = "Sun" ] ; then
if [ "${PRODUCTION_MODE}" = "" ] ; then
USER_MEM_ARGS="-Xms256m -Xmx512m -XX:MaxPermSize=512m -XX:CompileThreshold=8000 -XX:PermSize=128m"
fi
fi
NEW
USER_MEM_ARGS="-Xms2048m -Xmx2048m -XX:MaxPermSize=512m -Xss1024k"
if [ "${JAVA_VENDOR}" = "Sun" ] ; then
if [ "${PRODUCTION_MODE}" = "" ] ; then
USER_MEM_ARGS="-Xms2048m -Xmx2048m -XX:MaxPermSize=512m -XX:CompileThreshold=8000 -XX:PermSize=128m -Xss1024k"
fi
fi
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 18:46:46 on Tue Jul 12 21:07:43 2011
**********************************************************
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
**********************************************************
Additional information is available in:
/u01/home/dba/oracle/product/middleware/oms11g/user_projects/domains/GCDomain/jrockit.7054.dump
/u01/home/dba/oracle/product/middleware/oms11g/user_projects/domains/GCDomain/core or core.7054
Error Message: Illegal memory access. [54]
Signal info : si_signo=11, si_code=1 si_addr=0x80
Version : BEA JRockit(R) R27.6.5-32_o-121899-1.6.0_14-20091001-2106-solaris-sparcv9
CPU : SPARC64-VI (portid 1024 impl 0x6 ver 0x93 clock 2150 MHz)
Number CPUs : 16
Tot Phys Mem : 68719476736 (65536 MB)
OS version : SunOS 5.10 Generic_142900-11 sun4u
Thread System: Solaris Threads
Java locking : Lazy unlocking enabled (class banning) (transfer banning)
State : JVM is running
Command Line : -client -Xms256m -Xmx1024m -XX:MaxPermSize=512m -XX:CompileThreshold=8000 -XX:PermSize=128m -Dweblogic.Name=EMGC_OMS1 -Djava.security.policy=/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/server/lib/weblogic.policy -Dweblogic.system.BootIdentityFile=/u01/home/dba/oracle/product/middleware/oms11g/user_projects/domains/GCDomain/servers/EMGC_OMS1/data/nodemanager/boot.properties -Dweblogic.nodemanager.ServiceEnabled=true -Dweblogic.security.SSL.ignoreHostnameVerification=true -Dweblogic.ReverseDNSAllowed=false -DINSTANCE_HOME=/u01/home/dba/oracle/product/middleware/oms11g/em/EMGC_OMS1 -DORACLE_HOME=/u01/home/dba/oracle/product/middleware/grid/oms11g -Ddomain.home=/u01/home/dba/oracle/product/middleware/oms11g/user_projects/domains/GCDomain -Djava.awt.headless=true -Ddomain.name=GCDomain -Docm.repeater.home=/u01/home/dba/oracle/product/middleware/grid/oms11g -Djava.security.egd=file:///dev/urandom -Xverify:none -da -Dplatform.home=/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3 -Dwls.home=/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/server -Dweblogic.home=/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/server -Ddomain.home=/u01/home/dba/oracle/product/middleware/oms11g/user_projects/domains/GCDomain -Dcommon.components.home=/u01/home/dba/oracle/product/middleware/grid/oracle_common -Djrf.version=11.1.1 -Dorg.apache.commons.logging.Log=org.apache.commons.logging.impl.Jdk14Logger -Djrockit.optfile=/u01/home/dba/oracle/product/middleware/grid/oracle_common/modules/oracle.jrf_11.1.1/jrocket_optfile.txt -Doracle.domain.config.dir=/u01/home/dba/oracle/product/middleware/oms11g/user_projects/domains/GCDomain/config/fmwconfig -Doracle.server.config.dir=/u01/home/dba/oracle/product/middleware/oms11g/user_projects/domains/GCDomain/config/fmwconfig/servers/EMGC_OMS1 -Doracle.security.jps.config=/u01/home/dba/oracle/product/middleware/oms11g/user_projects/domains/GCDomain/config/fmwconfig/jps-config.xml -Djava.protocol.handler.pkgs=oracle.mds.net.protocol -Digf.arisidbeans.carmlloc=/u01/home/dba/oracle/product/middleware/oms11g/user_projects/domains/GCDomain/config/fmwconfig/carml -Digf.arisidstack.home=/u01/home/dba/oracle/product/middleware/oms11g/user_projects/domains/GCDomain/config/fmwconfig/arisidprovider -Dweblogic.alternateTypesDirectory=/u01/home/dba/oracle/product/middleware/grid/oracle_common/modules/oracle.ossoiap_11.1.1,/u01/home/dba/oracle/product/middleware/grid/oracle_common/modules/oracle.oamprovider_11.1.1 -Dweblogic.jdbc.remoteEnabled=false -Dweblogic.management.discover=false -Dweblogic.management.server=https://myhost.oracle.com:7101 -Dwlw.iterativeDev= -Dwlw.testConsole= -Dwlw.logErrorsToConsole= -Dweblogic.ext.dirs=/u01/home/dba/oracle/product/middleware/grid/patch_wls1032/profiles/default/sysext_manifest_classpath -Dsun.java.launcher=SUN_STANDARD weblogic.Server
java.home : /u01/home/dba/oracle/product/middleware/jrmc-3.1.2-1.6.0/jre
j.class.path : /u01/home/dba/oracle/product/middleware/grid/patch_wls1032/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/u01/home/dba/oracle/product/middleware/jrmc-3.1.2-1.6.0/lib/tools.jar:/u01/home/dba/oracle/product/middleware/grid/utils/config/10.3/config-launch.jar:/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/server/lib/weblogic_sp.jar:/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/server/lib/weblogic.jar:/u01/home/dba/oracle/product/middleware/grid/modules/features/weblogic.server.modules_10.3.2.0.jar:/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/server/lib/webservices.jar:/u01/home/dba/oracle/product/middleware/grid/modules/org.apache.ant_1.7.0/lib/ant-all.jar:/u01/home/dba/oracle/product/middleware/grid/modules/net.sf.antcontrib_1.0.0.0_1-0b2/lib/ant-contrib.jar:/u01/home/dba/oracle/product/middleware/grid/oracle_common/soa/modules/commons-cli-1.1.jar:/u01/home/dba/oracle/product/middleware/grid/oracle_common/soa/modules/oracle.soa.mgmt_11.1.1/soa-infra-mgmt.jar:/u01/home/dba/oracle/product/middleware/grid/oracle_common/modules/oracle.jrf_11.1.1/jrf.jar:/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/common/eval/pointbase/lib/pbclient57.jar:/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/server/lib/xqrl.jar:/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/server/lib/weblogic_sp.jar:/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/server/lib/weblogic.jar:/u01/home/dba/oracle/product/middleware/grid/modules/com.bea.core.apache.log4j_1.2.13.jar
j.lib.path : /u01/home/dba/oracle/product/middleware/jrmc-3.1.2-1.6.0/jre/lib/sparcv9/jrockit:/u01/home/dba/oracle/product/middleware/jrmc-3.1.2-1.6.0/jre/lib/sparcv9:/u01/home/dba/oracle/product/middleware/jrmc-3.1.2-1.6.0/jre/../lib/sparcv9:/u01/home/dba/oracle/product/middleware/grid/patch_wls1032/profiles/default/native:/u01/home/dba/oracle/product/middleware/grid/oms11g/lib:/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/server/native/solaris/sparc64:/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/server/native/solaris/sparc64/oci920_8:/usr/lib
JAVA_HOME : /u01/home/dba/oracle/product/middleware/jrmc-3.1.2-1.6.0
_JAVA_OPTIONS:
LD_LIBRARY_PATH: /u01/home/dba/oracle/product/middleware/jrmc-3.1.2-1.6.0/jre/lib/sparcv9/jrockit:/u01/home/dba/oracle/product/middleware/jrmc-3.1.2-1.6.0/jre/lib/sparcv9:/u01/home/dba/oracle/product/middleware/jrmc-3.1.2-1.6.0/jre/../lib/sparcv9:/u01/home/dba/oracle/product/middleware/grid/patch_wls1032/profiles/default/native:/u01/home/dba/oracle/product/middleware/grid/oms11g/lib:/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/server/native/solaris/sparc64:/u01/home/dba/oracle/product/middleware/grid/wlserver_10.3/server/native/solaris/sparc64/oci920_8
LD_LIBRARY_PATH_32:
LD_LIBRARY_PATH_64:
LD_PRELOAD :
LD_PRELOAD_32:
LD_PRELOAD_64: /usr/lib/sparcv9/libumem.so:
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
C Heap : Good; no memory allocations have failed
GC Strategy : Mode: static, with strategy: singleconcon
GC Status : OC currently running, in phase: initial marking. This is OC#1347.
Heap : 0x2b00000 - 0x42b00000 (Size: 1024 MB)
Compaction : 0x2b00000 - 0x3300000 (Current compaction type: internal)
CompRefs : References are compressed, with heap base 0x0.
....
.....
Stack 0: start=0xffffffff79b00000, end=0xffffffff79b44000, guards=0xffffffff79b0a000 (ok), forbidden=0xffffffff79b06000
Thread Stack Trace:
at findNext+288()@0xffffffff7d9bc9f4
at refIterGetNext2+52()@0xffffffff7d9bcb74
at triWorkChunkIteratorStep+328()@0xffffffff7d9cad80
at triWorkChunkIteratorGetNext+28()@0xffffffff7d9cafe0
at mmSingleConProcessWorkChunk+160()@0xffffffff7d9db880
at mmSingleConProcessThreadRoots+56()@0xffffffff7d9dbb8c
at mmSingleConMark+144()@0xffffffff7d9dbf64
at mmGCMainLoop+616()@0xffffffff7d88793c
at mmGCMainThread+812()@0xffffffff7d8c558c
at tsiThreadStub+144()@0xffffffff7d946b0c
at ptiThreadStub+8()@0xffffffff7d9ab090
at _lwp_start+0()@0xffffffff7ecd64b8
-- Java stack --
**********************************************************
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
**********************************************************
===== END DUMP ===============================================================
