Random crash of Tomcat server

[midnightfox]

Hope someone will be able to help me. I'm experiencing crashes on the tomcat server due to signal 11.
My setup is this:

Red Hat Linux Release 3
Kernel: 2.4.21-40.EL on an i686
Memory: 1Gb
JDK: 1.4.1 IBM
Tomcat: 4.1

Here is the beginning of the error(full file is too big)

NULL ------------------------------------------------------------------------
0SECTION TITLE subcomponent dump routine
NULL ===============================
1TISIGINFO signal 11 received
1TIDATETIME Date: 2007/06/29 at 10:35:39
1TIFILENAME Javacore filename: /home/tomcat/javacore.20070629.103539.4868.txt
NULL ------------------------------------------------------------------------
0SECTION XHPI subcomponent dump routine
NULL ==============================
1HPTIME Fri Jun 29 10:35:39 2007
1HPSIGRECV SIGSEGV received in ?? at 0xb59fd2c5 in /opt/WebSphere/AppServer/java/jre/bin/libjitc.so. Processing terminated.
1HPFULLVERSION J2RE 1.4.1 IBM build cxia321411-20031011
NULL
1HPOPENV Operating Environment
NULL ---------------------
2HPHOSTNAME Host : sdmiserv3.(none)
2HPOSLEVEL OS Level : 2.4.21-40.EL.#1 Thu Feb 2 22:32:00 EST 2006
2HPLIBCVER glibc Version : 2.3.2
2HPCPUS Processors -
3HPARCH Architecture : (not implemented)
3HPNUMCPUS How Many : (not implemented)
3HPCPUSENABLED Enabled : 1
NULL
1HPMEMINFO Memory Info
NULL -----------
2HPMEMLINE total: used: free: shared: buffers: cached:
2HPMEMLINE Mem: 1052168192 943656960 108511232 0 249077760 213872640
2HPMEMLINE Swap: 4178386944 0 4178386944
2HPMEMLINE MemTotal: 1027508 kB
2HPMEMLINE MemFree: 105968 kB
2HPMEMLINE MemShared: 0 kB
2HPMEMLINE Buffers: 243240 kB
2HPMEMLINE Cached: 208860 kB
2HPMEMLINE SwapCached: 0 kB
2HPMEMLINE Active: 518680 kB
2HPMEMLINE ActiveAnon: 175448 kB
2HPMEMLINE ActiveCache: 343232 kB
2HPMEMLINE Inact_dirty: 80928 kB
2HPMEMLINE Inact_laundry: 26572 kB
2HPMEMLINE Inact_clean: 0 kB
2HPMEMLINE Inact_target: 125236 kB
2HPMEMLINE HighTotal: 131056 kB
2HPMEMLINE HighFree: 3036 kB
2HPMEMLINE LowTotal: 896452 kB
2HPMEMLINE LowFree: 102932 kB
2HPMEMLINE SwapTotal: 4080456 kB
2HPMEMLINE SwapFree: 4080456 kB
2HPMEMLINE CommitLimit: 4594208 kB
2HPMEMLINE Committed_AS: 464448 kB
2HPMEMLINE HugePages_Total: 0
2HPMEMLINE HugePages_Free: 0
2HPMEMLINE Hugepagesize: 4096 kB
NULL
1HPUSERLIMITS User Limits (in bytes except for NOFILE and NPROC) -
NULL -----------
2HPUSERLIMIT RLIMIT_FSIZE : infinity
2HPUSERLIMIT RLIMIT_DATA : infinity
2HPUSERLIMIT RLIMIT_STACK : 10485760
2HPUSERLIMIT RLIMIT_CORE : 0
2HPUSERLIMIT RLIMIT_NOFILE : 1024
2HPUSERLIMIT RLIMIT_NPROC : 7168
NULL
1HPSIGHANDLERS JVM Signal Handlers
NULL -------------------
2HPSIGHANDLER HUP : unknown handler
2HPSIGHANDLER INT : unknown handler
2HPSIGHANDLER QUIT : unknown handler
2HPSIGHANDLER ILL : unknown handler
2HPSIGHANDLER TRAP : unknown handler
2HPSIGHANDLER ABRT : unknown handler
2HPSIGHANDLER FPE : unknown handler
2HPSIGHANDLER KILL : default handler
2HPSIGHANDLER BUS : unknown handler
2HPSIGHANDLER SEGV : unknown handler
2HPSIGHANDLER PIPE : ignored
2HPSIGHANDLER ALRM : default handler
2HPSIGHANDLER USR1 : unknown handler
2HPSIGHANDLER USR2 : unknown handler
2HPSIGHANDLER TERM : unknown handler
2HPSIGHANDLER CHLD : default handler
NULL
1HPSIGHANDLERS Chained Signal Handlers
NULL -----------------------
2HPSIGHANDLER HUP : unknown handler
2HPSIGHANDLER INT : unknown handler
2HPSIGHANDLER QUIT : unknown handler
2HPSIGHANDLER ILL : unknown handler
2HPSIGHANDLER TRAP : unknown handler
2HPSIGHANDLER ABRT : unknown handler
2HPSIGHANDLER FPE : unknown handler
2HPSIGHANDLER KILL : default handler
2HPSIGHANDLER BUS : unknown handler
2HPSIGHANDLER SEGV : unknown handler
2HPSIGHANDLER PIPE : ignored
2HPSIGHANDLER ALRM : default handler
2HPSIGHANDLER USR1 : unknown handler
2HPSIGHANDLER USR2 : unknown handler
2HPSIGHANDLER TERM : unknown handler
2HPSIGHANDLER CHLD : default handler
NULL
1HPENVVARS Environment Variables
NULL ---------------------
2HPENVVAR REMOTEHOST=10.2.1.26
2HPENVVAR HOSTNAME=sdmiserv3
2HPENVVAR SHELL=/bin/bash
2HPENVVAR TERM=ansi
2HPENVVAR CATALINA_HOME=/home/tomcat/tomcat4
2HPENVVAR HISTSIZE=1000
2HPENVVAR JAVA_OPTS=-Xms64m -Xmx256m
2HPENVVAR USER=tomcat
2HPENVVAR LS_COLORS=no=00:fi=00:di=01;34:ln=01;36:pi=40;33:s o=01;35:bd=40;33;01:cd=40;33;01:or=01;05;37;41:mi= 01;05;37;41:ex=01;32:*.cmd=01;32:*.exe=01;32:*.com =01;32:*.btm=01;32:*.bat=01;32:*.sh=01;32:*.csh=01 ;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;3 1:*.lzh=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.gz =01;31:*.bz2=01;31:*.bz=01;31:*.tz=01;31:*.rpm=01; 31:*.cpio=01;31:*.jpg=01;35:*.gif=01;35:*.bmp=01;3 5:*.xbm=01;35:*.xpm=01;35:*.png=01;35:*.tif=01;35:
2HPENVVAR MAIL=/var/spool/mail/tomcat
2HPENVVAR PATH=/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/home/tomcat/bin
2HPENVVAR INPUTRC=/etc/inputrc
2HPENVVAR PWD=/home/tomcat
2HPENVVAR JAVA_HOME=/opt/WebSphere/AppServer/java
2HPENVVAR LANG=en_US.UTF-8
2HPENVVAR SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
2HPENVVAR SHLVL=4
2HPENVVAR HOME=/root
2HPENVVAR LOGNAME=tomcat
2HPENVVAR LESSOPEN=|/usr/bin/lesspipe.sh %s
2HPENVVAR G_BROKEN_FILENAMES=1
2HPENVVAR _=/opt/WebSphere/AppServer/java/bin/java
2HPENVVAR LD_LIBRARY_PATH=/opt/WebSphere/AppServer/java/bin/../jre/bin:/opt/WebSphere/AppServer/java/jre/bin/classic:/opt/WebSphere/AppServer/java/jre/bin
2HPENVVAR IBM_JAVA_COMMAND_LINE=/opt/WebSphere/AppServer/java/bin/java -Xms64m -Xmx256m -Djava.endorsed.dirs=/home/tomcat/tomcat4/bin:/home/tomcat/tomcat4/common/endorsed -classpath /opt/WebSphere/AppServer/java/lib/tools.jar:/home/tomcat/tomcat4/bin/bootstrap.jar -Dcatalina.base=/home/tomcat/tomcat4 -Dcatalina.home=/home/tomcat/tomcat4 -Djava.io.tmpdir=/home/tomcat/tomcat4/temp org.apache.catalina.startup.Bootstrap start


What seems to be the problem?
Thank you in advance.

[Carla Schroder]

Geh, Tomcat makes me cry. A lot. Maybe this thread will help:

http://www.ibm.com/developerworks/forums/dw_thread.jsp?message=175522&cat=10&thread=27861&treeDisplayType=threadmode1&forum=244#175522

[midnightfox]

Thanks Carla, I've read the thread and it seems to be helpful. =)

But I wonder, is there any more ways to fix these? In the scenario of the mod_jk does not work....

[Carla Schroder]

In my own limited experience with Tomcat, having the exactly correct everything is essential. So you want the exactly correct supported Linux version, and Java libs and modules, and everything on down the line. This particular type of error is fairly common, and it's usually Java-related. There doesn't seem to be a single solution; a Tomcat server is a complex beast, and Java supplies its own unique headaches.

Just to cover all the bases, make sure your power supply is adequate and test your system RAM. Weak or failing power supplies cause apparently random failures under load. Corrupt memory does all kinds of bad things. I don't believe either one is the culprit here, but it never hurts to check. My money is on some sort of horrid Java problem. What to do about it? Beats the heck out of me :) I would visit both the official Sun java forums and the Tomcat forums and see if anyone there can be helpful. There might even be some answers already in the archives.

[midnightfox]

Thanks again, Carla. I really appreciated what you have done so far =)