Need help analyzing crash-dump with 5.4-RELEASE-p12

From: Jimmy Mäkelä | Loopia AB <jimmy.makela_at_loopia.se>
Date: Mon, 13 Mar 2006 12:32:54 +0100
Hi

We have a server running 5.4-RELEASE-p12 which craches several times a day. My 
current theory is faulty hardware, but I figured I might as well post the 
output from the crash and kgdb-output for the crash-dump, to see if anyone 
have got an idea of what is wrong.

Thanks in advance for any help. I'm not on the list, so please send me a CC of 
any replies.

Output:
Mar 13 11:49:10 s27 kernel: Fatal trap 12: page fault while in kernel mode
Mar 13 11:49:10 s27 kernel: fault virtual address       = 0x0
Mar 13 11:49:10 s27 kernel: fault code          = supervisor write, page not 
present
Mar 13 11:49:10 s27 kernel: instruction pointer = 0x8:0xc07f32ae
Mar 13 11:49:10 s27 kernel: stack pointer               = 0x10:0xf0d019d4
Mar 13 11:49:10 s27 kernel: frame pointer               = 0x10:0xf0d019ec
Mar 13 11:49:10 s27 kernel: code segment                = base 0x0, limit 
0xfffff, type 0x1b
Mar 13 11:49:10 s27 kernel: = DPL 0, pres 1, def32 1, gran 1
Mar 13 11:49:10 s27 kernel: processor eflags    = interrupt enabled, resume, 
IOPL = 0
Mar 13 11:49:10 s27 kernel: current process             = 502 (mysqld)
Mar 13 11:49:10 s27 kernel: trap number         = 12
Mar 13 11:49:10 s27 kernel: panic: page fault

(kgdb) list *0xc07f32ae
0xc07f32ae is in vm_page_insert (/usr/src/sys/vm/vm_page.c:561).
556                     root = vm_page_splay(pindex, root);
557                     if (pindex < root->pindex) {
558                             m->left = root->left;
559                             m->right = root;
560                             root->left = NULL;
561                             TAILQ_INSERT_BEFORE(root, m, listq);
562                     } else if (pindex == root->pindex)
563                             panic("vm_page_insert: offset already 
allocated");
564                     else {
565                             m->right = root->right;

(kgdb) bt
#0  doadump () at pcpu.h:159
#1  0xc065f93a in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:410
#2  0xc065fc41 in panic (fmt=0xc0899d09 "%s") at 
/usr/src/sys/kern/kern_shutdown.c:566
#3  0xc084f57d in trap_fatal (frame=0xf0d01994, eva=0) at 
/usr/src/sys/i386/i386/trap.c:817
#4  0xc084f2a0 in trap_pfault (frame=0xf0d01994, usermode=0, eva=0) at 
/usr/src/sys/i386/i386/trap.c:735
#5  0xc084ee6c in trap (frame=
      {tf_fs = -1030881256, tf_es = -1065025520, tf_ds = -254803952, tf_edi 
= -1026686016, tf_esi = 0, tf_ebp = -254797332, tf_isp = -254797376, tf_ebx = 
3964, tf_edx = -1032035616, tf_ecx = -1030872808, tf_eax = 0, tf_trapno = 12, 
tf_err = 2, tf_eip = -1065405778, tf_cs = 8, tf_eflags = 66050, tf_esp = 3964, 
tf_ss = 0}) at /usr/src/sys/i386/i386/trap.c:425
#6  0xc083d30a in calltrap () at /usr/src/sys/i386/i386/exception.s:140
#7  0xc28e0018 in ?? ()
#8  0xc0850010 in vm86_emulate (vmf=0xc2ce03c0) at 
/usr/src/sys/i386/i386/vm86.c:106
#9  0xc07f3863 in vm_page_alloc (object=0xc3dfb5ac, pindex=3964, req=546) at 
/usr/src/sys/vm/vm_page.c:857
#10 0xc06b01d9 in allocbuf (bp=0xd76ef304, size=16384) at 
/usr/src/sys/kern/vfs_bio.c:2880
#11 0xc06afa23 in getblk (vp=0xc3df7e70, blkno=991, size=16384, slpflag=0, 
slptimeo=0, flags=0) at /usr/src/sys/kern/vfs_bio.c:2646
#12 0xc06b49ec in cluster_read (vp=0xc3df7e70, filesize=18550632, lblkno=991, 
size=16384, cred=0x0, totread=20, seqcount=0,
    bpp=0x0) at /usr/src/sys/kern/vfs_cluster.c:123
#13 0xc07d036d in ffs_read (ap=0x0) at /usr/src/sys/ufs/ffs/ffs_vnops.c:462
#14 0xc06cd3a1 in vn_read (fp=0xc3be81dc, uio=0xf0d01c7c, 
active_cred=0xc3aa6800, flags=0, td=0xc3ecd480) at vnode_if.h:398
#15 0xc0682fff in dofileread (td=0xc3ecd480, fp=0xc3be81dc, fd=0, buf=0x0, 
nbyte=3230746080, offset=Unhandled dwarf expression opcode 0x93
) at file.h:233
#16 0xc0682e84 in read (td=0xc3ecd480, uap=0xf0d01d14) at 
/usr/src/sys/kern/sys_generic.c:107
#17 0xc084f929 in syscall (frame=
      {tf_fs = 47, tf_es = 47, tf_ds = 47, tf_edi = 179215360, tf_esi 
= -1083763404, tf_ebp = -1083763540, tf_isp = -254796428, tf_ebx = 676627644, 
tf_edx = 178215392, tf_ecx = 0, tf_eax = 3, tf_trapno = 22, tf_err = 2, tf_eip 
= 676970555, tf_cs = 31, tf_eflags = 658, tf_esp = -1083763568, tf_ss = 47}) 
at /usr/src/sys/i386/i386/trap.c:1009
#18 0xc083d35f in Xint0x80_syscall () at 
/usr/src/sys/i386/i386/exception.s:201
#19 0x0000002f in ?? ()
#20 0x0000002f in ?? ()
#21 0x0000002f in ?? ()
#22 0x0aae9c00 in ?? ()
#23 0xbf671534 in ?? ()
#24 0xbf6714ac in ?? ()
#25 0xf0d01d74 in ?? ()
#26 0x285484bc in ?? ()
#27 0x0a9f59e0 in ?? ()
#28 0x00000000 in ?? ()
#29 0x00000003 in ?? ()
#30 0x00000016 in ?? ()
#31 0x00000002 in ?? ()
#32 0x2859c03b in ?? ()
#33 0x0000001f in ?? ()
#34 0x00000292 in ?? ()
#35 0xbf671490 in ?? ()
#36 0x0000002f in ?? ()
#37 0x00000000 in ?? ()
#38 0x00000000 in ?? ()
#39 0x00000000 in ?? ()
#40 0x00000000 in ?? ()
#41 0x7c74e000 in ?? ()
#42 0xc37d254c in ?? ()
#43 0xc3ecd480 in ?? ()
#44 0xf0d019c4 in ?? ()
#45 0xf0d019ac in ?? ()
#46 0xc3437180 in ?? ()
#47 0xc0671d82 in sched_switch (td=0xbf671534, newtd=0x285484bc, flags=Cannot 
access memory at address 0xbf6714bc
) at /usr/src/sys/kern/sched_4bsd.c:881

Best regards,
Jimmy Mäkelä
____________________________

Loopia AB
Tfn: +46 (0)21 128222
Fax: +46 (0)21 128233
Email: support_at_loopia.se
Www: http://www.loopia.se 
Received on Mon Mar 13 2006 - 10:35:17 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:38:53 UTC