Recurring panic

Hi

I have the following recurring panic on all my heavily network
loaded -CURRENT routers.  The current process is always different.

Gleb, can you please chime in with what you've managed to uncover.

Unread portion of the kernel message buffer:
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 21363 (kgdb)
trap number             = 12
panic: page fault
cpuid = 1
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff846b4de530
panic() at panic+0x13d/frame 0xffffff846b4de630
trap_fatal() at trap_fatal+0x290/frame 0xffffff846b4de690
trap_pfault() at trap_pfault+0x21f/frame 0xffffff846b4de6f0
trap() at trap+0x2b4/frame 0xffffff846b4de830
calltrap() at calltrap+0x8/frame 0xffffff846b4de830
--- trap 0xc, rip = 0xffffffff8044872d, rsp = 0xffffff846b4de8f0, rbp = 0xffffff846b4de910 ---
__mtx_lock_sleep() at __mtx_lock_sleep+0x5d/frame 0xffffff846b4de910
selfdfree() at selfdfree+0xef/frame 0xffffff846b4de930
sys_poll() at sys_poll+0x332/frame 0xffffff846b4dead0
amd64_syscall() at amd64_syscall+0x572/frame 0xffffff846b4debf0
Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff846b4debf0
--- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80160670a, rsp = 0x7fffffffcc68, rbp = 0 ---
Uptime: 3d5h49m17s
Dumping 2580 out of 16368 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%

#0  doadump (textdump=1) at /usr/src/sys/kern/kern_shutdown.c:264
264             if (textdump && textdump_pending) {
(kgdb) #0  doadump (textdump=1) at /usr/src/sys/kern/kern_shutdown.c:264
#1  0xffffffff8045a424 in kern_reboot (howto=260)
    at /usr/src/sys/kern/kern_shutdown.c:447
#2  0xffffffff8045a927 in panic (fmt=<value optimized out>)
    at /usr/src/sys/kern/kern_shutdown.c:754
#3  0xffffffff8061e950 in trap_fatal (frame=0xc, eva=<value optimized out>)
    at /usr/src/sys/amd64/amd64/trap.c:872
#4  0xffffffff8061ecbf in trap_pfault (frame=0xffffff846b4de840, usermode=0)
    at /usr/src/sys/amd64/amd64/trap.c:789
#5  0xffffffff8061f074 in trap (frame=0xffffff846b4de840)
    at /usr/src/sys/amd64/amd64/trap.c:463
#6  0xffffffff806088ef in calltrap ()
    at /usr/src/sys/amd64/amd64/exception.S:228
#7  0xffffffff8044872d in __mtx_lock_sleep (c=0xffffff8006e551e8, 
    tid=18446741875506397184, opts=<value optimized out>, 
    file=<value optimized out>, line=0) at /usr/src/sys/kern/kern_mutex.c:425
#8  0xffffffff804a574f in selfdfree (stp=<value optimized out>, 
    sfp=0xfffffe02bbf92690) at /usr/src/sys/kern/sys_generic.c:1524
#9  0xffffffff804a6e82 in sys_poll (td=0xfffffe0030e1c000, 
    uap=0xffffff846b4deb70) at /usr/src/sys/kern/sys_generic.c:1369
#10 0xffffffff8061e2b2 in amd64_syscall (td=0xfffffe0030e1c000, traced=0)
    at subr_syscall.c:134
#11 0xffffffff80608bd7 in Xfast_syscall ()
    at /usr/src/sys/amd64/amd64/exception.S:387
#12 0x000000080160670a in ?? ()
Previous frame inner to this frame (corrupt stack?)
(kgdb) 


Ian

-- 
Ian Freislich