Re: Heavy I/O blocks FreeBSD box for several seconds

From: Rick Macklem <rmacklem_at_uoguelph.ca>
Date: Mon, 25 Jul 2011 17:44:04 -0400 (EDT)
Steve Kargl wrote:
> On Mon, Jul 25, 2011 at 01:00:27PM +0300, Andriy Gapon wrote:
> > on 12/07/2011 11:05 Andriy Gapon said the following:
> > > I think that the best thing you can further provide (as objective
> > > evidence for
> > > the problem at hand) is ktr(4) traces for at least KTR_SCHED mask.
> > > Perhaps you
> > > even already have them from your previous sessions with Jeff.
> > >
> > > P.S. This is not a promise to actually debug this issue based on
> > > the traces :-)
> >
> > So do you have an opportunity to provide this kind of information?
> > Actually I would like KTR_SCHED|KTR_INTR|KTR_PROC|KTR_SYSC mask.
> > Also, sysctl kern.sched output would be useful too.
> > This is for the ULE case, of course.
> >
> 
> I won't have time until next week to investigate.
> 
hrs sent me this panic. I'm wondering if it might be relevant to this?
spin lock 0xffffffff80cb52c0 (sched lock 1) held by 0xffffff0012c7f8c0 (tid 100317) too long
panic: spin lock held too long
cpuid = 0
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2a
kdb_backtrace() at kdb_backtrace+0x37
panic() at panic+0x187
_mtx_lock_spin_failed() at _mtx_lock_spin_failed+0x39
_mtx_lock_spin() at _mtx_lock_spin+0x9e
sched_add() at sched_add+0x117
setrunnable() at setrunnable+0x78
sleepq_signal() at sleepq_signal+0x7a
cv_signal() at cv_signal+0x3b
xprt_active() at xprt_active+0xe3
svc_vc_soupcall() at svc_vc_soupcall+0xc
sowakeup() at sowakeup+0x69
tcp_do_segment() at tcp_do_segment+0x2cbd
tcp_input() at tcp_input+0xcdd
ip_input() at ip_input+0xac
netisr_dispatch_src() at netisr_dispatch_src+0x7e
ether_demux() at ether_demux+0x14d
ether_input() at ether_input+0x17d
em_rxeof() at em_rxeof+0x1ca
em_handle_que() at em_handle_que+0x5b
taskqueue_run_locked() at taskqueue_run_locked+0x85
taskqueue_thread_loop() at taskqueue_thread_loop+0x4e
fork_exit() at fork_exit+0x11f
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8000160d00, rbp = 0 ---
KDB: enter: panic
[thread pid 0 tid 100033 ]
Stopped at      kdb_enter+0x3b: movq    $0,0x6b4e62(%rip)
db> ps
Received on Mon Jul 25 2011 - 19:44:05 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:40:16 UTC