deadlock in -current

From: Kris Kennaway <kris_at_obsecurity.org>
Date: Fri, 23 Sep 2005 23:43:22 -0400
Since updating my (UP i386) machines yesterday they're all hanging
after a few hours of load with all processes in the following states:

db> ps
  pid   proc     uid  ppid  pgrp  flag   stat  wmesg    wchan  cmd
28397 c5267a3c    0 28396 28397 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28396 c5267c48    0   386   386 0000000 [SLPQ ppwait 0xc5267c48][SLP] cron
28395 c4f5a624 65534   572 28395 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd
28394 c4f5a830    2 28393 28394 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28393 c4f5aa3c    0   386   386 0000000 [SLPQ ppwait 0xc4f5aa3c][SLP] cron
28392 c4f5ac48    0   371 28392 0000100 [SLPQ vmmaps 0xc1027178][SLP] sshd
28391 c5244000 65534   572 28391 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd
28390 c524420c    0 28389 28390 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28389 c5244418    0   386   386 0000000 [SLPQ ppwait 0xc5244418][SLP] cron
28388 c5244624 65534   572 28388 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd
28387 c5244830    0 28386 28387 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28386 c5244a3c    0   386   386 0000000 [SLPQ ppwait 0xc5244a3c][SLP] cron
28385 c5244c48 65534   572 28385 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd
28384 c5246000    2 28383 28384 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28383 c524620c    0   386   386 0000000 [SLPQ ppwait 0xc524620c][SLP] cron
28382 c5246418    0   371 28382 0000100 [SLPQ vmmaps 0xc1027178][SLP] sshd
28381 c5246624 65534   572 28381 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd
28380 c5246830    0 28379 28380 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28379 c4192830    0   386   386 0000000 [SLPQ ppwait 0xc4192830][SLP] cron
28378 c4191000    0   371 28378 0000100 [SLPQ vmmaps 0xc1027178][SLP] sshd
28377 c419220c 65534   572 28377 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd
28376 c4191624    0 28375 28376 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28375 c4f59c48    0   386   386 0000000 [SLPQ ppwait 0xc4f59c48][SLP] cron
28374 c4f5a000 65534   572 28374 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd
28373 c4192418    0   371 28373 0000100 [SLPQ vmmaps 0xc1027178][SLP] sshd
28372 c4f5a20c    2 28371 28372 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28371 c4f59624    0   386   386 0000000 [SLPQ ppwait 0xc4f59624][SLP] cron
28370 c4191830    0 28369 28370 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28369 c4192a3c    0   386   386 0000000 [SLPQ ppwait 0xc4192a3c][SLP] cron
28368 c2707c48 65534   572 28368 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd
28367 c4192c48 65534   572 28367 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd
28366 c4f59a3c    0 28365 28366 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28365 c2707624    0   386   386 0000000 [SLPQ ppwait 0xc2707624][SLP] cron
28364 c24fcc48    0   371 28364 0000100 [SLPQ vmmaps 0xc1027178][SLP] sshd
28363 c4f5a418 65534   572 28363 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd
28362 c2e75a3c    0 28359 28362 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28361 c418d418    2 28358 28361 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28360 c4192000    0 28357 28360 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28359 c4f59418    0   386   386 0000000 [SLPQ ppwait 0xc4f59418][SLP] cron
28358 c24fc20c    0   386   386 0000000 [SLPQ ppwait 0xc24fc20c][SLP] cron
28357 c2e7520c    0   386   386 0000000 [SLPQ ppwait 0xc2e7520c][SLP] cron
28356 c4191418 65534   572 28356 0000100 [SLPQ vmmaps 0xc1027178][SLP] inetd
28355 c4f59830    0 28353 28355 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28354 c4191c48    2 28352 28354 0000110 [SLPQ vmmaps 0xc1027178][SLP] cron
28353 c418da3c    0   386   386 0000000 [SLPQ ppwait 0xc418da3c][SLP] cron
28352 c24fc830    0   386   386 0000000 [SLPQ ppwait 0xc24fc830][SLP] cron
28350 c4f59000    0 26659  4286 0000000 [SLPQ vmmaps 0xc1027178][SLP] sh
26659 c4192624    0  5172  4286 0004000 [SLPQ wait 0xc4192624][SLP] sh
 5172 c2e75418    0  5171  4286 0004000 [SLPQ wait 0xc2e75418][SLP] sh
 5171 c2e72624    0  5170  4286 0000000 [SLPQ wait 0xc2e72624][SLP] sh
 5170 c418d830    0  5092  4286 0004000 [SLPQ wait 0xc418d830][SLP] sh
 5092 c2e7220c    0  5091  4286 0004000 [SLPQ wait 0xc2e7220c][SLP] make
 5091 c24fb20c    0  5068  4286 0004000 [SLPQ wait 0xc24fb20c][SLP] sh
 5069 c418d624    0  5067  4286 0000000 [SLPQ nanslp 0xc078ca6c][SLP] pnohang
 5068 c419120c    0  5067  4286 0004000 [SLPQ wait 0xc419120c][SLP] make
 5067 c418d000    0  4662  4286 0004000 [SLPQ wait 0xc418d000][SLP] pnohang
 4662 c418d20c    0  4309  4286 0004000 [SLPQ wait 0xc418d20c][SLP] sh
 4309 c2e75c48    0  4286  4286 0004000 [SLPQ wait 0xc2e75c48][SLP] sh
 4286 c418dc48    0  4248  4286 0004000 [SLPQ pause 0xc418dc7c][SLP] csh
 4248 c4191a3c    0   371  4248 0004100 [SLPQ select 0xc07d7584][SLP] sshd
  592 c270720c    0     1   592 0004002 [SLPQ ttyin 0xc23b8410][SLP] getty
  591 c2e75000    0     1   591 0004002 [SLPQ ttyin 0xc23b4810][SLP] getty
  590 c2e72a3c    0     1   590 0004002 [SLPQ ttyin 0xc23b4c10][SLP] getty
  589 c2e72830    0     1   589 0004002 [SLPQ ttyin 0xc238cc10][SLP] getty
  588 c24fc624    0     1   588 0004002 [SLPQ ttyin 0xc2387c10][SLP] getty
  587 c230a830    0     1   587 0004002 [SLPQ ttyin 0xc238c810][SLP] getty
  586 c2707000    0     1   586 0004002 [SLPQ ttyin 0xc2387010][SLP] getty
  585 c2707a3c    0     1   585 0004002 [SLPQ ttyin 0xc238c010][SLP] getty
  584 c2e72000    0     1   584 0004002 [SLPQ ttyin 0xc238bc10][SLP] getty
  572 c2e72c48    0     1   572 0000000 [SLPQ select 0xc07d7584][SLP] inetd
  554 c2e72418  100   540   554 0004000 [SLPQ piperd 0xc259c000][SLP] unlinkd
  540 c2e75830  100   538   538 0004000 [SLPQ select 0xc07d7584][SLP] squid
  538 c2e75624  100     1   538 0000000 [SLPQ wait 0xc2e75624][SLP] squid
  386 c2707418    0     1   386 0000000 [SLPQ nanslp 0xc078ca6c][SLP] cron
  371 c230a624    0     1   371 0000100 [SLPQ select 0xc07d7584][SLP] sshd
  356 c24fb000    0     1   356 0000000 [SLPQ select 0xc07d7584][SLP] ntpd
  280 c24fca3c    0     0     0 0000204 [SLPQ mdwait 0xc28bd000][SLP] md2
  247 c24fc418    0     1   247 0000000 [SLPQ select 0xc07d7584][SLP] syslogd
  229 c230ac48    0     1   229 0000000 [SLPQ select 0xc07d7584][SLP] devd
  117 c2707830    0     0     0 0000204 [SLPQ mdwait 0xc2648000][SLP] md1
   72 c230aa3c    0     0     0 0000204 [SLPQ mdwait 0xc2324800][SLP] md0
   44 c24fb418    0     0     0 0000204 [SLPQ - 0xe504dcf8][SLP] schedcpu
   43 c24fb624    0     0     0 0000204 [SLPQ - 0xc07e05cc][SLP] nfsiod 3
   42 c24fb830    0     0     0 0000204 [SLPQ - 0xc07e05c8][SLP] nfsiod 2
   41 c24fba3c    0     0     0 0000204 [SLPQ - 0xc07e05c4][SLP] nfsiod 1
   40 c24fbc48    0     0     0 0000204 [SLPQ - 0xc07e05c0][SLP] nfsiod 0
   39 c24fc000    0     0     0 0000204 [SLPQ syncer 0xc078c7dc][SLP] syncer
   38 c22c3c48    0     0     0 0000204 [SLPQ vlruwt 0xc22c3c48][SLP] vnlru
   37 c2309000    0     0     0 0000204 [SLPQ psleep 0xc07d7acc][SLP] bufdaemon
   36 c230920c    0     0     0 000020c [SLPQ pgzero 0xc07e1a04][SLP] pagezero
    9 c2309418    0     0     0 0000204 [SLPQ psleep 0xc07e1554][SLP] vmdaemon
    8 c2309624    0     0     0 0000204 [SLPQ psleep 0xc07e1510][SLP] pagedaemon
   35 c2309830    0     0     0 0000204 [IWAIT] swi0: sio
    7 c2309a3c    0     0     0 0000204 [SLPQ - 0xc230e23c][SLP] fdc0
   34 c2309c48    0     0     0 0000204 [IWAIT] swi6:+
   33 c230a000    0     0     0 0000204 [IWAIT] swi6: task queue
   32 c230a20c    0     0     0 0000204 [IWAIT] swi2: cambio
    6 c230a418    0     0     0 0000204 [SLPQ - 0xc226d680][SLP] kqueue taskq
   31 c22b4624    0     0     0 0000204 [IWAIT] swi5:+
    5 c22b4830    0     0     0 0000204 [SLPQ - 0xc226d800][SLP] thread taskq
   30 c22b4a3c    0     0     0 0000204 [SLPQ - 0xc0721480][SLP] yarrow
    4 c22b4c48    0     0     0 0000204 [SLPQ - 0xc0721f28][SLP] g_down
    3 c22c3000    0     0     0 0000204 [SLPQ - 0xc0721f24][SLP] g_up
    2 c22c320c    0     0     0 0000204 [SLPQ - 0xc0721f1c][SLP] g_event
   29 c22c3418    0     0     0 0000204 [IWAIT] swi3: vm
   28 c22c3624    0     0     0 000020c [IWAIT] swi4: clock sio
   27 c22c3830    0     0     0 0000204 [IWAIT] swi1: net
   26 c22c3a3c    0     0     0 0000204 [IWAIT] irq15: ata1
   25 c227420c    0     0     0 0000204 [IWAIT] irq14: ata0
   24 c2274418    0     0     0 0000204 [IWAIT] irq13:
   23 c2274624    0     0     0 0000204 [IWAIT] irq12:
   22 c2274830    0     0     0 0000204 [IWAIT] irq11: fxp1
   21 c2274a3c    0     0     0 0000204 [IWAIT] irq10: fxp0
   20 c2274c48    0     0     0 0000204 [IWAIT] irq9:
   19 c22b4000    0     0     0 0000204 [IWAIT] irq8: rtc
   18 c22b420c    0     0     0 0000204 [IWAIT] irq7:
   17 c22b4418    0     0     0 0000204 [IWAIT] irq6: fdc0
   16 c226e000    0     0     0 0000204 [IWAIT] irq5:
   15 c226e20c    0     0     0 0000204 [IWAIT] irq4: sio0
   14 c226e418    0     0     0 0000204 [IWAIT] irq3: sio1
   13 c226e624    0     0     0 0000204 [IWAIT] irq1: atkbd0
   12 c226e830    0     0     0 0000204 [IWAIT] irq0: clk
   11 c226ea3c    0     0     0 000020c [CPU 0] idle
    1 c226ec48    0     0     1 0004200 [SLPQ wait 0xc226ec48][SLP] init
   10 c2274000    0     0     0 0000204 [SLPQ ktrace 0xc078a9b8][SLP] ktrace
    0 c0722020    0     0     0 0000200 [IWAIT] swapper
28351 c4f5920c    0 28350  4286 0002000 zomb[INACTIVE] sh
db> wh 28397
Tracing pid 28397 tid 100138 td 0xc5265780
sched_switch(c5265780,0,1,11e,ffcfb3b8) at sched_switch+0x190
mi_switch(1,0,c06cbd2a,1a7,0) at mi_switch+0x2e6
sleepq_switch(c1027178,c06c863b,18b,0,e75cac10) at sleepq_switch+0x134
sleepq_wait(c1027178,0,c06c999b,da,0) at sleepq_wait+0x41
msleep(c1027178,c07e1120,244,c06e00d5,0) at msleep+0x405
vm_map_unlock_and_wait(c10270c0,0,42000,e75cac5c,302) at vm_map_unlock_and_wait+0x74
kmem_alloc_wait(c10270c0,41400,c2e27220,c2523cc0,1) at kmem_alloc_wait+0x97
exec_copyin_args(e75cacac,80560e6,0,bfbfe6c0,8052140) at exec_copyin_args+0x44
execve(c5265780,e75cad04,c,424,3) at execve+0x32
syscall(3b,3b,3b,bfbfe6f8,bfbfe6c0) at syscall+0x2c0
Xint0x80_syscall() at Xint0x80_syscall+0x1f
--- syscall (59, FreeBSD ELF32, execve), eip = 0x280e55d3, esp = 0xbfbfe6ac, ebp = 0xbfbfe6e8 ---
db> wh 28396
Tracing pid 28396 tid 100139 td 0xc5265600
sched_switch(c5265600,0,1,11e,b8c08f58) at sched_switch+0x190
mi_switch(1,0,c06cbd2a,1a7,0) at mi_switch+0x2e6
sleepq_switch(c5267c48,c06c863b,18b,0,e75c7c74) at sleepq_switch+0x134
sleepq_wait(c5267c48,0,c06c999b,da,0) at sleepq_wait+0x41
msleep(c5267c48,c5267aa4,5c,c06c696c,0) at msleep+0x405
fork1(c5265600,80000034,0,e75c7ccc,c5265600) at fork1+0x1283
vfork(c5265600,e75c7d04,c06e7254,424,0) at vfork+0x29
syscall(3b,3b,3b,1,8052060) at syscall+0x2c0
Xint0x80_syscall() at Xint0x80_syscall+0x1f
--- syscall (66, FreeBSD ELF32, vfork), eip = 0x280d08e0, esp = 0xbfbfe6f0, ebp = 0xbfbfecc8 ---
db> wh 37
Tracing pid 37 tid 100028 td 0xc22c4000
sched_switch(c22c4000,0,1,11e,d240727c) at sched_switch+0x190
mi_switch(1,0,c06cbd2a,1a7,1) at mi_switch+0x2e6
sleepq_switch(c07d7acc,1,c06c863b,18b,1) at sleepq_switch+0x134
sleepq_timedwait(c07d7acc,0,c06c999b,da,0) at sleepq_timedwait+0x42
msleep(c07d7acc,c07d7ae0,44,c06d0cf2,64) at msleep+0x3e1
buf_daemon(0,e502cd38,c06c68ef,30d,0) at buf_daemon+0x168
fork_exit(c05422c0,0,e502cd38) at fork_exit+0xc1
fork_trampoline() at fork_trampoline+0x8
--- trap 0x1, eip = 0, esp = 0xe502cd6c, ebp = 0 ---
db> wh 9
Tracing pid 9 tid 100030 td 0xc2275c00
sched_switch(c2275c00,0,1,11e,98d498b8) at sched_switch+0x190
mi_switch(1,0,c06cbd2a,1a7,1) at mi_switch+0x2e6
sleepq_switch(c07e1554,c06c863b,18b,1,e360ccc4) at sleepq_switch+0x134
sleepq_wait(c07e1554,0,c06c999b,da,0) at sleepq_wait+0x41
msleep(c07e1554,0,68,c06d0cf2,0) at msleep+0x405
vm_daemon(0,e360cd38,c06c68ef,30d,0) at vm_daemon+0x59
fork_exit(c064cb10,0,e360cd38) at fork_exit+0xc1
fork_trampoline() at fork_trampoline+0x8
--- trap 0x1, eip = 0, esp = 0xe360cd6c, ebp = 0 ---
db> wh 8
Tracing pid 8 tid 100031 td 0xc2275a80
sched_switch(c2275a80,0,1,11e,632b4356) at sched_switch+0x190
mi_switch(1,0,c06cbd2a,1a7,0) at mi_switch+0x2e6
sleepq_switch(c07e1510,1,c06c863b,18b,0) at sleepq_switch+0x134
sleepq_timedwait(c07e1510,0,c06c999b,da,0) at sleepq_timedwait+0x42
msleep(c07e1510,c07e14e0,44,c06d0cf2,1f4) at msleep+0x3e1
vm_pageout(0,e3609d38,c06c68ef,30d,0) at vm_pageout+0x2a0
fork_exit(c064c760,0,e3609d38) at fork_exit+0xc1
fork_trampoline() at fork_trampoline+0x8
--- trap 0x1, eip = 0, esp = 0xe3609d6c, ebp = 0 ---
db> wh 0
Tracing pid 0 tid 0 td 0xc0722240
sched_switch(c0722240,0,1,11e,8b861914) at sched_switch+0x190
mi_switch(1,0,c06dfcb2,28b,c06eb678) at mi_switch+0x2e6
scheduler(0,c1e000,c1ec00,c1e000,0) at scheduler+0x220
mi_startup() at mi_startup+0xb5
begin() at begin+0x2c
db> show alllocks
db> show lockedvnods
Locked vnodes
db> show witness
Sleep locks:
0 md bio queue -- last acquired _at_ dev/md/md.c:659
0 devfsmount -- last acquired _at_ fs/devfs/devfs_vnops.c:575
15 cdev -- last acquired _at_ kern/kern_conf.c:62
16  UMA zone -- last acquired _at_ vm/uma_core.c:2268
16 UMA zone -- (already displayed)
1  devfsrules -- last acquired _at_ fs/devfs/devfs_rule.c:140
11 system map -- last acquired _at_ vm/vm_kern.c:295
13  vm page queue mutex -- last acquired _at_ vm/vm_pageout.c:1498
14   vnode interlock -- last acquired _at_ kern/vfs_subr.c:2185
15    cdev -- (already displayed)
15    vnode_free_list -- last acquired _at_ kern/vfs_subr.c:701
15    Syncer mtx -- last acquired _at_ kern/vfs_subr.c:1692
14   pmap -- last acquired _at_ i386/i386/pmap.c:2667
16    UMA zone -- (already displayed)
15    uma object -- last acquired _at_ vm/uma_core.c:985
15    SYSMAPS -- last acquired _at_ i386/i386/pmap.c:2478
16   UMA zone -- (already displayed)
15   SYSMAPS -- (already displayed)
12  kmem object -- last acquired _at_ vm/vm_kern.c:397
15   SYSMAPS -- (already displayed)
13   vm page queue mutex -- (already displayed)
12  KMAP ENTRY -- last acquired _at_ vm/uma_core.c:413
15  SYSMAPS -- (already displayed)
12  kernel object -- last acquired _at_ kern/vfs_bio.c:3545
15   SYSMAPS -- (already displayed)
13   vm page queue mutex -- (already displayed)
14  pmap -- (already displayed)
15  uma object -- (already displayed)
16  UMA zone -- (already displayed)
5  eventhandler -- last acquired _at_ kern/subr_eventhandler.c:212
6   eventhandler list -- last acquired _at_ kern/kern_exit.c:199
6  eventhandler list -- (already displayed)
15 vnode_free_list -- (already displayed)
7  struct mount mtx -- last acquired _at_ kern/vfs_vnops.c:964
14  vnode interlock -- (already displayed)
14 vnode interlock -- (already displayed)
5  Name Cache -- last acquired _at_ kern/vfs_cache.c:356
14  vnode interlock -- (already displayed)
16  UMA zone -- (already displayed)
11  system map -- (already displayed)
10 process lock -- last acquired _at_ kern/subr_sleepqueue.c:369
11  session -- last acquired _at_ kern/kern_prot.c:2046
12   uidinfo hash -- last acquired _at_ kern/kern_resource.c:1032
13    uidinfo struct -- last acquired _at_ order list:0
14     allprison -- last acquired _at_ kern/kern_jail.c:537
13    sleep mtxpool -- last acquired _at_ kern/kern_prot.c:1876
12   tty -- last acquired _at_ kern/kern_event.c:1643
11  sigacts -- last acquired _at_ kern/subr_sleepqueue.c:370
13  sleep mtxpool -- (already displayed)
11  ktrace -- last acquired _at_ kern/kern_fork.c:590
11  struct pargs.ref -- last acquired _at_ kern/kern_proc.c:1111
3  user map -- last acquired _at_ vm/vm_glue.c:180
16  UMA zone -- (already displayed)
11  system map -- (already displayed)
6   vm object_list -- last acquired _at_ vm/vm_object.c:229
5   standard object -- last acquired _at_ kern/vfs_bio.c:3363
13   vm page queue mutex -- (already displayed)
14   vnode interlock -- (already displayed)
15   SYSMAPS -- (already displayed)
6    vm object_list -- (already displayed)
16   UMA zone -- (already displayed)
14   pmap -- (already displayed)
13  vm page queue mutex -- (already displayed)
14  vnode interlock -- (already displayed)
14  pmap -- (already displayed)
4   Giant -- last acquired _at_ kern/kern_timeout.c:258
5    filedesc structure -- last acquired _at_ kern/sys_generic.c:1036
6     pipe mutex -- last acquired _at_ kern/sys_pipe.c:1342
7      sigio lock -- last acquired _at_ kern/kern_descrip.c:741
8       process group -- last acquired _at_ kern/kern_proc.c:390
10       process lock -- (already displayed)
11       session -- (already displayed)
16       UMA zone -- (already displayed)
9        ttylist -- last acquired _at_ kern/tty.c:2806
12        tty -- (already displayed)
10     sellck -- last acquired _at_ kern/sys_generic.c:944
13     vm page queue mutex -- (already displayed)
7     accept -- last acquired _at_ kern/uipc_socket.c:480
8      so_snd -- last acquired _at_ kern/uipc_socket.c:2003
9       so_rcv -- last acquired _at_ kern/uipc_socket.c:2004
10       sellck -- (already displayed)
10       radix node head -- last acquired _at_ net/route.c:148
11        rtentry -- last acquired _at_ net/route.c:197
12         ifaddr -- last acquired _at_ net/route.c:791
16         UMA zone -- (already displayed)
16        UMA zone -- (already displayed)
11        system map -- (already displayed)
11        ifnet -- last acquired _at_ net/if.c:1166
16         UMA zone -- (already displayed)
12         arc4_mtx -- last acquired _at_ libkern/arc4random.c:137
10       process lock -- (already displayed)
13       sleep mtxpool -- (already displayed)
16       UMA zone -- (already displayed)
11       system map -- (already displayed)
13      sleep mtxpool -- (already displayed)
16      UMA zone -- (already displayed)
10      radix node head -- (already displayed)
11      rtentry -- (already displayed)
9       tcp_hc_entry -- last acquired _at_ netinet/tcp_hostcache.c:654
16       UMA zone -- (already displayed)
11       system map -- (already displayed)
10      sellck -- (already displayed)
11      system map -- (already displayed)
9      so_rcv -- (already displayed)
14    vnode interlock -- (already displayed)
13    sleep mtxpool -- (already displayed)
16   UMA zone -- (already displayed)
11   system map -- (already displayed)
9    UMA boot pages -- last acquired _at_ vm/uma_core.c:915
5    UMA lock -- last acquired _at_ vm/uma_core.c:1491
16    UMA zone -- (already displayed)
12    KMAP ENTRY -- (already displayed)
11    system map -- (already displayed)
5    eventhandler -- (already displayed)
6    eventhandler list -- (already displayed)
5    kobj -- last acquired _at_ kern/subr_kobj.c:307
5    kernel linker -- last acquired _at_ kern/kern_linker.c:440
12   kernel object -- (already displayed)
10   process lock -- (already displayed)
6    vm object_list -- (already displayed)
12   KMAP ENTRY -- (already displayed)
12   uidinfo hash -- (already displayed)
13   sleep mtxpool -- (already displayed)
5    standard object -- (already displayed)
5    TID lock -- last acquired _at_ kern/subr_unit.c:592
5    ithread -- last acquired _at_ kern/kern_intr.c:275
15   cdev -- (already displayed)
5    GEOM orphanage -- last acquired _at_ geom/geom_event.c:196
9    ttylist -- (already displayed)
5    taskqueue list -- last acquired _at_ kern/subr_taskqueue.c:90
5    rman head -- last acquired _at_ kern/subr_rman.c:111
5    rman -- last acquired _at_ kern/subr_rman.c:449
16    UMA zone -- (already displayed)
11    system map -- (already displayed)
5    devd -- last acquired _at_ kern/subr_bus.c:488
10    sellck -- (already displayed)
10   sellck -- (already displayed)
13   vm page queue mutex -- (already displayed)
5    bounce pages lock -- last acquired _at_ i386/i386/busdma_machdep.c:1041
11   ifnet -- (already displayed)
5    bpf global lock -- last acquired _at_ net/bpf.c:1548
6     bpf interface lock -- last acquired _at_ order list:0
7      bpf cdev lock -- last acquired _at_ order list:0
14   pmap -- (already displayed)
5    vm86 lock -- last acquired _at_ i386/i386/vm86.c:583
5    unit# allocation -- last acquired _at_ kern/subr_unit.c:719
16    UMA zone -- (already displayed)
5    pseudofs -- last acquired _at_ fs/pseudofs/pseudofs_fileno.c:55
7    random reseed -- last acquired _at_ dev/random/yarrow.c:193
12   arc4_mtx -- (already displayed)
5    if_clone lock -- last acquired _at_ net/if_clone.c:318
5    if_cloners lock -- last acquired _at_ net/if_clone.c:199
5    domain list -- last acquired _at_ kern/uipc_domain.c:224
8    pfil_head_list lock -- last acquired _at_ net/pfil.c:228
7    pfil_head_mtx -- last acquired _at_ net/pfil.c:71
8     pfil_head_list lock -- (already displayed)
5    tcp -- last acquired _at_ netinet/tcp_subr.c:1403
6     tcpinp -- last acquired _at_ netinet/tcp_input.c:742
8      so_snd -- (already displayed)
16     UMA zone -- (already displayed)
9      so_rcv -- (already displayed)
7      accept -- (already displayed)
11     system map -- (already displayed)
7      random reseed -- (already displayed)
12     arc4_mtx -- (already displayed)
10     radix node head -- (already displayed)
11     rtentry -- (already displayed)
9      tcp_hc_entry -- (already displayed)
7      pfil_head_mtx -- (already displayed)
7      IPFW static rules -- last acquired _at_ netinet/ip_fw2.c:157
9      if send queue -- last acquired _at_ dev/fxp/if_fxp.c:1218
8      network driver -- last acquired _at_ dev/fxp/if_fxp.c:1715
9       if_addr_mtx -- last acquired _at_ netinet6/ip6_output.c:746
16       UMA zone -- (already displayed)
9       taskqueue -- last acquired _at_ kern/subr_taskqueue.c:219
9       if send queue -- (already displayed)
16      UMA zone -- (already displayed)
9       UMA boot pages -- (already displayed)
11      system map -- (already displayed)
7      so_glabel -- last acquired _at_ kern/uipc_socket.c:267
13     sleep mtxpool -- (already displayed)
7      if_afdata -- last acquired _at_ netinet6/scope6.c:415
8       scope6_lock -- last acquired _at_ netinet6/scope6.c:444
7      ip6_inq -- last acquired _at_ net/netisr.c:232
7      ip_inq -- last acquired _at_ net/netisr.c:232
10    radix node head -- (already displayed)
7     pfil_head_mtx -- (already displayed)
7     IPFW static rules -- (already displayed)
11    rtentry -- (already displayed)
9     if send queue -- (already displayed)
8     network driver -- (already displayed)
8     so_snd -- (already displayed)
16    UMA zone -- (already displayed)
11    system map -- (already displayed)
13    sleep mtxpool -- (already displayed)
7     if_afdata -- (already displayed)
9     tcp_hc_entry -- (already displayed)
7     ip6_inq -- (already displayed)
10   radix node head -- (already displayed)
5    lo_mtx -- last acquired _at_ net/if_loop.c:160
7    IPFW static rules -- (already displayed)
5    ATA queue lock -- last acquired _at_ dev/ata/ata-queue.c:168
6     ATA state lock -- last acquired _at_ dev/ata/ata-all.c:327
12   tty -- (already displayed)
5    devstat -- last acquired _at_ kern/subr_devstat.c:83
7    buffer daemon lock -- last acquired _at_ kern/vfs_bio.c:2003
15   vnode_free_list -- (already displayed)
15   Syncer mtx -- (already displayed)
6    Softdep Lock -- last acquired _at_ ufs/ffs/ffs_softdep.c:675
16    UMA zone -- (already displayed)
9     UMA boot pages -- (already displayed)
11    system map -- (already displayed)
14    vnode interlock -- (already displayed)
7     buffer daemon lock -- (already displayed)
6    mountlist -- last acquired _at_ kern/vfs_subr.c:3050
7     struct mount mtx -- (already displayed)
7    struct mount mtx -- (already displayed)
5    mntid -- last acquired _at_ kern/vfs_subr.c:438
6     mountlist -- (already displayed)
14   vnode interlock -- (already displayed)
7    so_glabel -- (already displayed)
5    udp -- last acquired _at_ netinet/udp_usrreq.c:246
6     udpinp -- last acquired _at_ netinet/udp_usrreq.c:386
7      in_multi_mtx -- last acquired _at_ netinet/in.c:964
8       igmp_mtx -- last acquired _at_ netinet/igmp.c:443
9        if_addr_mtx -- (already displayed)
9       if_addr_mtx -- (already displayed)
8       network driver -- (already displayed)
16      UMA zone -- (already displayed)
8      so_snd -- (already displayed)
7      accept -- (already displayed)
12     arc4_mtx -- (already displayed)
16     UMA zone -- (already displayed)
10     radix node head -- (already displayed)
11     rtentry -- (already displayed)
9      so_rcv -- (already displayed)
7      pfil_head_mtx -- (already displayed)
7      IPFW static rules -- (already displayed)
9      if send queue -- (already displayed)
8      network driver -- (already displayed)
7      NFS reqq lock -- last acquired _at_ nfsclient/nfs_socket.c:1034
8       Synch NFS reply posting -- last acquired _at_ nfsclient/nfs_socket.c:582
16      UMA zone -- (already displayed)
10      process lock -- (already displayed)
11     ifnet -- (already displayed)
7      random reseed -- (already displayed)
7      ip_inq -- (already displayed)
11     system map -- (already displayed)
8     so_snd -- (already displayed)
16    UMA zone -- (already displayed)
11    system map -- (already displayed)
6     udp6inp -- last acquired _at_ netinet6/udp6_usrreq.c:743
16     UMA zone -- (already displayed)
7      accept -- (already displayed)
11     ifnet -- (already displayed)
10    radix node head -- (already displayed)
7     pfil_head_mtx -- (already displayed)
7     IPFW static rules -- (already displayed)
7     ip_inq -- (already displayed)
11    rtentry -- (already displayed)
8    network driver -- (already displayed)
9    if send queue -- (already displayed)
11   rtentry -- (already displayed)
7    in_multi_mtx -- (already displayed)
7    if_afdata -- (already displayed)
9    if_addr_mtx -- (already displayed)
12   ifaddr -- (already displayed)
7    sigio lock -- (already displayed)
7    accept -- (already displayed)
8    so_snd -- (already displayed)
9    so_rcv -- (already displayed)
6    udpinp -- (already displayed)
5    vfs hash -- last acquired _at_ kern/vfs_hash.c:71
14    vnode interlock -- (already displayed)
7    NFS reqq lock -- (already displayed)
8    Synch NFS reply posting -- (already displayed)
5    Name Cache -- (already displayed)
5    knlist lock for lockless objects -- last acquired _at_ kern/kern_event.c:1643
5    pbuf mutex -- last acquired _at_ vm/vm_pager.c:401
5    sf_buf -- last acquired _at_ i386/i386/vm_machdep.c:756
5    buf queue lock -- last acquired _at_ kern/vfs_bio.c:1398
14    vnode interlock -- (already displayed)
6     Softdep Lock -- (already displayed)
7     struct mount mtx -- (already displayed)
5    bdone lock -- last acquired _at_ kern/vfs_bio.c:3665
5    needsbuffer lock -- last acquired _at_ kern/vfs_bio.c:309
11   session -- (already displayed)
11   struct pargs.ref -- (already displayed)
5    fdesc -- last acquired _at_ kern/kern_descrip.c:1427
6    pipe mutex -- (already displayed)
5    bio queue -- last acquired _at_ geom/geom_io.c:68
5    FFS Lock -- last acquired _at_ ufs/ffs/ffs_vfsops.c:1039
12    arc4_mtx -- (already displayed)
5    runningbufspace lock -- last acquired _at_ kern/vfs_bio.c:328
5    rip -- last acquired _at_ netinet/raw_ip.c:198
8     so_snd -- (already displayed)
16    UMA zone -- (already displayed)
11    system map -- (already displayed)
5    unp -- last acquired _at_ kern/uipc_usrreq.c:250
8     so_snd -- (already displayed)
9     so_rcv -- (already displayed)
7     accept -- (already displayed)
5    ipqlock -- last acquired _at_ netinet/ip_input.c:1132
16    UMA zone -- (already displayed)
7    ip6_inq -- (already displayed)
9   UMA boot pages -- (already displayed)
7   struct mount mtx -- (already displayed)
5   buf queue lock -- (already displayed)
5   needsbuffer lock -- (already displayed)
6   Softdep Lock -- (already displayed)
7   buffer daemon lock -- (already displayed)
5   FFS Lock -- (already displayed)
4   vm map sleep mutex -- last acquired _at_ vm/vm_map.c:450
0 g_disk_done -- last acquired _at_ geom/geom_disk.c:198
16 UMA zone -- (already displayed)
5  bio queue -- (already displayed)
11 system map -- (already displayed)
0 MD config lock -- last acquired _at_ dev/md/md.c:1101
16 UMA zone -- (already displayed)
1  proctree -- last acquired _at_ kern/tty.c:842
2   allproc -- last acquired _at_ kern/sched_4bsd.c:441
10   process lock -- (already displayed)
5    fdesc -- (already displayed)
5    filedesc structure -- (already displayed)
14   vnode interlock -- (already displayed)
3    user map -- (already displayed)
8   process group -- (already displayed)
10  process lock -- (already displayed)
11  session -- (already displayed)
4   Giant -- (already displayed)
7   sigio lock -- (already displayed)
16  UMA zone -- (already displayed)
5  filedesc structure -- (already displayed)
10 process lock -- (already displayed)
5  eventhandler -- (already displayed)
5  UMA lock -- (already displayed)
1  GEOM topology -- last acquired _at_ geom/geom_event.c:228
5   GEOM orphanage -- (already displayed)
16  UMA zone -- (already displayed)
15  cdev -- (already displayed)
5   devstat -- (already displayed)
5   unit# allocation -- (already displayed)
11  system map -- (already displayed)
2   fdc lock -- last acquired _at_ dev/fdc/fdc.c:780
3    callout_wait_lock -- last acquired _at_ kern/kern_timeout.c:321
5   bio queue -- (already displayed)
5   bdone lock -- (already displayed)
6   vm object_list -- (already displayed)
14  vnode interlock -- (already displayed)
5   standard object -- (already displayed)
2   swapdev -- last acquired _at_ vm/swap_pager.c:2058
0 arp_inq -- last acquired _at_ net/netisr.c:232
0 ip6qlock -- last acquired _at_ netinet6/frag6.c:682
0 sem -- last acquired _at_ kern/sysv_sem.c:1268
0 p_peers -- last acquired _at_ kern/kern_exit.c:250
0 module subsystem sx lock -- last acquired _at_ kern/kern_module.c:315
0 protect sysfilt_ops -- last acquired _at_ kern/kern_event.c:739
0 kernel environment -- last acquired _at_ kern/kern_environment.c:286
0 sysctl lock -- last acquired _at_ kern/kern_sysctl.c:1349
16 UMA zone -- (already displayed)
10 process lock -- (already displayed)
3  user map -- (already displayed)
2  allproc -- (already displayed)
11 struct pargs.ref -- (already displayed)
15 cdev -- (already displayed)
1  filelist lock -- last acquired _at_ kern/kern_descrip.c:2129
13  sleep mtxpool -- (already displayed)
5   filedesc structure -- (already displayed)
5  GEOM orphanage -- (already displayed)
4  Giant -- (already displayed)
11 ktrace -- (already displayed)
5  kernel linker -- (already displayed)
1  malloc -- last acquired _at_ kern/kern_malloc.c:750
11 system map -- (already displayed)
5  devstat -- (already displayed)
9  ttylist -- (already displayed)
6  vm object_list -- (already displayed)
5  UMA lock -- (already displayed)
15 Syncer mtx -- (already displayed)
5  unp -- (already displayed)
5  tcp -- (already displayed)
5  udp -- (already displayed)
5  rip -- (already displayed)
1  addrsel_sxlock -- last acquired _at_ netinet6/in6_src.c:1031
1  linux osname -- last acquired _at_ compat/linux/linux_mib.c:231
14 allprison -- (already displayed)
11 ifnet -- (already displayed)
0 nfsd_mtx -- last acquired _at_ order list:0
8  so_snd -- (already displayed)
0 ddp_list_mtx -- last acquired _at_ order list:0
1  ddp_mtx -- last acquired _at_ order list:0
0 slip_mtx -- last acquired _at_ order list:0
1  slip sc_mtx -- last acquired _at_ order list:0

Spin locks:

Locks which were never acquired:
swap_pager swhash
IPFW dynamic rules
rts_inq
addrsel_lock
pseudofs_vncache
gif_mtx
ppp_softc_list_mtx
faith_mtx
tunmtx
msq
semid
nfs4dev state
nfs4dev waitq
nfs4dev newq
nullhs
CAM BIOQ lock
LED sx
LED mtx
nfslock
umtxq_lock
pmc shared lock
UUID generator mutex lock
rtsock route_cb lock
rawcb
accept_filter_mtx
kqueue order
accounting
securelevel mutex lock
fifo mutex
encapmtx
phys_pager list
dev_pager list
dev_pager create
swap_pager list
PMAP2
db> 

Anything else needed from DDB?

Kris

Received on Sat Sep 24 2005 - 02:11:01 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:38:44 UTC