Re: Seeing lock order reversal

From: pluknet <pluknet_at_gmail.com>
Date: Wed, 19 Mar 2008 00:03:09 +0300
On 18/03/2008, Attilio Rao <attilio_at_freebsd.org> wrote:
> 2008/3/18, pluknet <pluknet_at_gmail.com>:
>  > On 18/03/2008, Attilio Rao <attilio_at_freebsd.org> wrote:
>  >  > 2008/3/18, pluknet <pluknet_at_gmail.com>:
>  >  >  >
>  >
>  > >  >  Thought taking that into account I could obtain a new one yesterday. I
>  >  >  >  didn't see this before.
>  >  >  >
>  >  >  >  Mar 17 03:17:14 pl sudo:  pluknet : TTY=ttyv1 ; PWD=/usr/home/pluknet
>  >  >  >  ; USER=root ; COMMAND=/usr/libexec/getty 3wire.9600 ttyd0
>  >  >  >  Mar 17 03:17:14 pl kernel: lock order reversal:
>  >  >  >  Mar 17 03:17:14 pl kernel: 1st 0xc07e9274 proctree (proctree) _at_
>  >  >  >  /usr/src/sys/kern/kern_exit.c:291
>  >  >  >  Mar 17 03:17:14 pl kernel: 2nd 0xc2fc49e8 devfs (devfs) _at_
>  >  >  >  /usr/src/sys/kern/vfs_subr.c:2158
>  >  >
>  >  >
>  >  > This one seems interesting.
>  >  >  Next time you experience it can you please drop in DDB and print-out
>  >  >  the correct order revealed by WITNESS?
>  >  >
>  >
>  >
>  > Fortunately I could reproduce it.
>  >
>  >  lock order reversal:
>  >
>  >  1st 0xc07e9274 proctree (proctree) _at_ /usr/src/sys/kern/kern_exit.c:291
>  >
>  >  2nd 0xc3c18278 devfs (devfs) _at_ /usr/src/sys/kern/vfs_subr.c:2158
>  >  KDB: stack backtrace:
>  >  db_trace_self_wrapper(c07682d0,d6078b24,c0573236,c076a615,c3c18278,...)
>  >
>  > at db_trace_self_wrapper+0x26
>  >
>  > kdb_backtrace(c076a615,c3c18278,c075bcfb,c075bcfb,c0770a8c,...) at
>  >  kdb_backtrace+0x29
>  >  witness_checkorder(c3c18278,9,c0770a8c,86e,c07edcd4,...) at
>  >  witness_checkorder+0x6d6
>  >  _lockmgr_args(c3c18278,20002,c3c182a8,0,ffffffff,...) at _lockmgr_args+0x519
>  >  vop_stdlock(d6078bc4,d6078bbc,c0572a1c,20002,c3c182a8,...) at vop_stdlock+0x51
>  >  VOP_LOCK1_APV(c07a07e0,d6078bc4,851,d6078be4,c3c182a8,...) at VOP_LOCK1_APV+0xa5
>  >  _vn_lock(c3c18220,20002,c0770a8c,86e,4,...) at _vn_lock+0xf2
>  >  vrele(c3c18220,0,c07619a2,14e,ffffffff,...) at vrele+0x142
>  >  exit1(c2fdd690,0,d6078d2c,c0729ed3,c2fdd690,...) at exit1+0x8a1
>  >  sys_exit(c2fdd690,d6078cfc,4,c07625a5,c07a3d38,...) at sys_exit+0x1d
>  >  syscall(d6078d38) at syscall+0x2b3
>  >  Xint0x80_syscall() at Xint0x80_syscall+0x20
>  >  --- syscall (1, FreeBSD ELF32, sys_exit), eip = 0x2811964f, esp =
>  >  0xbfbfeacc, ebp = 0xbfbfead8 ---
>  >
>  >  Something else?
>
>
> This is the "2nd order".
>  It would be nice to get where these locks are acquired and what is the
>  "1st order".
>  In order to get it, it is enough to break in DDB and do: show witness
>  at DDB prompt.
>

[Couldn't connect via serial line, smth is broken in my hw :/
Nevertheless here it is, thanks to rwatson]

wbr,
pluknet

debug.ddb.capture.data: db> show witness

Sleep locks:
0 so_rcv_sx -- last acquired _at_ /usr/src/sys/kern/uipc_sockbuf.c:148
14 so_rcv -- last acquired _at_ /usr/src/sys/kern/uipc_socket.c:2475
19  sellck -- last acquired _at_ /usr/src/sys/kern/sys_generic.c:1406
15  radix node head -- last acquired _at_ /usr/src/sys/net/route.c:147
16   rtentry -- last acquired _at_ /usr/src/sys/net/route.c:196
17    ifaddr -- last acquired _at_ /usr/src/sys/net/route.c:821
18    UMA zone -- last acquired _at_ /usr/src/sys/vm/uma_core.c:2257
17    sctp-addr -- last acquired _at_ /usr/src/sys/netinet/sctp_pcb.c:649
17    system map -- last acquired _at_ /usr/src/sys/vm/vm_map.c:3111
19     vm page queue mutex -- last acquired _at_ /usr/src/sys/vm/vm_pageout.c:1480
20      vnode interlock -- last acquired _at_ /usr/src/sys/kern/vfs_bio.c:3846
21       cdev -- last acquired _at_ /usr/src/sys/kern/kern_conf.c:69
21       vnode_free_list -- last acquired _at_ /usr/src/sys/kern/vfs_subr.c:730
21       Syncer mtx -- last acquired _at_ /usr/src/sys/kern/vfs_subr.c:1682
20      pmap -- last acquired _at_ /usr/src/sys/i386/i386/pmap.c:3180
21       vm page queue free mutex -- last acquired _at_
/usr/src/sys/vm/vm_pageout.c:1448
21       SYSMAPS -- last acquired _at_ /usr/src/sys/i386/i386/pmap.c:2880
21      vm page queue free mutex -- (already displayed)
21      SYSMAPS -- (already displayed)
18     kmem object -- last acquired _at_ /usr/src/sys/vm/vm_object.c:460
21      vm page queue free mutex -- (already displayed)
19      vm page queue mutex -- (already displayed)
21      SYSMAPS -- (already displayed)
18     KMAP ENTRY -- last acquired _at_ /usr/src/sys/vm/uma_core.c:414
18     kernel object -- last acquired _at_ /usr/src/sys/kern/vfs_bio.c:3675
19      vm page queue mutex -- (already displayed)
21      vm page queue free mutex -- (already displayed)
21      SYSMAPS -- (already displayed)
21     vm page queue free mutex -- (already displayed)
21     SYSMAPS -- (already displayed)
20     pmap -- (already displayed)
17    sctp_it_wq -- last acquired _at_ /usr/src/sys/netinet/sctputil.c:1345
17    eventhandler -- last acquired _at_ /usr/src/sys/kern/subr_eventhandler.c:212
18     eventhandler list -- last acquired _at_ /usr/src/sys/kern/kern_exit.c:227
16   ifnet -- last acquired _at_ /usr/src/sys/net/if.c:1477
18    UMA zone -- (already displayed)
17    eventhandler -- (already displayed)
17    if_addr_mtx -- last acquired _at_ /usr/src/sys/netinet/ip_input.c:573
18     UMA zone -- (already displayed)
17    pf task mtx -- last acquired _at_
/usr/src/sys/modules/pf/../../contrib/pf/net/pf.c:980
18     UMA zone -- (already displayed)
18    eventhandler list -- (already displayed)
18   UMA zone -- (already displayed)
16   UMA boot pages -- last acquired _at_ /usr/src/sys/vm/uma_core.c:916
17   system map -- (already displayed)
15  process lock -- last acquired _at_ /usr/src/sys/kern/kern_kthread.c:201
16   session -- last acquired _at_ /usr/src/sys/kern/kern_proc.c:587
17    uidinfo hash -- last acquired _at_ /usr/src/sys/kern/kern_resource.c:1213
18     uidinfo struct -- last acquired _at_ order list:0
18     sleep mtxpool -- last acquired _at_ /usr/src/sys/kern/sys_generic.c:1316
19      sellck -- (already displayed)
17    tty -- last acquired _at_ /usr/src/sys/kern/kern_event.c:1666
20    vnode interlock -- (already displayed)
16   sigacts -- last acquired _at_ /usr/src/sys/kern/subr_sleepqueue.c:392
16   ktrace -- last acquired _at_ /usr/src/sys/kern/kern_fork.c:607
18   sleep mtxpool -- (already displayed)
16   fdesc -- last acquired _at_ /usr/src/sys/kern/kern_descrip.c:1467
18  sleep mtxpool -- (already displayed)
18  UMA zone -- (already displayed)
17  eventhandler -- (already displayed)
15  kqueue -- last acquired _at_ /usr/src/sys/kern/kern_event.c:1442
16   struct mount mtx -- last acquired _at_ /usr/src/sys/kern/vfs_mount.c:447
20    vnode interlock -- (already displayed)
18 UMA zone -- (already displayed)
11 unp_mtx -- last acquired _at_ /usr/src/sys/kern/uipc_usrreq.c:558
14  so_rcv -- (already displayed)
12  accept -- last acquired _at_ /usr/src/sys/kern/uipc_socket.c:685
13   so_snd -- last acquired _at_ /usr/src/sys/netinet/tcp_output.c:270
14    so_rcv -- (already displayed)
18    sleep mtxpool -- (already displayed)
18    UMA zone -- (already displayed)
15    radix node head -- (already displayed)
16    rtentry -- (already displayed)
14    tcp_hc_entry -- last acquired _at_ /usr/src/sys/netinet/tcp_hostcache.c:668
18     UMA zone -- (already displayed)
17     system map -- (already displayed)
14   so_rcv -- (already displayed)
13  so_snd -- (already displayed)
18  UMA zone -- (already displayed)
15 process lock -- (already displayed)
7  user map -- last acquired _at_ /usr/src/sys/vm/vm_map.c:3111
18  UMA zone -- (already displayed)
16  UMA boot pages -- (already displayed)
17  system map -- (already displayed)
21  vm page queue free mutex -- (already displayed)
12  vm object_list -- last acquired _at_ /usr/src/sys/vm/vm_object.c:693
11  standard object -- last acquired _at_ /usr/src/sys/kern/vfs_bio.c:3208
21   vm page queue free mutex -- (already displayed)
20   vnode interlock -- (already displayed)
19   vm page queue mutex -- (already displayed)
21   SYSMAPS -- (already displayed)
12   vm object_list -- (already displayed)
18   UMA zone -- (already displayed)
12   swap_pager swhash -- last acquired _at_ /usr/src/sys/vm/swap_pager.c:1888
19  vm page queue mutex -- (already displayed)
20  pmap -- (already displayed)
20  vnode interlock -- (already displayed)
8   tmpfs -- last acquired _at_ /usr/src/sys/kern/vfs_subr.c:2063
16   struct mount mtx -- (already displayed)
9    tmpfs node interlock -- last acquired _at_
/usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_subr.c:419
20    vnode interlock -- (already displayed)
20   vnode interlock -- (already displayed)
18   UMA zone -- (already displayed)
11   Name Cache -- last acquired _at_ /usr/src/sys/kern/vfs_cache.c:325
20    vnode interlock -- (already displayed)
18    UMA zone -- (already displayed)
9    filedesc structure -- last acquired _at_ /usr/src/sys/kern/sys_generic.c:959
20    vnode interlock -- (already displayed)
15    process lock -- (already displayed)
11    Name Cache -- (already displayed)
16    fdesc -- (already displayed)
18    UMA zone -- (already displayed)
16    UMA boot pages -- (already displayed)
17    system map -- (already displayed)
13    so_snd -- (already displayed)
21    cdev -- (already displayed)
10    Giant -- last acquired _at_ /usr/src/sys/kern/kern_intr.c:1033
11     pipe mutex -- last acquired _at_ /usr/src/sys/kern/sys_pipe.c:1336
12      sigio lock -- last acquired _at_ /usr/src/sys/kern/kern_descrip.c:783
13       process group -- last acquired _at_ /usr/src/sys/kern/kern_proc.c:276
15        process lock -- (already displayed)
16        session -- (already displayed)
18        UMA zone -- (already displayed)
14        ttylist -- last acquired _at_ /usr/src/sys/kern/tty.c:2855
17         tty -- (already displayed)
18      sleep mtxpool -- (already displayed)
19      vm page queue mutex -- (already displayed)
18     UMA zone -- (already displayed)
17     system map -- (already displayed)
11     UMA lock -- last acquired _at_ /usr/src/sys/vm/uma_core.c:1492
18      UMA zone -- (already displayed)
18      KMAP ENTRY -- (already displayed)
17     eventhandler -- (already displayed)
16     UMA boot pages -- (already displayed)
18     eventhandler list -- (already displayed)
12     kobj -- last acquired _at_ /usr/src/sys/kern/subr_kobj.c:307
12     kernel environment -- last acquired _at_
/usr/src/sys/kern/kern_environment.c:301
11     malloc -- last acquired _at_ /usr/src/sys/kern/kern_malloc.c:655
21     vm page queue free mutex -- (already displayed)
18     kernel object -- (already displayed)
12     vm object_list -- (already displayed)
18     KMAP ENTRY -- (already displayed)
17     uidinfo hash -- (already displayed)
15     process lock -- (already displayed)
18     sleep mtxpool -- (already displayed)
11     evclass_mtx -- last acquired _at_
/usr/src/sys/security/audit/audit_bsm_klib.c:112
11     TID lock -- last acquired _at_ /usr/src/sys/kern/subr_unit.c:623
11     standard object -- (already displayed)
11     intr event -- last acquired _at_ /usr/src/sys/kern/kern_intr.c:423
21     cdev -- (already displayed)
11     GEOM orphanage -- last acquired _at_ /usr/src/sys/geom/geom_event.c:201
11     vm86 lock -- last acquired _at_ /usr/src/sys/i386/i386/vm86.c:569
11     sndstat lock -- last acquired _at_
/usr/src/sys/modules/sound/sound/../../../dev/sound/pcm/sndstat.c:290
14     ttylist -- (already displayed)
11     taskqueue list -- last acquired _at_ /usr/src/sys/kern/subr_taskqueue.c:125
11     XPT lock -- last acquired _at_ /usr/src/sys/cam/cam_xpt.c:2646
18      UMA zone -- (already displayed)
12      XPT topology lock -- last acquired _at_ /usr/src/sys/cam/cam_xpt.c:7192
12      kernel environment -- (already displayed)
12      taskqueue -- last acquired _at_ /usr/src/sys/kern/subr_taskqueue.c:73
11     intr config -- last acquired _at_ /usr/src/sys/kern/subr_autoconf.c:72
11     rman head -- last acquired _at_ /usr/src/sys/kern/subr_rman.c:152
11     rman -- last acquired _at_ /usr/src/sys/kern/subr_rman.c:539
18      UMA zone -- (already displayed)
17      system map -- (already displayed)
11     devd -- last acquired _at_ /usr/src/sys/kern/subr_bus.c:499
18      sleep mtxpool -- (already displayed)
11     ACPI semaphore -- last acquired _at_
/usr/src/sys/modules/acpi/acpi/../../../dev/acpica/Osd/OsdSynch.c:303
11     acpi subsystem HW lock -- last acquired _at_
/usr/src/sys/modules/acpi/acpi/../../../dev/acpica/Osd/OsdSynch.c:377
11     acpi subsystem GPE lock -- last acquired _at_
/usr/src/sys/modules/acpi/acpi/../../../dev/acpica/Osd/OsdSynch.c:377
11     ACPI global lock -- last acquired _at_
/usr/src/sys/modules/acpi/acpi/../../../i386/acpica/acpi_machdep.c:270
12     taskqueue -- (already displayed)
16     ifnet -- (already displayed)
11     bpf global lock -- last acquired _at_ /usr/src/sys/net/bpf.c:1606
12      bpf interface lock -- last acquired _at_ order list:0
13       bpf cdev lock -- last acquired _at_ order list:0
13     pcm0:spicds0 -- last acquired _at_
/usr/src/sys/modules/sound/driver/spicds/../../../../dev/sound/pci/spicds.c:270
11     pcm0:spicds1 -- last acquired _at_
/usr/src/sys/modules/sound/driver/spicds/../../../../dev/sound/pci/spicds.c:179
11     pcm0:spicds2 -- last acquired _at_
/usr/src/sys/modules/sound/driver/spicds/../../../../dev/sound/pci/spicds.c:179
12     snd_envy24ht softc -- last acquired _at_
/usr/src/sys/modules/sound/driver/envy24ht/../../../../dev/sound/pci/envy24ht.c:1910
13      pcm0:spicds0 -- (already displayed)
18      UMA zone -- (already displayed)
17      system map -- (already displayed)
11     sound cdev -- last acquired _at_
/usr/src/sys/modules/sound/sound/../../../dev/sound/pcm/mixer.c:997
11     pcm fake channel -- last acquired _at_
/usr/src/sys/modules/sound/sound/../../../dev/sound/pcm/channel.c:1108
18      UMA zone -- (already displayed)
12      kobj -- (already displayed)
11     pcm play channel -- last acquired _at_
/usr/src/sys/modules/sound/sound/../../../dev/sound/pcm/mixer.c:171
18      UMA zone -- (already displayed)
12      kobj -- (already displayed)
12      snd_envy24ht softc -- (already displayed)
11     pcm record channel -- last acquired _at_
/usr/src/sys/modules/sound/sound/../../../dev/sound/pcm/mixer.c:171
18      UMA zone -- (already displayed)
12      kobj -- (already displayed)
12      snd_envy24ht softc -- (already displayed)
11     pcm virtual play channel -- last acquired _at_
/usr/src/sys/modules/sound/sound/../../../dev/sound/pcm/mixer.c:171
18      UMA zone -- (already displayed)
12      kobj -- (already displayed)
11     primary pcm mixer -- last acquired _at_
/usr/src/sys/modules/sound/sound/../../../dev/sound/pcm/mixer.c:970
11     pcm virtual record channel -- last acquired _at_
/usr/src/sys/modules/sound/sound/../../../dev/sound/pcm/mixer.c:171
18      UMA zone -- (already displayed)
12      kobj -- (already displayed)
11     bounce pages lock -- last acquired _at_
/usr/src/sys/i386/i386/busdma_machdep.c:1083
11     ACPI thermal zone -- last acquired _at_
/usr/src/sys/modules/acpi/acpi/../../../dev/acpica/acpi_thermal.c:941
11     unit# allocation -- last acquired _at_ /usr/src/sys/kern/subr_unit.c:623
21     vnode_free_list -- (already displayed)
11     pfs_node -- last acquired _at_
/usr/src/sys/fs/pseudofs/pseudofs_internal.h:103
11     pfs_fileno -- last acquired _at_ /usr/src/sys/kern/subr_unit.c:623
11     if_clone lock -- last acquired _at_ /usr/src/sys/net/if_clone.c:164
11     if_cloners lock -- last acquired _at_ /usr/src/sys/net/if_clone.c:252
11     domain list -- last acquired _at_ /usr/src/sys/kern/uipc_domain.c:228
12     pfil_head_list lock -- last acquired _at_ /usr/src/sys/net/pfil.c:115
11     PFil hook read/write mutex -- last acquired _at_ /usr/src/sys/net/pfil.c:109
12      pfil_head_list lock -- (already displayed)
12     random reseed -- last acquired _at_ /usr/src/sys/dev/random/yarrow.c:191
12     arc4_mtx -- last acquired _at_ /usr/src/sys/libkern/arc4random.c:137
11     isn_mtx -- last acquired _at_ /usr/src/sys/netinet/tcp_subr.c:1433
12      random reseed -- (already displayed)
12      arc4_mtx -- (already displayed)
15     radix node head -- (already displayed)
17     pf task mtx -- (already displayed)
12     XPT topology lock -- (already displayed)
11     ATA queue lock -- last acquired _at_ /usr/src/sys/dev/ata/ata-queue.c:177
12      ATA state lock -- last acquired _at_ /usr/src/sys/dev/ata/ata-all.c:316
11     devstat -- last acquired _at_ /usr/src/sys/kern/subr_devstat.c:83
11     ATAPICAM lock -- last acquired _at_
/usr/src/sys/modules/ata/atapicam/../../../dev/ata/atapi-cam.c:642
18      UMA zone -- (already displayed)
17      system map -- (already displayed)
12      kernel environment -- (already displayed)
12      XPT topology lock -- (already displayed)
12      CAM SIMQ lock -- last acquired _at_ /usr/src/sys/cam/cam_xpt.c:7207
12      taskqueue -- (already displayed)
12      bdone lock -- last acquired _at_ /usr/src/sys/kern/vfs_bio.c:2999
12      g_disk_done -- last acquired _at_ /usr/src/sys/geom/geom_disk.c:199
18       UMA zone -- (already displayed)
13       bio queue -- last acquired _at_ /usr/src/sys/geom/geom_io.c:68
11     mountlist -- last acquired _at_ /usr/src/sys/ufs/ffs/ffs_softdep.c:763
16      struct mount mtx -- (already displayed)
16     struct mount mtx -- (already displayed)
20     vnode interlock -- (already displayed)
11     buf queue lock -- last acquired _at_ /usr/src/sys/kern/vfs_bio.c:1466
20      vnode interlock -- (already displayed)
12     bdone lock -- (already displayed)
11     needsbuffer lock -- last acquired _at_ /usr/src/sys/kern/vfs_bio.c:321
11     FFS Lock -- last acquired _at_ /usr/src/sys/ufs/ffs/ffs_vfsops.c:1150
12      arc4_mtx -- (already displayed)
11     Name Cache -- (already displayed)
11     vfs hash -- last acquired _at_ /usr/src/sys/kern/vfs_hash.c:71
20      vnode interlock -- (already displayed)
11     dirhash list -- last acquired _at_ /usr/src/sys/ufs/ufs/ufs_dirhash.c:349
12      dirhash -- last acquired _at_ /usr/src/sys/ufs/ufs/ufs_dirhash.c:350
12     dirhash -- (already displayed)
11     pbuf mutex -- last acquired _at_ /usr/src/sys/vm/vm_pager.c:413
11     sf_buf -- last acquired _at_ /usr/src/sys/i386/i386/vm_machdep.c:820
19     vm page queue mutex -- (already displayed)
13     process group -- (already displayed)
17     tty -- (already displayed)
16     session -- (already displayed)
13     bio queue -- (already displayed)
11     Softdep Lock -- last acquired _at_ /usr/src/sys/ufs/ffs/ffs_softdep.c:770
18      UMA zone -- (already displayed)
20      vnode interlock -- (already displayed)
12      buffer daemon lock -- last acquired _at_ /usr/src/sys/kern/vfs_bio.c:2106
17      system map -- (already displayed)
11     if_afdata -- last acquired _at_ /usr/src/sys/netinet6/scope6.c:408
12      scope6_lock -- last acquired _at_ /usr/src/sys/netinet6/scope6.c:437
17     if_addr_mtx -- (already displayed)
12     if send queue -- last acquired _at_
/usr/src/sys/modules/nfe/../../dev/nfe/if_nfe.c:2517
11     network driver -- last acquired _at_
/usr/src/sys/modules/nfe/../../dev/nfe/if_nfe.c:1527
18      UMA zone -- (already displayed)
17      system map -- (already displayed)
16      UMA boot pages -- (already displayed)
17      if_addr_mtx -- (already displayed)
12      taskqueue -- (already displayed)
12      if send queue -- (already displayed)
17     ifaddr -- (already displayed)
12     sigio lock -- (already displayed)
11     nfsd_mtx -- last acquired _at_
/usr/src/sys/modules/nfsserver/../../nfsserver/nfs_srvsock.c:796
13      so_snd -- (already displayed)
14      so_rcv -- (already displayed)
11     devfs interlock -- last acquired _at_
/usr/src/sys/fs/devfs/devfs_vnops.c:194
20      vnode interlock -- (already displayed)
21      cdev -- (already displayed)
11     ip6_inq -- last acquired _at_ /usr/src/sys/net/netisr.c:140
12     ATA state lock -- (already displayed)
18    sleep mtxpool -- (already displayed)
11    pipe mutex -- (already displayed)
15    kqueue -- (already displayed)
10    unp_global_rwlock -- last acquired _at_ /usr/src/sys/kern/uipc_usrreq.c:557
11     unp_mtx -- (already displayed)
12     accept -- (already displayed)
18     UMA zone -- (already displayed)
11     so_glabel -- last acquired _at_ /usr/src/sys/kern/uipc_socket.c:299
13     so_snd -- (already displayed)
9    tmpfs allnode lock -- last acquired _at_
/usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_subr.c:238
17   system map -- (already displayed)
21   vnode_free_list -- (already displayed)
21   cdev -- (already displayed)
12   vm object_list -- (already displayed)
11   standard object -- (already displayed)
15   process lock -- (already displayed)
11   sf_buf -- (already displayed)
4  tcpinp -- last acquired _at_ /usr/src/sys/netinet/tcp_input.c:479
13  so_snd -- (already displayed)
18  UMA zone -- (already displayed)
17  system map -- (already displayed)
14  so_rcv -- (already displayed)
16  ifnet -- (already displayed)
5   tcp_sc_head -- last acquired _at_ /usr/src/sys/kern/kern_mutex.c:137
18   UMA zone -- (already displayed)
17   system map -- (already displayed)
12   arc4_mtx -- (already displayed)
15   radix node head -- (already displayed)
16   rtentry -- (already displayed)
14   tcp_hc_entry -- (already displayed)
12  accept -- (already displayed)
11  so_glabel -- (already displayed)
15  radix node head -- (already displayed)
16  rtentry -- (already displayed)
14  tcp_hc_entry -- (already displayed)
5   ip_id_mtx -- last acquired _at_ /usr/src/sys/netinet/ip_id.c:176
18   UMA zone -- (already displayed)
17   system map -- (already displayed)
12   arc4_mtx -- (already displayed)
12   random reseed -- (already displayed)
12  if send queue -- (already displayed)
11  network driver -- (already displayed)
12  arc4_mtx -- (already displayed)
11  isn_mtx -- (already displayed)
9  filedesc structure -- (already displayed)
0 so_snd_sx -- last acquired _at_ /usr/src/sys/kern/uipc_sockbuf.c:148
13 so_snd -- (already displayed)
18 UMA zone -- (already displayed)
10 unp_global_rwlock -- (already displayed)
4  tcpinp -- (already displayed)
9  filedesc structure -- (already displayed)
4  rawinp -- last acquired _at_ /usr/src/sys/netinet/raw_ip.c:639
18  UMA zone -- (already displayed)
11  if_afdata -- (already displayed)
5   addrsel_lock -- last acquired _at_ /usr/src/sys/netinet6/in6_src.c:860
17  if_addr_mtx -- (already displayed)
12  if send queue -- (already displayed)
11  network driver -- (already displayed)
5   ip_id_mtx -- (already displayed)
15  radix node head -- (already displayed)
16  rtentry -- (already displayed)
14  so_rcv -- (already displayed)
17 system map -- (already displayed)
0 syncer -- last acquired _at_ /usr/src/sys/kern/vfs_subr.c:1666
20 vnode interlock -- (already displayed)
11 mountlist -- (already displayed)
1  vfslock -- last acquired _at_ /usr/src/sys/kern/vfs_subr.c:364
18  UMA zone -- (already displayed)
18  sleep mtxpool -- (already displayed)
12  arc4_mtx -- (already displayed)
11  unit# allocation -- (already displayed)
16  struct mount mtx -- (already displayed)
2   mntid -- last acquired _at_ /usr/src/sys/kern/vfs_subr.c:460
11   mountlist -- (already displayed)
2   devfsmount -- last acquired _at_ /usr/src/sys/fs/devfs/devfs_vnops.c:201
11   devfs interlock -- (already displayed)
21   vnode_free_list -- (already displayed)
18   UMA zone -- (already displayed)
20   vnode interlock -- (already displayed)
3    devfs -- last acquired _at_ /usr/src/sys/kern/vfs_vnops.c:673
11    devfs interlock -- (already displayed)
16    struct mount mtx -- (already displayed)
20    vnode interlock -- (already displayed)
9     filedesc structure -- (already displayed)
5     clone events drain lock -- last acquired _at_ /usr/src/sys/kern/tty_tty.c:70
17     eventhandler -- (already displayed)
18     eventhandler list -- (already displayed)
21     cdev -- (already displayed)
18     UMA zone -- (already displayed)
18    UMA zone -- (already displayed)
21    cdev -- (already displayed)
4     GEOM topology -- last acquired _at_ /usr/src/sys/geom/geom_event.c:233
11     GEOM orphanage -- (already displayed)
18     UMA zone -- (already displayed)
11     devstat -- (already displayed)
11     unit# allocation -- (already displayed)
21     cdev -- (already displayed)
13     bio queue -- (already displayed)
12     bdone lock -- (already displayed)
17     system map -- (already displayed)
11     ATA queue lock -- (already displayed)
12     vm object_list -- (already displayed)
20     vnode interlock -- (already displayed)
11     standard object -- (already displayed)
12     XPT topology lock -- (already displayed)
11     ATAPICAM lock -- (already displayed)
15     process lock -- (already displayed)
5      swapdev -- last acquired _at_ /usr/src/sys/vm/swap_pager.c:2235
10    Giant -- (already displayed)
11    Name Cache -- (already displayed)
11    mountlist -- (already displayed)
5     knlist lock for lockless objects -- last acquired _at_
/usr/src/sys/kern/kern_event.c:1666
11    vfs hash -- (already displayed)
17    system map -- (already displayed)
21    vnode_free_list -- (already displayed)
4     ufs -- last acquired _at_ /usr/src/sys/kern/vfs_subr.c:2063
16     struct mount mtx -- (already displayed)
11     vfs hash -- (already displayed)
20     vnode interlock -- (already displayed)
11     buf queue lock -- (already displayed)
9      filedesc structure -- (already displayed)
11     Name Cache -- (already displayed)
6      bufwait -- last acquired _at_ /usr/src/sys/sys/buf.h:300
17      system map -- (already displayed)
20      vnode interlock -- (already displayed)
11      standard object -- (already displayed)
18      UMA zone -- (already displayed)
13      bio queue -- (already displayed)
12      bdone lock -- (already displayed)
10      Giant -- (already displayed)
11      buf queue lock -- (already displayed)
11      needsbuffer lock -- (already displayed)
18      kernel object -- (already displayed)
15      process lock -- (already displayed)
7       user map -- (already displayed)
11      pbuf mutex -- (already displayed)
12      dirhash -- (already displayed)
19      vm page queue mutex -- (already displayed)
21      cdev -- (already displayed)
12      buffer daemon lock -- (already displayed)
11      Softdep Lock -- (already displayed)
11      FFS Lock -- (already displayed)
11      vfs hash -- (already displayed)
16      UMA boot pages -- (already displayed)
7       runningbufspace lock -- last acquired _at_ /usr/src/sys/kern/vfs_bio.c:340
18     UMA zone -- (already displayed)
21     vnode_free_list -- (already displayed)
11     standard object -- (already displayed)
7      user map -- (already displayed)
15     process lock -- (already displayed)
18     sleep mtxpool -- (already displayed)
11     sf_buf -- (already displayed)
19     vm page queue mutex -- (already displayed)
11     pbuf mutex -- (already displayed)
11     dirhash list -- (already displayed)
12     dirhash -- (already displayed)
20     pmap -- (already displayed)
21     cdev -- (already displayed)
16     UMA boot pages -- (already displayed)
12     vm object_list -- (already displayed)
17     system map -- (already displayed)
17     uidinfo hash -- (already displayed)
12     buffer daemon lock -- (already displayed)
11     mountlist -- (already displayed)
5      knlist lock for lockless objects -- (already displayed)
10     Giant -- (already displayed)
9      tmpfs node interlock -- (already displayed)
8      tmpfs -- (already displayed)
12     kobj -- (already displayed)
5      module subsystem sx lock -- last acquired _at_
/usr/src/sys/kern/kern_module.c:407
18      UMA zone -- (already displayed)
17      system map -- (already displayed)
5      msdosfs -- last acquired _at_ /usr/src/sys/kern/vfs_subr.c:2063
16      struct mount mtx -- (already displayed)
11      vfs hash -- (already displayed)
20      vnode interlock -- (already displayed)
6       bufwait -- (already displayed)
18      UMA zone -- (already displayed)
11     FFS Lock -- (already displayed)
11     Softdep Lock -- (already displayed)
13     bio queue -- (already displayed)
10     unp_global_rwlock -- (already displayed)
7      runningbufspace lock -- (already displayed)
12     bdone lock -- (already displayed)
11     needsbuffer lock -- (already displayed)
4     proctree -- last acquired _at_ /usr/src/sys/kern/tty.c:2080
5      allproc -- last acquired _at_ /usr/src/sys/kern/kern_exit.c:793
6       allprison -- last acquired _at_ /usr/src/sys/kern/kern_jail.c:952
18      sleep mtxpool -- (already displayed)
15      process lock -- (already displayed)
16      fdesc -- (already displayed)
9       filedesc structure -- (already displayed)
20      vnode interlock -- (already displayed)
7       user map -- (already displayed)
13     process group -- (already displayed)
10     Giant -- (already displayed)
15     process lock -- (already displayed)
16     session -- (already displayed)
12     sigio lock -- (already displayed)
5      clone events drain lock -- (already displayed)
20     vnode interlock -- (already displayed)
18     UMA zone -- (already displayed)
11    GEOM orphanage -- (already displayed)
13    bio queue -- (already displayed)
7     runningbufspace lock -- (already displayed)
15    process lock -- (already displayed)
11    Softdep Lock -- (already displayed)
21   cdev -- (already displayed)
17   system map -- (already displayed)
3    DEVFS ruleset lock -- last acquired _at_
/usr/src/sys/fs/devfs/devfs_rule.c:177
18    UMA zone -- (already displayed)
17    system map -- (already displayed)
11  mountlist -- (already displayed)
3   devfs -- (already displayed)
17  system map -- (already displayed)
9   filedesc structure -- (already displayed)
20  vnode interlock -- (already displayed)
12  kernel environment -- (already displayed)
11  UMA lock -- (already displayed)
11  FFS Lock -- (already displayed)
4   GEOM topology -- (already displayed)
10  Giant -- (already displayed)
11  Softdep Lock -- (already displayed)
4   ufs -- (already displayed)
2   sysctl lock -- last acquired _at_ /usr/src/sys/kern/kern_sysctl.c:1415
12   arc4_mtx -- (already displayed)
18   UMA zone -- (already displayed)
5    allproc -- (already displayed)
15   process lock -- (already displayed)
7    user map -- (already displayed)
21   cdev -- (already displayed)
9    filedesc structure -- (already displayed)
16   fdesc -- (already displayed)
3    kernel linker -- last acquired _at_ /usr/src/sys/kern/kern_linker.c:415
18    UMA zone -- (already displayed)
9     filedesc structure -- (already displayed)
20    vnode interlock -- (already displayed)
4     ufs -- (already displayed)
16    struct mount mtx -- (already displayed)
17    system map -- (already displayed)
6     bufwait -- (already displayed)
5     module subsystem sx lock -- (already displayed)
11   GEOM orphanage -- (already displayed)
10   Giant -- (already displayed)
16   ktrace -- (already displayed)
11   malloc -- (already displayed)
17   system map -- (already displayed)
11   devstat -- (already displayed)
14   ttylist -- (already displayed)
12   vm object_list -- (already displayed)
11   UMA lock -- (already displayed)
21   Syncer mtx -- (already displayed)
10   unp_global_rwlock -- (already displayed)
3    tcp -- last acquired _at_ /usr/src/sys/netinet/tcp_timer.c:128
4     tcpinp -- (already displayed)
18    UMA zone -- (already displayed)
17    system map -- (already displayed)
12    accept -- (already displayed)
18    sleep mtxpool -- (already displayed)
11    so_glabel -- (already displayed)
5     ip_id_mtx -- (already displayed)
15    radix node head -- (already displayed)
16    rtentry -- (already displayed)
12    if send queue -- (already displayed)
11    network driver -- (already displayed)
5    tcp_sc_head -- (already displayed)
3    udp -- last acquired _at_ /usr/src/sys/netinet/udp_usrreq.c:385
4     udpinp -- last acquired _at_ /usr/src/sys/netinet/udp_usrreq.c:1100
5      in_multi_mtx -- last acquired _at_ /usr/src/sys/netinet/ip_input.c:572
6       igmp_mtx -- last acquired _at_ /usr/src/sys/netinet/igmp.c:446
17       if_addr_mtx -- (already displayed)
17      if_addr_mtx -- (already displayed)
18      UMA zone -- (already displayed)
11      network driver -- (already displayed)
13     so_snd -- (already displayed)
18     UMA zone -- (already displayed)
16     ifnet -- (already displayed)
12     arc4_mtx -- (already displayed)
15     radix node head -- (already displayed)
16     rtentry -- (already displayed)
12     accept -- (already displayed)
14     so_rcv -- (already displayed)
5      ip_id_mtx -- (already displayed)
5      ip_inq -- last acquired _at_ /usr/src/sys/net/netisr.c:140
12     if send queue -- (already displayed)
11     network driver -- (already displayed)
18    UMA zone -- (already displayed)
17    system map -- (already displayed)
3    sctp-info -- last acquired _at_ /usr/src/sys/netinet/sctp_pcb.c:6138
3    rip -- last acquired _at_ /usr/src/sys/netinet/raw_ip.c:208
18    UMA zone -- (already displayed)
17    system map -- (already displayed)
4     rawinp -- (already displayed)
3    addrsel_sxlock -- last acquired _at_ /usr/src/sys/netinet6/in6_src.c:1025
5     addrsel_lock -- (already displayed)
3    db_capture_sx -- last acquired _at_ /usr/src/sys/ddb/db_capture.c:181
3    db_script_mtx -- last acquired _at_ /usr/src/sys/ddb/db_script.c:526
11   ACPI semaphore -- (already displayed)
6    allprison -- (already displayed)
11   sound cdev -- (already displayed)
11   pcm play channel -- (already displayed)
11   pcm virtual play channel -- (already displayed)
11   pcm record channel -- (already displayed)
11   pcm virtual record channel -- (already displayed)
5    swapdev -- (already displayed)
16   ifnet -- (already displayed)
12   random reseed -- (already displayed)
9   tmpfs allnode lock -- (already displayed)
21  vnode_free_list -- (already displayed)
11  vfs hash -- (already displayed)
6   bufwait -- (already displayed)
13  bio queue -- (already displayed)
9   tmpfs node interlock -- (already displayed)
8   tmpfs -- (already displayed)
7   runningbufspace lock -- (already displayed)
12  buffer daemon lock -- (already displayed)
5   msdosfs -- (already displayed)
12  kobj -- (already displayed)
15  radix node head -- (already displayed)
11  buf queue lock -- (already displayed)
16 struct mount mtx -- (already displayed)
0 rts_inq -- last acquired _at_ /usr/src/sys/net/netisr.c:140
0 iterator -- last acquired _at_ /usr/src/sys/netinet/sctputil.c:1209
0 ipqlock -- last acquired _at_ /usr/src/sys/netinet/ip_input.c:1086
0 ip6qlock -- last acquired _at_ /usr/src/sys/netinet6/frag6.c:690
0 sem -- last acquired _at_ /usr/src/sys/kern/sysv_sem.c:1288
0 polling -- last acquired _at_ /usr/src/sys/kern/kern_poll.c:367
11 network driver -- (already displayed)
15 radix node head -- (already displayed)
18 UMA zone -- (already displayed)
3  udp -- (already displayed)
5  in_multi_mtx -- (already displayed)
3  rip -- (already displayed)
11 ip6_inq -- (already displayed)
12 if send queue -- (already displayed)
3  tcp -- (already displayed)
5  tcp_sc_head -- (already displayed)
16 rtentry -- (already displayed)
14 tcp_hc_entry -- (already displayed)
5  ip_id_mtx -- (already displayed)
0 crossmp -- last acquired _at_ /usr/src/sys/kern/vfs_lookup.c:686
20 vnode interlock -- (already displayed)
18 UMA zone -- (already displayed)
0 intr sources -- last acquired _at_ /usr/src/sys/i386/i386/intr_machdep.c:179
0 audit_mtx -- last acquired _at_ /usr/src/sys/security/audit/audit_worker.c:395
0 uma object -- last acquired _at_ /usr/src/sys/vm/vm_meter.c:115
0 p_peers -- last acquired _at_ /usr/src/sys/kern/kern_exit.c:278
0 ACPI root bus -- last acquired _at_
/usr/src/sys/modules/acpi/acpi/../../../dev/acpica/acpi.c:1022
11 rman -- (already displayed)
18 UMA zone -- (already displayed)
11 ACPI semaphore -- (already displayed)
0 ACPI PCI bus methods -- last acquired _at_
/usr/src/sys/modules/acpi/acpi/../../../dev/acpica/acpi_pcib.c:221
18 UMA zone -- (already displayed)
11 ACPI semaphore -- (already displayed)
12 kernel environment -- (already displayed)
1  ACPI PCI link -- last acquired _at_
/usr/src/sys/modules/acpi/acpi/../../../dev/acpica/acpi_pci_link.c:1046
18  UMA zone -- (already displayed)
11  ACPI semaphore -- (already displayed)
17  system map -- (already displayed)
12  kernel environment -- (already displayed)
0 pf_statetbl_lock -- last acquired _at_
/usr/src/sys/modules/pf/../../contrib/pf/net/pf.c:979
17 pf task mtx -- (already displayed)
0 umtxql -- last acquired _at_ /usr/src/sys/kern/kern_umtx.c:326
0 accept_filter_mtx -- last acquired _at_ /usr/src/sys/kern/uipc_accf.c:116
0 protect sysfilt_ops -- last acquired _at_ /usr/src/sys/kern/kern_event.c:771
0 vm daemon -- last acquired _at_ /usr/src/sys/vm/vm_pageout.c:1533
0 rtsock route_cb lock -- last acquired _at_ /usr/src/sys/net/rtsock.c:236
0 rawcb -- last acquired _at_ /usr/src/sys/net/raw_cb.c:104
14 so_rcv -- (already displayed)
18 UMA zone -- (already displayed)
0 ng_node -- last acquired _at_ order list:0
1  ng_worklist -- last acquired _at_ order list:0
0 802.11 com lock -- last acquired _at_ order list:0
0 ddp_list_mtx -- last acquired _at_ order list:0
1  ddp_mtx -- last acquired _at_ order list:0
0 slip_mtx -- last acquired _at_ order list:0
1  slip sc_mtx -- last acquired _at_ order list:0
0 unp -- last acquired _at_ order list:0
13 so_snd -- (already displayed)

Spin locks:

Locks which were never acquired:
SCSI CD Changer List
MD config lock
arp_inq
pfs_vncache
ppp_softc_list_mtx
tunmtx
msq
semid
shm dictionary
shm timestamps
ehcidb
agp lock
LED sx
LED mtx
midistat lock
audit_pipe_mtx
pt_mtx
msi
audit_worker_sx
audit_trigger_mtx
ktrace_sx
bpin lock
ACPI embedded controller
ACPI power resources
PCM channel sync group lock
ACPI CPU
ACPI cmbat
ACPI generic battery
ACPI AC adapter
ACPI PCI power methods
ACPI Smart Battery
ACPI lid
ACPI HPET support
MSDOSFS fileno
UUID generator mutex lock
/dev/mem lock
fifo mutex
kqueue order
securelevel mutex lock
encapmtx
acct_sx
phys_pager list
dev_pager list
swap_pager list
vm map sleep mutex
PMAP2
db> c
Received on Tue Mar 18 2008 - 20:03:12 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:39:29 UTC