Boot time crash - Sleeping thread owns a non-sleepable lock

From: David R. Bergstein <david.r.bergstein_at_gmail.com>
Date: Thu, 18 Mar 2021 21:09:12 -0400
I have been seeing this boot time crash on an intermittent basis on a 
virtual machine; FreeBSD-13.0-RC2.   Below is a copy of the kernel crash 
dump file in case it is helpful to anyone:

--------------------------------------------------

drb-freebsd-13.localdomain dumped core - see /var/crash/vmcore.4

Thu Mar 18 20:58:47 EDT 2021

FreeBSD drb-freebsd-13.localdomain 13.0-RC2 FreeBSD 13.0-RC2 #0 
releng/13.0-n244684-13c22f74953: Fri Mar 12 04:05:19 UTC 2021 
root_at_releng1.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64

panic: sleeping thread

GNU gdb (GDB) 10.1 [GDB v10.1 for FreeBSD]
Copyright (C) 2020 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later 
<http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-portbld-freebsd13.0".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<https://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
     <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /boot/kernel/kernel...
Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug...

Unread portion of the kernel message buffer:
---<<BOOT>>---
Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
     The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 13.0-RC2 #0 releng/13.0-n244684-13c22f74953: Fri Mar 12 04:05:19 
UTC 2021
root_at_releng1.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64
FreeBSD clang version 11.0.1 (git_at_github.com:llvm/llvm-project.git 
llvmorg-11.0.1-0-g43ff75f2c3fe)
VT(vga): text 80x25
CPU: Intel(R) Core(TM) i7 CPU         950  _at_ 3.07GHz (3103.68-MHz 
K8-class CPU)
   Origin="GenuineIntel"  Id=0x106a5  Family=0x6  Model=0x1a Stepping=5
Features=0x1783fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,HTT>
   Features2=0x180201<SSE3,SSSE3,SSE4.1,SSE4.2>
   AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
   AMD Features2=0x1<LAHF>
   Structured Extended Features3=0x10000000<L1DFL>
   TSC: P-state invariant
real memory  = 9126805504 (8704 MB)
avail memory = 8285257728 (7901 MB)
Event timer "LAPIC" quality 100
ACPI APIC Table: <VBOX   VBOXAPIC>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 cache groups x 1 core(s)
random: unblocking device.
ioapic0: MADT APIC ID 4 != hw id 0
ioapic0 <Version 2.0> irqs 0-23
Launching APs: 2 1 3
Timecounter "TSC-low" frequency 1551839460 Hz quality 1000
KTLS: Initialized 4 threads
random: entropy device external interface
[ath_hal] loaded
WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 
14.0.
kbd1 at kbdmux0
000.000058 [4350] netmap_init               netmap: loaded module
mlx5en: Mellanox Ethernet driver 3.6.0 (December 2020)
nexus0
vtvga0: <VT VGA driver>
cryptosoft0: <software crypto>
aesni0: No AES or SHA support.
acpi0: <VBOX VBOXXSDT>
acpi0: Power Button (fixed)
acpi0: Sleep Button (fixed)
cpu0: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
isab0: <PCI-ISA bridge> at device 1.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel PIIX4 UDMA33 controller> port 
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xd000-0xd00f at device 1.1 on pci0
ata0: <ATA channel> at channel 0 on atapci0
ata1: <ATA channel> at channel 1 on atapci0
vgapci0: <VGA-compatible display> mem 0xe0000000-0xefffffff irq 18 at 
device 2.0 on pci0
vgapci0: Boot video device
em0: <Intel(R) PRO/1000 Network Connection> port 0xd010-0xd017 mem 
0xf0000000-0xf001ffff irq 19 at device 3.0 on pci0
em0: Using 1024 TX descriptors and 1024 RX descriptors
<6>em0: Ethernet address: 08:00:27:dd:d4:fc
<6>em0: netmap queues/slots: TX 1/1024, RX 1/1024
pcm0: <Intel ICH (82801AA)> port 0xd100-0xd1ff,0xd200-0xd23f irq 21 at 
device 5.0 on pci0
pcm0: <SigmaTel STAC9700/83/84 AC97 Codec>
ohci0: <Apple KeyLargo/Intrepid USB controller> mem 
0xf0804000-0xf0804fff irq 22 at device 6.0 on pci0
usbus0 on ohci0
usbus0: 12Mbps Full Speed USB v1.0
pci0: <bridge> at device 7.0 (no driver attached)
ehci0: <Intel 82801FB (ICH6) USB 2.0 controller> mem 
0xf0805000-0xf0805fff irq 19 at device 11.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
usbus1: 480Mbps High Speed USB v2.0
acpi_acad0: <AC Adapter> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 
14.0.
psm0: model IntelliMouse Explorer, device ID 4
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xe2000-0xe2fff pnpid 
ORM0000 on isa0
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid 
PNP0900 on isa0
atrtc0: <AT realtime clock> at port 0x70 irq 8 on isa0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
atrtc0: non-PNP ISA device will be removed from GENERIC in FreeBSD 14.
Timecounters tick every 10.000 msec
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Trying to mount root from zfs:zroot/ROOT/default []...
Root mount waiting for: CAM usbus0 usbus1
ugen0.1: <Apple OHCI root HUB> at usbus0
uhub0 on usbus0
ugen1.1: <Intel EHCI root HUB> at usbus1
uhub0: <Apple OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
uhub1 on usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ada0 at ata0 bus 0 scbus0 target 0 lun 0
ada0: <VBOX HARDDISK 1.0> ATA8-ACS device
ada0: Serial Number VBb8450cb8-277eed0b
ada0: 33.300MB/s transfers (UDMA2, PIO 65536bytes)
ada0: 61440MB (125829120 512 byte sectors)
cd0 at ata1 bus 0 scbus1 target 0 lun 0
cd0: <VBOX CD-ROM 1.0> Removable CD-ROM SCSI device
cd0: Serial Number VB2-01700376
cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
uhub0: 12 ports with 12 removable, self powered
Root mount waiting for: usbus1
Root mount waiting for: usbus1
Root mount waiting for: usbus1
Root mount waiting for: usbus1
uhub1: 12 ports with 12 removable, self powered
<118>Setting hostuuid: 56767ad9-d311-7b42-9f7f-db26ca8d9b82.
<118>Setting hostid: 0x10458f66.
<118>Starting file system checks:
<118>no pools available to import
<118>Mounting local filesystems:.
<118>Setting hostname: drb-freebsd-13.localdomain.
<118>ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 
/usr/local/lib/compat/pkg /usr/local/lib/compat/pkg /usr/local/lib/gcc10 
/usr/local/lib/gcc9 /usr/local/lib/mysql /usr/local/lib/mysql/plugin 
/usr/local/lib/perl5/5.32/mach/CORE /usr/local/lib/qt5 
/usr/local/lib/samba4 /usr/local/lib/signon 
/usr/local/lib/signon/extensions /usr/local/llvm10/lib
<118>32-bit compatibility ldconfig path: /usr/lib32
<118>Setting up harvesting: 
[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED
<118>Feeding entropy: .
vboxguest0 port 0xd020-0xd03f mem 
0xf0400000-0xf07fffff,0xf0800000-0xf0803fff irq 20 at device 4.0 on pci0
Sleeping thread (tid 100521, pid 174) owns a non-sleepable lock
KDB: stack backtrace of thread 100521:
#0 0xffffffff80c16291 at mi_switch+0xc1
#1 0xffffffff8293cf37 at rtR0SemEventMultiBsdWait+0x297
#2 0xffffffff8291d36a at vgdrvHgcmAsyncWaitCallbackWorker+0x14a
#3 0xffffffff8291e49b at VbglR0HGCMInternalConnect+0x11b
#4 0xffffffff8291ad33 at VGDrvCommonIoCtl+0xb53
#5 0xffffffff82919af6 at VGDrvCommonProcessOptionsFromHost+0x146
#6 0xffffffff8291d9f8 at vgdrvFreeBSDAttach+0x1d8
#7 0xffffffff80c462ad at device_attach+0x3dd
#8 0xffffffff80c45eb1 at device_probe_and_attach+0x41
#9 0xffffffff8085b966 at pci_driver_added+0xf6
#10 0xffffffff80c43d29 at devclass_driver_added+0x39
#11 0xffffffff80c43cad at devclass_add_driver+0x13d
#12 0xffffffff80be6964 at module_register_init+0xa4
#13 0xffffffff80bd8667 at linker_load_module+0xbc7
#14 0xffffffff80bd9e4b at kern_kldload+0xbb
#15 0xffffffff80bd9f7b at sys_kldload+0x5b
#16 0xffffffff8108aa8c at amd64_syscall+0x10c
#17 0xffffffff810618be at fast_syscall_common+0xf8
panic: sleeping thread
cpuid = 0
time = 1616100801
KDB: stack backtrace:
#0 0xffffffff80c57105 at kdb_backtrace+0x65
#1 0xffffffff80c09cd1 at vpanic+0x181
#2 0xffffffff80c09b43 at panic+0x43
#3 0xffffffff80c6e526 at propagate_priority+0x296
#4 0xffffffff80c6f0c3 at turnstile_wait+0x313
#5 0xffffffff80be7b9c at __mtx_lock_sleep+0x17c
#6 0xffffffff80c256bf at softclock_call_cc+0xff
#7 0xffffffff80c25b89 at softclock+0x79
#8 0xffffffff80bcae0d at ithread_loop+0x24d
#9 0xffffffff80bc7c0e at fork_exit+0x7e
#10 0xffffffff8106201e at fork_trampoline+0xe
Uptime: 8s
Dumping 364 out of 8152 MB:..5%..14%..22%..31%..44%..53%..62%..71%..84%..93%

__curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55
55        __asm("movq %%gs:%P1,%0" : "=r" (td) : "n" (offsetof(struct pcpu,
(kgdb) #0  __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55
#1  doadump (textdump=<optimized out>) at 
/usr/src/sys/kern/kern_shutdown.c:399
#2  0xffffffff80c098c6 in kern_reboot (howto=260)
     at /usr/src/sys/kern/kern_shutdown.c:486
#3  0xffffffff80c09d40 in vpanic (fmt=<optimized out>, ap=<optimized out>)
     at /usr/src/sys/kern/kern_shutdown.c:919
#4  0xffffffff80c09b43 in panic (fmt=<unavailable>)
     at /usr/src/sys/kern/kern_shutdown.c:843
#5  0xffffffff80c6e526 in propagate_priority (td=0xfffffe00c2c0be00)
     at /usr/src/sys/kern/subr_turnstile.c:251
#6  0xffffffff80c6f0c3 in turnstile_wait (ts=ts_at_entry=0xfffff800035b9540,
     owner=<optimized out>, owner_at_entry=0xfffffe00c2c0be00, 
queue=queue_at_entry=0)
     at /usr/src/sys/kern/subr_turnstile.c:808
#7  0xffffffff80be7b9c in __mtx_lock_sleep (c=0xffffffff81802718 
<Giant+24>,
     v=<optimized out>) at /usr/src/sys/kern/kern_mutex.c:664
#8  0xffffffff80c256bf in softclock_call_cc (
     c=0xffffffff81d1b700 <default_kbd_state+40>,
     cc=cc_at_entry=0xffffffff81ca8200 <cc_cpu>, direct=direct_at_entry=0)
     at /usr/src/sys/kern/kern_timeout.c:658
#9  0xffffffff80c25b89 in softclock (arg=0xffffffff81ca8200 <cc_cpu>)
     at /usr/src/sys/kern/kern_timeout.c:816
#10 0xffffffff80bcae0d in intr_event_execute_handlers (p=<optimized out>,
     ie=0xfffff8000364a700) at /usr/src/sys/kern/kern_intr.c:1168
#11 ithread_execute_handlers (p=<optimized out>, ie=0xfffff8000364a700)
     at /usr/src/sys/kern/kern_intr.c:1181
#12 ithread_loop (arg=arg_at_entry=0xfffff80003657d20)
     at /usr/src/sys/kern/kern_intr.c:1269
#13 0xffffffff80bc7c0e in fork_exit (
     callout=0xffffffff80bcabc0 <ithread_loop>, arg=0xfffff80003657d20,
     frame=0xfffffe00835e8d40) at /usr/src/sys/kern/kern_fork.c:1069
#14 <signal handler called>
(kgdb)

------------------------------------------------------------------------
ps -axlww

UID PID PPID  C PRI NI   VSZ  RSS MWCHAN   STAT TT     TIME COMMAND
   0   0    0  3 -16  0     0    0 swapin   DLs   -  0:00.00 [kernel]
   0   1    0  1  21  0 11824  968 wait     DLs   -  0:00.00 [init]
   0   2    0  3 -16  0     0    0 -        DL    -  0:00.00 [KTLS]
   0   3    0  3 -16  0     0    0 crypto_w DL    -  0:00.00 [crypto]
   0   4    0  3 -16  0     0    0 crypto_r DL    -  0:00.00 [crypto 
returns 0]
   0   5    0  0 -16  0     0    0 crypto_r DL    -  0:00.00 [crypto 
returns 1]
   0   6    0  3 -16  0     0    0 crypto_r DL    -  0:00.00 [crypto 
returns 2]
   0   7    0  0 -16  0     0    0 crypto_r DL    -  0:00.00 [crypto 
returns 3]
   0   8    0  3 -16  0     0    0 -        RL    -  0:00.00 [cam]
   0   9    0  2 -16  0     0    0 -        DL    -  0:00.00 [soaiod1]
   0  10    0  3 -16  0     0    0 audit_wo DL    -  0:00.00 [audit]
   0  11    0  0 155  0     0    0 -        RL    -  0:00.00 [idle]
   0  12    0 -1 -52  0     0    0 -        WL    -  0:00.00 [intr]
   0  13    0  0  -8  0     0    0 -        DL    -  0:00.00 [geom]
   0  14    0  0 -16  0     0    0 seqstate DL    -  0:00.00 [sequencer 00]
   0  15    0  0 -68  0     0    0 -        DL    -  0:00.00 [usb]
   0  16    0  2 -16  0     0    0 -        DL    -  0:00.00 [soaiod2]
   0  17    0  0 -16  0     0    0 -        DL    -  0:00.00 [soaiod3]
   0  18    0  2 -16  0     0    0 -        DL    -  0:00.00 [soaiod4]
   0  19    0  0  -8  0     0    0 t->zthr_ DL    -  0:00.03 [zfskern]
   0  20    0  0 -16  0     0    0 -        DL    -  0:00.00 [rand_harvestq]
   0  21    0  1 -16  0     0    0 psleep   DL    -  0:00.00 [pagedaemon]
   0  22    0  3 -16  0     0    0 psleep   DL    -  0:00.00 [vmdaemon]
   0  23    0  2 -16  0     0    0 qsleep   DL    -  0:00.00 [bufdaemon]
   0  24    0  2 -16  0     0    0 vlruwt   DL    -  0:00.00 [vnlru]
   0  25    0  0  16  0     0    0 syncer   DL    -  0:00.00 [syncer]
   0  26    1  1  52  0 13624 2820 wait     Ds+   -  0:00.00 [sh]
   0 172   26  2  52  0 13624 2820 wait     D+    -  0:00.00 [sh]
   0 174  172  3  52  0 12768 2100 VBoxIS   D+    -  0:00.00 [kldload]
   0 175    0  2 -20  0     0    0 VBoxIS   DL    -  0:00.00 [Timer]

------------------------------------------------------------------------
vmstat -s

     19751 cpu context switches
      1534 device interrupts
       112 software interrupts
     16622 traps
     11362 system calls
        26 kernel threads created
       103  fork() calls
        46 vfork() calls
         0 rfork() calls
         0 swap pager pageins
         0 swap pager pages paged in
         0 swap pager pageouts
         0 swap pager pages paged out
       222 vnode pager pageins
      1540 vnode pager pages paged in
         0 vnode pager pageouts
         0 vnode pager pages paged out
         0 page daemon wakeups
         0 pages examined by the page daemon
         0 clean page reclamation shortfalls
         0 pages reactivated by the page daemon
      5335 copy-on-write faults
        26 copy-on-write optimized faults
      8321 zero fill pages zeroed
         0 zero fill pages prezeroed
         0 intransit blocking page faults
     15666 total VM faults taken
       163 page faults requiring I/O
         0 pages affected by kernel thread creation
      4173 pages affected by  fork()
      1610 pages affected by vfork()
         0 pages affected by rfork()
     52437 pages freed
         0 pages freed by daemon
         0 pages freed by exiting processes
         0 pages active
         0 pages inactive
         0 pages in the laundry queue
         0 pages wired down
         0 virtual user pages wired down
         0 pages free
         0 bytes per page
         0 total name lookups
           cache hits (0% pos + 0% neg) system 0% per-directory
           deletions 0%, falsehits 0%, toolong 0%

------------------------------------------------------------------------
vmstat -m

vmstat: memstat_kvm_malloc:
          Type InUse MemUse Requests  Size(s)

------------------------------------------------------------------------
vmstat -z

ITEM                   SIZE  LIMIT     USED     FREE      REQ FAILSLEEP 
XDOMAIN
UMA Kegs:               384,      0,     169,       0,     169, 0,   0,   0
UMA Zones:             1024,      0,     180,       0,     180, 0,   0,   0
UMA Slabs 0:             80,      0,    4234,       0,    4234, 0,   0,   0
UMA Slabs 1:            112,      0,       6,       0,       6, 0,   0,   0
UMA Hash:               256,      0,       0,       0,       0, 0,   0,   0
2 Bucket:                32,      0,     171,     333,    4435, 0,   0,   0
4 Bucket:                48,      0,      20,     316,      39, 0,   0,   0
8 Bucket:                80,      0,      71,     229,     855, 0,   0,   0
16 Bucket:              144,      0,      31,     137,    1716, 2,   0,   0
32 Bucket:              256,      0,      75,      30,     532, 0,   0,   0
64 Bucket:              512,      0,      44,      28,     403, 15,   0,   0
128 Bucket:            1024,      0,      64,      11, 637,1902,   0,   0
256 Bucket:            2048,      0,      75,       3,     493, 122,   
0,   0
SMR SHARED:              24,      0,       2,      61,       2, 0,   0,   0
SMR CPU:                 32,      0,       2,      61,       2, 0,   0,   0
vmem:                  1856,      0,       1,       1,       1, 0,   0,   0
vmem btag:               56,      0,    3281,     230,    3281, 91,   0,   0
VM OBJECT:              264,      0,     359,      91,    2350, 0,   0,   0
RADIX NODE:             144,      0,    1848,     306,    8632, 0,   0,   0
KMAP ENTRY:              96,      0,       6,       0,       8, 0,   0,   0
MAP ENTRY:               96,      0,      85,     629,    6531, 0,   0,   0
VMSPACE:               2544,      0,       4,      23,     151, 0,   0,   0
fakepg:                 104,      0,       0,       0,       0, 0,   0,   0
pcpu-4:                   4,      0,       0,       0,       0, 0,   0,   0
pcpu-8:                   8,      0,    2985,     595,    2985, 0,   0,   0
pcpu-16:                 16,      0,      21,     745,      21, 0,   0,   0
pcpu-32:                 32,      0,       0,       0,       0, 0,   0,   0
pcpu-64:                 64,      0,     453,     123,     453, 0,   0,   0
malloc-16:               16,      0,   12459,     645,   40358, 0,   0,   0
malloc-32:               32,      0,    5906,     772,   16645, 0,   0,   0
malloc-64:               64,      0,   10648,     503,   50876, 0,   0,   0
malloc-128:             128,      0,   13450,     376,   73945, 0,   0,   0
malloc-256:             256,      0,    1155,     210,    3239, 0,   0,   0
malloc-384:             384,      0,     978,      22,   56179, 0,   0,   0
malloc-512:             512,      0,      26,     102,     586, 0,   0,   0
malloc-1024:           1024,      0,    1728,      52,    8627, 0,   0,   0
malloc-2048:           2048,      0,     168,      26,    2628, 0,   0,   0
malloc-4096:           4096,      0,     596,       1,    1553, 0,   0,   0
malloc-8192:           8192,      0,      23,       8,     301, 0,   0,   0
malloc-16384:         16384,      0,      14,       4,     432, 0,   0,   0
malloc-32768:         32768,      0,       7,       3,     172, 0,   0,   0
malloc-65536:         65536,      0,       8,       2,     172, 0,   0,   0
SLEEPQUEUE:              80,      0,     523,      85,     523, 0,   0,   0
kenv:                   258,      0,      17,      43,     781, 0,   0,   0
Files:                   80,      0,       4,     196,    1256, 0,   0,   0
filedesc0:             1072,      0,      30,      40,     176, 0,   0,   0
PWD:                     32,      0,       3,     501,      75, 0,   0,   0
rl_entry:                40,      0,      11,     292,      11, 0,   0,   0
TURNSTILE:              136,      0,     523,      44,     523, 0,   0,   0
rangeset pctrie nodes:    144,      0,       0,       0, 0,   0,   0,   0
umtx pi:                 96,      0,       0,       0,       0, 0,   0,   0
umtx_shm:                88,      0,       0,       0,       0, 0,   0,   0
swrbuf:                2368,    128,       0,       0,       0, 0,   0,   0
swwbuf:                2368,     64,       0,       0,       0, 0,   0,   0
nfspbuf:               2368,    128,       0,       0,       0, 0,   0,   0
mdpbuf:                2368,     25,       0,       0,       0, 0,   0,   0
clpbuf:                2368,    128,       0,       0,       0, 0,   0,   0
vnpbuf:                2368,    512,       0,       0,       0, 0,   0,   0
pbuf:                  2368,     16,       0,       0,       0, 0,   0,   0
MAC labels:              40,      0,       0,       0,       0, 0,   0,   0
PROC:                  1320,      0,      29,      10,     175, 0,   0,   0
PGRP:                    88,      0,       2,      90,       2, 0,   0,   0
THREAD:                1792,      0,     498,      23,     522, 0,   0,   0
cpuset:                 104,      0,      11,     113,      11, 0,   0,   0
domainset:               40,      0,       0,       0,       0, 0,   0,   0
audit_record:          1280,      0,       0,       0,       0, 0,   0,   0
mbuf_packet:            256,      0,       0,       0,       0, 0,   0,   0
mbuf:                   256, 3247531,       1,      14,       1, 0,   0,   0
mbuf_cluster:          2048, 507426,       0,       0,       0, 0,   0,   0
mbuf_jumbo_page:       4096, 253713,       0,       0,       0, 0,   0,   0
mbuf_jumbo_9k:         9216,  75174,       0,       0,       0, 0,   0,   0
mbuf_jumbo_16k:       16384,  42285,       0,       0,       0, 0,   0,   0
epoch_record pcpu:      256,      0,       4,      12,       4, 0,   0,   0
ktls_session:           192,      0,       0,       0,       0, 0,   0,   0
ttyinq:                 160,      0,      15,      10,      15, 0,   0,   0
ttyoutq:                256,      0,       8,       7,       8, 0,   0,   0
FPU_save_area:          512,      0,       1,       7,       1, 0,   0,   0
DEVCTL:                1024,   1000,     142,       0,     142, 0,   0,   0
IOMMU_MAP_ENTRY:        120,      0,       0,       0,       0, 0,   0,   0
g_bio:                  376,      0,       0,     180,    4596, 0,   0,   0
linux_dma_pctrie:       144,      0,       0,       0,       0, 0,   0,   0
linux_dma_object:        24,      0,       0,       0,       0, 0,   0,   0
cryptop:                280,      0,       0,       0,       0, 0,   0,   0
vtnet_tx_hdr:            24,      0,       0,       0,       0, 0,   0,   0
taskq_zone:             192,      0,       0,     189,     339, 0,   0,   0
VNODE:                  488,      0,     419,      61,     469, 0,   0,   0
BUF TRIE:               144,      0,       0,       0,       0, 0,   0,   0
NAMEI:                 1024,      0,       0,      16,    2162, 0,   0,   0
S VFS Cache:            104,      0,     475,     110,     496, 0,   0,   0
STS VFS Cache:          144,      0,       0,       0,       0, 0,   0,   0
L VFS Cache:            320,      0,       0,      12,       1, 0,   0,   0
LTS VFS Cache:          360,      0,       0,       0,       0, 0,   0,   0
TMPFS node:             224,      0,       0,       0,       0, 0,   0,   0
DIRHASH:               1024,      0,       0,       0,       0, 0,   0,   0
NCLNODE:                592,      0,       0,       0,       0, 0,   0,   0
pipe:                   744,      0,       0,      10,      37, 0,   0,   0
Mountpoints:           2752,      0,      12,       6,      12, 0,   0,   0
AIO:                    208,      0,       0,       0,       0, 0,   0,   0
AIOP:                    32,      0,       0,       0,       0, 0,   0,   0
AIOCB:                  552,      0,       0,       0,       0, 0,   0,   0
AIOLIO:                 272,      0,       0,       0,       0, 0,   0,   0
zfs_btree_leaf_cache:   4096,      0,     104,      21,     292, 0,   0,   0
metaslab_alloc_trace_cache:     72,      0,       0, 0,       0,   0,   
0,   0
ddt_cache:            24840,      0,      13,       0,      13, 0,   0,   0
ddt_entry_cache:        392,      0,       0,       0,       0, 0,   0,   0
zio_cache:             1232,      0,       8,     178,   24000, 0,   0,   0
zio_link_cache:          48,      0,       0,    1008,   12945, 0,   0,   0
zio_buf_comb_512:       512,      0,      69,      59,   18526, 0,   0,   0
zio_buf_comb_1024:     1024,      0,      61,       7,      70, 0,   0,   0
zio_buf_comb_1536:     1536,      0,      40,      10,      53, 0,   0,   0
zio_buf_comb_2048:     2048,      0,      24,       4,      32, 0,   0,   0
zio_buf_comb_2560:     2560,      0,      21,       3,      29, 0,   0,   0
zio_buf_comb_3072:     3072,      0,      13,      11,      20, 0,   0,   0
zio_buf_comb_3584:     3584,      0,       4,       2,       4, 0,   0,   0
zio_buf_comb_4096:     4096,      0,     446,       7,    1248, 0,   0,   0
zio_buf_comb_5120:     5120,      0,       6,       0,       6, 0,   0,   0
zio_buf_comb_6144:     6144,      0,       3,       0,       3, 0,   0,   0
zio_buf_comb_7168:     7168,      0,       6,       0,       6, 0,   0,   0
zio_buf_comb_8192:     8192,      0,       9,       9,     150, 0,   0,   0
zio_buf_comb_10240:   10240,      0,       9,       0,       9, 0,   0,   0
zio_buf_comb_12288:   12288,      0,       3,       9,      64, 0,   0,   0
zio_buf_comb_14336:   14336,      0,       8,       0,       9, 0,   0,   0
zio_buf_comb_16384:   16384,      0,     202,      11,     422, 0,   0,   0
zio_buf_comb_20480:   20480,      0,       3,       7,      32, 0,   0,   0
zio_buf_comb_24576:   24576,      0,       7,       4,      27, 0,   0,   0
zio_buf_comb_28672:   28672,      0,       3,       5,      19, 0,   0,   0
zio_buf_comb_32768:   32768,      0,       2,       2,      19, 0,   0,   0
zio_buf_comb_40960:   40960,      0,       5,       3,      25, 0,   0,   0
zio_buf_comb_49152:   49152,      0,       2,       9,      47, 0,   0,   0
zio_buf_comb_57344:   57344,      0,       3,       6,      20, 0,   0,   0
zio_buf_comb_65536:   65536,      0,       1,       3,      11, 0,   0,   0
zio_buf_comb_81920:   81920,      0,       2,       8,      43, 0,   0,   0
zio_buf_comb_98304:   98304,      0,       1,      12,      58, 0,   0,   0
zio_buf_comb_114688: 114688,      0,       2,       6,      16, 0,   0,   0
zio_buf_comb_131072: 131072,      0,     119,      10,     535, 0,   0,   0
zio_buf_comb_163840: 163840,      0,       0,       0,       0, 0,   0,   0
zio_buf_comb_196608: 196608,      0,       0,       0,       0, 0,   0,   0
zio_buf_comb_229376: 229376,      0,       0,       0,       0, 0,   0,   0
zio_buf_comb_262144: 262144,      0,       0,       0,       0, 0,   0,   0
zio_buf_comb_327680: 327680,      0,       0,       0,       0, 0,   0,   0
zio_buf_comb_393216: 393216,      0,       0,       0,       0, 0,   0,   0
zio_buf_comb_458752: 458752,      0,       0,       0,       0, 0,   0,   0
zio_buf_comb_524288: 524288,      0,       0,       0,       0, 0,   0,   0
zio_buf_comb_655360: 655360,      0,       0,       0,       0, 0,   0,   0
zio_buf_comb_786432: 786432,      0,       0,       0,       0, 0,   0,   0
zio_buf_comb_917504: 917504,      0,       0,       0,       0, 0,   0,   0
zio_buf_comb_1048576: 1048576,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_1310720: 1310720,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_1572864: 1572864,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_1835008: 1835008,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_2097152: 2097152,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_2621440: 2621440,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_3145728: 3145728,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_3670016: 3670016,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_4194304: 4194304,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_5242880: 5242880,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_6291456: 6291456,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_7340032: 7340032,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_8388608: 8388608,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_10485760: 10485760,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_12582912: 12582912,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_14680064: 14680064,      0,       0,       0, 0,   0,   0,   0
zio_buf_comb_16777216: 16777216,      0,       0,       0, 0,   0,   0,   0
abd_chunk:             4096,      0,    1579,       1,    2466, 0,   0,   0
sa_cache:               288,      0,     394,      26,     404, 0,   0,   0
dnode_t:                816,      0,     910,      15,    1604, 0,   0,   0
arc_buf_hdr_t_full:     248,      0,     814,      34,   10055, 0,   0,   0
arc_buf_hdr_t_full_crypt:    312,      0,       0,       0, 0,   0,   0,   0
arc_buf_hdr_t_l2only:     96,      0,       0,       0,       0, 0,   0,   0
arc_buf_t:               64,      0,     634,     122,   10465, 0,   0,   0
dmu_buf_impl_t:         296,      0,    1333,      45,   10741, 0,   0,   0
zil_lwb_cache:          360,      0,       4,      18,       4, 0,   0,   0
zil_zcw_cache:           80,      0,       0,      50,       4, 0,   0,   0
sio_cache_0:            136,      0,       0,       0,       0, 0,   0,   0
sio_cache_1:            152,      0,       0,       0,       0, 0,   0,   0
sio_cache_2:            168,      0,       0,       0,       0, 0,   0,   0
zfs_znode_cache:        472,      0,     394,      30,     404, 0,   0,   0
ksiginfo:               112,      0,      17,     487,      17, 0,   0,   0
itimer:                 352,      0,       0,       0,       0, 0,   0,   0
KNOTE:                  160,      0,       0,       0,       0, 0,   0,   0
socket:                 944, 260881,       0,       8,       2, 0,   0,   0
ipq:                     56,  15857,       0,       0,       0, 0,   0,   0
udp_inpcb:              488, 260881,       0,      16,       2, 0,   0,   0
udpcb:                   32, 260881,       0,     252,       2, 0,   0,   0
tcp_inpcb:              488, 260881,       0,       0,       0, 0,   0,   0
tcpcb:                 1048, 260881,       0,       0,       0, 0,   0,   0
tcptw:                   88,  27767,       0,       0,       0, 0,   0,   0
syncache:               168,  15360,       0,       0,       0, 0,   0,   0
hostcache:               96,  15360,       0,       0,       0, 0,   0,   0
sackhole:                32,      0,       0,       0,       0, 0,   0,   0
tfo:                      4,      0,       0,       0,       0, 0,   0,   0
tfo_ccache_entries:      80,      0,       0,       0,       0, 0,   0,   0
tcpreass:                48,  31714,       0,       0,       0, 0,   0,   0
tcp_log:                408, 5000000,       0,       0,       0, 0,   0,   0
tcp_log_bucket:         176,      0,       0,       0,       0, 0,   0,   0
tcp_log_node:           120,      0,       0,       0,       0, 0,   0,   0
udplite_inpcb:          488, 260881,       0,       0,       0, 0,   0,   0
ripcb:                  488, 260881,       0,       0,       0, 0,   0,   0
IPsec SA lft_c:          16,      0,       0,       0,       0, 0,   0,   0
unpcb:                  256, 260881,       0,       0,       0, 0,   0,   0
routing nhops:          256,      0,       0,       0,       0, 0,   0,   0
rtentry:                176,      0,       0,       0,       0, 0,   0,   0
swpctrie:               144, 1014860,       0,       0,       0, 0,   0,   0
swblk:                  136, 1014855,       0,       0,       0, 0,   0,   0

------------------------------------------------------------------------
vmstat -i

interrupt                          total       rate
irq1: atkbd0                           2          0
irq14: ata0                         1492          5
irq15: ata1                           39          0
irq20: vboxguest0                      1          0
cpu0:timer                           861          3
cpu1:timer                           722          2
cpu2:timer                           642          2
cpu3:timer                           544          2
Total                               4303         14

------------------------------------------------------------------------
pstat -T

   4/260881 files
0M/0M swap space

------------------------------------------------------------------------
pstat -s

Device          512-blocks     Used    Avail Capacity

------------------------------------------------------------------------
iostat

        tty            ada0              cd0 pass0             cpu
  tin  tout KB/t  tps  MB/s  KB/t  tps  MB/s  KB/t  tps  MB/s  us ni sy 
in id
    0    95 13.5  186   2.5   0.0    0   0.0   0.0    0   0.0   0 0 13  3 84

------------------------------------------------------------------------
ipcs -a

Message Queues:
T           ID          KEY MODE        OWNER    GROUP    CREATOR 
CGROUP                 CBYTES                 QNUM QBYTES        
LSPID        LRPID STIME    RTIME    CTIME

Shared Memory:
T           ID          KEY MODE        OWNER    GROUP    CREATOR 
CGROUP         NATTCH        SEGSZ         CPID         LPID ATIME    
DTIME    CTIME

Semaphores:
T           ID          KEY MODE        OWNER    GROUP    CREATOR 
CGROUP          NSEMS OTIME    CTIME


------------------------------------------------------------------------
ipcs -T

msginfo:
     msgmax:        16384    (max characters in a message)
     msgmni:           40    (# of message queues)
     msgmnb:         2048    (max characters in a message queue)
     msgtql:           40    (max # of messages in system)
     msgssz:            8    (size of a message segment)
     msgseg:         2048    (# of message segments in system)

shminfo:
     shmmax:    536870912    (max shared memory segment size)
     shmmin:            1    (min shared memory segment size)
     shmmni:          192    (max number of shared memory identifiers)
     shmseg:          128    (max shared memory segments per process)
     shmall:       131072    (max amount of shared memory in pages)

seminfo:
     semmni:           50    (# of semaphore identifiers)
     semmns:          340    (# of semaphores in system)
     semmnu:          150    (# of undo structures in system)
     semmsl:          340    (max # of semaphores per id)
     semopm:          100    (max # of operations per semop call)
     semume:           50    (max # of undo entries per process)
     semusz:          632    (size in bytes of undo structure)
     semvmx:        32767    (semaphore maximum value)
     semaem:        16384    (adjust on exit max value)


------------------------------------------------------------------------
netstat -s

tcp:
     0 packets sent
         0 data packets (0 bytes)
         0 data packets (0 bytes) retransmitted
         0 data packets unnecessarily retransmitted
         0 resends initiated by MTU discovery
         0 ack-only packets (0 delayed)
         0 URG only packets
         0 window probe packets
         0 window update packets
         0 control packets
     0 packets received
         0 acks (for 0 bytes)
         0 duplicate acks
         0 acks for unsent data
         0 packets (0 bytes) received in-sequence
         0 completely duplicate packets (0 bytes)
         0 old duplicate packets
         0 packets with some dup. data (0 bytes duped)
         0 out-of-order packets (0 bytes)
         0 packets (0 bytes) of data after window
         0 window probes
         0 window update packets
         0 packets received after close
         0 discarded for bad checksums
         0 discarded for bad header offset fields
         0 discarded because packet too short
         0 discarded due to full reassembly queue
     0 connection requests
     0 connection accepts
     0 bad connection attempts
     0 listen queue overflows
     0 ignored RSTs in the windows
     0 connections established (including accepts)
         0 times used RTT from hostcache
         0 times used RTT variance from hostcache
         0 times used slow-start threshold from hostcache
     0 connections closed (including 0 drops)
         0 connections updated cached RTT on close
         0 connections updated cached RTT variance on close
         0 connections updated cached ssthresh on close
     0 embryonic connections dropped
     0 segments updated rtt (of 0 attempts)
     0 retransmit timeouts
         0 connections dropped by rexmit timeout
     0 persist timeouts
         0 connections dropped by persist timeout
     0 Connections (fin_wait_2) dropped because of timeout
     0 keepalive timeouts
         0 keepalive probes sent
         0 connections dropped by keepalive
     0 correct ACK header predictions
     0 correct data packet header predictions
     0 syncache entries added
         0 retransmitted
         0 dupsyn
         0 dropped
         0 completed
         0 bucket overflow
         0 cache overflow
         0 reset
         0 stale
         0 aborted
         0 badack
         0 unreach
         0 zone failures
     0 cookies sent
     0 cookies received
     0 hostcache entries added
         0 bucket overflow
     0 SACK recovery episodes
     0 segment rexmits in SACK recovery episodes
     0 byte rexmits in SACK recovery episodes
     0 SACK options (SACK blocks) received
     0 SACK options (SACK blocks) sent
     0 SACK scoreboard overflow
     0 packets with ECN CE bit set
     0 packets with ECN ECT(0) bit set
     0 packets with ECN ECT(1) bit set
     0 successful ECN handshakes
     0 times ECN reduced the congestion window
     0 packets with matching signature received
     0 packets with bad signature received
     0 times failed to make signature due to no SA
     0 times unexpected signature received
     0 times no signature provided by segment
     0 Path MTU discovery black hole detection activations
     0 Path MTU discovery black hole detection min MSS activations
     0 Path MTU discovery black hole detection failures
TCP connection count by state:
     0 connections in CLOSED state
     0 connections in LISTEN state
     0 connections in SYN_SENT state
     0 connections in SYN_RCVD state
     0 connections in ESTABLISHED state
     0 connections in CLOSE_WAIT state
     0 connections in FIN_WAIT_1 state
     0 connections in CLOSING state
     0 connections in LAST_ACK state
     0 connections in FIN_WAIT_2 state
     0 connections in TIME_WAIT state
udp:
     0 datagrams received
     0 with incomplete header
     0 with bad data length field
     0 with bad checksum
     0 with no checksum
     0 dropped due to no socket
     0 broadcast/multicast datagrams undelivered
     0 dropped due to full socket buffers
     0 not for hashed pcb
     0 delivered
     0 datagrams output
     0 times multicast source filter matched
ip:
     0 total packets received
     0 bad header checksums
     0 with size smaller than minimum
     0 with data size < data length
     0 with ip length > max ip packet size
     0 with header length < data size
     0 with data length < header length
     0 with bad options
     0 with incorrect version number
     0 fragments received
     0 fragments dropped (dup or out of space)
     0 fragments dropped after timeout
     0 packets reassembled ok
     0 packets for this host
     0 packets for unknown/unsupported protocol
     0 packets forwarded (0 packets fast forwarded)
     0 packets not forwardable
     0 packets received for unknown multicast group
     0 redirects sent
     0 packets sent from this host
     0 packets sent with fabricated ip header
     0 output packets dropped due to no bufs, etc.
     0 output packets discarded due to no route
     0 output datagrams fragmented
     0 fragments created
     0 datagrams that can't be fragmented
     0 tunneling packets that can't find gif
     0 datagrams with bad address in header
icmp:
     0 calls to icmp_error
     0 errors not generated in response to an icmp message
     0 messages with bad code fields
     0 messages less than the minimum length
     0 messages with bad checksum
     0 messages with bad length
     0 multicast echo requests ignored
     0 multicast timestamp requests ignored
     0 message responses generated
     0 invalid return addresses
     0 no return routes
arp:
     0 ARP requests sent
     0 ARP requests failed to sent
     0 ARP replies sent
     0 ARP requests received
     0 ARP replies received
     0 ARP packets received
     0 total packets dropped due to no ARP entry
     0 ARP entrys timed out
     0 Duplicate IPs seen
ip6:
     0 total packets received
     0 with size smaller than minimum
     0 with data size < data length
     0 with bad options
     0 with incorrect version number
     0 fragments received
     0 fragments dropped (dup or out of space)
     0 fragments dropped after timeout
     0 fragments that exceeded limit
     0 atomic fragments
     0 packets reassembled ok
     0 packets for this host
     0 packets forwarded
     0 packets not forwardable
     0 redirects sent
     0 packets sent from this host
     0 packets sent with fabricated ip header
     0 output packets dropped due to no bufs, etc.
     0 output packets discarded due to no route
     0 output datagrams fragmented
     0 fragments created
     0 datagrams that can't be fragmented
     0 packets that violated scope rules
     0 multicast packets which we don't join
     Mbuf statistics:
         0 one mbuf
         0 one ext mbuf
         0 two or more ext mbuf
     0 packets whose headers are not contiguous
     0 tunneling packets that can't find gif
     0 packets discarded because of too many headers
     0 failures of source address selection
icmp6:
     0 calls to icmp6_error
     0 errors not generated in response to an icmp6 message
     0 errors not generated because of rate limitation
     0 messages with bad code fields
     0 messages < minimum length
     0 bad checksums
     0 messages with bad length
     Histogram of error messages to be generated:
         0 no route
         0 administratively prohibited
         0 beyond scope
         0 address unreachable
         0 port unreachable
         0 packet too big
         0 time exceed transit
         0 time exceed reassembly
         0 erroneous header field
         0 unrecognized next header
         0 unrecognized option
         0 redirect
         0 unknown
     0 message responses generated
     0 messages with too many ND options
     0 messages with bad ND options
     0 bad neighbor solicitation messages
     0 bad neighbor advertisement messages
     0 bad router solicitation messages
     0 bad router advertisement messages
     0 bad redirect messages
     0 default routers overflows
     0 prefix overflows
     0 neighbour entries overflows
     0 redirect overflows
     0 messages with invalid hop limit
     0 path MTU changes
rip6:
     0 messages received
     0 checksum calculations on inbound
     0 messages with bad checksum
     0 messages dropped due to no socket
     0 multicast messages dropped due to no socket
     0 messages dropped due to full socket buffers
     0 delivered
     0 datagrams output
pfkey:
     0 requests sent from userland
     0 bytes sent from userland
     0 messages with invalid length field
     0 messages with invalid version field
     0 messages with invalid message type field
     0 messages too short
     0 messages with memory allocation failure
     0 messages with duplicate extension
     0 messages with invalid extension type
     0 messages with invalid sa type
     0 messages with invalid address extension
     0 requests sent to userland
     0 bytes sent to userland
     0 messages toward single socket
     0 messages toward all sockets
     0 messages toward registered sockets
     0 messages with memory allocation failure

------------------------------------------------------------------------
netstat -m

netstat: memstat_kvm_all:

------------------------------------------------------------------------
netstat -anA

Active Internet connections (including servers)
Tcpcb            Proto Recv-Q Send-Q Local Address      Foreign 
Address    (state)
fffffe00db199418 tcp4       0      0 192.168.1.160.4551 
172.217.7.163.80   ESTABLISHED
fffffe00db4588f0 tcp4       0      0 192.168.1.160.4551 
172.217.13.72.443  ESTABLISHED
fffff800cc04daa8 tcp4       0      0 192.168.1.160.4551 
96.47.72.84.443    TIME_WAIT
fffff800cc04db00 tcp4       0      0 192.168.1.160.4551 
96.47.72.84.443    TIME_WAIT
fffff800cc04db58 tcp4       0      0 192.168.1.160.4551 
96.47.72.84.443    TIME_WAIT
fffff800cc04da50 tcp4       0      0 192.168.1.160.4551 
96.47.72.84.443    TIME_WAIT
fffff800cc04d9f8 tcp4       0      0 192.168.1.160.4551 
96.47.72.84.443    TIME_WAIT
fffff800cc04dbb0 tcp4       0      0 192.168.1.160.4550 
96.47.72.84.443    TIME_WAIT
fffffe00db1f1000 tcp4       0      0 192.168.1.160.4550 
96.47.72.84.443    ESTABLISHED
fffffe00db1f1418 tcp4       0      0 192.168.1.160.4550 
96.47.72.84.443    ESTABLISHED
fffffe00db1f1830 tcp4       0      0 192.168.1.160.4550 
96.47.72.84.443    ESTABLISHED
fffffe00db187c48 tcp4       0      0 192.168.1.160.4550 
96.47.72.84.443    ESTABLISHED
fffffe00db1f1c48 tcp4       0      0 192.168.1.160.4550 
72.21.91.29.80     ESTABLISHED
fffffe00db188060 tcp4       0      0 192.168.1.160.4550 
34.98.75.36.443    ESTABLISHED
fffffe00db199c48 tcp4       0      0 192.168.1.160.4550 
13.249.39.62.443   ESTABLISHED
fffffe00db195ca8 tcp4       0      0 192.168.1.160.4547 
172.217.15.78.443  ESTABLISHED
fffffe00db188ca8 tcp4       0      0 192.168.1.160.4547 
192.0.73.2.443     ESTABLISHED
fffff800cc04d840 tcp4       0      0 192.168.1.160.4546 
172.217.2.98.443   TIME_WAIT
fffff800cc04d8f0 tcp4       0      0 192.168.1.160.4546 
142.250.73.227.443 TIME_WAIT
fffff800cc04d898 tcp4       0      0 192.168.1.160.4545 
172.217.7.226.443  TIME_WAIT
fffff800cc04d948 tcp4       0      0 192.168.1.160.4545 
172.217.2.110.443  TIME_WAIT
fffff800cc04d9a0 tcp4       0      0 192.168.1.160.4545 
142.250.73.227.443 TIME_WAIT
fffff800cc04dc08 tcp4       0      0 192.168.1.160.4545 
142.250.73.195.443 TIME_WAIT
fffff800cc04d7e8 tcp4       0      0 192.168.1.160.4545 
142.250.31.105.443 TIME_WAIT
fffffe00d8b90890 tcp4       0      0 192.168.1.160.4545 
172.217.7.227.443  ESTABLISHED
fffff800cc04dc60 tcp4       0      0 192.168.1.160.4544 
172.217.9.195.443  TIME_WAIT
fffffe00d8bdb830 tcp4       0      0 192.168.1.160.4544 
172.217.3.99.80    ESTABLISHED
fffffe00db1894d8 tcp4       0      0 192.168.1.160.4544 
142.250.31.104.443 ESTABLISHED
fffffe00d8b3f478 tcp4       0      0 192.168.1.160.4544 
142.250.31.99.443  CLOSE_WAIT
fffffe00d8b3f890 tcp4       0      0 192.168.1.160.4544 
172.217.3.99.80    ESTABLISHED
fffffe00d8b8f000 tcp4       0      0 192.168.1.160.4544 
72.21.91.29.80     CLOSED
fffffe00d8b90060 tcp4       0      0 192.168.1.160.4544 
185.199.108.153.44 ESTABLISHED
fffffe00d8b8f418 tcp4       0      0 192.168.1.160.4544 
185.199.110.153.44 ESTABLISHED
fffffe00d8cfd478 tcp4       0      0 192.168.1.160.4543 
72.21.91.29.80     CLOSE_WAIT
fffffe00d8b404d8 tcp4       0      0 192.168.1.160.4543 
72.21.91.29.80     CLOSED
fffffe00d8b8f830 tcp4       0      0 192.168.1.160.4543 
13.249.39.105.443  CLOSED
fffffe00d8b8fc48 tcp4       0      0 192.168.1.160.4543 
13.249.39.105.443  CLOSED
fffffe00d8b90478 tcp4       0      0 192.168.1.160.4543 
34.120.237.76.443  CLOSE_WAIT
fffffe00d8bdbc48 tcp4       0      0 192.168.1.160.4543 
172.217.3.99.80    ESTABLISHED
fffffe00d8b3fca8 tcp4       0      0 192.168.1.160.4543 
13.249.39.105.443  CLOSED
fffffe00d8b400c0 tcp4       0      0 192.168.1.160.4543 
52.33.6.204.443    ESTABLISHED
fffffe00d8cfd890 tcp4       0      0 192.168.1.160.4542 
99.84.176.92.443   CLOSED
fffffe00d8b90ca8 tcp4       0      0 192.168.1.160.4542 
72.21.91.29.80     CLOSED
fffffe00d8bdc060 tcp4       0      0 192.168.1.160.4542 
99.84.176.92.443   CLOSED
fffffe00d8cfdca8 tcp4       0      0 192.168.1.160.4542 
34.120.5.221.443   CLOSE_WAIT
fffffe00d8cfe4d8 tcp4       0      0 192.168.1.160.4542 
13.32.196.214.80   ESTABLISHED
fffffe00d8b910c0 tcp4       0      0 192.168.1.160.3787 
52.85.149.37.443   ESTABLISHED
fffffe00d8b914d8 tcp4       0      0 192.168.1.160.2102 
18.208.93.32.443   CLOSE_WAIT
fffffe00d8cfe0c0 tcp4       0      0 192.168.1.160.6160 
34.107.221.82.80   ESTABLISHED
fffffe00d8bdc478 tcp4       0      0 192.168.1.160.4903 
34.107.221.82.80   ESTABLISHED
fffffe00d8bdc890 tcp4       0      0 127.0.0.1.139 *.*                
LISTEN
fffffe00d8bdcca8 tcp4       0      0 127.0.0.1.445 *.*                
LISTEN
fffffe00d8bdd0c0 tcp4       0      0 192.168.1.160.139 
*.*                LISTEN
fffffe00d8bdd4d8 tcp4       0      0 192.168.1.160.445 
*.*                LISTEN
fffffe00d8cfe8f0 tcp4       0      0 192.168.1.160.5357 
*.*                LISTEN
fffffe00d8bdd8f0 tcp4       0      0 *.22 *.*                LISTEN
fffffe00d8b408f0 tcp6       0      0 *.22 *.*                LISTEN
fffffe00d8b918f0 tcp4       0      0 127.0.0.1.25 *.*                LISTEN
fffff8000d7d0b70 udp4       0      0 192.168.1.160.3702 *.*
fffff8000dc88d58 udp4       0      0 *.11821 *.*
fffff800870cb5b8 udp4       0      0 239.255.255.250.37 *.*
fffff800870cbb70 udp4       0      0 192.168.1.255.138 *.*
fffff800870cbd58 udp4       0      0 192.168.1.160.138 *.*
fffff8000d870000 udp4       0      0 192.168.1.255.137 *.*
fffff8000d8701e8 udp4       0      0 192.168.1.160.137 *.*
fffff8000d870988 udp4       0      0 *.138 *.*
fffff8000d870d58 udp4       0      0 *.137 *.*
fffff8000d5723d0 udp6       0      0 *.23305 *.*
fffff8000d572b70 udp4       0      0 *.58262 *.*
fffff8000d5725b8 udp6       0      0 *.5353 *.*
fffff8000d572988 udp4       0      0 *.5353 *.*
fffff8000d572d58 udp4       0      0 *.514 *.*
fffff8000d5727a0 udp6       0      0 *.514 *.*

------------------------------------------------------------------------
netstat -aL

Current listen queue sizes (qlen/incqlen/maxqlen)
Proto Listen                           Local Address
tcp4  0/0/128                          localhost.netbios-ssn
tcp4  0/0/128                          localhost.microsoft-ds
tcp4  0/0/128                          drb-freebsd-13.f.netbi
tcp4  0/0/128                          drb-freebsd-13.f.micro
tcp4  0/0/5                            drb-freebsd-13.f.5357
tcp4  0/0/128                          *.ssh
tcp6  0/0/128                          *.ssh
tcp4  0/0/10                           localhost.smtp

------------------------------------------------------------------------
fstat

USER     CMD          PID   FD MOUNT      INUM MODE         SZ|DV R/W
root     Timer        175 root /            34 drwxr-xr-x      26 r
root     Timer        175   wd /            34 drwxr-xr-x      26 r
root     kldload      174 root /            34 drwxr-xr-x      26 r
root     kldload      174   wd /            34 drwxr-xr-x      26 r
root     kldload      174 text /           603 -r-xr-xr-x    8720 r
root     kldload      174 ctty /dev          6 crw-------  console rw
root     kldload      174    0 /dev          6 crw-------  console rw
root     kldload      174    1 /dev         13 crw-rw-rw-    null w
root     kldload      174    2 /dev         13 crw-rw-rw-    null w
root     sh           172 root /            34 drwxr-xr-x      26 r
root     sh           172   wd /            34 drwxr-xr-x      26 r
root     sh           172 text /        361232 -r-xr-xr-x  162616 r
root     sh           172 ctty /dev          6 crw-------  console rw
root     sh           172    0 /dev          6 crw-------  console rw
root     sh           172    1 /dev          6 crw-------  console rw
root     sh           172    2 /dev          6 crw-------  console rw
root     sh           172   10 /        428033 -rwxr-xr-x    1178 r
root     sh            26 root /            34 drwxr-xr-x      26 r
root     sh            26   wd /            34 drwxr-xr-x      26 r
root     sh            26 text /        361232 -r-xr-xr-x  162616 r
root     sh            26 ctty /dev          6 crw-------  console rw
root     sh            26    0 /dev          6 crw-------  console rw
root     sh            26    1 /dev          6 crw-------  console rw
root     sh            26    2 /dev          6 crw-------  console rw
root     sh            26   10 /           880 -rw-r--r--    5042 r
root     init           1 root /            34 drwxr-xr-x      26 r
root     init           1   wd /            34 drwxr-xr-x      26 r
root     init           1 text /        361300 -r-xr-xr-x 1253152  r
root     kernel         0 root /            34 drwxr-xr-x      26 r
root     kernel         0   wd /            34 drwxr-xr-x      26 r

------------------------------------------------------------------------
dmesg

---<<BOOT>>---
Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
     The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 13.0-RC2 #0 releng/13.0-n244684-13c22f74953: Fri Mar 12 04:05:19 
UTC 2021
root_at_releng1.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64
FreeBSD clang version 11.0.1 (git_at_github.com:llvm/llvm-project.git 
llvmorg-11.0.1-0-g43ff75f2c3fe)
VT(vga): text 80x25
CPU: Intel(R) Core(TM) i7 CPU         950  _at_ 3.07GHz (3103.68-MHz 
K8-class CPU)
   Origin="GenuineIntel"  Id=0x106a5  Family=0x6  Model=0x1a Stepping=5
Features=0x1783fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,HTT>
   Features2=0x180201<SSE3,SSSE3,SSE4.1,SSE4.2>
   AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
   AMD Features2=0x1<LAHF>
   Structured Extended Features3=0x10000000<L1DFL>
   TSC: P-state invariant
real memory  = 9126805504 (8704 MB)
avail memory = 8285257728 (7901 MB)
Event timer "LAPIC" quality 100
ACPI APIC Table: <VBOX   VBOXAPIC>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 cache groups x 1 core(s)
random: unblocking device.
ioapic0: MADT APIC ID 4 != hw id 0
ioapic0 <Version 2.0> irqs 0-23
Launching APs: 2 1 3
Timecounter "TSC-low" frequency 1551839460 Hz quality 1000
KTLS: Initialized 4 threads
random: entropy device external interface
[ath_hal] loaded
WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 
14.0.
kbd1 at kbdmux0
000.000058 [4350] netmap_init               netmap: loaded module
mlx5en: Mellanox Ethernet driver 3.6.0 (December 2020)
nexus0
vtvga0: <VT VGA driver>
cryptosoft0: <software crypto>
aesni0: No AES or SHA support.
acpi0: <VBOX VBOXXSDT>
acpi0: Power Button (fixed)
acpi0: Sleep Button (fixed)
cpu0: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
isab0: <PCI-ISA bridge> at device 1.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel PIIX4 UDMA33 controller> port 
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xd000-0xd00f at device 1.1 on pci0
ata0: <ATA channel> at channel 0 on atapci0
ata1: <ATA channel> at channel 1 on atapci0
vgapci0: <VGA-compatible display> mem 0xe0000000-0xefffffff irq 18 at 
device 2.0 on pci0
vgapci0: Boot video device
em0: <Intel(R) PRO/1000 Network Connection> port 0xd010-0xd017 mem 
0xf0000000-0xf001ffff irq 19 at device 3.0 on pci0
em0: Using 1024 TX descriptors and 1024 RX descriptors
em0: Ethernet address: 08:00:27:dd:d4:fc
em0: netmap queues/slots: TX 1/1024, RX 1/1024
pcm0: <Intel ICH (82801AA)> port 0xd100-0xd1ff,0xd200-0xd23f irq 21 at 
device 5.0 on pci0
pcm0: <SigmaTel STAC9700/83/84 AC97 Codec>
ohci0: <Apple KeyLargo/Intrepid USB controller> mem 
0xf0804000-0xf0804fff irq 22 at device 6.0 on pci0
usbus0 on ohci0
usbus0: 12Mbps Full Speed USB v1.0
pci0: <bridge> at device 7.0 (no driver attached)
ehci0: <Intel 82801FB (ICH6) USB 2.0 controller> mem 
0xf0805000-0xf0805fff irq 19 at device 11.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
usbus1: 480Mbps High Speed USB v2.0
acpi_acad0: <AC Adapter> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 
14.0.
psm0: model IntelliMouse Explorer, device ID 4
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xe2000-0xe2fff pnpid 
ORM0000 on isa0
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid 
PNP0900 on isa0
atrtc0: <AT realtime clock> at port 0x70 irq 8 on isa0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
atrtc0: non-PNP ISA device will be removed from GENERIC in FreeBSD 14.
Timecounters tick every 10.000 msec
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Trying to mount root from zfs:zroot/ROOT/default []...
Root mount waiting for: CAM usbus0 usbus1
ugen0.1: <Apple OHCI root HUB> at usbus0
uhub0 on usbus0
ugen1.1: <Intel EHCI root HUB> at usbus1
uhub0: <Apple OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
uhub1 on usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ada0 at ata0 bus 0 scbus0 target 0 lun 0
ada0: <VBOX HARDDISK 1.0> ATA8-ACS device
ada0: Serial Number VBb8450cb8-277eed0b
ada0: 33.300MB/s transfers (UDMA2, PIO 65536bytes)
ada0: 61440MB (125829120 512 byte sectors)
cd0 at ata1 bus 0 scbus1 target 0 lun 0
cd0: <VBOX CD-ROM 1.0> Removable CD-ROM SCSI device
cd0: Serial Number VB2-01700376
cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
uhub0: 12 ports with 12 removable, self powered
Root mount waiting for: usbus1
Root mount waiting for: usbus1
Root mount waiting for: usbus1
Root mount waiting for: usbus1
uhub1: 12 ports with 12 removable, self powered
Setting hostuuid: 56767ad9-d311-7b42-9f7f-db26ca8d9b82.
Setting hostid: 0x10458f66.
Starting file system checks:
no pools available to import
Mounting local filesystems:.
Setting hostname: drb-freebsd-13.localdomain.
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 
/usr/local/lib/compat/pkg /usr/local/lib/compat/pkg /usr/local/lib/gcc10 
/usr/local/lib/gcc9 /usr/local/lib/mysql /usr/local/lib/mysql/plugin 
/usr/local/lib/perl5/5.32/mach/CORE /usr/local/lib/qt5 
/usr/local/lib/samba4 /usr/local/lib/signon 
/usr/local/lib/signon/extensions /usr/local/llvm10/lib
32-bit compatibility ldconfig path: /usr/lib32
Setting up harvesting: 
[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED
Feeding entropy: .
vboxguest0 port 0xd020-0xd03f mem 
0xf0400000-0xf07fffff,0xf0800000-0xf0803fff irq 20 at device 4.0 on pci0
Sleeping thread (tid 100521, pid 174) owns a non-sleepable lock
KDB: stack backtrace of thread 100521:
#0 0xffffffff80c16291 at mi_switch+0xc1
#1 0xffffffff8293cf37 at rtR0SemEventMultiBsdWait+0x297
#2 0xffffffff8291d36a at vgdrvHgcmAsyncWaitCallbackWorker+0x14a
#3 0xffffffff8291e49b at VbglR0HGCMInternalConnect+0x11b
#4 0xffffffff8291ad33 at VGDrvCommonIoCtl+0xb53
#5 0xffffffff82919af6 at VGDrvCommonProcessOptionsFromHost+0x146
#6 0xffffffff8291d9f8 at vgdrvFreeBSDAttach+0x1d8
#7 0xffffffff80c462ad at device_attach+0x3dd
#8 0xffffffff80c45eb1 at device_probe_and_attach+0x41
#9 0xffffffff8085b966 at pci_driver_added+0xf6
#10 0xffffffff80c43d29 at devclass_driver_added+0x39
#11 0xffffffff80c43cad at devclass_add_driver+0x13d
#12 0xffffffff80be6964 at module_register_init+0xa4
#13 0xffffffff80bd8667 at linker_load_module+0xbc7
#14 0xffffffff80bd9e4b at kern_kldload+0xbb
#15 0xffffffff80bd9f7b at sys_kldload+0x5b
#16 0xffffffff8108aa8c at amd64_syscall+0x10c
#17 0xffffffff810618be at fast_syscall_common+0xf8
panic: sleeping thread
cpuid = 0
time = 1616100801
KDB: stack backtrace:
#0 0xffffffff80c57105 at kdb_backtrace+0x65
#1 0xffffffff80c09cd1 at vpanic+0x181
#2 0xffffffff80c09b43 at panic+0x43
#3 0xffffffff80c6e526 at propagate_priority+0x296
#4 0xffffffff80c6f0c3 at turnstile_wait+0x313
#5 0xffffffff80be7b9c at __mtx_lock_sleep+0x17c
#6 0xffffffff80c256bf at softclock_call_cc+0xff
#7 0xffffffff80c25b89 at softclock+0x79
#8 0xffffffff80bcae0d at ithread_loop+0x24d
#9 0xffffffff80bc7c0e at fork_exit+0x7e
#10 0xffffffff8106201e at fork_trampoline+0xe
Uptime: 8s
Dumping 364 out of 8152 MB:..5%..14%..22%..31%..44%..53%..62%..71%..84%..93%

------------------------------------------------------------------------
kernel config

options    CONFIG_AUTOGENERATED
ident    GENERIC
machine    amd64
cpu    HAMMER
makeoptions    WITH_CTF=1
makeoptions    DEBUG=-g
options    IICHID_SAMPLING
options    HID_DEBUG
options    EVDEV_SUPPORT
options    XENHVM
options    USB_DEBUG
options    ATH_ENABLE_11N
options    AH_AR5416_INTERRUPT_MITIGATION
options    IEEE80211_SUPPORT_MESH
options    IEEE80211_DEBUG
options    SC_PIXEL_MODE
options    VESA
options    COMPAT_LINUXKPI
options    PCI_IOV
options    PCI_HP
options    IOMMU
options    EARLY_AP_STARTUP
options    SMP
options    NETGDB
options    NETDUMP
options    DEBUGNET
options    ZSTDIO
options    GZIO
options    EKCD
options    KDB_TRACE
options    KDB
options    RCTL
options    RACCT_DEFAULT_TO_DISABLED
options    RACCT
options    INCLUDE_CONFIG_FILE
options    DDB_CTF
options    KDTRACE_HOOKS
options    KDTRACE_FRAME
options    MAC
options    CAPABILITIES
options    CAPABILITY_MODE
options    AUDIT
options    HWPMC_HOOKS
options    KBD_INSTALL_CDEV
options    PRINTF_BUFR_SIZE=128
options    _KPOSIX_PRIORITY_SCHEDULING
options    SYSVSEM
options    SYSVMSG
options    SYSVSHM
options    STACK
options    KTRACE
options    SCSI_DELAY=5000
options    COMPAT_FREEBSD12
options    COMPAT_FREEBSD11
options    COMPAT_FREEBSD10
options    COMPAT_FREEBSD9
options    COMPAT_FREEBSD7
options    COMPAT_FREEBSD6
options    COMPAT_FREEBSD5
options    COMPAT_FREEBSD4
options    COMPAT_FREEBSD32
options    EFIRT
options    GEOM_LABEL
options    GEOM_RAID
options    TMPFS
options    PSEUDOFS
options    PROCFS
options    CD9660
options    MSDOSFS
options    NFS_ROOT
options    NFSLOCKD
options    NFSD
options    NFSCL
options    MD_ROOT
options    QUOTA
options    UFS_GJOURNAL
options    UFS_DIRHASH
options    UFS_ACL
options    SOFTUPDATES
options    FFS
options    KERN_TLS
options    SCTP_SUPPORT
options    TCP_RFC7413
options    TCP_HHOOK
options    TCP_BLACKBOX
options    TCP_OFFLOAD
options    ROUTE_MPATH
options    IPSEC_SUPPORT
options    INET6
options    INET
options    VIMAGE
options    PREEMPTION
options    NUMA
options    SCHED_ULE
options    NEW_PCIB
options    GEOM_PART_GPT
options    GEOM_PART_MBR
options    GEOM_PART_EBR
options    GEOM_PART_BSD
device    isa
device    mem
device    io
device    uart_ns8250
device    cpufreq
device    acpi
device    pci
device    fdc
device    ahci
device    ata
device    mvs
device    siis
device    ahc
device    ahd
device    esp
device    hptiop
device    isp
device    mpt
device    mps
device    mpr
device    sym
device    isci
device    ocs_fc
device    pvscsi
device    scbus
device    ch
device    da
device    sa
device    cd
device    pass
device    ses
device    amr
device    arcmsr
device    ciss
device    iir
device    ips
device    mly
device    twa
device    smartpqi
device    tws
device    aac
device    aacp
device    aacraid
device    ida
device    mfi
device    mlx
device    mrsas
device    pmspcv
device    twe
device    nvme
device    nvd
device    vmd
device    vmd_bus
device    atkbdc
device    atkbd
device    psm
device    kbdmux
device    vga
device    splash
device    sc
device    vt
device    vt_vga
device    vt_efifb
device    vt_vbefb
device    agp
device    cbb
device    pccard
device    cardbus
device    uart
device    ppc
device    ppbus
device    lpt
device    ppi
device    puc
device    iflib
device    em
device    ix
device    ixv
device    ixl
device    iavf
device    ice
device    vmx
device    axp
device    bxe
device    le
device    ti
device    mlx5
device    mlxfw
device    mlx5en
device    miibus
device    ae
device    age
device    alc
device    ale
device    bce
device    bfe
device    bge
device    cas
device    dc
device    et
device    fxp
device    gem
device    jme
device    lge
device    msk
device    nfe
device    nge
device    re
device    rl
device    sge
device    sis
device    sk
device    ste
device    stge
device    vge
device    vr
device    xl
device    wlan
device    wlan_wep
device    wlan_ccmp
device    wlan_tkip
device    wlan_amrr
device    an
device    ath
device    ath_pci
device    ath_hal
device    ath_rate_sample
device    ipw
device    iwi
device    iwn
device    malo
device    mwl
device    ral
device    wpi
device    crypto
device    aesni
device    loop
device    padlock_rng
device    rdrand_rng
device    ether
device    vlan
device    tuntap
device    md
device    gif
device    firmware
device    xz
device    bpf
device    uhci
device    ohci
device    ehci
device    xhci
device    usb
device    ukbd
device    umass
device    sound
device    snd_cmi
device    snd_csa
device    snd_emu10kx
device    snd_es137x
device    snd_hda
device    snd_ich
device    snd_via8233
device    mmc
device    mmcsd
device    sdhci
device    rtsx
device    virtio
device    virtio_pci
device    vtnet
device    virtio_blk
device    virtio_scsi
device    virtio_balloon
device    hyperv
device    xenpci
device    netmap
device    evdev
device    uinput
device    hid

------------------------------------------------------------------------
ddb capture buffer

ddb: ddb_capture: kvm_nlist
Received on Fri Mar 19 2021 - 00:09:17 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:41:27 UTC