Re: No display after resume in r196086

From: Damian Gerow <dgerow_at_afflictions.org>
Date: Thu, 13 Aug 2009 13:36:28 -0400
Attilio Rao wrote:
: So, what you can do is to compile a kernel with the following options:
: KDB, DDB, INVARIANT_SUPPORT, INVARIANTS, WITNESS

As I'm running GENERIC, these options are already present.

: when you get the deadlock, you should break in DDB.
: Through a textdump(4) (or serial console or whatever you prefer) you
: should get the following informations:
: bt, ps, show allpcpu, alltrace, show alllocks
: 
: and report here.

I've set ddb script kdb.enter.default="textdump set; capture on; show
allpcpu; bt; ps; alltrace; showalllocks; showalllock; call doadump; reset",
as I don't have a serial console on this machine (and my USB<->serial
adapter doesn't work on FreeBSD).

The script does not run when resuming in graphics mode, unfortunately.
Try as I might, I just don't get anything.  I'm not sure what exactly
the system is doing when it resumes, as attempts to create files on
the local fs seem to fail.

Resuming in text mode does generate a panic.  I've included the requested
information below.  However, this may be a red herring: I've never been
able to resume in text mode, so it is possible these two resume problems
are unrelated.

Note that the below was generated on r196037.  I'm currently building an
8-STABLE for further testing.

----- begin msgbuf.txt
<snip dmesg output>

<5>em0: link state changed to DOWN
usbus7: port reset timeout
uhub_reattach_port:373: port 1 reset failed, error=USB_ERR_TIMEOUT
uhub_reattach_port:463: device problem (USB_ERR_TIMEOUT), disabling port 1
calcru: runtime went backwards from 219239654 usec to 74088058 usec for pid
11 (idle)
<5>em0: link state changed to UP
ugen1.2: <vendor 0x08ff> at usbus1 (disconnected)


Fatal trap 9: general protection fault while in kernel mode
cpuid = 0; apic id = 00
instruction pointer = 0x20:0xffffffff8048e71b
stack pointer           = 0x28:0xffffff8072d59ad0
frame pointer           = 0x28:0xffffff8072d59b20
code segment        = base 0x0, limit 0xfffff, type 0x1b
            = DPL 0, pres 1, long 1, def32 0, gran 1
            processor eflags    = interrupt enabled, resume, IOPL = 0
            current process     = 22 (usbus1)
----- end msgbuf.txt

----- begin ddb.txt
db:0:kdb.enter.default>  show allpcpu
Current CPU: 0

cpuid        = 0
dynamic pcpu    = 0x53d514
curthread    = 0xffffff0003567720: pid 22 "usbus1"
curpcb       = 0xffffff8072d59d40
fpcurthread  = none
idlethread   = 0xffffff00024e6390: pid 11 "idle: cpu0"
curpmap         = 0
tssp            = 0xffffffff80de7300
commontssp      = 0xffffffff80de7300
rsp0            = 0xffffff8072d59d40
gs32p           = 0xffffffff80de6138
ldt             = 0xffffffff80de6178
tss             = 0xffffffff80de6168
spin locks held:

cpuid        = 1
dynamic pcpu    = 0xffffff807f484514
curthread    = 0xffffff000b46d390: pid 1372 "hald"
curpcb       = 0xffffff80755e4d40
fpcurthread  = none
idlethread   = 0xffffff00024e6720: pid 11 "idle: cpu1"
curpmap         = 0
tssp            = 0xffffffff80de7368
commontssp      = 0xffffffff80de7368
rsp0            = 0xffffff80755e4d40
gs32p           = 0xffffffff80de61a0
ldt             = 0xffffffff80de61e0
tss             = 0xffffffff80de61d0
spin locks held:

db:0:kdb.enter.default>  bt
Tracing pid 22 tid 100047 td 0xffffff0003567720
usb_unconfigure() at usb_unconfigure+0x267
usb_free_device() at usb_free_device+0x1bc
uhub_explore() at uhub_explore+0x2a3
usb_bus_explore() at usb_bus_explore+0x9e
usb_process() at usb_process+0xcd
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8072d59d30, rbp = 0 ---
db:0:kdb.enter.default>  ps
  pid  ppid  pgrp   uid   state   wmesg         wchan        cmd
 1424  1416   653     0  R                                   acpiconf
 1416   653   653     0  S       wait     0xffffff0003d63460 sh
 1411  1360  1411  1001  S+      ttyin    0xffffff00035010a8 zsh
 1381  1376  1372     0  S       select   0xffffff000b5ea540 initial thread
 1376  1372  1372     0  S       select   0xffffff000b0bee40 initial thread
 1375     1  1375     0  Ss      (threaded)                  console-kit-daemon
100206                   S       waitvt   0xffffffff80bd7438 console-kit-daemon
100205                   S       waitvt   0xffffffff80bd7430 console-kit-daemon
100204                   S       waitvt   0xffffffff80bd7428 console-kit-daemon
100203                   S       waitvt   0xffffffff80bd7420 console-kit-daemon
100202                   S       waitvt   0xffffffff80bd7418 console-kit-daemon
100201                   S       waitvt   0xffffffff80bd7410 console-kit-daemon
100200                   S       waitvt   0xffffffff80bd7408 console-kit-daemon
100199                   S       waitvt   0xffffffff80bd7400 console-kit-daemon
100198                   S       waitvt   0xffffffff80bd73f8 console-kit-daemon
100197                   S       waitvt   0xffffffff80bd73f0 console-kit-daemon
100196                   S       waitvt   0xffffffff80bd73e8 console-kit-daemon
100195                   S       waitvt   0xffffffff80bd73e0 console-kit-daemon
100194                   S       waitvt   0xffffffff80bd73d8 console-kit-daemon
100193                   S       waitvt   0xffffffff80bd73d0 console-kit-daemon
100192                   S       waitvt   0xffffffff80bd73c8 console-kit-daemon
100191                   S       ucond    0xffffff0003870980 console-kit-daemon
100126                   S       select   0xffffff0003dfda40 console-kit-daemon
 1372     1  1372   560  Rs      CPU 1                       hald
 1367     1  1367     0  Ss+     ttyin    0xffffff00033318a8 getty
 1366     1  1366     0  Ss+     ttyin    0xffffff00034fd8a8 getty
 1365     1  1365     0  Ss+     ttyin    0xffffff00034fe4a8 getty
 1364     1  1364     0  Ss+     ttyin    0xffffff00035000a8 getty
 1363     1  1363     0  Ss+     ttyin    0xffffff00034fd0a8 getty
 1362     1  1362     0  Ss+     ttyin    0xffffff0003500ca8 getty
 1361     1  1361     0  Ss+     ttyin    0xffffff00035008a8 getty
 1360     1  1360     0  Ss+     wait     0xffffff000b416460 login
 1358  1356   292     0  S+      nanslp   0xffffffff80bdc5e8 sleep
 1357     1   292     0  S+      piperd   0xffffff00039dc5b0 logger
 1356     1   292     0  S+      wait     0xffffff0003f738c0 sh
 1304     1  1304     0  Ss      nanslp   0xffffffff80bdc5e8 cron
 1295     1  1295     0  Ss      select   0xffffff000b22c2c0 sshd
 1252     1  1252   556  Ss      select   0xffffff000b0da9c0 dbus-daemon
 1247  1236  1236   125  S       kqread   0xffffff000b240b00 qmgr
 1245  1236  1236   125  S       kqread   0xffffff000b3ac000 pickup
 1236     1  1236     0  Ss      kqread   0xffffff000b37b700 master
 1117     1  1117    65  Ss      select   0xffffff000b0e8940 dhclient
 1101     1  1101     0  Ss      select   0xffffff000b0ead40 dhclient
 1077     1  1077     0  Ss      kqread   0xffffff0003ff4500 cupsd
 1034     1  1034     0  Ss      select   0xffffff0003e76840 powerd
  961     1   961     0  Ss      rpcsvc   0xffffff0003d8b1a0 NLM: master
  948     1   948     0  Ss      select   0xffffff000b009540 rpc.statd
  946     1   946     0  Ss      select   0xffffff0003e774c0 rpcbind
  872     0     0     0  SL      mdwait   0xffffff0003e9d800 [md0]
  823     1   823     0  Ss      select   0xffffff0003e76e40 syslogd
  726     0     0     0  SL      -        0xffffffff80bd9640 [accounting]
  653     1   653     0  Ss      wait     0xffffff0003f75000 devd
  285     0     0     0  SL      tq->tq_d 0xffffff0003ae3720 [zil_clean]
  284     0     0     0  SL      tq->tq_d 0xffffff0003a70840 [zil_clean]
  283     0     0     0  SL      tq->tq_d 0xffffff0003ae32a0 [zil_clean]
  282     0     0     0  SL      tq->tq_d 0xffffff0003ae3180 [zil_clean]
  281     0     0     0  SL      tq->tq_d 0xffffff0003ae3060 [zil_clean]
  280     0     0     0  SL      tq->tq_d 0xffffff0003ae3840 [zil_clean]
  279     0     0     0  SL      tq->tq_d 0xffffff0003a71840 [zil_clean]
  278     0     0     0  SL      tq->tq_d 0xffffff0003a71720 [zil_clean]
  277     0     0     0  SL      tq->tq_d 0xffffff0003a71600 [zil_clean]
  276     0     0     0  SL      tq->tq_d 0xffffff0003a714e0 [zil_clean]
  275     0     0     0  SL      tx->tx_s 0xffffff000365b638 [txg_thread_enter]
  274     0     0     0  SL      tx->tx_q 0xffffff000365b658 [txg_thread_enter]
  273     0     0     0  SL      vgeom:io 0xffffff0003acfc90 [vdev:worker ad4s1d.]
  272     0     0     0  SL      tq->tq_d 0xffffff0003a713c0 [spa_zio]
  271     0     0     0  SL      tq->tq_d 0xffffff0003a712a0 [spa_zio]
  270     0     0     0  SL      tq->tq_d 0xffffff0003a71180 [spa_zio]
  269     0     0     0  SL      tq->tq_d 0xffffff0003a71de0 [spa_zio]
  268     0     0     0  SL      tq->tq_d 0xffffff0003af32a0 [spa_zio]
  267     0     0     0  SL      tq->tq_d 0xffffff0003af3180 [spa_zio]
  266     0     0     0  SL      tq->tq_d 0xffffff0003af3060 [spa_zio]
  265     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
  264     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
  263     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
  262     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
  261     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
  260     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
  259     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
  258     0     0     0  SL      tq->tq_d 0xffffff0003ae3de0 [spa_zio]
  257     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
  256     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
  255     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
  254     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
  253     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
  252     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
  251     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
  250     0     0     0  SL      tq->tq_d 0xffffff0003ae3cc0 [spa_zio]
  249     0     0     0  SL      tq->tq_d 0xffffff0003ae3ba0 [spa_zio]
  248     0     0     0  SL      tq->tq_d 0xffffff0003ae3a80 [spa_zio]
  247     0     0     0  SL      tq->tq_d 0xffffff0003ae3960 [spa_zio]
  192     0     0     0  SL      geli:w   0xffffff0003649400 [g_eli[1] ad4s1d]
  191     0     0     0  SL      geli:w   0xffffff0003649400 [g_eli[0] ad4s1d]
  186     0     0     0  SL      crypto_r 0xffffffff813398a0 [crypto returns]
  185     0     0     0  SL      crypto_w 0xffffffff81339860 [crypto]
   75     0     0     0  SL      l2arc_fe 0xffffffff8130be80 [l2arc_feed_thread]
   74     0     0     0  SL      arc_recl 0xffffffff813038a0 [arc_reclaim_thread]
   72     0     0     0  SL      vacv     0xffffffff813025a0 [vaclean]
   71     0     0     0  SL      tq->tq_d 0xffffff0003a71060 [system_taskq]
   70     0     0     0  SL      tq->tq_d 0xffffff0003a71060 [system_taskq]
   52     0     0     0  SL      flowclea 0xffffffff80bdc2c4 [flowcleaner]
   51     0     0     0  SL      sdflush  0xffffffff80dacd58 [softdepflush]
   50     0     0     0  SL      syncer   0xffffffff80d9dbc0 [syncer]
   49     0     0     0  SL      vlruwt   0xffffff000358a000 [vnlru]
   48     0     0     0  SL      psleep   0xffffffff80d9d6e8 [bufdaemon]
    9     0     0     0  SL      pgzero   0xffffffff80dae7ac [pagezero]
    8     0     0     0  SL      psleep   0xffffffff80dadb48 [vmdaemon]
    7     0     0     0  SL      psleep   0xffffffff80dadb0c [pagedaemon]
   47     0     0     0  SL      wmsg     0xffffff8000326dd0 [usbus7]
   46     0     0     0  SL      wmsg     0xffffff8000326d78 [usbus7]
   45     0     0     0  SL      wmsg     0xffffff8000326d20 [usbus7]
   44     0     0     0  SL      wmsg     0xffffff8000326cc8 [usbus7]
   43     0     0     0  SL      wmsg     0xffffff800031def0 [usbus6]
   42     0     0     0  SL      wmsg     0xffffff800031de98 [usbus6]
   41     0     0     0  SL      wmsg     0xffffff800031de40 [usbus6]
   40     0     0     0  SL      wmsg     0xffffff800031dde8 [usbus6]
   39     0     0     0  SL      wmsg     0xffffff8000314ef0 [usbus5]
   38     0     0     0  SL      wmsg     0xffffff8000314e98 [usbus5]
   37     0     0     0  SL      wmsg     0xffffff8000314e40 [usbus5]
   36     0     0     0  SL      wmsg     0xffffff8000314de8 [usbus5]
   35     0     0     0  SL      wmsg     0xffffff800030bef0 [usbus4]
   34     0     0     0  SL      wmsg     0xffffff800030be98 [usbus4]
   33     0     0     0  SL      wmsg     0xffffff800030be40 [usbus4]
   32     0     0     0  SL      wmsg     0xffffff800030bde8 [usbus4]
   31     0     0     0  SL      wmsg     0xffffff8000302dd0 [usbus3]
   30     0     0     0  SL      wmsg     0xffffff8000302d78 [usbus3]
   29     0     0     0  SL      wmsg     0xffffff8000302d20 [usbus3]
   28     0     0     0  SL      wmsg     0xffffff8000302cc8 [usbus3]
   27     0     0     0  SL      wmsg     0xffffff80002f9ef0 [usbus2]
   26     0     0     0  SL      wmsg     0xffffff80002f9e98 [usbus2]
   25     0     0     0  SL      wmsg     0xffffff80002f9e40 [usbus2]
   24     0     0     0  SL      wmsg     0xffffff80002f9de8 [usbus2]
   23     0     0     0  SL      wmsg     0xffffff80002f0ef0 [usbus1]
   22     0     0     0  RL      CPU 0                       [usbus1]
   21     0     0     0  SL      wmsg     0xffffff80002f0e40 [usbus1]
   20     0     0     0  SL      wmsg     0xffffff80002f0de8 [usbus1]
   19     0     0     0  SL      wmsg     0xffffff80002e7ef0 [usbus0]
   18     0     0     0  SL      wmsg     0xffffff80002e7e98 [usbus0]
   17     0     0     0  SL      wmsg     0xffffff80002e7e40 [usbus0]
   16     0     0     0  SL      wmsg     0xffffff80002e7de8 [usbus0]
    6     0     0     0  SL      waiting_ 0xffffffff80da0ae0 [sctp_iterator]
   15     0     0     0  SL      cooling  0xffffff0002713558 [acpi_cooling1]
   14     0     0     0  RL                                  [acpi_thermal]
    5     0     0     0  SL      ccb_scan 0xffffffff80ba5560 [xpt_thrd]
   13     0     0     0  SL      -        0xffffffff80bdc2c4 [yarrow]
    4     0     0     0  SL      -        0xffffffff80bd8aa8 [g_down]
    3     0     0     0  RL                                  [g_up]
    2     0     0     0  SL      -        0xffffffff80bd8a90 [g_event]
   12     0     0     0  WL      (threaded)                  intr
100039                   I                                   [irq12: psm0]
100038                   I                                   [irq1: atkbd0]
100035                   I                                   [irq19: ehci1]
100034                   I                                   [irq18: uhci5]
100033                   I                                   [irq17: uhci4]
100032                   I                                   [irq16: uhci3+]
100031                   I                                   [irq257: hdac0]
100030                   I                                   [irq23: ehci0+]
100029                   I                                   [irq22: uhci2]
100028                   I                                   [irq21: uhci1]
100027                   I                                   [irq20: uhci0]
100025                   I                                   [irq9: acpi0]
100024                   I                                   [swi6: task queue]
100023                   I                                   [swi6: Giant taskq]
100020                   I                                   [swi5: +]
100019                   I                                   [swi2: cambio]
100008                   I                                   [swi1: netisr 0]
100007                   I                                   [swi3: vm]
100006                   I                                   [swi4: clock]
100005                   I                                   [swi4: clock]
   11     0     0     0  RL      (threaded)                  idle
100004                   CanRun                              [idle: cpu0]
100003                   CanRun                              [idle: cpu1]
    1     0     1     0  SLs     wait     0xffffff00024e38c0 [init]
   10     0     0     0  SL      audit_wo 0xffffffff80dac0b0 [audit]
    0     0     0     0  SLs     (threaded)                  kernel
100026                   D       -        0xffffff0002711d80 [em0 taskq]
100022                   D       -        0xffffff0002621980 [aiod_bio taskq]
100021                   D       -        0xffffff0002621a00 [thread taskq]
100017                   D       -        0xffffff0002647380 [kqueue taskq]
100016                   D       -        0xffffff0002647400 [acpi_task_2]
100015                   D       -        0xffffff0002647400 [acpi_task_1]
100014                   D       ecgpe    0xffffff00026badf0 [acpi_task_0]
100012                   D       -        0xffffff00024f7780 [firmware taskq]
100000                   D       sched    0xffffffff80bd8ba0 [swapper]
db:0:kdb.enter.default>  alltrace

Tracing command acpiconf pid 1424 tid 100177 td 0xffffff0003f86720
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
ast() at ast+0x27d
doreti_ast() at doreti_ast+0x1f

Tracing command sh pid 1416 tid 100154 td 0xffffff0003d90390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
kern_wait() at kern_wait+0xa9e
wait4() at wait4+0x3a
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80092f16c, rsp = 0x7fffffffe988, rbp = 0x28d ---

Tracing command zsh pid 1411 tid 100179 td 0xffffff0003f86000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_cv_wait_sig() at _cv_wait_sig+0x23b
tty_wait() at tty_wait+0x65
ttydisc_read() at ttydisc_read+0x220
ttydev_read() at ttydev_read+0x86
devfs_read_f() at devfs_read_f+0x7f
dofileread() at dofileread+0x97
kern_readv() at kern_readv+0x46
read() at read+0x4e
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (3, FreeBSD ELF64, read), rip = 0x800bea14c, rsp = 0x7fffffffe768, rbp = 0 ---

Tracing command hald-addon-mouse-sy pid 1381 tid 100164 td 0xffffff0003afeab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
_cv_timedwait_sig() at _cv_timedwait_sig+0x24b
seltdwait() at seltdwait+0x73
poll() at poll+0x325
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (209, FreeBSD ELF64, poll), rip = 0x800e0d4dc, rsp = 0x7fffffffe6a8, rbp = 0x80161d100 ---

Tracing command hald-runner pid 1376 tid 100159 td 0xffffff0003d8f000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_cv_wait_sig() at _cv_wait_sig+0x23b
seltdwait() at seltdwait+0x84
poll() at poll+0x325
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (209, FreeBSD ELF64, poll), rip = 0x800c0d4dc, rsp = 0x7fffffffeb68, rbp = 0x1 ---

Tracing command console-kit-daemon pid 1375 tid 100206 td 0xffffff000b4f8720
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffafff38, rbp = 0x10 ---

Tracing command console-kit-daemon pid 1375 tid 100205 td 0xffffff000b4f8ab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb10f38, rbp = 0xf ---

Tracing command console-kit-daemon pid 1375 tid 100204 td 0xffffff000b4fb000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb21f38, rbp = 0xe ---

Tracing command console-kit-daemon pid 1375 tid 100203 td 0xffffff000b4fb390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb32f38, rbp = 0xd ---

Tracing command console-kit-daemon pid 1375 tid 100202 td 0xffffff000b4fb720
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb43f38, rbp = 0xc ---

Tracing command console-kit-daemon pid 1375 tid 100201 td 0xffffff000b4fbab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb54f38, rbp = 0xb ---

Tracing command console-kit-daemon pid 1375 tid 100200 td 0xffffff000b4fc000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb65f38, rbp = 0xa ---

Tracing command console-kit-daemon pid 1375 tid 100199 td 0xffffff000b4fc390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb76f38, rbp = 0x9 ---

Tracing command console-kit-daemon pid 1375 tid 100198 td 0xffffff0003f8b720
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb87f38, rbp = 0x8 ---

Tracing command console-kit-daemon pid 1375 tid 100197 td 0xffffff0003f8bab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb98f38, rbp = 0x7 ---

Tracing command console-kit-daemon pid 1375 tid 100196 td 0xffffff000b46f000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffba9f38, rbp = 0x6 ---

Tracing command console-kit-daemon pid 1375 tid 100195 td 0xffffff000b46f390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbbaf38, rbp = 0x5 ---

Tracing command console-kit-daemon pid 1375 tid 100194 td 0xffffff000b46f720
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbcbf38, rbp = 0x4 ---

Tracing command console-kit-daemon pid 1375 tid 100193 td 0xffffff000b46fab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbdcf38, rbp = 0x3 ---

Tracing command console-kit-daemon pid 1375 tid 100192 td 0xffffff000b46c000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
sctty_ioctl() at sctty_ioctl+0xe13
tty_ioctl() at tty_ioctl+0xaa
ttydev_ioctl() at ttydev_ioctl+0x99
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbedf38, rbp = 0x2 ---

Tracing command console-kit-daemon pid 1375 tid 100191 td 0xffffff0003a25ab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
do_cv_wait() at do_cv_wait+0x4e1
__umtx_op_cv_wait() at __umtx_op_cv_wait+0x58
_umtx_op() at _umtx_op+0x1c
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80143ef0c, rsp = 0x7fffffbfed58, rbp = 0x80186d380 ---

Tracing command console-kit-daemon pid 1375 tid 100126 td 0xffffff0003acb390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_cv_wait_sig() at _cv_wait_sig+0x23b
seltdwait() at seltdwait+0x84
poll() at poll+0x325
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (209, FreeBSD ELF64, poll), rip = 0x8015da4dc, rsp = 0x7fffffffeac8, rbp = 0x4 ---

Tracing command hald pid 1372 tid 100186 td 0xffffff000b46d390
cpustop_handler() at cpustop_handler+0x40
ipi_nmi_handler() at ipi_nmi_handler+0x36
trap() at trap+0x42
nmi_calltrap() at nmi_calltrap+0x8
--- trap 0x13, rip = 0xffffffff8055b213, rsp = 0xffffff8000018fe0, rbp = 0xffffff80755e4970 ---
_sx_slock_hard() at _sx_slock_hard+0x13c
_sx_slock() at _sx_slock+0xaa
newbus_slock() at newbus_slock+0x21
acpi_battery_ioctl() at acpi_battery_ioctl+0x6f
acpiioctl() at acpiioctl+0x163
devfs_ioctl_f() at devfs_ioctl_f+0xde
kern_ioctl() at kern_ioctl+0x1e4
ioctl() at ioctl+0x158
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (54, FreeBSD ELF64, ioctl), rip = 0x8012370ec, rsp = 0x7fffffffe598, rbp = 0x801a0ab60 ---

Tracing command getty pid 1367 tid 100184 td 0xffffff000b46dab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_cv_wait_sig() at _cv_wait_sig+0x23b
tty_wait() at tty_wait+0x65
ttydisc_read() at ttydisc_read+0x220
ttydev_read() at ttydev_read+0x86
devfs_read_f() at devfs_read_f+0x7f
dofileread() at dofileread+0x97
kern_readv() at kern_readv+0x46
read() at read+0x4e
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---

Tracing command getty pid 1366 tid 100178 td 0xffffff0003f86390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_cv_wait_sig() at _cv_wait_sig+0x23b
tty_wait() at tty_wait+0x65
ttydisc_read() at ttydisc_read+0x220
ttydev_read() at ttydev_read+0x86
devfs_read_f() at devfs_read_f+0x7f
dofileread() at dofileread+0x97
kern_readv() at kern_readv+0x46
read() at read+0x4e
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---

Tracing command getty pid 1365 tid 100183 td 0xffffff000b468000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_cv_wait_sig() at _cv_wait_sig+0x23b
tty_wait() at tty_wait+0x65
ttydisc_read() at ttydisc_read+0x220
ttydev_read() at ttydev_read+0x86
devfs_read_f() at devfs_read_f+0x7f
dofileread() at dofileread+0x97
kern_readv() at kern_readv+0x46
read() at read+0x4e
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---

Tracing command getty pid 1364 tid 100182 td 0xffffff000b468390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_cv_wait_sig() at _cv_wait_sig+0x23b
tty_wait() at tty_wait+0x65
ttydisc_read() at ttydisc_read+0x220
ttydev_read() at ttydev_read+0x86
devfs_read_f() at devfs_read_f+0x7f
dofileread() at dofileread+0x97
kern_readv() at kern_readv+0x46
read() at read+0x4e
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---

Tracing command getty pid 1363 tid 100181 td 0xffffff0003d92720
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_cv_wait_sig() at _cv_wait_sig+0x23b
tty_wait() at tty_wait+0x65
ttydisc_read() at ttydisc_read+0x220
ttydev_read() at ttydev_read+0x86
devfs_read_f() at devfs_read_f+0x7f
dofileread() at dofileread+0x97
kern_readv() at kern_readv+0x46
read() at read+0x4e
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---

Tracing command getty pid 1362 tid 100180 td 0xffffff0003d92ab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_cv_wait_sig() at _cv_wait_sig+0x23b
tty_wait() at tty_wait+0x65
ttydisc_read() at ttydisc_read+0x220
ttydev_read() at ttydev_read+0x86
devfs_read_f() at devfs_read_f+0x7f
dofileread() at dofileread+0x97
kern_readv() at kern_readv+0x46
read() at read+0x4e
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---

Tracing command getty pid 1361 tid 100094 td 0xffffff0003a28ab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_cv_wait_sig() at _cv_wait_sig+0x23b
tty_wait() at tty_wait+0x65
ttydisc_read() at ttydisc_read+0x220
ttydev_read() at ttydev_read+0x86
devfs_read_f() at devfs_read_f+0x7f
dofileread() at dofileread+0x97
kern_readv() at kern_readv+0x46
read() at read+0x4e
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 ---

Tracing command login pid 1360 tid 100188 td 0xffffff000b46cab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
kern_wait() at kern_wait+0xa9e
wait4() at wait4+0x3a
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x8009e416c, rsp = 0x7fffffffec58, rbp = 0x800b969c0 ---

Tracing command sleep pid 1358 tid 100089 td 0xffffff00037aeab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
_sleep() at _sleep+0x312
kern_nanosleep() at kern_nanosleep+0xec
nanosleep() at nanosleep+0x61
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x800710cfc, rsp = 0x7fffffffed58, rbp = 0x7fffffffedb0 ---

Tracing command logger pid 1357 tid 100170 td 0xffffff0003f8a390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
pipe_read() at pipe_read+0x3ce
dofileread() at dofileread+0x97
kern_readv() at kern_readv+0x46
read() at read+0x4e
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (3, FreeBSD ELF64, read), rip = 0x80072e14c, rsp = 0x7fffffffe858, rbp = 0x7fffffffed78 ---

Tracing command sh pid 1356 tid 100167 td 0xffffff0003f8b000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
kern_wait() at kern_wait+0xa9e
wait4() at wait4+0x3a
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80092f16c, rsp = 0x7fffffffccb8, rbp = 0x124 ---

Tracing command cron pid 1304 tid 100176 td 0xffffff0003f86ab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
_sleep() at _sleep+0x312
kern_nanosleep() at kern_nanosleep+0xec
nanosleep() at nanosleep+0x61
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x80092ecfc, rsp = 0x7fffffffeb38, rbp = 0x29 ---

Tracing command sshd pid 1295 tid 100169 td 0xffffff0003f8a720
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_cv_wait_sig() at _cv_wait_sig+0x23b
seltdwait() at seltdwait+0x84
kern_select() at kern_select+0x507
select() at select+0x54
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (93, FreeBSD ELF64, select), rip = 0x8013b70cc, rsp = 0x7fffffffe318, rbp = 0x4 ---

Tracing command dbus-daemon pid 1252 tid 100121 td 0xffffff0003acd720
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
_cv_timedwait_sig() at _cv_timedwait_sig+0x24b
seltdwait() at seltdwait+0x73
poll() at poll+0x325
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (209, FreeBSD ELF64, poll), rip = 0x8009544dc, rsp = 0x7fffffffe6c8, rbp = 0 ---

Tracing command qmgr pid 1247 tid 100157 td 0xffffff0003d8f720
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
_sleep() at _sleep+0x312
kern_kevent() at kern_kevent+0x3a7
kevent() at kevent+0x199
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (363, FreeBSD ELF64, kevent), rip = 0x801132c0c, rsp = 0x7fffffffd9e8, rbp = 0x7fffffffd9f0 ---

Tracing command pickup pid 1245 tid 100152 td 0xffffff0003d90ab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
_sleep() at _sleep+0x312
kern_kevent() at kern_kevent+0x3a7
kevent() at kevent+0x199
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (363, FreeBSD ELF64, kevent), rip = 0x801126c0c, rsp = 0x7fffffffda28, rbp = 0x7fffffffda30 ---

Tracing command master pid 1236 tid 100093 td 0xffffff0003a2a000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
_sleep() at _sleep+0x312
kern_kevent() at kern_kevent+0x3a7
kevent() at kevent+0x199
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (363, FreeBSD ELF64, kevent), rip = 0x80111dc0c, rsp = 0x7fffffffdce8, rbp = 0x7fffffffdcf0 ---

Tracing command dhclient pid 1117 tid 100162 td 0xffffff0003d8e390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
_cv_timedwait_sig() at _cv_timedwait_sig+0x24b
seltdwait() at seltdwait+0x73
poll() at poll+0x325
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (209, FreeBSD ELF64, poll), rip = 0x8006eb4dc, rsp = 0x7fffffffece8, rbp = 0x2 ---

Tracing command dhclient pid 1101 tid 100166 td 0xffffff0003f8b390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_cv_wait_sig() at _cv_wait_sig+0x23b
seltdwait() at seltdwait+0x84
poll() at poll+0x325
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (209, FreeBSD ELF64, poll), rip = 0x8006eb4dc, rsp = 0x7fffffffece8, rbp = 0x9 ---

Tracing command cupsd pid 1077 tid 100132 td 0xffffff0003a94ab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
kern_kevent() at kern_kevent+0x3a7
kevent() at kevent+0x199
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (363, FreeBSD ELF64, kevent), rip = 0x801257c0c, rsp = 0x7fffffffe7d8, rbp = 0x1 ---

Tracing command powerd pid 1034 tid 100161 td 0xffffff0003d8e720
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
_cv_timedwait_sig() at _cv_timedwait_sig+0x24b
seltdwait() at seltdwait+0x73
kern_select() at kern_select+0x507
select() at select+0x54
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (93, FreeBSD ELF64, select), rip = 0x80083d0cc, rsp = 0x7fffffffe7e8, rbp = 0x960 ---

Tracing command rpc.lockd pid 961 tid 100171 td 0xffffff0003f8a000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
_cv_timedwait_sig() at _cv_timedwait_sig+0x24b
svc_run_internal() at svc_run_internal+0x2f8
svc_run() at svc_run+0x97
nlm_syscall() at nlm_syscall+0x6f7
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (154, FreeBSD ELF64, nlm_syscall), rip = 0x8008baeac, rsp = 0x7fffffffec38, rbp = 0x7fffffffed60 ---

Tracing command rpc.statd pid 948 tid 100122 td 0xffffff0003acd390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
_cv_timedwait_sig() at _cv_timedwait_sig+0x24b
seltdwait() at seltdwait+0x73
kern_select() at kern_select+0x507
select() at select+0x54
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (93, FreeBSD ELF64, select), rip = 0x8008380cc, rsp = 0x7fffffffeb58, rbp = 0x800980900 ---

Tracing command rpcbind pid 946 tid 100168 td 0xffffff0003f8aab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12
_cv_timedwait_sig() at _cv_timedwait_sig+0x24b
seltdwait() at seltdwait+0x73
poll() at poll+0x325
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (209, FreeBSD ELF64, poll), rip = 0x8008fb4dc, rsp = 0x7fffffffcad8, rbp = 0x800b100c0 ---

Tracing command md0 pid 872 tid 100090 td 0xffffff0003a2a390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_wait() at sleepq_wait+0x6d
_sleep() at _sleep+0x348
md_kthread() at md_kthread+0x10c
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8075400d30, rbp = 0 ---

Tracing command syslogd pid 823 tid 100174 td 0xffffff0003f87390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_cv_wait_sig() at _cv_wait_sig+0x23b
seltdwait() at seltdwait+0x84
kern_select() at kern_select+0x507
select() at select+0x54
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (93, FreeBSD ELF64, select), rip = 0x8008430cc, rsp = 0x7fffffffdd08, rbp = 0x800a2f0d0 ---

Tracing command accounting pid 726 tid 100103 td 0xffffff0003a94000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_timedwait() at sleepq_timedwait+0x6d
_sleep() at _sleep+0x322
acct_thread() at acct_thread+0x2b2
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8075441d30, rbp = 0 ---

Tracing command devd pid 653 tid 100163 td 0xffffff0003d8e000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_catch_signals() at sleepq_catch_signals+0xbf
sleepq_wait_sig() at sleepq_wait_sig+0xc
_sleep() at _sleep+0x338
kern_wait() at kern_wait+0xa9e
wait4() at wait4+0x3a
syscall() at syscall+0x2e9
Xfast_syscall() at Xfast_syscall+0xe1
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x4215ec, rsp = 0x7fffffffe778, rbp = 0x8006640d8 ---

Tracing command zil_clean pid 285 tid 100092 td 0xffffff00037ae390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_wait() at sleepq_wait+0x6d
_cv_wait() at _cv_wait+0x239
taskq_thread() at taskq_thread+0x379
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff807540ad30, rbp = 0 ---

Tracing command zil_clean pid 284 tid 100151 td 0xffffff0003d92000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_wait() at sleepq_wait+0x6d
_cv_wait() at _cv_wait+0x239
taskq_thread() at taskq_thread+0x379
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8075535d30, rbp = 0 ---

Tracing command zil_clean pid 283 tid 100150 td 0xffffff0003d92390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_wait() at sleepq_wait+0x6d
_cv_wait() at _cv_wait+0x239
taskq_thread() at taskq_thread+0x379
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8075530d30, rbp = 0 ---

Tracing command zil_clean pid 282 tid 100149 td 0xffffff0003ace720
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_wait() at sleepq_wait+0x6d
_cv_wait() at _cv_wait+0x239
taskq_thread() at taskq_thread+0x379
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff807552bd30, rbp = 0 ---

Tracing command zil_clean pid 281 tid 100148 td 0xffffff0003aceab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_wait() at sleepq_wait+0x6d
_cv_wait() at _cv_wait+0x239
taskq_thread() at taskq_thread+0x379
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8075526d30, rbp = 0 ---

Tracing command zil_clean pid 280 tid 100147 td 0xffffff0003a4f000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_wait() at sleepq_wait+0x6d
_cv_wait() at _cv_wait+0x239
taskq_thread() at taskq_thread+0x379
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8075521d30, rbp = 0 ---

Tracing command zil_clean pid 279 tid 100146 td 0xffffff0003a4f390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_wait() at sleepq_wait+0x6d
_cv_wait() at _cv_wait+0x239
taskq_thread() at taskq_thread+0x379
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff807551cd30, rbp = 0 ---

Tracing command zil_clean pid 278 tid 100145 td 0xffffff0003a4f720
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_wait() at sleepq_wait+0x6d
_cv_wait() at _cv_wait+0x239
taskq_thread() at taskq_thread+0x379
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8075517d30, rbp = 0 ---

Tracing command zil_clean pid 277 tid 100144 td 0xffffff0003a4fab0
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_wait() at sleepq_wait+0x6d
_cv_wait() at _cv_wait+0x239
taskq_thread() at taskq_thread+0x379
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff8075512d30, rbp = 0 ---

Tracing command zil_clean pid 276 tid 100143 td 0xffffff0003af8000
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_wait() at sleepq_wait+0x6d
_cv_wait() at _cv_wait+0x239
taskq_thread() at taskq_thread+0x379
fork_exit() at fork_exit+0x147
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffff807550dd30, rbp = 0 ---

Tracing command txg_thread_enter pid 275 tid 100134 td 0xffffff0003afe390
sched_switch() at sched_switch+0x403
mi_switch() at mi_switch+0x2a6
sleepq_switch() at sleepq_switch+0x145
sleepq_timedwai
----- end ddb.txt
Received on Thu Aug 13 2009 - 15:37:24 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:39:53 UTC