On Thu, 2009-08-13 at 13:36 -0400, Damian Gerow wrote: > Attilio Rao wrote: > : So, what you can do is to compile a kernel with the following options: > : KDB, DDB, INVARIANT_SUPPORT, INVARIANTS, WITNESS > > As I'm running GENERIC, these options are already present. > > : when you get the deadlock, you should break in DDB. > : Through a textdump(4) (or serial console or whatever you prefer) you > : should get the following informations: > : bt, ps, show allpcpu, alltrace, show alllocks > : > : and report here. > > I've set ddb script kdb.enter.default="textdump set; capture on; show > allpcpu; bt; ps; alltrace; showalllocks; showalllock; call doadump; reset", > as I don't have a serial console on this machine (and my USB<->serial > adapter doesn't work on FreeBSD). > > The script does not run when resuming in graphics mode, unfortunately. > Try as I might, I just don't get anything. I'm not sure what exactly > the system is doing when it resumes, as attempts to create files on > the local fs seem to fail. > > Resuming in text mode does generate a panic. I've included the requested > information below. However, this may be a red herring: I've never been > able to resume in text mode, so it is possible these two resume problems > are unrelated. Manually kldload i915.ko when in text mode. As long as it is loaded, it should manage the hardware during suspend/resume. Meaning that you don't need to be in X for it to do it's thing... robert. > Note that the below was generated on r196037. I'm currently building an > 8-STABLE for further testing. > > ----- begin msgbuf.txt > <snip dmesg output> > > <5>em0: link state changed to DOWN > usbus7: port reset timeout > uhub_reattach_port:373: port 1 reset failed, error=USB_ERR_TIMEOUT > uhub_reattach_port:463: device problem (USB_ERR_TIMEOUT), disabling port 1 > calcru: runtime went backwards from 219239654 usec to 74088058 usec for pid > 11 (idle) > <5>em0: link state changed to UP > ugen1.2: <vendor 0x08ff> at usbus1 (disconnected) > > > Fatal trap 9: general protection fault while in kernel mode > cpuid = 0; apic id = 00 > instruction pointer = 0x20:0xffffffff8048e71b > stack pointer = 0x28:0xffffff8072d59ad0 > frame pointer = 0x28:0xffffff8072d59b20 > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags = interrupt enabled, resume, IOPL = 0 > current process = 22 (usbus1) > ----- end msgbuf.txt > > ----- begin ddb.txt > db:0:kdb.enter.default> show allpcpu > Current CPU: 0 > > cpuid = 0 > dynamic pcpu = 0x53d514 > curthread = 0xffffff0003567720: pid 22 "usbus1" > curpcb = 0xffffff8072d59d40 > fpcurthread = none > idlethread = 0xffffff00024e6390: pid 11 "idle: cpu0" > curpmap = 0 > tssp = 0xffffffff80de7300 > commontssp = 0xffffffff80de7300 > rsp0 = 0xffffff8072d59d40 > gs32p = 0xffffffff80de6138 > ldt = 0xffffffff80de6178 > tss = 0xffffffff80de6168 > spin locks held: > > cpuid = 1 > dynamic pcpu = 0xffffff807f484514 > curthread = 0xffffff000b46d390: pid 1372 "hald" > curpcb = 0xffffff80755e4d40 > fpcurthread = none > idlethread = 0xffffff00024e6720: pid 11 "idle: cpu1" > curpmap = 0 > tssp = 0xffffffff80de7368 > commontssp = 0xffffffff80de7368 > rsp0 = 0xffffff80755e4d40 > gs32p = 0xffffffff80de61a0 > ldt = 0xffffffff80de61e0 > tss = 0xffffffff80de61d0 > spin locks held: > > db:0:kdb.enter.default> bt > Tracing pid 22 tid 100047 td 0xffffff0003567720 > usb_unconfigure() at usb_unconfigure+0x267 > usb_free_device() at usb_free_device+0x1bc > uhub_explore() at uhub_explore+0x2a3 > usb_bus_explore() at usb_bus_explore+0x9e > usb_process() at usb_process+0xcd > fork_exit() at fork_exit+0x147 > fork_trampoline() at fork_trampoline+0xe > --- trap 0, rip = 0, rsp = 0xffffff8072d59d30, rbp = 0 --- > db:0:kdb.enter.default> ps > pid ppid pgrp uid state wmesg wchan cmd > 1424 1416 653 0 R acpiconf > 1416 653 653 0 S wait 0xffffff0003d63460 sh > 1411 1360 1411 1001 S+ ttyin 0xffffff00035010a8 zsh > 1381 1376 1372 0 S select 0xffffff000b5ea540 initial thread > 1376 1372 1372 0 S select 0xffffff000b0bee40 initial thread > 1375 1 1375 0 Ss (threaded) console-kit-daemon > 100206 S waitvt 0xffffffff80bd7438 console-kit-daemon > 100205 S waitvt 0xffffffff80bd7430 console-kit-daemon > 100204 S waitvt 0xffffffff80bd7428 console-kit-daemon > 100203 S waitvt 0xffffffff80bd7420 console-kit-daemon > 100202 S waitvt 0xffffffff80bd7418 console-kit-daemon > 100201 S waitvt 0xffffffff80bd7410 console-kit-daemon > 100200 S waitvt 0xffffffff80bd7408 console-kit-daemon > 100199 S waitvt 0xffffffff80bd7400 console-kit-daemon > 100198 S waitvt 0xffffffff80bd73f8 console-kit-daemon > 100197 S waitvt 0xffffffff80bd73f0 console-kit-daemon > 100196 S waitvt 0xffffffff80bd73e8 console-kit-daemon > 100195 S waitvt 0xffffffff80bd73e0 console-kit-daemon > 100194 S waitvt 0xffffffff80bd73d8 console-kit-daemon > 100193 S waitvt 0xffffffff80bd73d0 console-kit-daemon > 100192 S waitvt 0xffffffff80bd73c8 console-kit-daemon > 100191 S ucond 0xffffff0003870980 console-kit-daemon > 100126 S select 0xffffff0003dfda40 console-kit-daemon > 1372 1 1372 560 Rs CPU 1 hald > 1367 1 1367 0 Ss+ ttyin 0xffffff00033318a8 getty > 1366 1 1366 0 Ss+ ttyin 0xffffff00034fd8a8 getty > 1365 1 1365 0 Ss+ ttyin 0xffffff00034fe4a8 getty > 1364 1 1364 0 Ss+ ttyin 0xffffff00035000a8 getty > 1363 1 1363 0 Ss+ ttyin 0xffffff00034fd0a8 getty > 1362 1 1362 0 Ss+ ttyin 0xffffff0003500ca8 getty > 1361 1 1361 0 Ss+ ttyin 0xffffff00035008a8 getty > 1360 1 1360 0 Ss+ wait 0xffffff000b416460 login > 1358 1356 292 0 S+ nanslp 0xffffffff80bdc5e8 sleep > 1357 1 292 0 S+ piperd 0xffffff00039dc5b0 logger > 1356 1 292 0 S+ wait 0xffffff0003f738c0 sh > 1304 1 1304 0 Ss nanslp 0xffffffff80bdc5e8 cron > 1295 1 1295 0 Ss select 0xffffff000b22c2c0 sshd > 1252 1 1252 556 Ss select 0xffffff000b0da9c0 dbus-daemon > 1247 1236 1236 125 S kqread 0xffffff000b240b00 qmgr > 1245 1236 1236 125 S kqread 0xffffff000b3ac000 pickup > 1236 1 1236 0 Ss kqread 0xffffff000b37b700 master > 1117 1 1117 65 Ss select 0xffffff000b0e8940 dhclient > 1101 1 1101 0 Ss select 0xffffff000b0ead40 dhclient > 1077 1 1077 0 Ss kqread 0xffffff0003ff4500 cupsd > 1034 1 1034 0 Ss select 0xffffff0003e76840 powerd > 961 1 961 0 Ss rpcsvc 0xffffff0003d8b1a0 NLM: master > 948 1 948 0 Ss select 0xffffff000b009540 rpc.statd > 946 1 946 0 Ss select 0xffffff0003e774c0 rpcbind > 872 0 0 0 SL mdwait 0xffffff0003e9d800 [md0] > 823 1 823 0 Ss select 0xffffff0003e76e40 syslogd > 726 0 0 0 SL - 0xffffffff80bd9640 [accounting] > 653 1 653 0 Ss wait 0xffffff0003f75000 devd > 285 0 0 0 SL tq->tq_d 0xffffff0003ae3720 [zil_clean] > 284 0 0 0 SL tq->tq_d 0xffffff0003a70840 [zil_clean] > 283 0 0 0 SL tq->tq_d 0xffffff0003ae32a0 [zil_clean] > 282 0 0 0 SL tq->tq_d 0xffffff0003ae3180 [zil_clean] > 281 0 0 0 SL tq->tq_d 0xffffff0003ae3060 [zil_clean] > 280 0 0 0 SL tq->tq_d 0xffffff0003ae3840 [zil_clean] > 279 0 0 0 SL tq->tq_d 0xffffff0003a71840 [zil_clean] > 278 0 0 0 SL tq->tq_d 0xffffff0003a71720 [zil_clean] > 277 0 0 0 SL tq->tq_d 0xffffff0003a71600 [zil_clean] > 276 0 0 0 SL tq->tq_d 0xffffff0003a714e0 [zil_clean] > 275 0 0 0 SL tx->tx_s 0xffffff000365b638 [txg_thread_enter] > 274 0 0 0 SL tx->tx_q 0xffffff000365b658 [txg_thread_enter] > 273 0 0 0 SL vgeom:io 0xffffff0003acfc90 [vdev:worker ad4s1d.] > 272 0 0 0 SL tq->tq_d 0xffffff0003a713c0 [spa_zio] > 271 0 0 0 SL tq->tq_d 0xffffff0003a712a0 [spa_zio] > 270 0 0 0 SL tq->tq_d 0xffffff0003a71180 [spa_zio] > 269 0 0 0 SL tq->tq_d 0xffffff0003a71de0 [spa_zio] > 268 0 0 0 SL tq->tq_d 0xffffff0003af32a0 [spa_zio] > 267 0 0 0 SL tq->tq_d 0xffffff0003af3180 [spa_zio] > 266 0 0 0 SL tq->tq_d 0xffffff0003af3060 [spa_zio] > 265 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] > 264 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] > 263 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] > 262 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] > 261 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] > 260 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] > 259 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] > 258 0 0 0 SL tq->tq_d 0xffffff0003ae3de0 [spa_zio] > 257 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] > 256 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] > 255 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] > 254 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] > 253 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] > 252 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] > 251 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] > 250 0 0 0 SL tq->tq_d 0xffffff0003ae3cc0 [spa_zio] > 249 0 0 0 SL tq->tq_d 0xffffff0003ae3ba0 [spa_zio] > 248 0 0 0 SL tq->tq_d 0xffffff0003ae3a80 [spa_zio] > 247 0 0 0 SL tq->tq_d 0xffffff0003ae3960 [spa_zio] > 192 0 0 0 SL geli:w 0xffffff0003649400 [g_eli[1] ad4s1d] > 191 0 0 0 SL geli:w 0xffffff0003649400 [g_eli[0] ad4s1d] > 186 0 0 0 SL crypto_r 0xffffffff813398a0 [crypto returns] > 185 0 0 0 SL crypto_w 0xffffffff81339860 [crypto] > 75 0 0 0 SL l2arc_fe 0xffffffff8130be80 [l2arc_feed_thread] > 74 0 0 0 SL arc_recl 0xffffffff813038a0 [arc_reclaim_thread] > 72 0 0 0 SL vacv 0xffffffff813025a0 [vaclean] > 71 0 0 0 SL tq->tq_d 0xffffff0003a71060 [system_taskq] > 70 0 0 0 SL tq->tq_d 0xffffff0003a71060 [system_taskq] > 52 0 0 0 SL flowclea 0xffffffff80bdc2c4 [flowcleaner] > 51 0 0 0 SL sdflush 0xffffffff80dacd58 [softdepflush] > 50 0 0 0 SL syncer 0xffffffff80d9dbc0 [syncer] > 49 0 0 0 SL vlruwt 0xffffff000358a000 [vnlru] > 48 0 0 0 SL psleep 0xffffffff80d9d6e8 [bufdaemon] > 9 0 0 0 SL pgzero 0xffffffff80dae7ac [pagezero] > 8 0 0 0 SL psleep 0xffffffff80dadb48 [vmdaemon] > 7 0 0 0 SL psleep 0xffffffff80dadb0c [pagedaemon] > 47 0 0 0 SL wmsg 0xffffff8000326dd0 [usbus7] > 46 0 0 0 SL wmsg 0xffffff8000326d78 [usbus7] > 45 0 0 0 SL wmsg 0xffffff8000326d20 [usbus7] > 44 0 0 0 SL wmsg 0xffffff8000326cc8 [usbus7] > 43 0 0 0 SL wmsg 0xffffff800031def0 [usbus6] > 42 0 0 0 SL wmsg 0xffffff800031de98 [usbus6] > 41 0 0 0 SL wmsg 0xffffff800031de40 [usbus6] > 40 0 0 0 SL wmsg 0xffffff800031dde8 [usbus6] > 39 0 0 0 SL wmsg 0xffffff8000314ef0 [usbus5] > 38 0 0 0 SL wmsg 0xffffff8000314e98 [usbus5] > 37 0 0 0 SL wmsg 0xffffff8000314e40 [usbus5] > 36 0 0 0 SL wmsg 0xffffff8000314de8 [usbus5] > 35 0 0 0 SL wmsg 0xffffff800030bef0 [usbus4] > 34 0 0 0 SL wmsg 0xffffff800030be98 [usbus4] > 33 0 0 0 SL wmsg 0xffffff800030be40 [usbus4] > 32 0 0 0 SL wmsg 0xffffff800030bde8 [usbus4] > 31 0 0 0 SL wmsg 0xffffff8000302dd0 [usbus3] > 30 0 0 0 SL wmsg 0xffffff8000302d78 [usbus3] > 29 0 0 0 SL wmsg 0xffffff8000302d20 [usbus3] > 28 0 0 0 SL wmsg 0xffffff8000302cc8 [usbus3] > 27 0 0 0 SL wmsg 0xffffff80002f9ef0 [usbus2] > 26 0 0 0 SL wmsg 0xffffff80002f9e98 [usbus2] > 25 0 0 0 SL wmsg 0xffffff80002f9e40 [usbus2] > 24 0 0 0 SL wmsg 0xffffff80002f9de8 [usbus2] > 23 0 0 0 SL wmsg 0xffffff80002f0ef0 [usbus1] > 22 0 0 0 RL CPU 0 [usbus1] > 21 0 0 0 SL wmsg 0xffffff80002f0e40 [usbus1] > 20 0 0 0 SL wmsg 0xffffff80002f0de8 [usbus1] > 19 0 0 0 SL wmsg 0xffffff80002e7ef0 [usbus0] > 18 0 0 0 SL wmsg 0xffffff80002e7e98 [usbus0] > 17 0 0 0 SL wmsg 0xffffff80002e7e40 [usbus0] > 16 0 0 0 SL wmsg 0xffffff80002e7de8 [usbus0] > 6 0 0 0 SL waiting_ 0xffffffff80da0ae0 [sctp_iterator] > 15 0 0 0 SL cooling 0xffffff0002713558 [acpi_cooling1] > 14 0 0 0 RL [acpi_thermal] > 5 0 0 0 SL ccb_scan 0xffffffff80ba5560 [xpt_thrd] > 13 0 0 0 SL - 0xffffffff80bdc2c4 [yarrow] > 4 0 0 0 SL - 0xffffffff80bd8aa8 [g_down] > 3 0 0 0 RL [g_up] > 2 0 0 0 SL - 0xffffffff80bd8a90 [g_event] > 12 0 0 0 WL (threaded) intr > 100039 I [irq12: psm0] > 100038 I [irq1: atkbd0] > 100035 I [irq19: ehci1] > 100034 I [irq18: uhci5] > 100033 I [irq17: uhci4] > 100032 I [irq16: uhci3+] > 100031 I [irq257: hdac0] > 100030 I [irq23: ehci0+] > 100029 I [irq22: uhci2] > 100028 I [irq21: uhci1] > 100027 I [irq20: uhci0] > 100025 I [irq9: acpi0] > 100024 I [swi6: task queue] > 100023 I [swi6: Giant taskq] > 100020 I [swi5: +] > 100019 I [swi2: cambio] > 100008 I [swi1: netisr 0] > 100007 I [swi3: vm] > 100006 I [swi4: clock] > 100005 I [swi4: clock] > 11 0 0 0 RL (threaded) idle > 100004 CanRun [idle: cpu0] > 100003 CanRun [idle: cpu1] > 1 0 1 0 SLs wait 0xffffff00024e38c0 [init] > 10 0 0 0 SL audit_wo 0xffffffff80dac0b0 [audit] > 0 0 0 0 SLs (threaded) kernel > 100026 D - 0xffffff0002711d80 [em0 taskq] > 100022 D - 0xffffff0002621980 [aiod_bio taskq] > 100021 D - 0xffffff0002621a00 [thread taskq] > 100017 D - 0xffffff0002647380 [kqueue taskq] > 100016 D - 0xffffff0002647400 [acpi_task_2] > 100015 D - 0xffffff0002647400 [acpi_task_1] > 100014 D ecgpe 0xffffff00026badf0 [acpi_task_0] > 100012 D - 0xffffff00024f7780 [firmware taskq] > 100000 D sched 0xffffffff80bd8ba0 [swapper] > db:0:kdb.enter.default> alltrace > > Tracing command acpiconf pid 1424 tid 100177 td 0xffffff0003f86720 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > ast() at ast+0x27d > doreti_ast() at doreti_ast+0x1f > > Tracing command sh pid 1416 tid 100154 td 0xffffff0003d90390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > kern_wait() at kern_wait+0xa9e > wait4() at wait4+0x3a > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (7, FreeBSD ELF64, wait4), rip = 0x80092f16c, rsp = 0x7fffffffe988, rbp = 0x28d --- > > Tracing command zsh pid 1411 tid 100179 td 0xffffff0003f86000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _cv_wait_sig() at _cv_wait_sig+0x23b > tty_wait() at tty_wait+0x65 > ttydisc_read() at ttydisc_read+0x220 > ttydev_read() at ttydev_read+0x86 > devfs_read_f() at devfs_read_f+0x7f > dofileread() at dofileread+0x97 > kern_readv() at kern_readv+0x46 > read() at read+0x4e > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (3, FreeBSD ELF64, read), rip = 0x800bea14c, rsp = 0x7fffffffe768, rbp = 0 --- > > Tracing command hald-addon-mouse-sy pid 1381 tid 100164 td 0xffffff0003afeab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 > _cv_timedwait_sig() at _cv_timedwait_sig+0x24b > seltdwait() at seltdwait+0x73 > poll() at poll+0x325 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (209, FreeBSD ELF64, poll), rip = 0x800e0d4dc, rsp = 0x7fffffffe6a8, rbp = 0x80161d100 --- > > Tracing command hald-runner pid 1376 tid 100159 td 0xffffff0003d8f000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _cv_wait_sig() at _cv_wait_sig+0x23b > seltdwait() at seltdwait+0x84 > poll() at poll+0x325 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (209, FreeBSD ELF64, poll), rip = 0x800c0d4dc, rsp = 0x7fffffffeb68, rbp = 0x1 --- > > Tracing command console-kit-daemon pid 1375 tid 100206 td 0xffffff000b4f8720 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffafff38, rbp = 0x10 --- > > Tracing command console-kit-daemon pid 1375 tid 100205 td 0xffffff000b4f8ab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb10f38, rbp = 0xf --- > > Tracing command console-kit-daemon pid 1375 tid 100204 td 0xffffff000b4fb000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb21f38, rbp = 0xe --- > > Tracing command console-kit-daemon pid 1375 tid 100203 td 0xffffff000b4fb390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb32f38, rbp = 0xd --- > > Tracing command console-kit-daemon pid 1375 tid 100202 td 0xffffff000b4fb720 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb43f38, rbp = 0xc --- > > Tracing command console-kit-daemon pid 1375 tid 100201 td 0xffffff000b4fbab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb54f38, rbp = 0xb --- > > Tracing command console-kit-daemon pid 1375 tid 100200 td 0xffffff000b4fc000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb65f38, rbp = 0xa --- > > Tracing command console-kit-daemon pid 1375 tid 100199 td 0xffffff000b4fc390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb76f38, rbp = 0x9 --- > > Tracing command console-kit-daemon pid 1375 tid 100198 td 0xffffff0003f8b720 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb87f38, rbp = 0x8 --- > > Tracing command console-kit-daemon pid 1375 tid 100197 td 0xffffff0003f8bab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffb98f38, rbp = 0x7 --- > > Tracing command console-kit-daemon pid 1375 tid 100196 td 0xffffff000b46f000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffba9f38, rbp = 0x6 --- > > Tracing command console-kit-daemon pid 1375 tid 100195 td 0xffffff000b46f390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbbaf38, rbp = 0x5 --- > > Tracing command console-kit-daemon pid 1375 tid 100194 td 0xffffff000b46f720 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbcbf38, rbp = 0x4 --- > > Tracing command console-kit-daemon pid 1375 tid 100193 td 0xffffff000b46fab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbdcf38, rbp = 0x3 --- > > Tracing command console-kit-daemon pid 1375 tid 100192 td 0xffffff000b46c000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > sctty_ioctl() at sctty_ioctl+0xe13 > tty_ioctl() at tty_ioctl+0xaa > ttydev_ioctl() at ttydev_ioctl+0x99 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x80162c0ec, rsp = 0x7fffffbedf38, rbp = 0x2 --- > > Tracing command console-kit-daemon pid 1375 tid 100191 td 0xffffff0003a25ab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > do_cv_wait() at do_cv_wait+0x4e1 > __umtx_op_cv_wait() at __umtx_op_cv_wait+0x58 > _umtx_op() at _umtx_op+0x1c > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (454, FreeBSD ELF64, _umtx_op), rip = 0x80143ef0c, rsp = 0x7fffffbfed58, rbp = 0x80186d380 --- > > Tracing command console-kit-daemon pid 1375 tid 100126 td 0xffffff0003acb390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _cv_wait_sig() at _cv_wait_sig+0x23b > seltdwait() at seltdwait+0x84 > poll() at poll+0x325 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (209, FreeBSD ELF64, poll), rip = 0x8015da4dc, rsp = 0x7fffffffeac8, rbp = 0x4 --- > > Tracing command hald pid 1372 tid 100186 td 0xffffff000b46d390 > cpustop_handler() at cpustop_handler+0x40 > ipi_nmi_handler() at ipi_nmi_handler+0x36 > trap() at trap+0x42 > nmi_calltrap() at nmi_calltrap+0x8 > --- trap 0x13, rip = 0xffffffff8055b213, rsp = 0xffffff8000018fe0, rbp = 0xffffff80755e4970 --- > _sx_slock_hard() at _sx_slock_hard+0x13c > _sx_slock() at _sx_slock+0xaa > newbus_slock() at newbus_slock+0x21 > acpi_battery_ioctl() at acpi_battery_ioctl+0x6f > acpiioctl() at acpiioctl+0x163 > devfs_ioctl_f() at devfs_ioctl_f+0xde > kern_ioctl() at kern_ioctl+0x1e4 > ioctl() at ioctl+0x158 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x8012370ec, rsp = 0x7fffffffe598, rbp = 0x801a0ab60 --- > > Tracing command getty pid 1367 tid 100184 td 0xffffff000b46dab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _cv_wait_sig() at _cv_wait_sig+0x23b > tty_wait() at tty_wait+0x65 > ttydisc_read() at ttydisc_read+0x220 > ttydev_read() at ttydev_read+0x86 > devfs_read_f() at devfs_read_f+0x7f > dofileread() at dofileread+0x97 > kern_readv() at kern_readv+0x46 > read() at read+0x4e > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- > > Tracing command getty pid 1366 tid 100178 td 0xffffff0003f86390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _cv_wait_sig() at _cv_wait_sig+0x23b > tty_wait() at tty_wait+0x65 > ttydisc_read() at ttydisc_read+0x220 > ttydev_read() at ttydev_read+0x86 > devfs_read_f() at devfs_read_f+0x7f > dofileread() at dofileread+0x97 > kern_readv() at kern_readv+0x46 > read() at read+0x4e > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- > > Tracing command getty pid 1365 tid 100183 td 0xffffff000b468000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _cv_wait_sig() at _cv_wait_sig+0x23b > tty_wait() at tty_wait+0x65 > ttydisc_read() at ttydisc_read+0x220 > ttydev_read() at ttydev_read+0x86 > devfs_read_f() at devfs_read_f+0x7f > dofileread() at dofileread+0x97 > kern_readv() at kern_readv+0x46 > read() at read+0x4e > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- > > Tracing command getty pid 1364 tid 100182 td 0xffffff000b468390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _cv_wait_sig() at _cv_wait_sig+0x23b > tty_wait() at tty_wait+0x65 > ttydisc_read() at ttydisc_read+0x220 > ttydev_read() at ttydev_read+0x86 > devfs_read_f() at devfs_read_f+0x7f > dofileread() at dofileread+0x97 > kern_readv() at kern_readv+0x46 > read() at read+0x4e > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- > > Tracing command getty pid 1363 tid 100181 td 0xffffff0003d92720 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _cv_wait_sig() at _cv_wait_sig+0x23b > tty_wait() at tty_wait+0x65 > ttydisc_read() at ttydisc_read+0x220 > ttydev_read() at ttydev_read+0x86 > devfs_read_f() at devfs_read_f+0x7f > dofileread() at dofileread+0x97 > kern_readv() at kern_readv+0x46 > read() at read+0x4e > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- > > Tracing command getty pid 1362 tid 100180 td 0xffffff0003d92ab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _cv_wait_sig() at _cv_wait_sig+0x23b > tty_wait() at tty_wait+0x65 > ttydisc_read() at ttydisc_read+0x220 > ttydev_read() at ttydev_read+0x86 > devfs_read_f() at devfs_read_f+0x7f > dofileread() at dofileread+0x97 > kern_readv() at kern_readv+0x46 > read() at read+0x4e > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- > > Tracing command getty pid 1361 tid 100094 td 0xffffff0003a28ab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _cv_wait_sig() at _cv_wait_sig+0x23b > tty_wait() at tty_wait+0x65 > ttydisc_read() at ttydisc_read+0x220 > ttydev_read() at ttydev_read+0x86 > devfs_read_f() at devfs_read_f+0x7f > dofileread() at dofileread+0x97 > kern_readv() at kern_readv+0x46 > read() at read+0x4e > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (3, FreeBSD ELF64, read), rip = 0x80084014c, rsp = 0x7fffffffecc8, rbp = 0 --- > > Tracing command login pid 1360 tid 100188 td 0xffffff000b46cab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > kern_wait() at kern_wait+0xa9e > wait4() at wait4+0x3a > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (7, FreeBSD ELF64, wait4), rip = 0x8009e416c, rsp = 0x7fffffffec58, rbp = 0x800b969c0 --- > > Tracing command sleep pid 1358 tid 100089 td 0xffffff00037aeab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 > _sleep() at _sleep+0x312 > kern_nanosleep() at kern_nanosleep+0xec > nanosleep() at nanosleep+0x61 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x800710cfc, rsp = 0x7fffffffed58, rbp = 0x7fffffffedb0 --- > > Tracing command logger pid 1357 tid 100170 td 0xffffff0003f8a390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > pipe_read() at pipe_read+0x3ce > dofileread() at dofileread+0x97 > kern_readv() at kern_readv+0x46 > read() at read+0x4e > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (3, FreeBSD ELF64, read), rip = 0x80072e14c, rsp = 0x7fffffffe858, rbp = 0x7fffffffed78 --- > > Tracing command sh pid 1356 tid 100167 td 0xffffff0003f8b000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > kern_wait() at kern_wait+0xa9e > wait4() at wait4+0x3a > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (7, FreeBSD ELF64, wait4), rip = 0x80092f16c, rsp = 0x7fffffffccb8, rbp = 0x124 --- > > Tracing command cron pid 1304 tid 100176 td 0xffffff0003f86ab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 > _sleep() at _sleep+0x312 > kern_nanosleep() at kern_nanosleep+0xec > nanosleep() at nanosleep+0x61 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x80092ecfc, rsp = 0x7fffffffeb38, rbp = 0x29 --- > > Tracing command sshd pid 1295 tid 100169 td 0xffffff0003f8a720 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _cv_wait_sig() at _cv_wait_sig+0x23b > seltdwait() at seltdwait+0x84 > kern_select() at kern_select+0x507 > select() at select+0x54 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (93, FreeBSD ELF64, select), rip = 0x8013b70cc, rsp = 0x7fffffffe318, rbp = 0x4 --- > > Tracing command dbus-daemon pid 1252 tid 100121 td 0xffffff0003acd720 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 > _cv_timedwait_sig() at _cv_timedwait_sig+0x24b > seltdwait() at seltdwait+0x73 > poll() at poll+0x325 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (209, FreeBSD ELF64, poll), rip = 0x8009544dc, rsp = 0x7fffffffe6c8, rbp = 0 --- > > Tracing command qmgr pid 1247 tid 100157 td 0xffffff0003d8f720 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 > _sleep() at _sleep+0x312 > kern_kevent() at kern_kevent+0x3a7 > kevent() at kevent+0x199 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (363, FreeBSD ELF64, kevent), rip = 0x801132c0c, rsp = 0x7fffffffd9e8, rbp = 0x7fffffffd9f0 --- > > Tracing command pickup pid 1245 tid 100152 td 0xffffff0003d90ab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 > _sleep() at _sleep+0x312 > kern_kevent() at kern_kevent+0x3a7 > kevent() at kevent+0x199 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (363, FreeBSD ELF64, kevent), rip = 0x801126c0c, rsp = 0x7fffffffda28, rbp = 0x7fffffffda30 --- > > Tracing command master pid 1236 tid 100093 td 0xffffff0003a2a000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 > _sleep() at _sleep+0x312 > kern_kevent() at kern_kevent+0x3a7 > kevent() at kevent+0x199 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (363, FreeBSD ELF64, kevent), rip = 0x80111dc0c, rsp = 0x7fffffffdce8, rbp = 0x7fffffffdcf0 --- > > Tracing command dhclient pid 1117 tid 100162 td 0xffffff0003d8e390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 > _cv_timedwait_sig() at _cv_timedwait_sig+0x24b > seltdwait() at seltdwait+0x73 > poll() at poll+0x325 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (209, FreeBSD ELF64, poll), rip = 0x8006eb4dc, rsp = 0x7fffffffece8, rbp = 0x2 --- > > Tracing command dhclient pid 1101 tid 100166 td 0xffffff0003f8b390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _cv_wait_sig() at _cv_wait_sig+0x23b > seltdwait() at seltdwait+0x84 > poll() at poll+0x325 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (209, FreeBSD ELF64, poll), rip = 0x8006eb4dc, rsp = 0x7fffffffece8, rbp = 0x9 --- > > Tracing command cupsd pid 1077 tid 100132 td 0xffffff0003a94ab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > kern_kevent() at kern_kevent+0x3a7 > kevent() at kevent+0x199 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (363, FreeBSD ELF64, kevent), rip = 0x801257c0c, rsp = 0x7fffffffe7d8, rbp = 0x1 --- > > Tracing command powerd pid 1034 tid 100161 td 0xffffff0003d8e720 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 > _cv_timedwait_sig() at _cv_timedwait_sig+0x24b > seltdwait() at seltdwait+0x73 > kern_select() at kern_select+0x507 > select() at select+0x54 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (93, FreeBSD ELF64, select), rip = 0x80083d0cc, rsp = 0x7fffffffe7e8, rbp = 0x960 --- > > Tracing command rpc.lockd pid 961 tid 100171 td 0xffffff0003f8a000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 > _cv_timedwait_sig() at _cv_timedwait_sig+0x24b > svc_run_internal() at svc_run_internal+0x2f8 > svc_run() at svc_run+0x97 > nlm_syscall() at nlm_syscall+0x6f7 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (154, FreeBSD ELF64, nlm_syscall), rip = 0x8008baeac, rsp = 0x7fffffffec38, rbp = 0x7fffffffed60 --- > > Tracing command rpc.statd pid 948 tid 100122 td 0xffffff0003acd390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 > _cv_timedwait_sig() at _cv_timedwait_sig+0x24b > seltdwait() at seltdwait+0x73 > kern_select() at kern_select+0x507 > select() at select+0x54 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (93, FreeBSD ELF64, select), rip = 0x8008380cc, rsp = 0x7fffffffeb58, rbp = 0x800980900 --- > > Tracing command rpcbind pid 946 tid 100168 td 0xffffff0003f8aab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12 > _cv_timedwait_sig() at _cv_timedwait_sig+0x24b > seltdwait() at seltdwait+0x73 > poll() at poll+0x325 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (209, FreeBSD ELF64, poll), rip = 0x8008fb4dc, rsp = 0x7fffffffcad8, rbp = 0x800b100c0 --- > > Tracing command md0 pid 872 tid 100090 td 0xffffff0003a2a390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_wait() at sleepq_wait+0x6d > _sleep() at _sleep+0x348 > md_kthread() at md_kthread+0x10c > fork_exit() at fork_exit+0x147 > fork_trampoline() at fork_trampoline+0xe > --- trap 0, rip = 0, rsp = 0xffffff8075400d30, rbp = 0 --- > > Tracing command syslogd pid 823 tid 100174 td 0xffffff0003f87390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _cv_wait_sig() at _cv_wait_sig+0x23b > seltdwait() at seltdwait+0x84 > kern_select() at kern_select+0x507 > select() at select+0x54 > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (93, FreeBSD ELF64, select), rip = 0x8008430cc, rsp = 0x7fffffffdd08, rbp = 0x800a2f0d0 --- > > Tracing command accounting pid 726 tid 100103 td 0xffffff0003a94000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_timedwait() at sleepq_timedwait+0x6d > _sleep() at _sleep+0x322 > acct_thread() at acct_thread+0x2b2 > fork_exit() at fork_exit+0x147 > fork_trampoline() at fork_trampoline+0xe > --- trap 0, rip = 0, rsp = 0xffffff8075441d30, rbp = 0 --- > > Tracing command devd pid 653 tid 100163 td 0xffffff0003d8e000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_catch_signals() at sleepq_catch_signals+0xbf > sleepq_wait_sig() at sleepq_wait_sig+0xc > _sleep() at _sleep+0x338 > kern_wait() at kern_wait+0xa9e > wait4() at wait4+0x3a > syscall() at syscall+0x2e9 > Xfast_syscall() at Xfast_syscall+0xe1 > --- syscall (7, FreeBSD ELF64, wait4), rip = 0x4215ec, rsp = 0x7fffffffe778, rbp = 0x8006640d8 --- > > Tracing command zil_clean pid 285 tid 100092 td 0xffffff00037ae390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_wait() at sleepq_wait+0x6d > _cv_wait() at _cv_wait+0x239 > taskq_thread() at taskq_thread+0x379 > fork_exit() at fork_exit+0x147 > fork_trampoline() at fork_trampoline+0xe > --- trap 0, rip = 0, rsp = 0xffffff807540ad30, rbp = 0 --- > > Tracing command zil_clean pid 284 tid 100151 td 0xffffff0003d92000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_wait() at sleepq_wait+0x6d > _cv_wait() at _cv_wait+0x239 > taskq_thread() at taskq_thread+0x379 > fork_exit() at fork_exit+0x147 > fork_trampoline() at fork_trampoline+0xe > --- trap 0, rip = 0, rsp = 0xffffff8075535d30, rbp = 0 --- > > Tracing command zil_clean pid 283 tid 100150 td 0xffffff0003d92390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_wait() at sleepq_wait+0x6d > _cv_wait() at _cv_wait+0x239 > taskq_thread() at taskq_thread+0x379 > fork_exit() at fork_exit+0x147 > fork_trampoline() at fork_trampoline+0xe > --- trap 0, rip = 0, rsp = 0xffffff8075530d30, rbp = 0 --- > > Tracing command zil_clean pid 282 tid 100149 td 0xffffff0003ace720 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_wait() at sleepq_wait+0x6d > _cv_wait() at _cv_wait+0x239 > taskq_thread() at taskq_thread+0x379 > fork_exit() at fork_exit+0x147 > fork_trampoline() at fork_trampoline+0xe > --- trap 0, rip = 0, rsp = 0xffffff807552bd30, rbp = 0 --- > > Tracing command zil_clean pid 281 tid 100148 td 0xffffff0003aceab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_wait() at sleepq_wait+0x6d > _cv_wait() at _cv_wait+0x239 > taskq_thread() at taskq_thread+0x379 > fork_exit() at fork_exit+0x147 > fork_trampoline() at fork_trampoline+0xe > --- trap 0, rip = 0, rsp = 0xffffff8075526d30, rbp = 0 --- > > Tracing command zil_clean pid 280 tid 100147 td 0xffffff0003a4f000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_wait() at sleepq_wait+0x6d > _cv_wait() at _cv_wait+0x239 > taskq_thread() at taskq_thread+0x379 > fork_exit() at fork_exit+0x147 > fork_trampoline() at fork_trampoline+0xe > --- trap 0, rip = 0, rsp = 0xffffff8075521d30, rbp = 0 --- > > Tracing command zil_clean pid 279 tid 100146 td 0xffffff0003a4f390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_wait() at sleepq_wait+0x6d > _cv_wait() at _cv_wait+0x239 > taskq_thread() at taskq_thread+0x379 > fork_exit() at fork_exit+0x147 > fork_trampoline() at fork_trampoline+0xe > --- trap 0, rip = 0, rsp = 0xffffff807551cd30, rbp = 0 --- > > Tracing command zil_clean pid 278 tid 100145 td 0xffffff0003a4f720 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_wait() at sleepq_wait+0x6d > _cv_wait() at _cv_wait+0x239 > taskq_thread() at taskq_thread+0x379 > fork_exit() at fork_exit+0x147 > fork_trampoline() at fork_trampoline+0xe > --- trap 0, rip = 0, rsp = 0xffffff8075517d30, rbp = 0 --- > > Tracing command zil_clean pid 277 tid 100144 td 0xffffff0003a4fab0 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_wait() at sleepq_wait+0x6d > _cv_wait() at _cv_wait+0x239 > taskq_thread() at taskq_thread+0x379 > fork_exit() at fork_exit+0x147 > fork_trampoline() at fork_trampoline+0xe > --- trap 0, rip = 0, rsp = 0xffffff8075512d30, rbp = 0 --- > > Tracing command zil_clean pid 276 tid 100143 td 0xffffff0003af8000 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_wait() at sleepq_wait+0x6d > _cv_wait() at _cv_wait+0x239 > taskq_thread() at taskq_thread+0x379 > fork_exit() at fork_exit+0x147 > fork_trampoline() at fork_trampoline+0xe > --- trap 0, rip = 0, rsp = 0xffffff807550dd30, rbp = 0 --- > > Tracing command txg_thread_enter pid 275 tid 100134 td 0xffffff0003afe390 > sched_switch() at sched_switch+0x403 > mi_switch() at mi_switch+0x2a6 > sleepq_switch() at sleepq_switch+0x145 > sleepq_timedwai > ----- end ddb.txt -- Robert Noland <rnoland_at_FreeBSD.org> FreeBSDReceived on Thu Aug 13 2009 - 15:42:42 UTC
This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:39:53 UTC