Scheduling deadlock on alpha?

From: Kris Kennaway <kris_at_obsecurity.org>
Date: Sun, 15 Feb 2004 21:58:40 -0800
One of the alpha package machines seems to have deadlocked; no
processes are running, but the kernel itself responds to pings, and I
can break to DDB:

> console -A axp5
Enter password:
[replay]
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
Feb  1 22:29:12 axp5 kernel: pid 60194 (test), uid 0: exited on signal 11 (core dumped)
kern.ipc.maxpipekva exceeded; see tuning(7)
Feb  2 12:10:13 axp5 kernel: pid 50025 (cc1), uid 0, was killed: exceeded maximum CPU limit
Feb  2 19:15:18 axp5 kernel: pid 36506 (test), uid 0: exited on signal 11 (core dumped)
Feb  2 19:59:25 axp5 kernel: pid 38934 (ocamlrun), uid 0: exited on signal 6 (core dumped)
Feb  3 00:38:59 axp5 kernel: pid 54527 (c++), uid 0: exited on signal 6
Feb  3 06:38:36 axp5 kernel: pid 78939 (harbour), uid 0, was killed: exceeded maximum CPU limit
Feb  3 08:10:08 axp5 kernel: pid 82027 (harbour), uid 0, was killed: exceeded maximum CPU limit
Feb  3 09:28:50 axp5 kernel: pid 84627 (harbour), uid 0, was killed: exceeded maximum CPU limit
Feb  3 10:39:30 axp5 kernel: pid 87408 (harbour), uid 0, was killed: exceeded maximum CPU limit
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
Feb 15 20:30:34 axp5 kernel: pid 43956 (abortme), uid 0: exited on signal 6 (core dumped)
Stopped at      siointr1+0x1a4: ldq_u   zero,0(sp) <0xfffffe0004ddfb08> <zero=0x0,sp=0xfffffe0004ddfb08>
db> ps
  pid   proc     uarea   uid  ppid  pgrp  flag   stat  wmesg    wchan  cmd
45482 fffffc0003c950e0 fffffe000544a000    0   184   184 0000000 [SLP]pfault 0xfffffc00006e4028] inetd
45481 fffffc0000b1f3b0 fffffe0005152000 65534   184 45481 0004000 [SLP]pfault 0xfffffc00006e4028] sh
44062 fffffc00021210e0 fffffe00055fa000    0 34716 29363 0004000 [SLP]pfault 0xfffffc00006e4028] pkg_delete
43990 fffffc0003c94b40 fffffe0005446000    0 43958 19032 0004000 [SLP]pfault 0xfffffc00006e4028] gdb
43958 fffffc0001549950 fffffe000538a000    0 43947 19032 0004000 [SLP]wait 0xfffffc0001549950][SWAP] sh
43947 fffffc0003baa870 fffffe00054ec000    0 43933 19032 0004000 [SLP]wait 0xfffffc0003baa870][SWAP] sh
43933 fffffc000366c000 fffffe0005216000    0 43932 19032 0004000 [SLP]wait 0xfffffc000366c000][SWAP] sh
43932 fffffc0003bab680 fffffe00054f6000    0 43931 19032 0004000 [SLP]wait 0xfffffc0003bab680][SWAP] sh
43931 fffffc00015482d0 fffffe0005332000    0 42552 19032 0004000 [SLP]wait 0xfffffc00015482d0][SWAP] make
43914 fffffc0000acf0e0 fffffe00051ae000    0 43912 93755 0004000 [SLP]piperd 0xfffffc0001c48c00] as
43913 fffffc000366d0e0 fffffe0005222000    0 43912 93755 0004000 [SLP]pfault 0xfffffc00006e4028] cc1
43912 fffffc0001549680 fffffe0005388000    0 43840 93755 0004000 [SLP]wait 0xfffffc0001549680][SWAP] cc
43840 fffffc00032e6e10 fffffe0005656000    0 43839 93755 0004000 [SLP]wait 0xfffffc00032e6e10][SWAP] sh
43839 fffffc0001549c20 fffffe000538c000    0 26563 93755 0004000 [SLP]wait 0xfffffc0001549c20][SWAP] sh
42552 fffffc0003d1cb40 fffffe0004ed2000    0 42548 19032 0004000 [SLP]wait 0xfffffc0003d1cb40][SWAP] make
42548 fffffc00024e50e0 fffffe0005486000    0 42026 19032 0004000 [SLP]wait 0xfffffc00024e50e0][SWAP] make
42026 fffffc000366d950 fffffe00052b8000    0 42024 19032 0004000 [SLP]wait 0xfffffc000366d950][SWAP] sh
42024 fffffc0002ad9950 fffffe0005140000    0 42013 19032 0004000 [SLP]wait 0xfffffc0002ad9950][SWAP] make
42013 fffffc0001548e10 fffffe000533a000    0 41997 19032 0004000 [SLP]wait 0xfffffc0001548e10][SWAP] make
41997 fffffc0000da10e0 fffffe00054dc000    0 41994 19032 0004000 [SLP]wait 0xfffffc0000da10e0][SWAP] sh
41994 fffffc00015490e0 fffffe000533c000    0 41988 19032 0004000 [SLP]wait 0xfffffc00015490e0][SWAP] make
41988 fffffc0002ad8b40 fffffe0005136000    0 22241 19032 0004000 [SLP]wait 0xfffffc0002ad8b40][SWAP] sh
34863 fffffc0002fc65a0 fffffe000508c000    0 34856 41991 0004000 [SLP]piperd 0xfffffc0003249c00] as
34862 fffffc00032e6000 fffffe000564c000    0 34856 41991 0004000 [SLP]pfault 0xfffffc00006e4028] cc1plus
34856 fffffc0000be9c20 fffffe0005214000    0 34829 41991 0004000 [SLP]wait 0xfffffc0000be9c20][SWAP] c++
34829 fffffc00024e5c20 fffffe000555c000    0 68725 41991 0004000 [SLP]wait 0xfffffc00024e5c20][SWAP] sh
34716 fffffc0000eb0b40 fffffe000539e000    0 29365 29363 0004000 [SLP]wait 0xfffffc0000eb0b40][SWAP] sh
29365 fffffc0000be8870 fffffe0005206000    0 29363 29363 0004000 [SLP]wait 0xfffffc0000be8870][SWAP] sh
29363 fffffc0003c95950 fffffe0005450000    0 29361 29363 0004000 [SLP]pause 0xfffffc0000fc6000][SWAP] csh
29361 fffffc0001104000 fffffe00052d2000    0   186 29361 0000100 [CV]select 0xfffffc00006dae08][SWAP] sshd
26563 fffffc00011965a0 fffffe00052c0000    0  8802 93755 0004000 [SLP]wait 0xfffffc00011965a0][SWAP] make
22242 fffffc00024e53b0 fffffe00054e6000    0 22233 19032 0000000 [SWAP] pnohang
22241 fffffc00032e6b40 fffffe0005654000    0 22233 19032 0004000 [SLP]wait 0xfffffc00032e6b40][SWAP] make
22233 fffffc000282f950 fffffe0005556000    0 22153 19032 0004000 [SLP]wait 0xfffffc000282f950][SWAP] pnohang
22153 fffffc00032e62d0 fffffe000564e000    0 19034 19032 0004000 [SLP]wait 0xfffffc00032e62d0][SWAP] sh
19034 fffffc0001197950 fffffe00052ce000    0 19032 19032 0004000 [SLP]wait 0xfffffc0001197950][SWAP] sh
19032 fffffc00011962d0 fffffe00052be000    0 19030 19032 0004000 [SLP]pause 0xfffffc0001478000][SWAP] csh
19030 fffffc0000b1f950 fffffe000519e000    0   186 19030 0000100 [CV]select 0xfffffc00006dae08][SWAP] sshd
 8802 fffffc000282e870 fffffe000554a000    0  8799 93755 0004000 [SLP]wait 0xfffffc000282e870][SWAP] sh
 8799 fffffc00024e4e10 fffffe0005484000    0  8789 93755 0004000 [SLP]wait 0xfffffc00024e4e10][SWAP] make
 8789 fffffc000366c5a0 fffffe000521a000    0  8784 93755 0004000 [SLP]wait 0xfffffc000366c5a0][SWAP] sh
 8784 fffffc000282e2d0 fffffe0005546000    0  8783 93755 0004000 [SLP]wait 0xfffffc000282e2d0][SWAP] make
 8783 fffffc0000be82d0 fffffe00051ba000    0 95037 93755 0004000 [SLP]wait 0xfffffc0000be82d0][SWAP] sh
95038 fffffc00032e65a0 fffffe0005650000    0 95036 93755 0000000 [SLP]pfault 0xfffffc00006e4028] pnohang
95037 fffffc00011045a0 fffffe000531e000    0 95036 93755 0004000 [SLP]wait 0xfffffc00011045a0][SWAP] make
95036 fffffc0000acf680 fffffe00051b2000    0 95016 93755 0004000 [SLP]wait 0xfffffc0000acf680][SWAP] pnohang
95016 fffffc0001196870 fffffe00052c2000    0 93762 93755 0004000 [SLP]wait 0xfffffc0001196870][SWAP] sh
93762 fffffc0000eb02d0 fffffe0005394000    0 93755 93755 0004000 [SLP]wait 0xfffffc0000eb02d0][SWAP] sh
93755 fffffc0001105c20 fffffe000532e000    0 93716 93755 0004000 [SLP]pause 0xfffffc0002dc1000][SWAP] csh
93716 fffffc0000be85a0 fffffe00051bc000    0   186 93716 0000100 [CV]select 0xfffffc00006dae08][SWAP] sshd
68725 fffffc0003c94e10 fffffe0005448000    0 68722 41991 0004000 [SLP]wait 0xfffffc0003c94e10][SWAP] make
68722 fffffc000366dc20 ffffe00052c4000    0     1 73455 0004000 [SLP]wait 0xfffffc0001196b40][SWAP] sh
48119 fffffc0000eb05a0 fffffe0005396000    0 48110 41991 0000000 [SWAP] pnohang
48118 fffffc0000da0000 fffffe0005488000    0 48110 41991 0004000 [SLP]wait 0xfffffc0000da0000][SWAP] make
48110 fffffc00024e45a0 fffffe000547a000    0 46974 41991 0004000 [SLP]wait 0xfffffc00024e45a0][SWAP] pnohang
46974 fffffc0003bab0e0 fffffe00054f2000    0 41993 41991 0004000 [SLP]wait 0xfffffc0003bab0e0][SWAP] sh
41993 fffffc0000be8b40 fffffe0005208000    0 41991 41991 0004000 [SLP]wait 0xfffffc0000be8b40][SWAP] sh
41991 fffffc00011050e0 fffffe0005326000    0 41970 41991 0004000 [SLP]pause 0xfffffc0001066000][SWAP] csh
41970 fffffc000366d680 fffffe00052b6000    0   186 41970 0000100 [CV]select 0xfffffc00006dae08][SWAP] sshd
76779 fffffc0002ad90e0 fffffe000513a000    0 75438 73455 0004000 [CV]select 0xfffffc00006dae08][SWAP] tclsh8.4
75438 fffffc0003baab40 fffffe00054ee000    0 75426 73455 0004000 [SLP]accept 0xfffffc0000f2b136][SWAP] tclsh8.4
75426 fffffc0000acf950 fffffe00051b4000    0 75424 73455 0004000 [SLP]wait 0xfffffc0000acf950][SWAP] tclsh8.4
75424 fffffc0001196b40 fffffe00052c4000    0     1 73455 0004000 [SLP]wait 0xfffffc0001196b40][SWAP] sh
  272 fffffc0002ad85a0 fffffe00050a2000    0     1   272 0004002 [SWAP] getty
  192 fffffc0003ca5950 fffffe0004f42000   25     1   192 0000100 [SWAP] sendmail
  189 fffffc0002fc73b0 fffffe0005096000    0     1   189 0000100 [SWAP] sendmail
  186 fffffc0002fc62d0 fffffe000508a000    0     1   186 0000100 [SWAP] sshd
  184 fffffc0002fc7950 fffffe000509a000    0     1   184 0000000 [SLP]pfault 0xfffffc00006e4028] inetd
  175 fffffc0003ca53b0 fffffe0004f3e000    0     1   175 0000000 [CV]select 0xfffffc00006dae08] rpcbind
  173 fffffc0002fc6000 fffffe0005088000    0     1   173 0000000 [CV]select 0xfffffc00006dae08] ntpd
  167 fffffc0003ca50e0 fffffe0004f3c000    0     1   167 0000000 [SLP]pfault 0xfffffc00006e4028] syslogd
   94 fffffc0003ca5c20 fffffe0004f8c000    0     0     0 0000204 [SLP]mdwait 0xfffffc000315d400] md2
   79 fffffc0002fc7680 fffffe0005098000    0     0     0 0000204 [SLP]mdwait 0xfffffc00032a1600] md1
   46 fffffc0003d1c870 fffffe0004ed0000    0     0     0 0000204 [SLP]mdwait 0xfffffc00032a0200] md0
   36 fffffc0003d1d0e0 fffffe0004f1e000    0     0     0 0000204 [SLP]- 0xfffffc00006e29a0] nfsiod 3
   35 fffffc0003d1d3b0 fffffe0004f20000    0     0     0 0000204 [SLP]- 0xfffffc00006e2998] nfsiod 2
   34 fffffc0003d1d680 fffffe0004f22000    0     0     0 0000204 [SLP]- 0xfffffc00006e2990] nfsiod 1
   33 fffffc0003d1d950 fffffe0004f24000    0     0     0 0000204 [SLP]- 0xfffffc00006e2988] nfsiod 0
   32 fffffc0003d1dc20 fffffe0004f26000    0     0     0 0000204 [SLP]vlruwt 0xfffffc0003d1dc20] vnlru
   31 fffffc0003ca4000 fffffe0004f30000    0     0     0 0000204 [SLP]syncer 0xfffffc000068b2bc] syncer
   30 fffffc0003ca42d0 fffffe0004f32000    0     0     0 0000204 [SLP]psleep 0xfffffc000068b864] bufdaemon
    9 fffffc0003ca45a0 fffffe0004f34000    0     0     0 000020c [SLP]pgzero 0xfffffc000068c410] pagezero
    8 fffffc0003ca4870 fffffe0004f36000    0     0     0 0000204 [SLP]psleep 0xfffffc000068c47c] vmdaemon
    7 fffffc0003ca4b40 fffffe0004f38000    0     0     0 0000204 [SLP]VMWait 0xfffffc000068c468] pagedaemon
    6 fffffc0003ca4e10 fffffe0004f3a000    0     0     0 0000204 [SLP]- 0xfffffe0004e9bcf0] schedcpu
   29 fffffc0003cb22d0 fffffe0004e6e000    0     0     0 0000204 [IWAIT] intr: ppc0
   28 fffffc0003cb25a0 fffffe0004e70000    0     0     0 0000204 new [IWAIT] intr: sio1
   27 fffffc0003cb2870 fffffe0004eba000    0     0     0 0000204 new [IWAIT] intr: sio0
   26 fffffc0003cb2b40 fffffe0004ebc000    0     0     0 0000204 [IWAIT] swi0: tty:sio
   25 fffffc0003cb2e10 fffffe0004ebe000    0     0     0 0000204 new [IWAIT] intr: atkbd0
   24 fffffc0003cb30e0 fffffe0004ec0000    0     0     0 0000204 new [IWAIT] intr: fdc0
   23 fffffc0003cb33b0 fffffe0004ec2000    0     0     0 0000204 [IWAIT] intr: isp0
   22 fffffc0003cb3680 fffffe0004ec4000    0     0     0 0000204 [IWAIT] intr: dc1
   21 fffffc0003cb3950 fffffe0004ec6000    0     0     0 0000204 [IWAIT] intr: dc0
   20 fffffc0003cb3c20 fffffe0004ec8000    0     0     0 0000204 new [IWAIT] swi7: task queue
   19 fffffc0003d1c000 fffffe0004eca000    0     0     0 0000204 [IWAIT] swi3: cambio
   18 fffffc0003d1c2d0 fffffe0004ecc000    0     0     0 0000204 new [IWAIT] swi2: camnet
   17 fffffc0003d1c5a0 fffffe0004ece000    0     0     0 0000204 new [IWAIT] swi5:+
    5 fffffc0003ce4000 fffffe0004dc6000    0     0     0 0000204 [SLP]tqthr 0xfffffc000068b580] taskqueue
   16 fffffc0003ce42d0 fffffe0004e58000    0     0     0 0000204 new [IWAIT] swi6:+
   15 fffffc0003ce45a0 fffffe0004e5a000    0     0     0 0000204 [SLP]- 0xfffffc000068f340] random
    4 fffffc0003ce4870 fffffe0004e5c000    0     0     0 0000204 [SLP]- 0xfffffc000068af08] g_down
    3 fffffc0003ce4b40 fffffe0004e5e000    0     0     0 0000204 [SLP]- 0xfffffc000068af00] g_up
    2 fffffc0003ce4e10 fffffe0004e60000    0     0     0 0000204 [SLP]- 0xfffffc000068aef0] g_event
   14 fffffc0003ce50e0 fffffe0004e62000    0     0     0 0000204 new [IWAIT] swi4: vm
   13 fffffc0003ce53b0 fffffe0004e64000    0     0     0 000020c [IWAIT] swi8: tty:sio clock
   12 fffffc0003ce5680 fffffe0004e66000    0     0     0 0000204 [IWAIT] swi1: net
   11 fffffc0003ce5950 fffffe0004e68000    0     0     0 000020c [CPU 0] idle
    1 fffffc0003ce5c20 fffffe0004e6a000    0     0     1 0004200 [SLP]wait 0xfffffc0003ce5c20] init
   10 fffffc0003cb2000 fffffe0004e6c000    0     0     0 0000204 [CV]ktrace 0xfffffc0000698000] ktrace
    0 fffffc0000693178 fffffc0000796000    0     0     0 0000200 [SLP]vmwait 0xfffffc00006e4028] swapper
db>    

WITNESS was not enabled, and the machines are running

FreeBSD axp1.FreeBSD.org 5.2-CURRENT FreeBSD 5.2-CURRENT #0: Wed Jan 21 13:30:26 PST 2004     kris_at_bento.FreeBSD.org:/local0/obj/alpha/a/asami/portbuild/alpha/src-client/sys/NETBOOT  alpha

Scheduler is 4BSD.

Kris

Received on Sun Feb 15 2004 - 20:58:43 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:37:43 UTC