Re: STABILITY [Fwd: cvs commit: src/sys/kern kern_switch.c]

On Thu, Jul 22, 2004 at 09:13:55AM -0600, Scott Long wrote:
> All,
> 
> This commit is another hack to try to improve stability some
> more.  Please let me know if it helps or hurts.  If it helps
> then I think that we are getting closer to at least one of the
> real culprits.

Difficult to say after running one day. I have the impression stability
is improved somewhat, but nevertheless had some crashes. I got a crash
dump that looks very similar to the one I obtained earlier this week. 
Please let me know what I can do to provide some useful information.

Karel.




phys9911# gdb53 -k kernel.debug /usr/crash/vmcore.9
GNU gdb 5.3 (FreeBSD)
Copyright 2002 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "i386-portbld-freebsd5.2"...
panic: sched_rem: KSE not on run queue
panic messages:
---
panic: sched_rem: KSE not on run queue
cpuid = 0;
KDB: enter: panic
panic: from debugger
cpuid = 0;
Uptime: 3h28m6s
Dumping 247 MB
 16 32 48 64 80 96 112 128 144 160 176 192 208 224 240
---
#0  doadump () at pcpu.h:159
159             __asm __volatile("movl %%fs:0,%0" : "=r" (td));
Ready to go.  Enter 'tr' to connect to the remote target
with /dev/cuaa0, 'tr /dev/cuaa1' to connect to a different port
or 'trf portno' to connect to the remote target with the firewire
interface.  portno defaults to 5556.

Type 'getsyms' after connection to load kld symbols.

If you're debugging a local system, you can use 'kldsyms' instead
to load the kld symbols.  That's a less obnoxious interface.
(kgdb) kldsyms
add symbol table from file "/usr/obj/usr/src/sys/GENERIC/modules/usr/src/sys/modules/sound/driver/ich/snd_ich.ko.debug" at
        .text_addr = 0xc09b6800
        .data_addr = 0xc09b9040
        .bss_addr = 0xc09b92bc
add symbol table from file "/usr/obj/usr/src/sys/GENERIC/modules/usr/src/sys/modules/sound/sound/sound.ko.debug" at
        .text_addr = 0xc09c33b4
        .data_addr = 0xc09d05a0
        .bss_addr = 0xc09d2d40
add symbol table from file "/usr/obj/usr/src/sys/GENERIC/modules/usr/src/sys/modules/acpi/acpi/acpi.ko.debug" at
        .text_addr = 0xc09e8d80
        .data_addr = 0xc0a18000
        .bss_addr = 0xc0a19aa0
add symbol table from file "/usr/obj/usr/src/sys/GENERIC/modules/usr/src/sys/modules/linprocfs/linprocfs.ko.debug" at
        .text_addr = 0xc1740ff0
        .data_addr = 0xc1744020
        .bss_addr = 0xc1744280
add symbol table from file "/usr/obj/usr/src/sys/GENERIC/modules/usr/src/sys/modules/linux/linux.ko.debug" at
        .text_addr = 0xc174b660
        .data_addr = 0xc1759ae0
        .bss_addr = 0xc175ad40
(kgdb) bt
#0  doadump () at pcpu.h:159
#1  0xc05f0208 in boot (howto=0x104) at /usr/src/sys/kern/kern_shutdown.c:392
#2  0xc05f051f in panic (fmt=0xc079f247 "from debugger") at /usr/src/sys/kern/kern_shutdown.c:554
#3  0xc045eb71 in db_panic (addr=0xc0606c93, have_addr=0x0, count=0xffffffff, modif=0xd4ee2a78 "")
    at /usr/src/sys/ddb/db_command.c:435
#4  0xc045eb08 in db_command (last_cmdp=0xc0875a44, cmd_table=0x0, aux_cmd_tablep=0xc07f6f48,
    aux_cmd_tablep_end=0xc07f6f60) at /usr/src/sys/ddb/db_command.c:349
#5  0xc045ebd0 in db_command_loop () at /usr/src/sys/ddb/db_command.c:455
#6  0xc0460559 in db_trap (type=0x3, code=0x0) at /usr/src/sys/ddb/db_main.c:219
#7  0xc0606f1d in kdb_trap (type=0x3, code=0x0, tf=0xd4ee2bbc) at /usr/src/sys/kern/subr_kdb.c:401
#8  0xc076aed4 in trap (frame=
      {tf_fs = 0xd4ee0018, tf_es = 0xc0600010, tf_ds = 0xc07d0010, tf_edi = 0xc07d3e6a, tf_esi = 0x1, tf_ebp = 0xd4ee2bfc, tf_isp = 0xd4ee2be8, tf_ebx = 0xd4ee2c28, tf_edx = 0x0, tf_ecx = 0xc1014000, tf_eax = 0x12, tf_trapno = 0x3, tf_err = 0x0, tf_eip = 0xc0606c93, tf_cs = 0x8, tf_eflags = 0x86, tf_esp = 0xd4ee2c1c, tf_ss = 0xc05f04d1})
    at /usr/src/sys/i386/i386/trap.c:576
#9  0xc0606c93 in kdb_enter (msg=0x0) at cpufunc.h:56
#10 0xc05f04d1 in panic (fmt=0xc07d3e6a "sched_rem: KSE not on run queue") at /usr/src/sys/kern/kern_shutdown.c:538
#11 0xc06004ae in sched_rem (td=0x0) at /usr/src/sys/kern/sched_ule.c:1668
#12 0xc05f5725 in setrunqueue (td=0xc1f36420) at /usr/src/sys/kern/kern_switch.c:362
#13 0xc05ffb72 in sched_wakeup (td=0xc1f36420) at /usr/src/sys/kern/sched_ule.c:1251
#14 0xc05f690c in setrunnable (td=0xc1f36420) at /usr/src/sys/kern/kern_synch.c:408
#15 0xc060c4de in sleepq_resume_thread (td=0xc1f36420, pri=0xffffffff) at /usr/src/sys/kern/subr_sleepqueue.c:632
#16 0xc060c578 in sleepq_signal (wchan=0xc190d3dc, flags=0xc1f36420, pri=0xffffffff)
    at /usr/src/sys/kern/subr_sleepqueue.c:662
#17 0xc05f65fb in wakeup_one (ident=0xc190d3dc) at /usr/src/sys/kern/kern_synch.c:278
#18 0xc05e172f in thread_userret (td=0xc18be160, frame=0xd4ee2d48) at /usr/src/sys/kern/kern_kse.c:1191
#19 0xc060d494 in userret (td=0xc18be160, frame=0xd4ee2d48, oticks=0x0) at /usr/src/sys/kern/subr_trap.c:118
#20 0xc076af6c in trap (frame=
      {tf_fs = 0xbfbf002f, tf_es = 0x280c002f, tf_ds = 0xbfbf002f, tf_edi = 0x82469b4, tf_esi = 0x8246800, tf_ebp = 0xbfbfcd48, tf_isp = 0xd4ee2d74, tf_ebx = 0x2a7bd9f8, tf_edx = 0x80a3090, tf_ecx = 0x0, tf_eax = 0x82cf000, tf_trapno = 0xc, tf_err = 0x4, tf_eip = 0x2a7a9e8b, tf_cs = 0x1f, tf_eflags = 0x10246, tf_esp = 0xbfbfcd1c, tf_ss = 0x2f})
    at /usr/src/sys/i386/i386/trap.c:635
(kgdb)