Re: Harddiskproblems

From: Robert Watson <rwatson_at_freebsd.org>
Date: Wed, 1 Oct 2003 11:42:34 -0400 (EDT)
On Wed, 1 Oct 2003, Gerhard Schmidt wrote:

> since 3 weeks i've problems with my 5.1-CURRENT Box. When i try to
> delete very large direktories (for examplte the builddir of a make
> release) the box Panics. 
> 
> panic: kmem_malloc(4096): kmem_map to small: 275251200 total allocated
> cpuid=0: lapic.id = 00000000
> boot() called on cpu#0
> 
> The Box hangs after that. no automatic reboot. 

And presumably no backtrace/dump possible?  If you're not using a serial
console, you might want to try it and see if you get more reliable access
to the debugger.

The panic message means that the kernel ran out of address space for
kernel memory allocation, which is typically a sign of one of two things:
(1) a kernel memory leak, or (2) lack of an allocation/resource bound for
some type of allocation, or alternatively, a scaling factor for the
resource bound that permits too much allocation (perhaps scaled to
physical memory).  It would be interesting, if this is pretty
reproduceable, to see the output of a series of calls to vmstat -m and
vmstat -z leading up to the panic, to see if we can track down what is
getting allocated "too much".  To work around the problem, you can
increase the amount of address space allocated to kernel memory, or you
might try reducing the amount of memory in the machine and see if that
fixes the scaling factor.  Getting a dump of the kernel in its toasted
state would be highly desirable, as it's possible to run vmstat on the
kernel dump to see what state memory allocation is in.  Using a serial
console might let you get further into the debugger...

> 
> Regards 
> 	estartu
> 
> ---- Bootmsg ----
> 
> Copyright (c) 1992-2003 The FreeBSD Project.
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
> 	The Regents of the University of California. All rights reserved.
> FreeBSD 5.1-CURRENT #1: Tue Sep 30 13:23:39 CEST 2003
>     root_at_sol.ze.tu-muenchen.de:/usr/src/sys/i386/compile/SOL
> Preloaded elf kernel "/boot/kernel/kernel" at 0xc04f8000.
> Preloaded elf module "/boot/kernel/acpi.ko" at 0xc04f826c.
> Timecounter "i8254" frequency 1193182 Hz quality 0
> CPU: Intel(R) Xeon(TM) CPU 2.40GHz (2399.33-MHz 686-class CPU)
>   Origin = "GenuineIntel"  Id = 0xf27  Stepping = 7
>   Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
>   Hyperthreading: 2 logical CPUs
> real memory  = 4160684032 (3967 MB)
> avail memory = 4048343040 (3860 MB)
> Programming 24 pins in IOAPIC #0
> IOAPIC #0 intpin 2 -> irq 0
> Programming 24 pins in IOAPIC #1
> Programming 24 pins in IOAPIC #2
> FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
>  cpu0 (BSP): apic id:  0, version: 0x00050014, at 0xfee00000
>  cpu1 (AP):  apic id:  1, version: 0x00050014, at 0xfee00000
>  cpu2 (AP):  apic id:  6, version: 0x00050014, at 0xfee00000
>  cpu3 (AP):  apic id:  7, version: 0x00050014, at 0xfee00000
>  io0 (APIC): apic id:  8, version: 0x00178020, at 0xfec00000
>  io1 (APIC): apic id:  9, version: 0x00178020, at 0xfec80000
>  io2 (APIC): apic id: 10, version: 0x00178020, at 0xfec80400
> Pentium Pro MTRR support enabled
> npx0: <math processor> on motherboard
> npx0: INT 16 interface
> acpi0: <A M I  OEMRSDT > on motherboard
> pcibios: BIOS version 2.10
> Using $PIR table, 14 entries at 0xc00f2fb0
> acpi0: Power Button (fixed)
> Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
> acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
> acpi_cpu0: <CPU> on acpi0
> acpi_cpu1: <CPU> on acpi0
> acpi_cpu2: <CPU> on acpi0
> acpi_cpu3: <CPU> on acpi0
> pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
> pci0: <ACPI PCI bus> on pcib0
> IOAPIC #0 intpin 16 -> irq 2
> IOAPIC #0 intpin 18 -> irq 9
> IOAPIC #0 intpin 17 -> irq 10
> pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
> pcib1: could not get PCI interrupt routing table for \\_SB_.PCI0.P0P2 - AE_NOT_FOUND
> pci2: <ACPI PCI bus> on pcib1
> pci2: <base peripheral, interrupt controller> at device 28.0 (no driver attached)
> pcib2: <ACPI PCI-PCI bridge> at device 29.0 on pci2
> pci4: <ACPI PCI bus> on pcib2
> IOAPIC #2 intpin 0 -> irq 11
> em0: <Intel(R) PRO/1000 Network Connection, Version - 1.7.16> port 0xd800-0xd83f mem 0xfe9e0000-0xfe9fffff irq 11 at device 1.0 on pci4
> em0:  Speed:N/A  Duplex:N/A
> pci2: <base peripheral, interrupt controller> at device 30.0 (no driver attached)
> pcib3: <ACPI PCI-PCI bridge> at device 31.0 on pci2
> pci3: <ACPI PCI bus> on pcib3
> IOAPIC #1 intpin 4 -> irq 16
> twe0: <3ware Storage Controller> port 0xc800-0xc80f mem 0xfe000000-0xfe7fffff,0xfe8ffc00-0xfe8ffc0f irq 16 at device 6.0 on pci3
> twe0: 8 ports, Firmware FE7S 1.05.00.049, BIOS BE7X 1.08.00.046
> uhci0: <Intel 82801CA/CAM (ICH3) USB controller USB-A> port 0xe800-0xe81f irq 2 at device 29.0 on pci0
> usb0: <Intel 82801CA/CAM (ICH3) USB controller USB-A> on uhci0
> usb0: USB revision 1.0
> uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
> uhub0: 2 ports with 2 removable, self powered
> pcib4: <ACPI PCI-PCI bridge> at device 30.0 on pci0
> pci1: <ACPI PCI bus> on pcib4
> fxp0: <Intel 82551 Pro/100 Ethernet> port 0xb400-0xb43f mem 0xfd7a0000-0xfd7bffff,0xfd7fe000-0xfd7fefff irq 10 at device 1.0 on pci1
> fxp0: Ethernet address 00:e0:81:26:9e:56
> miibus0: <MII bus> on fxp0
> inphy0: <i82555 10/100 media interface> on miibus0
> inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
> pci1: <display, VGA> at device 2.0 (no driver attached)
> isab0: <PCI-ISA bridge> at device 31.0 on pci0
> isa0: <ISA bus> on isab0
> atapci0: <Intel ICH3 UDMA100 controller> port 0xffa0-0xffaf,0-0x3,0-0x7,0-0x3,0-0x7 irq 9 at device 31.1 on pci0
> ata0: at 0x1f0 irq 14 on atapci0
> ata0: [MPSAFE]
> ata1: at 0x170 irq 15 on atapci0
> ata1: [MPSAFE]
> pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
> acpi_button0: <Power Button> on acpi0
> acpi_button1: <Sleep Button> on acpi0
> atkbdc0: <Keyboard controller (i8042)> port 0x64,0x60 irq 1 on acpi0
> atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
> kbd0 at atkbd0
> sio0 port 0x3f8-0x3ff irq 4 on acpi0
> sio0: type 16550A
> fdc0: <Enhanced floppy controller (i82077, NE72065 or clone)> port 0x3f7,0x3f0-0x3f5 irq 6 drq 2 on acpi0
> fdc0: FIFO enabled, 8 bytes threshold
> fd0: <1440-KB 3.5" drive> on fdc0 drive 0
> ppc0 port 0x378-0x37f irq 7 on acpi0
> ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
> ppbus0: <Parallel port bus> on ppc0
> ppi0: <Parallel I/O> on ppbus0
> plip0: <PLIP network interface> on ppbus0
> lpt0: <Printer> on ppbus0
> lpt0: Interrupt-driven port
> orm0: <Option ROMs> at iomem 0xc9800-0xcafff,0xc8000-0xc8fff,0xc0000-0xc7fff on isa0
> pmtimer0 on isa0
> sc0: <System console> at flags 0x100 on isa0
> sc0: VGA <16 virtual consoles, flags=0x300>
> sio1: configured irq 3 not in bitmap of probed irqs 0
> sio1: port may not be enabled
> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
> APIC_IO: Testing 8254 interrupt delivery
> APIC_IO: routing 8254 via IOAPIC #0 intpin 2
> 
> Timecounters tick every 10.000 msec
> acpi_cpu: throttling enabled, 8 steps (100% to 12.5%), currently 100.0%
> acd0: CDROM <ATAPI CD-ROM 52XMax> at ata0-master PIO4
> GEOM: create disk ad2 dp=0xcab5e470
> ad2: 117246MB <Maxtor 6Y120L0> [238216/16/63] at ata1-master UDMA100
> twed0: <Unit 0, RAID5, Normal> on twe0
> twed0: 351737MB (720359040 sectors)
> GEOM: create disk twed0 dp=0xcadd008c
> twe0: command interrupt
> (probe0:ata0:0:0:0): Recovered Sense
> (probe0:ata0:0:0:0): INQUIRY. CDB: 12 1 80 0 ff 0 
> (probe0:ata0:0:0:0): CAM Status: SCSI Status Error
> (probe0:ata0:0:0:0): SCSI Status: Check Condition
> (probe0:ata0:0:0:0): ILLEGAL REQUEST asc:24,0
> (probe0:ata0:0:0:0): Invalid field in CDB
> (probe0:ata0:0:0:0): Recovered Sense
> (probe0:ata0:0:0:0): INQUIRY. CDB: 12 1 80 0 ff 0 
> (probe0:ata0:0:0:0): CAM Status: SCSI Status Error
> (probe0:ata0:0:0:0): SCSI Status: Check Condition
> (probe0:ata0:0:0:0): ILLEGAL REQUEST asc:24,0
> (probe0:ata0:0:0:0): Invalid field in CDB
> SMP: AP CPU #1 Launched!
> SMP: AP CPU #2 Launched!
> SMP: AP CPU #3 Launched!
> (cd0:ata0:0:0:0): Recovered Sense
> (cd0:ata0:0:0:0): READ CD RECORDED CAPACITY. CDB: 25 0 0 0 0 0 0 0 0 0 
> (cd0:ata0:0:0:0): CAM Status: SCSI Status Error
> (cd0:ata0:0:0:0): SCSI Status: Check Condition
> (cd0:ata0:0:0:0): NOT READY asc:3a,0
> (cd0:ata0:0:0:0): Medium not present
> cd0 at ata0 bus 0 target 0 lun 0
> cd0: <ATAPI CD-ROM 52XMax 1.20> Removable CD-ROM SCSI-0 device 
> cd0: 16.000MB/s transfers
> cd0: Attempt to query device size failed: NOT READY, Medium not present
> Mounting root from ufs:/dev/ad2s1a
> 
> ----------------------------------------------------------------------------
> Gerhard Schmidt    | Nick : estartu      IRC : Estartu  |  PGP Public Key
> Fischbachweg 3     | Privat: estartu_at_augusta.de         |   auf Anfrage/
> 86856 Hiltenfingen | Dienst: schmidt_at_ze.tu-muenchen.de  |    on request
> Germany	           |                                    |     
> 
> 
Received on Wed Oct 01 2003 - 06:43:53 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:37:24 UTC