lock up

Greetings all!

A system (Tyan S2932) I am testing CURRENT amd64 with is experiencing a
strange lock up. No panic, not much on the console, just a lock up, freeze.

I first noticed the issue while tailing a build in a ssh session over a
vpn connection. On the local network the issue doesn't seem to occur.
I can reproduce the lock up all the time.

Last I tried, the system was running CURRENT from a couple hours ago.

I have tried:

- 4BSD and ULE
- switching network cards
- taking the IPMI card out (seems to work locally with freeipmi and
ipmitoll remotely)
- enabled/disabled "redirection after post" (BIOS setting)
- without debug
- without IPv6 and friends (see rtfree below)

dmesg and pciconf attached. The dmesg is after a lock up.
rtfree pops a few times before the lock up. I noticed from a recent post
some action was taken and the related patch is there (ie. today's CURRENT).

The system had a fresh install this past weekend and the LSI MegaRAID
array doesn't contain any data, it is just mounted. The system boots off
the onboard LSI SAS (couple disks in RAID 1).

Thank you for your input.

Joao

Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.0-CURRENT #2: Tue Sep 25 22:52:58 PDT 2007
    root_at_daemons.somedomain.com:/usr/obj/usr/src/sys/GENERIC
WARNING: WITNESS option enabled, expect reduced performance.
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Dual-Core AMD Opteron(tm) Processor 2210 HE (1800.08-MHz K8-class CPU)
  Origin = "AuthenticAMD"  Id = 0x40f12  Stepping = 2
  Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
  Features2=0x2001<SSE3,CX16>
  AMD Features=0xea500800<SYSCALL,NX,MMX+,FFXSR,RDTSCP,LM,3DNow!+,3DNow!>
  AMD Features2=0x1f<LAHF,CMP,SVM,ExtAPIC,CR8>
  Cores per package: 2
usable memory = 4281667584 (4083 MB)
avail memory  = 4124246016 (3933 MB)
ACPI APIC Table: <082907 APIC1947>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
ioapic0 <Version 1.1> irqs 0-23 on motherboard
kbd1 at kbdmux0
ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
acpi0: <082907 XSDT1947> on motherboard
acpi0: [ITHREAD]
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 25000000 Hz quality 900
acpi0: Power Button (fixed)
acpi0: reservation of fec00000, 1400000 (3) failed
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, d7f00000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x2008-0x200b on acpi0
cpu0: <ACPI CPU> on acpi0
powernow0: <PowerNow! K8> on cpu0
cpu1: <ACPI CPU> on acpi0
powernow1: <PowerNow! K8> on cpu1
cpu2: <ACPI CPU> on acpi0
powernow2: <PowerNow! K8> on cpu2
cpu3: <ACPI CPU> on acpi0
powernow3: <PowerNow! K8> on cpu3
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <memory, RAM> at device 0.0 (no driver attached)
isab0: <PCI-ISA bridge> port 0x2f00-0x2f7f at device 1.0 on pci0
isa0: <ISA bus> on isab0
pci0: <serial bus, SMBus> at device 1.1 (no driver attached)
ohci0: <OHCI (generic) USB controller> mem 0xfdafb000-0xfdafbfff irq 21 at device 2.0 on pci0
ohci0: [GIANT-LOCKED]
ohci0: [ITHREAD]
usb0: OHCI version 1.0, legacy support
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: <nVidia OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 10 ports with 10 removable, self powered
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xfdafac00-0xfdafacff irq 22 at device 2.1 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb1: EHCI version 1.0
usb1: companion controller, 10 ports each: usb0
usb1: <EHCI (generic) USB 2.0 controller> on ehci0
usb1: USB revision 2.0
uhub1: <nVidia EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb1
uhub1: 10 ports with 10 removable, self powered
atapci0: <nVidia nForce MCP55 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 4.0 on pci0
ata0: <ATA channel 0> on atapci0
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci0
ata1: [ITHREAD]
atapci1: <nVidia nForce MCP55 SATA300 controller> port 0xb480-0xb487,0xb400-0xb403,0xb080-0xb087,0xb000-0xb003,0xac00-0xac0f mem 0xfdaf9000-0xfdaf9fff irq 23 at device 5.0 on pci0
atapci1: [ITHREAD]
ata2: <ATA channel 0> on atapci1
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci1
ata3: [ITHREAD]
atapci2: <nVidia nForce MCP55 SATA300 controller> port 0xa880-0xa887,0xa800-0xa803,0xa480-0xa487,0xa400-0xa403,0xa080-0xa08f mem 0xfdaf8000-0xfdaf8fff irq 20 at device 5.1 on pci0
atapci2: [ITHREAD]
ata4: <ATA channel 0> on atapci2
ata4: [ITHREAD]
ata5: <ATA channel 1> on atapci2
ata5: [ITHREAD]
atapci3: <nVidia nForce MCP55 SATA300 controller> port 0xa000-0xa007,0x9c00-0x9c03,0x9880-0x9887,0x9800-0x9803,0x9480-0x948f mem 0xfdaf7000-0xfdaf7fff irq 21 at device 5.2 on pci0
atapci3: [ITHREAD]
ata6: <ATA channel 0> on atapci3
ata6: [ITHREAD]
ata7: <ATA channel 1> on atapci3
ata7: [ITHREAD]
pcib1: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci1: <ACPI PCI bus> on pcib1
ahc0: <Adaptec 2940 Ultra2 SCSI adapter> port 0xc800-0xc8ff mem 0xfdbff000-0xfdbfffff irq 16 at device 6.0 on pci1
ahc0: [ITHREAD]
aic7890/91: Ultra2 Wide Channel A, SCSI Id=7, 32/253 SCBs
vgapci0: <VGA-compatible display> port 0xc000-0xc0ff mem 0xf0000000-0xf7ffffff,0xfdbe0000-0xfdbeffff irq 17 at device 7.0 on pci1
nfe0: <NVIDIA nForce MCP55 Networking Adapter> port 0x9400-0x9407 mem 0xfdaf6000-0xfdaf6fff,0xfdafa800-0xfdafa8ff,0xfdafa400-0xfdafa40f irq 22 at device 8.0 on pci0
miibus0: <MII bus> on nfe0
e1000phy0: <Marvell 88E1149 Gigabit PHY> PHY 16 on miibus0
e1000phy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX-FDX, auto
nfe0: Ethernet address: 00:e0:81:48:f8:42
nfe0: [FILTER]
nfe0: [FILTER]
nfe0: [FILTER]
nfe0: [FILTER]
nfe0: [FILTER]
nfe0: [FILTER]
nfe0: [FILTER]
nfe0: [FILTER]
nfe1: <NVIDIA nForce MCP55 Networking Adapter> port 0x9080-0x9087 mem 0xfdaf5000-0xfdaf5fff,0xfdafa000-0xfdafa0ff,0xfdaf4c00-0xfdaf4c0f irq 23 at device 9.0 on pci0
miibus1: <MII bus> on nfe1
e1000phy1: <Marvell 88E1149 Gigabit PHY> PHY 17 on miibus1
e1000phy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX-FDX, auto
nfe1: Ethernet address: 00:e0:81:48:f8:43
nfe1: [FILTER]
nfe1: [FILTER]
nfe1: [FILTER]
nfe1: [FILTER]
nfe1: [FILTER]
nfe1: [FILTER]
nfe1: [FILTER]
nfe1: [FILTER]
pcib2: <ACPI PCI-PCI bridge> at device 10.0 on pci0
pci2: <ACPI PCI bus> on pcib2
mpt0: <LSILogic SAS/SATA Adapter> port 0xd000-0xd0ff mem 0xfdefc000-0xfdefffff,0xfdee0000-0xfdeeffff irq 18 at device 0.0 on pci2
mpt0: [ITHREAD]
mpt0: MPI Version=1.5.13.0
mpt0: mpt_cam_event: 0x16
mpt0: Unhandled Event Notify Frame. Event 0x16 (ACK not required).
mpt0: mpt_cam_event: 0x12
mpt0: Unhandled Event Notify Frame. Event 0x12 (ACK not required).
mpt0: mpt_cam_event: 0x12
mpt0: Unhandled Event Notify Frame. Event 0x12 (ACK not required).
mpt0: mpt_cam_event: 0x16
mpt0: Unhandled Event Notify Frame. Event 0x16 (ACK not required).
pcib3: <ACPI PCI-PCI bridge> at device 13.0 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <PCI-PCI bridge> at device 0.0 on pci3
pci4: <PCI bus> on pcib4
pcib5: <PCI-PCI bridge> at device 0.0 on pci4
pci5: <PCI bus> on pcib5
amr0: <LSILogic MegaRAID 1.53> mem 0xfcff0000-0xfcffffff,0xfe800000-0xfe8fffff irq 19 at device 14.0 on pci5
amr0: Using 64-bit DMA
amr0: [ITHREAD]
amr0: delete logical drives supported by controller
amr0: <LSILogic LSI MegaRAID SATA300-8X PCI-X> Firmware 815C, BIOS H432, 128MB RAM
pcib6: <PCI-PCI bridge> at device 0.1 on pci3
pci6: <PCI bus> on pcib6
fxp0: <Intel 82559 Pro/100 Ethernet> port 0xec00-0xec3f mem 0xfebff000-0xfebfffff,0xfea00000-0xfeafffff irq 16 at device 2.0 on pci6
miibus2: <MII bus> on fxp0
inphy0: <i82555 10/100 media interface> PHY 1 on miibus2
inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp0: Ethernet address: 00:d0:b7:ba:a0:bd
fxp0: [ITHREAD]
pcib7: <ACPI PCI-PCI bridge> at device 14.0 on pci0
pci7: <ACPI PCI bus> on pcib7
pcib8: <ACPI PCI-PCI bridge> at device 15.0 on pci0
pci8: <ACPI PCI bus> on pcib8
acpi_button0: <Power Button> on acpi0
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A, console
sio0: [FILTER]
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 drq 0 on acpi0
sio1: type 16550A
sio1: [FILTER]
fdc0: <floppy drive controller (FDE)> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FILTER]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc8fff,0xc9000-0xca7ff,0xca800-0xcafff,0xd3000-0xd3fff on isa0
ppc0: cannot reserve I/O port range
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
acd0: DVDR <PIONEER DVD-RW DVR-212D/1.09> at ata2-master SATA150
Waiting 5 seconds for SCSI devices to settle
amr0: delete logical drives supported by controller
amrd0: <LSILogic MegaRAID logical drive> on amr0
amrd0: 915525MB (1874995200 sectors) RAID 5 (optimal)
da0 at mpt0 bus 0 target 11 lun 0
da0: <LSILOGIC Logical Volume 3000> Fixed Direct Access SCSI-2 device 
da0: 300.000MB/s transfers
da0: Command Queueing Enabled
da0: 69618MB (142577664 512 byte sectors: 255H 63S/T 8875C)
sa0 at ahc0 bus 0 target 2 lun 0
sa0: <HP C1537A L610> Removable Sequential Access SCSI-2 device 
sa0: 10.000MB/s transfers (10.000MHz, offset 32)
SMP: AP CPU #1 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #3 Launched!
WARNING: WITNESS option enabled, expect reduced performance.
Trying to mount root from ufs:/dev/da0s1a
WARNING: / was not properly dismounted
WARNING: /tmp was not properly dismounted
/tmp: mount pending error: blocks 52 files 13
WARNING: /usr was not properly dismounted
/usr: mount pending error: blocks 37776 files 2374
WARNING: /var was not properly dismounted
WARNING: /resource was not properly dismounted

none0_at_pci0:0:0:	class=0x050000 card=0xcb8410de chip=0x036910de rev=0xa2 hdr=0x00
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 Memory Controller'
    class      = memory
    subclass   = RAM
isab0_at_pci0:1:0:	class=0x060100 card=0xcb8410de chip=0x036410de rev=0xa3 hdr=0x00
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 LPC Bridge'
    class      = bridge
    subclass   = PCI-ISA
none1_at_pci0:1:1:	class=0x0c0500 card=0xcb8410de chip=0x036810de rev=0xa3 hdr=0x00
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 SMBus'
    class      = serial bus
    subclass   = SMBus
ohci0_at_pci0:2:0:	class=0x0c0310 card=0xcb8410de chip=0x036c10de rev=0xa1 hdr=0x00
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 USB Controller'
    class      = serial bus
    subclass   = USB
ehci0_at_pci0:2:1:	class=0x0c0320 card=0xcb8410de chip=0x036d10de rev=0xa2 hdr=0x00
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 USB Controller'
    class      = serial bus
    subclass   = USB
atapci0_at_pci0:4:0:	class=0x01018a card=0xcb8410de chip=0x036e10de rev=0xa1 hdr=0x00
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 IDE'
    class      = mass storage
    subclass   = ATA
atapci1_at_pci0:5:0:	class=0x010185 card=0xcb8410de chip=0x037f10de rev=0xa3 hdr=0x00
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 SATA Controller'
    class      = mass storage
    subclass   = ATA
atapci2_at_pci0:5:1:	class=0x010185 card=0xcb8410de chip=0x037f10de rev=0xa3 hdr=0x00
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 SATA Controller'
    class      = mass storage
    subclass   = ATA
atapci3_at_pci0:5:2:	class=0x010185 card=0xcb8410de chip=0x037f10de rev=0xa3 hdr=0x00
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 SATA Controller'
    class      = mass storage
    subclass   = ATA
pcib1_at_pci0:6:0:	class=0x060401 card=0xcb8410de chip=0x037010de rev=0xa2 hdr=0x01
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 PCI bridge'
    class      = bridge
    subclass   = PCI-PCI
nfe0_at_pci0:8:0:	class=0x068000 card=0xcb8410de chip=0x037310de rev=0xa3 hdr=0x00
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 Ethernet'
    class      = bridge
nfe1_at_pci0:9:0:	class=0x068000 card=0xcb8410de chip=0x037310de rev=0xa3 hdr=0x00
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 Ethernet'
    class      = bridge
pcib2_at_pci0:10:0:	class=0x060400 card=0x000010de chip=0x037610de rev=0xa3 hdr=0x01
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 PCI Express bridge'
    class      = bridge
    subclass   = PCI-PCI
pcib3_at_pci0:13:0:	class=0x060400 card=0x000010de chip=0x037810de rev=0xa3 hdr=0x01
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 PCI Express bridge'
    class      = bridge
    subclass   = PCI-PCI
pcib7_at_pci0:14:0:	class=0x060400 card=0x000010de chip=0x037510de rev=0xa3 hdr=0x01
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 PCI Express bridge'
    class      = bridge
    subclass   = PCI-PCI
pcib8_at_pci0:15:0:	class=0x060400 card=0x000010de chip=0x037710de rev=0xa3 hdr=0x01
    vendor     = 'Nvidia Corp'
    device     = 'MCP55 PCI Express bridge'
    class      = bridge
    subclass   = PCI-PCI
hostb0_at_pci0:24:0:	class=0x060000 card=0x00000000 chip=0x11001022 rev=0x00 hdr=0x00
    vendor     = 'Advanced Micro Devices (AMD)'
    device     = 'Athlon 64 / Opteron HyperTransport Technology Configuration'
    class      = bridge
    subclass   = HOST-PCI
hostb1_at_pci0:24:1:	class=0x060000 card=0x00000000 chip=0x11011022 rev=0x00 hdr=0x00
    vendor     = 'Advanced Micro Devices (AMD)'
    device     = 'Athlon 64 / Opteron Address Map'
    class      = bridge
    subclass   = HOST-PCI
hostb2_at_pci0:24:2:	class=0x060000 card=0x00000000 chip=0x11021022 rev=0x00 hdr=0x00
    vendor     = 'Advanced Micro Devices (AMD)'
    device     = 'Athlon 64 / Opteron DRAM Controller'
    class      = bridge
    subclass   = HOST-PCI
hostb3_at_pci0:24:3:	class=0x060000 card=0x00000000 chip=0x11031022 rev=0x00 hdr=0x00
    vendor     = 'Advanced Micro Devices (AMD)'
    device     = 'Athlon 64 / Opteron Miscellaneous Control'
    class      = bridge
    subclass   = HOST-PCI
hostb4_at_pci0:25:0:	class=0x060000 card=0x00000000 chip=0x11001022 rev=0x00 hdr=0x00
    vendor     = 'Advanced Micro Devices (AMD)'
    device     = 'Athlon 64 / Opteron HyperTransport Technology Configuration'
    class      = bridge
    subclass   = HOST-PCI
hostb5_at_pci0:25:1:	class=0x060000 card=0x00000000 chip=0x11011022 rev=0x00 hdr=0x00
    vendor     = 'Advanced Micro Devices (AMD)'
    device     = 'Athlon 64 / Opteron Address Map'
    class      = bridge
    subclass   = HOST-PCI
hostb6_at_pci0:25:2:	class=0x060000 card=0x00000000 chip=0x11021022 rev=0x00 hdr=0x00
    vendor     = 'Advanced Micro Devices (AMD)'
    device     = 'Athlon 64 / Opteron DRAM Controller'
    class      = bridge
    subclass   = HOST-PCI
hostb7_at_pci0:25:3:	class=0x060000 card=0x00000000 chip=0x11031022 rev=0x00 hdr=0x00
    vendor     = 'Advanced Micro Devices (AMD)'
    device     = 'Athlon 64 / Opteron Miscellaneous Control'
    class      = bridge
    subclass   = HOST-PCI
ahc0_at_pci1:6:0:	class=0x010000 card=0xa1809005 chip=0x00109005 rev=0x00 hdr=0x00
    vendor     = 'Adaptec Inc'
    device     = 'AHA-2940U2W/U2B AHA-2950U2W Ultra2 SCSI Controller'
    class      = mass storage
    subclass   = SCSI
vgapci0_at_pci1:7:0:	class=0x030000 card=0x515e1002 chip=0x515e1002 rev=0x02 hdr=0x00
    vendor     = 'ATI Technologies Inc.'
    device     = 'Radeon ES1000 Radeon ES1000'
    class      = display
    subclass   = VGA
mpt0_at_pci2:0:0:	class=0x010000 card=0x10001000 chip=0x00581000 rev=0x04 hdr=0x00
    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
    device     = 'SAS 3000 series, 8-port with 1068E -StorPort'
    class      = mass storage
    subclass   = SCSI
pcib4_at_pci3:0:0:	class=0x060400 card=0x00000000 chip=0x01251033 rev=0x07 hdr=0x01
    vendor     = 'NEC Electronics Hong Kong'
    class      = bridge
    subclass   = PCI-PCI
pcib6_at_pci3:0:1:	class=0x060400 card=0x00000000 chip=0x01251033 rev=0x07 hdr=0x01
    vendor     = 'NEC Electronics Hong Kong'
    class      = bridge
    subclass   = PCI-PCI
pcib5_at_pci4:0:0:	class=0x060400 card=0x00000000 chip=0x03358086 rev=0x0a hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '80331 [Lindsay] I/O processor PCI-X bridge'
    class      = bridge
    subclass   = PCI-PCI
amr0_at_pci5:14:0:	class=0x010400 card=0x30081000 chip=0x04091000 rev=0x0a hdr=0x00
    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
    device     = 'MegaRAID'
    class      = mass storage
    subclass   = RAID
fxp0_at_pci6:2:0:	class=0x020000 card=0x000c8086 chip=0x12298086 rev=0x08 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82550/1/7/8/9 EtherExpress PRO/100(B) Ethernet Adapter'
    class      = network
    subclass   = ethernet