Hi All, I get panics at random times of the day with -CURRENT from 20031105, with absolutely no load on the machine. The machine acts as a dial-up server/gateway/firewall for my local lan. I managed to get a coredump. The contents of the rt pointer passed to RTFREE() does really not look right to me. These in particular: rt_llinfo = 0xc0f95880 "\220ǼÁ\200qùÀ" rn_Key = 0xc1bcc7a0 "0AùÀ8AùÀ" Anyone got any ideas? Thanks Jaco firewall# uname -a FreeBSD firewall.symphiano 5.1-CURRENT FreeBSD 5.1-CURRENT #0: Fri Nov 7 15:31:34 SAST 2003 jacovt_at_firewall.symphiano:/usr/src/sys/i386/compile/FIREWALL i386 firewall# dmesg Copyright (c) 1992-2003 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 5.1-CURRENT #0: Fri Nov 7 15:31:34 SAST 2003 jacovt_at_firewall.symphiano:/usr/src/sys/i386/compile/FIREWALL Preloaded elf kernel "/boot/kernel/kernel" at 0xc06cf000. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Pentium II/Pentium II Xeon/Celeron (501.14-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x665 Stepping = 5 Features=0x183f9ff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,SEP,MTRR,PGE,MCA,CMOV, PAT,PSE36,MMX,FXSR> real memory = 134217728 (128 MB) avail memory = 124952576 (119 MB) Pentium Pro MTRR support enabled npx0: [FAST] npx0: <math processor> on motherboard npx0: INT 16 interface pcibios: BIOS version 2.10 Using $PIR table, 7 entries at 0xc00fded0 pcib0: <Host to PCI bridge> at pcibus 0 on motherboard pci0: <PCI bus> on pcib0 pci_cfgintr: 0:8 INTA BIOS irq 11 pci_cfgintr: 0:10 INTA BIOS irq 10 pcib1: <PCI-PCI bridge> at device 1.0 on pci0 pci1: <PCI bus> on pcib1 pci_cfgintr: 0:1 INTA routed to irq 11 pcib1: slot 0 INTA is routed to irq 11 pci1: <display, VGA> at device 0.0 (no driver attached) isab0: <PCI-ISA bridge> at device 7.0 on pci0 isa0: <ISA bus> on isab0 atapci0: <VIA 82C596 UDMA33 controller> port 0xe000-0xe00f at device 7.1 on pci0 ata0: at 0x1f0 irq 14 on atapci0 ata0: [MPSAFE] ata1: at 0x170 irq 15 on atapci0 ata1: [MPSAFE] pci0: <serial bus, USB> at device 7.2 (no driver attached) pci0: <bridge, HOST-PCI> at device 7.3 (no driver attached) xl0: <3Com 3c905C-TX Fast Etherlink XL> port 0xe800-0xe87f mem 0xdf800000-0xdf80007f irq 11 at device 8.0 on pci0 xl0: Ethernet address: 00:50:da:45:92:81 miibus0: <MII bus> on xl0 xlphy0: <3c905C 10/100 internal PHY> on miibus0 xlphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto pci0: <multimedia, audio> at device 10.0 (no driver attached) orm0: <Option ROMs> at iomem 0xc8000-0xc87ff,0xc0000-0xc7fff on isa0 atkbdc0: <Keyboard controller (i8042)> at port 0x64,0x60 on isa0 atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0 kbd0 at atkbd0 fdc0: <Enhanced floppy controller (i82077, NE72065 or clone)> at port 0x3f7,0x3f0-0x3f5 irq 6 drq 2 on isa0 fdc0: FIFO enabled, 8 bytes threshold fd0: <1440-KB 3.5" drive> on fdc0 drive 0 ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0 ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode ppbus0: <Parallel port bus> on ppc0 ppi0: <Parallel I/O> on ppbus0 sc0: <System console> at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0 sio0: type 16550A sio1 at port 0x2f8-0x2ff irq 3 on isa0 sio1: type 16550A vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 unknown: <PNP0303> can't assign resources (port) unknown: <PNP0501> can't assign resources (port) unknown: <PNP0700> can't assign resources (port) unknown: <PNP0400> can't assign resources (port) unknown: <PNP0501> can't assign resources (port) Timecounter "TSC" frequency 501139304 Hz quality 800 Timecounters tick every 10.000 msec ipfw2 initialized, divert enabled, rule-based forwarding enabled, default to deny, logging limited to 1000 packets/entry by default GEOM: create disk ad0 dp=0xc1c48370 ad0: 2014MB <ST32122A> [4092/16/63] at ata0-master UDMA33 acd0: CDROM <CD-ROM 50X> at ata1-slave PIO4 Mounting root from ufs:/dev/ad0s1a WARNING: / was not properly dismounted WARNING: /tmp was not properly dismounted WARNING: /usr was not properly dismounted WARNING: /var was not properly dismounted firewall# cat /usr/src/sys/i386/conf/FIREWALL machine i386 cpu I686_CPU ident FIREWALL maxusers 0 options SCHED_4BSD #4BSD scheduler options INET #InterNETworking #options INET6 #IPv6 communications protocols options FFS #Berkeley Fast Filesystem options SOFTUPDATES #Enable FFS soft updates support options UFS_ACL #Support for access control lists options UFS_DIRHASH #Improve performance on big directories options CD9660 #ISO 9660 Filesystem options PROCFS #Process filesystem (requires PSEUDOFS) options PSEUDOFS #Pseudo-filesystem framework options COMPAT_43 #Compatible with BSD 4.3 [KEEP THIS!] options COMPAT_FREEBSD4 #Compatible with FreeBSD4 #options SCSI_DELAY=5000 #Delay (in ms) before probing SCSI options KTRACE #ktrace(1) support options SYSVSHM #SYSV-style shared memory options SYSVMSG #SYSV-style message queues options SYSVSEM #SYSV-style semaphores options _KPOSIX_PRIORITY_SCHEDULING #Posix P1003_1B real-time extensions options KBD_INSTALL_CDEV # install a CDEV entry in /dev #options AHC_REG_PRETTY_PRINT # Print register bitfields in debug # output. Adds ~128k to driver. #options AHD_REG_PRETTY_PRINT # Print register bitfields in debug # output. Adds ~215k to driver. # Debugging for use in -current makeoptions DEBUG=-g options DDB #Enable the kernel debugger options DDB_UNATTENDED #options INVARIANTS #Enable calls of extra sanity checking #options INVARIANT_SUPPORT #Extra sanity checks of internal structures, required by INVARIANTS #options WITNESS #Enable checks to detect deadlocks and cycles #options WITNESS_SKIPSPIN #Don't run witness on spinlocks for speed device isa device pci # Floppy drives device fdc # ATA and ATAPI devices device ata device atadisk # ATA disk drives device atapicd # ATAPI CDROM drives device atapifd # ATAPI floppy drives #device atapist # ATAPI tape drives options ATA_STATIC_ID #Static device numbering # atkbdc0 controls both the keyboard and the PS/2 mouse device atkbdc # AT keyboard controller device atkbd # AT keyboard device psm # PS/2 mouse device vga # VGA video card driver # syscons is the default console driver, resembling an SCO console device sc #device agp # support several AGP chipsets # Floating point support - do not disable. device npx # Serial (COM) ports device sio # 8250, 16[45]50 based serial ports # Parallel port device ppc device ppbus # Parallel port bus (required) device ppi # Parallel port interface device # PCI Ethernet NICs that use the common MII bus controller code. # NOTE: Be sure to keep the 'device miibus' line in order to use these NICs! device miibus # MII bus support device xl # 3Com 3c90x (``Boomerang'', ``Cyclone'') # Pseudo devices - the number indicates how many units to allocate. device random # Entropy device device loop # Network loopback device ether # Ethernet support device tun # Packet tunnel. device pty # Pseudo-ttys (telnet etc) #device gif # IPv6 and IPv4 tunneling #device faith # IPv6-to-IPv4 relaying (translation) # The `bpf' device enables the Berkeley Packet Filter. # Be aware of the administrative consequences of enabling this! device bpf # Berkeley packet filter # Firewall Stuff options IPFIREWALL options IPFIREWALL_VERBOSE options IPFIREWALL_VERBOSE_LIMIT=1000 options IPDIVERT firewall# firewall# nm /var/crash/kernel.debug | grep c049d c049d270 T _mtx_lock_spin c049d330 T _mtx_unlock_sleep c049d5f0 T mtx_destroy c049d540 T mtx_init c049d920 T mtx_pool_alloc c049d7c0 T mtx_pool_create c049d850 T mtx_pool_destroy c049d6f0 T mtx_pool_find c049d720 t mtx_pool_initialize c049d8f0 t mtx_pool_setup_dynamic c049d8b0 t mtx_pool_setup_static c049d510 T mtx_sysinit c049d620 T mutex_init c049d9e0 T ntp_adjtime c049d940 t ntp_sysctl c049de30 T ntp_update_second firewall# gdb -k /var/crash/kernel.debug ~jacovt/vmcore.1 GNU gdb 5.2.1 (FreeBSD) Copyright 2002 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-undermydesk-freebsd"... panic: page fault panic messages: --- Fatal trap 12: page fault while in kernel mode fault virtual address = 0x68 fault code = supervisor read, page not present instruction pointer = 0x8:0xc049d182 stack pointer = 0x10:0xc8da4a14 frame pointer = 0x10:0xc8da4a3c code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = resume, IOPL = 0 current process = 29 (swi1: net) trap number = 12 panic: page fault syncing disks, buffers remaining... 502 502 502 502 502 502 502 502 502 502 502 502 502 502 502 502 502 502 502 502 giving up on 379 buffers Uptime: 1h36m46s Dumping 128 MB 16 32 48 64 80 96 112 --- #0 doadump () at ../../../kern/kern_shutdown.c:240 240 dumping++; (kgdb) where #0 doadump () at ../../../kern/kern_shutdown.c:240 #1 0xc04a7b60 in boot (howto=256) at ../../../kern/kern_shutdown.c:372 #2 0xc04a7f48 in panic () at ../../../kern/kern_shutdown.c:550 #3 0xc05cda26 in trap_fatal (frame=0xc8da49d4, eva=0) at ../../../i386/i386/trap.c:821 #4 0xc05cd043 in trap (frame= {tf_fs = -925237224, tf_es = -1068302320, tf_ds = -1044381680, tf_edi = -1042780416, tf_esi = -1042847856, tf_ebp = -925218244, tf_isp = -925218304, f_ebx = -1057406672, tf_edx = 2, tf_ecx = 0, tf_eax = 1, tf_trapno = 12, tf_err = 0, tf_eip = -1068904062, tf_cs = 8, tf_eflags = 65606, tf_esp = -043482368, f_ss = -1043482368}) at ../../../i386/i386/trap.c:250 #5 0xc05be6f8 in calltrap () at {standard input}:94 #6 0xc05339cb in ip_forward_cacheinval () at ../../../netinet/ip_input.c:343 #7 0xc052bcee in in_addroute (v_arg=0xc1d86f00, n_arg=0x0, head=0xc1c48600, treenodes=0xc1cdb900) at ../../../netinet/in_rmx.c:142 #8 0xc05238ea in rtrequest1 (req=11, info=0xc8da4b00, ret_nrt=0xc8da4b5c) at ../../../net/route.c:773 #9 0xc052302a in rtrequest (req=0, dst=0x0, gateway=0x0, netmask=0x0, flags=0, ret_nrt=0x0) at ../../../net/route.c:486 #10 0xc05227bd in rtalloc1 (dst=0xc8da4bc4, report=1, ignflags=0) at ../../../net/route.c:148 #11 0xc0527de5 in arplookup (addr=0, create=1, proxy=0) at ../../../netinet/if_ether.c:928 #12 0xc052749e in in_arpinput (m=0xc0fa5a00) at ../../../netinet/if_ether.c:664 ---Type <return> to continue, or q <return> to quit--- #13 0xc05271d6 in arpintr (m=0xc0fa5a00) at ../../../netinet/if_ether.c:543 #14 0xc0520359 in netisr_processqueue (ni=0xc0640230) at ../../../net/netisr.c:140 #15 0xc0520848 in swi_net (dummy=0x0) at ../../../net/netisr.c:246 #16 0xc0491948 in ithread_loop (arg=0xc0f90480) at ../../../kern/kern_intr.c:544 #17 0xc04905c0 in fork_exit (callout=0xc0491770 <ithread_loop>, arg=0x0, frame=0x0) at ../../../kern/kern_fork.c:793 (kgdb) up 6 #6 0xc05339cb in ip_forward_cacheinval () at ../../../netinet/ip_input.c:343 343 RTFREE(rt); (kgdb) p rt $1 = (struct rtentry *) 0xc0f94130 (kgdb) p *rt $2 = {rt_nodes = {{rn_mklist = 0xc1bcc790, rn_parent = 0xc0f97180, rn_bit =0, rn_bmask = 0 '\0', rn_flags = 0 '\0', rn_u = {rn_leaf = { rn_Key = 0xc1bcc7a0 "0AùÀ8AùÀ", rn_Mask = 0x0, rn_Dupedkey = 0xc0f9719c}, rn_node = {rn_Off = -1044592736, rn_L = 0x0, rn_R = 0xc0f9719c}}}, {rn_mklist = 0x0, rn_parent = 0x0, rn_bit = 0, rn_bmask = 0 '\0', rn_flags = 0 '\0', rn_u = {rn_leaf = { rn_Key = 0xc063c0a4 "", rn_Mask = 0x0, rn_Dupedkey = 0x0}, rn_node = {rn_Off = -1067204444, rn_L = 0x0, rn_R = 0x0}}}}, rt_gateway = 0x0, rt_refcnt = 0, rt_flags = 65538, rt_ifp = 0x0, rt_ifa = 0x0, rt_genmask = 0xc0f95880, rt_llinfo = 0xc0f95880 "\220ǼÁ\200qùÀ", rt_rmx = {rmx_locks = 0, rmx_mtu = 0, rmx_hopcount = 0, rmx_expire = 0, rmx_recvpipe = 0, rmx_sendpipe = 3237545088, rmx_ssthresh = 3227453828, rmx_rtt = 0, rmx_rttvar = 0, rmx_pksent = 0, rmx_filler = {0, 3237514880, 0, 0}}, rt_gwroute = 0x0, rt_output = 0, rt_parent = 0x0, rt_mtx = {mtx_object = { lo_class = 0x0, lo_name = 0x0, lo_type = 0x0, lo_flags = 0, lo_list = { tqe_next = 0x0, tqe_prev = 0x0}, lo_witness = 0x0}, mtx_lock = 0, mtx_recurse = 0, mtx_blocked = {tqh_first = 0x0, tqh_last = 0x0}, mtx_contested = {le_next = 0x0, le_prev = 0x0}}} (kgdb) q firewall# exit Jaco van Tonder Magic Developer :: Premsoft Development (Pty) Ltd Direct: +27 11 312 2122 :: Fax: +27 11 312 2122 :: Mobile: +27 83 417 5424 Email: jaco_at_premsoft.co.za :: Web: http://www.premsoft.co.za/ PGP: http://www.premsoft.co.za/jaco/jaco_premsoft.ascReceived on Fri Nov 07 2003 - 06:50:37 UTC
This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:37:28 UTC