Re: FreeBSD 7.0Beta4 (amd64) freezes with dummynet enabled

From: <matthew_at_matthew.sk>
Date: Sat, 22 Dec 2007 14:43:11 +0100 (CET)
Hi, i have almost the same setup like Thomas

> Please try this patch:
> http://www.freebsd.org/cgi/query-pr.cgi?prp=113548-3-diff
> and report does it help or not.

but this patch doesn`t solve my problem with freeze.

My config:

cpu             HAMMER
ident           HANKA-SMP-ULE

options         DEVICE_POLLING

options         IPFIREWALL
options         IPFIREWALL_VERBOSE
options         IPFIREWALL_FORWARD
options         IPFIREWALL_VERBOSE_LIMIT=1000
options         IPFIREWALL_DEFAULT_TO_ACCEPT
options         DUMMYNET
options         HZ=1000

# To statically compile in device wiring instead of /boot/device.hints
#hints          "GENERIC.hints"         # Default places to look for devices.

#makeoptions    DEBUG=-g                # Build kernel with gdb(1) debug symbols

options         SCHED_ULE               # ULE scheduler
#options        SCHED_4BSD              # 4BSD scheduler

The rest is from GENERIC

The shaper looks like this:

CMD=ipfw
# SHAPER
IPFW_PIPE_DOWNLOAD=1
IPFW_PIPE_UPLOAD=11
IPFW_QUEUE_DOWNLOAD=1
IPFW_QUEUE_UPLOAD=11

DOWNLOAD_ROOT="450Mbit/s"
UPLOAD_ROOT="450Mbit/s"
SHAPER_BUCKETS="1024"

IPFW_SHAPER_ROOT=1000

$CMD pipe $IPFW_PIPE_DOWNLOAD config bw $DOWNLOAD_ROOT buckets $SHAPER_BUCKETS
$CMD pipe $IPFW_PIPE_UPLOAD config bw $UPLOAD_ROOT buckets $SHAPER_BUCKETS

$CMD queue $IPFW_QUEUE_DOWNLOAD config pipe $IPFW_PIPE_DOWNLOAD buckets $SHAPER_BUCKETS mask
dst-ip 0xFFFFFFFF
$CMD queue $IPFW_QUEUE_UPLOAD config pipe $IPFW_PIPE_UPLOAD buckets $SHAPER_BUCKETS mask
src-ip 0xFFFFFFFF

$CMD delete $IPFW_SHAPER_ROOT
$CMD $IPFW_SHAPER_ROOT add queue $IPFW_QUEUE_DOWNLOAD ip from me to any out  // Share download
$CMD $IPFW_SHAPER_ROOT add queue $IPFW_QUEUE_UPLOAD ip from any to me in // Share upload


I also have an ZFS pool:
# zpool list
NAME                    SIZE    USED   AVAIL    CAP  HEALTH     ALTROOT
data                   1.81T    832G   1024G    44%  ONLINE     -
upload                  210G    354K    210G     0%  ONLINE     -


I have a an SMP setup:
processor       : 0
vendor_id       : GenuineIntel
cpu family      : 15
model           : 1
model name      : Intel(R) Pentium(R) Dual  CPU  E2160  _at_ 1.80GHz
stepping        : 13
processor       : 1
vendor_id       : GenuineIntel
cpu family      : 15
model           : 1
model name      : Intel(R) Pentium(R) Dual  CPU  E2160  _at_ 1.80GHz
stepping        : 13
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36
b19 b21 mmxext mmx fxsr xmm b26 b27 b28 b29 3dnow
cpu MHz         : 1809.00
bogomips        : 1809.00

I also have an GBit NIC:
ifconfig em0
em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=1db<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,POLLING,VLAN_HWCSUM,TSO4>

em0: <Intel(R) PRO/1000 Network Connection Version - 6.7.3> port 0x20e0-0x20ff mem
0x50200000-0x5021ffff,0x50220000-0x50220fff irq 20 at device 25.0 on pci0

FreeBSD hanka 7.0-BETA4 FreeBSD 7.0-BETA4 #1: Sat Dec 22 13:53:44 CET 2007    
root_at_hanka:/usr/src/sys/amd64/compile/HANKA-SMP-ULE  amd64

I also have an pf firewall, that had the same issues (deathlock) in 6.X wjen used with user
config, i have that same in 7.0RC4 but it works fine, but maybe it is something related.
It is an simple setup:

pass in all
pass out all

table <tabulka> { 10.0.0.0/8 }

block out proto { tcp, udp } from any to any user some_user
pass out proto { tcp, udp } from any to <tabulka> user some_user

I don`t have debug options in my kernel,its an production machine,but i can include them and
post the debug messages, if it can help.

With dummynet rules, the server freezes after some minutes (3-10), when under heavy load
200-400Mbit/s.


Matthew
Received on Sat Dec 22 2007 - 13:09:56 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:39:24 UTC