Re: NFS lockd/statd lock up network connection

From: Tom McLaughlin <tmclaugh_at_sdf.lonestar.org>
Date: Sun, 19 Apr 2009 20:53:12 -0400
Ryan Stone wrote, On 04/08/2009 06:12 PM:
> On Wed, Apr 8, 2009 at 6:05 PM, Ryan Stone <rysto32_at_gmail.com 
> <mailto:rysto32_at_gmail.com>> wrote:
> 
>      > em0: Could not setup receive structures
> 
>     The em driver prints this out when it can't allocate mbufs or
>     clusters.  Can you show the output of vmstat -z?  This error is
>     indicative of a leak of mbufs or clusters, or a misconfiguration(too
>     few mbufs or clusters).
> 
>     Ryan Stone
> 
> 
> Also, can you run sysctl dev.em.0.debug=1?  That will print a bunch of 
> debugging information to the console.  The two lines I'm most interested 
> in are
> 
> Std mbuf failed = <value>
> Std mbuf cluster failed = <value>

Sorry, email got lost in the inbox.  Here's the output.  And again, only
thing that seems to trigger this is enabling lockd and mounting a share
from my OpenBSD NFS server.

ITEM                     SIZE     LIMIT      USED      FREE  REQUESTS  FAILURES

UMA Kegs:                 208,        0,       84,        1,       84,        0
UMA Zones:                224,        0,       84,        1,       84,        0
UMA Slabs:                568,        0,      508,        3,     1050,        0
UMA RCntSlabs:            568,        0,    12802,        1,    12802,        0
UMA Hash:                 256,        0,        3,       12,        3,        0
16 Bucket:                152,        0,       46,        4,       46,        0
32 Bucket:                280,        0,       27,        1,       28,        0
64 Bucket:                536,        0,       28,        0,       28,        1
128 Bucket:              1048,        0,       13,        2,      375,        0
VM OBJECT:                200,        0,     1376,      125,    17634,        0
MAP:                      224,        0,        7,       27,        7,        0
KMAP ENTRY:               112,    87912,       23,      109,     1359,        0
MAP ENTRY:                112,        0,     1487,       97,    38298,        0
DP fakepg:                112,        0,        0,        0,        0,        0
mt_zone:                 2056,        0,      252,       11,      252,        0
16:                        16,        0,     1220,      124,    15053,        0
32:                        32,        0,     1779,      140,     3278,        0
64:                        64,        0,     1794,      110,    12672,        0
128:                      128,        0,     2317,       61,     6407,        0
256:                      256,        0,      405,      105,     4677,        0
512:                      512,        0,      302,       20,    28815,        0
1024:                    1024,        0,       81,       47,     1194,        0
2048:                    2048,        0,       29,        5,      354,        0
4096:                    4096,        0,      381,       10,     5592,        0
Files:                     80,        0,      112,       68,     6273,        0
TURNSTILE:                136,        0,       97,       23,       97,        0
umtx pi:                   96,        0,        0,        0,        0,        0
PROC:                    1088,        0,       53,        7,     1074,        0
THREAD:                   896,        0,       92,        4,       92,        0
SLEEPQUEUE:                80,        0,       97,       48,       97,        0
VMSPACE:                  384,        0,       32,        8,     1053,        0
cpuset:                    72,        0,        2,       98,        2,        0
audit_record:             984,        0,        0,        0,        0,        0
mbuf_packet:              256,        0,    25601,        1,    26343,      141
mbuf:                     256,        0,        1,      129,   128427,        0
mbuf_cluster:            2048,    25600,    25600,        0,    50984,      218
mbuf_jumbo_page:         4096,    12800,        0,        2,        5,        0
mbuf_jumbo_9k:           9216,     6400,        0,        0,        0,        0
mbuf_jumbo_16k:         16384,     3200,        0,        0,        0,        0
mbuf_ext_refcnt:            4,        0,        0,        0,        0,        0
ACL UMA zone:             388,        0,        0,        0,        0,        0
g_bio:                    216,        0,        0,      144,     8533,        0
ttyinq:                   160,        0,      120,       24,      255,        0
ttyoutq:                  256,        0,       64,       11,      136,        0
ata_request:              312,        0,        0,       24,       19,        0
ata_composite:            336,        0,        0,        0,        0,        0
VNODE:                    472,        0,      612,        4,      676,        0
VNODEPOLL:                104,        0,        0,        0,        0,        0
S VFS Cache:              104,        0,      594,       18,     2013,        0
L VFS Cache:              327,        0,        0,        0,        0,        0
NAMEI:                   1024,        0,        0,       12,    17243,        0
NFSMOUNT:                 744,        0,        2,        8,        2,        0
NFSNODE:                  760,        0,        5,        5,        5,        0
DIRHASH:                 1024,        0,       70,       14,       70,        0
pipe:                     712,        0,        7,        8,      573,        0
ksiginfo:                 112,        0,       49,     1007,       49,        0
itimer:                   344,        0,        1,       21,        2,        0
KNOTE:                    120,        0,        9,       53,      849,        0
socket:                   640,    25602,       55,        5,      677,        0
unpcb:                    240,    25600,       14,       18,      227,        0
ipq:                       56,      819,        0,        0,        0,        0
udpcb:                    288,    25610,       24,       15,      391,        0
inpcb:                    288,    25610,       15,       24,       53,        0
tcpcb:                    736,    25600,       15,       10,       53,        0
tcptw:                     88,     5124,        0,       84,        5,        0
syncache:                 136,    15372,        0,       56,        4,        0
hostcache:                136,    15372,        3,       53,        3,        0
tcpreass:                  40,     1680,        0,        0,        0,        0
sackhole:                  32,        0,        0,        0,        0,        0
sctp_ep:                 1184,    25602,        0,        0,        0,        0
sctp_asoc:               2176,    40000,        0,        0,        0,        0
sctp_laddr:                48,    80064,        0,      144,        1,        0
sctp_raddr:               584,    80003,        0,        0,        0,        0
sctp_chunk:               144,   400010,        0,        0,        0,        0
sctp_readq:               104,   400032,        0,        0,        0,        0
sctp_stream_msg_out:       96,   400026,        0,        0,        0,        0
sctp_asconf:               40,   400008,        0,        0,        0,        0
sctp_asconf_ack:           48,   400032,        0,        0,        0,        0
ripcb:                    288,    25610,        0,        0,        0,        0
rtentry:                  192,        0,        7,       33,        8,        0
selfd:                     56,        0,       69,      120,    10094,        0
SWAPMETA:                 288,   116519,        0,        0,        0,        0
Mountpoints:              752,        0,        8,        7,        8,        0
FFS inode:                176,        0,      571,       17,      634,        0
FFS1 dinode:              128,        0,        0,        0,        0,        0
FFS2 dinode:              256,        0,      571,       14,      634,        0


Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: Adapter hardware address = 0xfffffffe40265320 
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: CTRL = 0x40c00249 RCTL = 0x8002 
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: Packet buffer = Tx=16k Rx=48k 
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: Flow control watermarks high = 47104 low = 45604
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: tx_int_delay = 66, tx_abs_int_delay = 66
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: rx_int_delay = 0, rx_abs_int_delay = 66
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: fifo workaround = 0, fifo_reset_count = 0
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: hw tdh = 250, hw tdt = 250
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: hw rdh = 160, hw rdt = 159
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: Num Tx descriptors avail = 256
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: Tx Descriptors not avail1 = 0
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: Tx Descriptors not avail2 = 0
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: Std mbuf failed = 0
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: Std mbuf cluster failed = 142
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: Driver dropped packets = 0
Apr 19 20:26:40 freebsd-8-amd64 kernel: em0: Driver tx dma failure in encap = 0


-- 
| tmclaugh at sdf.lonestar.org                 tmclaugh at FreeBSD.org |
| FreeBSD                                       http://www.FreeBSD.org |
Received on Sun Apr 19 2009 - 22:53:19 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:39:46 UTC