Re: Help me select hardware....Some real world data that might help

From: Freddie Cash <fjwcash_at_gmail.com>
Date: Tue, 27 Jan 2009 22:17:15 -0800
On Tue, Jan 27, 2009 at 8:54 PM, Paul Tice <ptice_at_aldridge.com> wrote:
> I just bumped up the kmem, arc.max, enabled zil and reenabled mdcomp.
> Prefetch is disabled.

> Less than 1 minute into a backup run of only 4 machines, I've got a fresh
> ZFS wedgie. Ouch.

Others more knowledgeable than I will have to jump in here, but
getting the kmem_max and arc_max settings set right for each system is
a bit of an art unto itself.  It took almost 6 weeks to get the
settings we are currently using, which keeps the system stable while
running backups for 83 servers via rsync+ssh.  Others find smaller
arc_max settings work better, others find smaller kmem_max work
better.  Each system is different.

> I'm intrigued by the ssh/rsync double process throughput bump, but it does
> require ssh as well as rsync.

Yes, if you aren't using ssh as the transport, then adding -z to rsync
can be benfecial.  :)

> I'm not 100% sure about the gstat, I did no slicing/labeling on the disks,
> they are purely /dev/adX used by ZFS, would GEOM level even see this?

Yes.  All disk access goes through GEOM.  You can't hit the device
nodes without going through GEOM.  It's quite interesting watching the
output of gstat.

> I suspected you could upsize raidz pools one disk at a time, I do wonder how
> the inner/outer track speed differences would affect throughput over a
> one-by-one disk full array replacement. And yes, I might wonder too much
> about corner cases. ;>

We haven't got that far yet.  :)  We've only filled 6 TB of the 9, so
won't be needing to move to larger drives for several more months.

-- 
Freddie Cash
fjwcash_at_gmail.com
Received on Wed Jan 28 2009 - 05:17:16 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:39:41 UTC