Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server

From: Lev Serebryakov <lev_at_FreeBSD.org>
Date: Mon, 19 Dec 2011 13:47:20 +0400
Hello, Matthew.
You wrote 19 декабря 2011 г., 13:13:09:

>> (1) Make FreeBSD looks good on benchmarks by "fixing" FreeBSD
>> 
>> (2) Make FreeBSD looks good on benchmarks by "fixing" Phoronix
>> (communication with them, convincing, that they benchamrks are unfare
>> / meaningless, ets)
> (2a) Ignore Phoronix, other than explaining concisely why their numbers
> are complete balderdash.  Publish our own benchmarks, done with care and
> rigour and using well defined, repeatable, peer reviewed methodology
> that anyone can repeat.  Aggressively publicise these results.
  Ok, it is The Way too, I agree. But in modern world, unfortunately
 (for me, and I'm sure, for many FreeBSD hackers), keywords are "Aggressively
 publicise" but not "done with care and rigour and using well defined,
repeatable, peer reviewed methodology that anyone can repeat"

>> (3) Lose [potential] userbase.
> Indeed.  Unfortunately "performance" is /the/ deciding factor in many OS
> choices, never mind that it is an impossibly complex subject to
> generalise to a few management-friendly numbers in a one-size-fits-all
> abstract way.  Having only one source of published numbers suggesting
> that "OS Foo is better" *even if those numbers are completely bogus*
> will have a disproportionate effect.
  Yep.

-- 
// Black Lion AKA Lev Serebryakov <lev_at_FreeBSD.org>
Received on Mon Dec 19 2011 - 08:47:24 UTC

This archive was generated by hypermail 2.4.0 : Wed May 19 2021 - 11:40:22 UTC