Re: freebsd perf testing

On 11/8/13, 1:54 AM, Olivier Cochard-Labbé wrote:
> On Fri, Nov 8, 2013 at 3:02 AM, Julian Elischer <julian_at_elischer.org 
> <mailto:julian_at_elischer.org>>wrote:
>
>     Some time ago someone showed some freebsd performance graphs
>     graphed against time.
>     He had them up on a website that was updated each day or so.
>
>     I think they were network perf tests but I'm not sure.
>     He indicated that he was going to continue the daily testing
>     but I've not seen any mention of them since.
>
>     If you know who that was or how to find him let me (or gnn) know...
>
>
> Hi Julian,
>
> Perhaps you are referring to my network performance graphs on this 
> thread:
> http://lists.freebsd.org/pipermail/freebsd-current/2013-April/041323.html
>

yes, you are the person we are looking for.
In yesterday's 'vendor summit' we were discussing performance 
monitoring and your methodology was cited as one worth looking at.

The idea of graphing the output of various performance tests against 
svn commit number is a very good one.
I thonk it migh teven be worth doing these tests daily, and putting 
the output onto a web site, showing the last month, the last year and 
the whole range.
it would even be interesting to put out 'xplot' files so that people 
can zoom in and out using xplot to see exactly which revision was 
responsinble for reversions or problems.

George..  this is what we mentioned at the meeting yesterday.

Julian


> I didn't generate other tests since because I need to fix the test 
> used before continuing.
> I only generate one IP-flow (same IP src/dst, same UDP port): there 
> is no IP distribution. And by generating only one flow, we didn't 
> use the multi-queue NIC capability, neither the multi-threaded 
> features (like with the SMP-pf) of FreeBSD forwarding/firewalling stack.
> I plan to add the support of generating multiple IP 
> source/destination to the netmap pkt-gen, but the current status of 
> this project is: I'm at page 42 of the book "C programming, a modern 
> approach", then you have to wait :-)
>
> By the way, I've documented a little more my benching lab and 
> scripts used here:
> http://bsdrp.net/documentation/examples/freebsd_performance_regression_lab
>
> Regards,
>
> Olivier