Re: RFC: use EM_LEGACY_IRQ in if_lem.c ?

On Wed, Jul 25, 2012 at 07:48:57AM -0700, Adrian Chadd wrote:
> On 24 July 2012 13:20, Luigi Rizzo <rizzo_at_iet.unipi.it> wrote:
> > if_lem.c ("lem", one of the e1000 drivers) has 2 possible interrupt modes:
> > EM_LEGACY_IRQ uses the standard dispatch mechanism, whereas
> > FAST_INTR has a custom handler that signals a taskqueue to do the job.
> >
> > I have no idea which actual hardware uses it (all of my Intel 1G
> > cards use either "em" or "igb"), but "lem" is the driver used in
> > qemu, and there the EM_LEGACY_IRQ gives approx 10% higher packet
> > rates than the other.
> >
> > Any objections if i change the default to EM_LEGACY_IRQ ?
> 
> I suggest doing some digging to understand why. I bet we all know the
> answer, but it would be nice to have it documented and investigated. I
> bet em(4) isn't the only device that would benefit from this?

I am not so sure i know the answer on bare iron (and my take is that the
difference is more or less irrelevant there), but in the virtualized case
the improvement is almost surely because the code used in FAST_INTR
has a couple of MMIO accesses to disable/enable interrupts on the
card while the taskqueue runs.  These are expensive in a VM
(such accesses cost ~10K cycles each, even with hw support)

cheers
luigi