Packet loss with traffic shaper and routing

[tpeixoto at widesoft.com.br]

Hello.

I did that and compiled the kernel.
Then I restarted the system and enabled sysctl kern.polling.enable=1

It seems that it has no effect in the system. Maybe bge driver doesn't
like polling?

At this moment, I'm getting more than 50% interrupts and 20% packets lost.
I also disabled HT in BIOS and the interrupts are now passing 80% mark.
Don't know what else to do. Aren't these cards supposed to work at
100Mbits or 1Gbit? They are failing with 12Mbits traffic on a 100Mbits
LAN. Something is wrong and I am having a hard time trying to identify the
problem.

Thanks for the hints, anything else would be greatly appreciated.


> Then try commenting these out:
>
> #ifdef SMP
> #ifndef COMPILING_LINT
> #error DEVICE_POLLING is not compatible with SMP
> #endif
> #endif
>
>
> It should compile with both SMP and POLLING.
>
>
> On Wed, 2006-04-26 at 13:09 -0300, tpeixoto at widesoft.com.br wrote:
>> Hi Lee,
>>
>> I got excited, but... surprise!
>>
>> ../../../kern/kern_poll.c:46:2: #error DEVICE_POLLING is not compatible
>> with SMP
>> mkdep: compile failed
>> *** Error code 1
>>
>> :(
>>
>> Thanks anyway!
>>
>>
>> > Hi,
>> >
>> > Try using device polling to reduce the number of interrupts.
>> >
>> > Add this to your kernel:
>> > options         DEVICE_POLLING
>> > options         HZ=1000
>> >
>> > And set sysctl kern.polling.enable=1
>> >
>> > Hope this helps,
>> >
>> > Regards,
>> > Lee.
>> >
>> >
>> >
>> >
>> >
>> > tpeixoto at widesoft.com.br wrote:
>> >> Hello all!
>> >>
>> >> We have a machine working as a router and bandwidth limiter for our
>> >> network. It routes the traffic through two 'bge' interfaces utilizing
>> >> only
>> >> public IPs. No NAT is used. We only have IPFW rules for traffic
>> shaping
>> >> by
>> >> MAC addresses.
>> >> It works fine, but we have been experiencing high latency and packet
>> >> loss.
>> >> There is no other major services in this machine, cpu utilization is
>> >> low,
>> >> memory is fine, no disk activity, but load average is always around
>> 1.5
>> >> or
>> >> 2, even if I disable IPFW layer 2 filtering.
>> >> Network traffic is not greater than 12 Mbit/s.
>> >>
>> >> The system is a FreeBSD 5.4-RELEASE, running on a dual CPU: Intel(R)
>> >> Xeon(TM) CPU 3.06GHz (3051.47-MHz 686-class CPU) compiled with SMP
>> >> kernel:
>> >>  cpu0 (BSP): APIC ID:  0
>> >>  cpu1 (AP): APIC ID:  1
>> >>  cpu2 (AP): APIC ID:  6
>> >>  cpu3 (AP): APIC ID:  7
>> >>
>> >>
>> >> top output:
>> >>
>> >> last pid: 14039;  load averages:  1.61,  1.62,  1.56
>> >> 37 processes:  1 running, 35 sleeping, 1 zombie
>> >> CPU states:  0.0% user,  0.0% nice,  1.4% system, 30.8% interrupt,
>> 67.8%
>> >> idle
>> >> Mem: 16M Active, 421M Inact, 149M Wired, 688K Cache, 112M Buf, 1417M
>> >> Free
>> >> Swap: 1024M Total, 1024M Free
>> >>
>> >>   PID USERNAME PRI NICE   SIZE    RES STATE  C   TIME   WCPU    CPU
>> >> COMMAND
>> >>  6245 root      96    0  2672K  2236K select 2   3:48  0.00%  0.00%
>> >> dhcpd
>> >>   329 root      96    0  1328K   892K select 0   2:48  0.00%  0.00%
>> >> syslogd
>> >>   453 root      96    0  3384K  2508K select 2   0:33  0.00%  0.00%
>> sshd
>> >>
>> >>
>> >>
>> >>
>> >> systat -iostat output:
>> >>
>> >>                     /0   /1   /2   /3   /4   /5   /6   /7   /8   /9
>> >> /10
>> >>      Load Average   ||||||||||
>> >>
>> >>           /0   /10  /20  /30  /40  /50  /60  /70  /80  /90  /100
>> >> cpu  user|
>> >>      nice|
>> >>    system|
>> >> interrupt|XXXXXXXXXXXXXXXXX
>> >>      idle|XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
>> >>
>> >>           /0   /10  /20  /30  /40  /50  /60  /70  /80  /90  /100
>> >> da0   MB/s
>> >>       tps|X
>> >> pass0 MB/s
>> >>       tps|
>> >>
>> >>
>> >> Can anyone give me some advice?
>> >> Thank you in advance!
>> >>
>> >>
>> >> _______________________________________________
>> >> freebsd-net at freebsd.org mailing list
>> >> http://lists.freebsd.org/mailman/listinfo/freebsd-net
>> >> To unsubscribe, send any mail to
>> "freebsd-net-unsubscribe at freebsd.org"
>> >>
>> >>
>> >>
>> >
>> >
>> > --
>> > ------------------------------------------------------------------------
>> > Wildcard Internet - end-to-end internet solutions
>> > Lee Johnston - Wildcard Internet
>> > Tel: 0845 165 1510
>> > Fax: 0845 165 1511
>> > Email: lee at wildcard.net.uk <mailto:lee at wildcard.net.uk>
>> > Web: www.wildcard.net.uk <http://www.wildcard.net.uk>
>> >
>> >
>>
>>
>> _______________________________________________
>> freebsd-net at freebsd.org mailing list
>> http://lists.freebsd.org/mailman/listinfo/freebsd-net
>> To unsubscribe, send any mail to "freebsd-net-unsubscribe at freebsd.org"
>
>