Intel 82574L interface wedging on em 7.1.9/7.2.3 when MSIX enabled

Fri Oct 7 19:24:46 UTC 2011

Hi,

On Fri, Oct 7, 2011 at 2:57 PM, Jason Wolfe <nitroboost at gmail.com> wrote:
> Jack,
>
> Entirely possible there are multiple moving pieces here, the only bit I know
> for certain is it's related to the different operation when running with MSI
> vs MSI-X. Here is also my loader.conf for reference. I'm currently running
> the modular congestion control stuff with cubic in use, but these issues
> predate those changes also. Just to give you a scope of it though, it was
> somewhat 'rare' for them to wedge. Out of a pool of ~2000 servers running
> with the 82574L doing ~800Mb/s average, there were ~220 reports in a week.
> So with some fuzzy math to put it in the same terms you were talking in, a
> server in particular would hang about once every 9 weeks.
>
Just a two questions out of my mind:

Are the failing server evenly distributed, or always the same are failing ?

Did you collect the uptime and the kernel msgbuf of the server when
the issue triggered ?

Thanks,
 - Arnaud

> net.inet.tcp.cc.available: cubic, newreno
> net.inet.tcp.cc.algorithm: cubic
>
> loader.conf:
> hw.pci.do_power_nodriver="3"
> net.link.ifqmaxlen="1024"
> net.inet.tcp.tcbhashsize="4096"
> net.inet.tcp.syncache.hashsize="1024"
> net.inet.tcp.syncache.bucketlimit="512"
> net.inet.tcp.syncache.cachelimit="65536"
> net.inet.tcp.hostcache.hashsize="1024"
> net.inet.tcp.hostcache.bucketlimit="512"
> net.inet.tcp.hostcache.cachelimit="65536"
> hw.em.enable_msix="0"
> hw.em.rxd="2048"
> hw.em.txd="2048"
> cc_cubic_load="YES"
>
> Thanks again for looking into it.
>
> Jason
>
> On Thu, Oct 6, 2011 at 5:02 PM, Jack Vogel <jfvogel at gmail.com> wrote:
>
>> There are plenty other users using the 574 with MSI-X without issue, so its
>> likely
>> more complicated than just that 1 variable. The issue discussed was like
>> last year,
>> it has to do with getting stuck in low power state, and my driver has code
>> that addresses
>> that. There was rigorous testing done at the performance center in Canada,
>> got to
>> the point of having a hang once in maybe 3 weeks, and then that was fixed.
>> I have
>> not heard of a problem from Mike since.
>>
>> So, I'd say something else must be coming into play here, I'll stare at the
>> data
>> a bit when I get a chance and see if anything jumps out at me.
>>
>> Jack
>>
>>
>> On Thu, Oct 6, 2011 at 4:15 PM, Jason Wolfe <nitroboost at gmail.com> wrote:
>>
>>> I'm seeing the interface wedge on a good number of systems with Intel
>>> 82574L
>>> chips under FBSD8.2 _only when MSI-X is enabled_, running either 7.1.9
>>> from
>>> 8.2-RELEASE or 7.2.3 from 8.2-STABLE.  I have em0 and em1 in a lagg, but
>>> only one side would fail, and a few systems that didn't have a lagg also
>>> saw
>>> the issue.  Higher traffic did seem to increase the likely hood of it
>>> cropping up, but lower traffic server also showed the same issues
>>> (anywhere
>>> from 200Mb/s -> 1.8Gb/s).  This wedging on the Intel chips has been
>>> discussed in many threads over the past year, though some have turned out
>>> to
>>> be various other issues.  I haven't seen reports of it being fixed by
>>> disabling MSI-X via loader.conf, hw.em.enable_msix=0, so I figured I'd
>>> start
>>> a fresh one.
>>>
>>> The band aid for me was throwing a quick script into cron that watched for
>>> incrementing drops and static outgoing packet counts from netstat, then
>>> just
>>> bounced the interface with ifconfig down/up.  Prior to the bounce I had it
>>> emailing me the output of the following commands:
>>>
>>> vmstat -i
>>> netstat -m
>>> netstat -ndi
>>> sysctl dev.em.X.debug=1
>>> sysctl net.inet.ip.intr_queue_maxlen net.inet.ip.intr_queue_drops dev.em
>>>
>>> I have ~300 reports from over the course of a week or so while I played
>>> with
>>> various bits before finding MSI-X to be the culprit.  These were all
>>> collected about a month ago, but as I'm seeing now the increased latency
>>> with MSI-X disabled (as discussed in another thread) I'm more interested
>>> in
>>> seeing we can tackle this.  I can bounce them over to anyone interested.
>>> Random one, follow by pciconf output:
>>>
>>> I bounced em1 because dropped packets incremented 3175498 to 3175688 and
>>> the
>>> interface is not incrementing packets out.
>>>
>>> interrupt total rate
>>> irq3: uart1 94210 0
>>> cpu0: timer 8536176695 2000
>>> irq256: em0:rx 0 24657925778 5777
>>> irq257: em0:tx 0 18016438387 4221
>>> irq258: em0:link 1096 0
>>> irq259: em1:rx 0 49440830 11
>>> irq260: em1:tx 0 17831558454 4177
>>> irq261: em1:link 3 0
>>> irq262: mps0 971428418 227
>>> cpu1: timer 8536168686 2000
>>> cpu2: timer 8536168739 2000
>>> cpu3: timer 8536168715 2000
>>> Total 95671570011 22415
>>>
>>> 43620/31830/75450 mbufs in use (current/cache/total)
>>> 8457/1825/10282/6192924 mbuf clusters in use (current/cache/total/max)
>>> 8457/1490 mbuf+clusters out of packet secondary zone in use
>>> (current/cache)
>>> 32620/3569/36189/3096461 4k (page size) jumbo clusters in use
>>> (current/cache/total/max)
>>> 0/0/0/6400 9k jumbo clusters in use (current/cache/total/max)
>>> 0/0/0/3200 16k jumbo clusters in use (current/cache/total/max)
>>> 158299K/25883K/184182K bytes allocated to network (current/cache/total)
>>> 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
>>> 0/0/0 requests for jumbo clusters denied (4k/9k/16k)
>>> 0/0/0 sfbufs in use (current/peak/max)
>>> 0 requests for sfbufs denied
>>> 0 requests for sfbufs delayed
>>> 0 requests for I/O initiated by sendfile
>>> 0 calls to protocol drain routines
>>>
>>> Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll Drop
>>> em0 1500 <Link#1> 00:25:90:2c:a8:c8 70347342717 2290 0 53256848932 0 0
>>> 1209615
>>> em0 1500 fe80:1::225:9 fe80:1::225:90ff: 0 - - 5 - - -
>>> em1 1500 <Link#2> 00:25:90:2c:a8:c8 49440879 0 0 50500079972 0 0 3176057
>>> em1 1500 fe80:2::225:9 fe80:2::225:90ff: 0 - - 2 - - -
>>> lagg0 1500 <Link#5> 00:25:90:2c:a8:c8 70396711726 0 0 103748441456 4385672
>>> 0
>>> 0
>>> lagg0 1500 117.121.249.0 117.121.249.76 46351366311 - - 103757765366 - - -
>>> lagg0 1500 fe80:5::225:9 fe80:5::225:90ff: 607 - - 674 - - -
>>> lagg0 1500 2402:6800:730 2402:6800:730:12: 136847 - - 142450 - - -
>>>
>>> Aug 30 23:05:04 cds56 kernel: Interface is RUNNING and INACTIVE
>>> Aug 30 23:05:04 cds56 kernel: em0: hw tdh = 371, hw tdt = 376
>>> Aug 30 23:05:04 cds56 kernel: em0: hw rdh = 923, hw rdt = 922
>>> Aug 30 23:05:04 cds56 kernel: em0: Tx Queue Status = 0
>>> Aug 30 23:05:04 cds56 kernel: em0: TX descriptors avail = 1014
>>> Aug 30 23:05:04 cds56 kernel: em0: Tx Descriptors avail failure = 0
>>> Aug 30 23:05:04 cds56 kernel: em0: RX discarded packets = 0
>>> Aug 30 23:05:04 cds56 kernel: em0: RX Next to Check = 986
>>> Aug 30 23:05:04 cds56 kernel: em0: RX Next to Refresh = 994
>>> Aug 30 23:05:04 cds56 kernel: Interface is RUNNING and INACTIVE
>>> Aug 30 23:05:04 cds56 kernel: em1: hw tdh = 78, hw tdt = 78
>>> Aug 30 23:05:04 cds56 kernel: em1: hw rdh = 88, hw rdt = 87
>>> Aug 30 23:05:04 cds56 kernel: em1: Tx Queue Status = 0
>>> Aug 30 23:05:04 cds56 kernel: em1: TX descriptors avail = 1024
>>> Aug 30 23:05:04 cds56 kernel: em1: Tx Descriptors avail failure = 0
>>> Aug 30 23:05:04 cds56 kernel: em1: RX discarded packets = 0
>>> Aug 30 23:05:04 cds56 kernel: em1: RX Next to Check = 88
>>> Aug 30 23:05:04 cds56 kernel: em1: RX Next to Refresh = 88
>>>
>>> net.inet.ip.intr_queue_maxlen: 512
>>> net.inet.ip.intr_queue_drops: 0
>>> dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.1.9
>>> dev.em.0.%driver: em
>>> dev.em.0.%location: slot=0 function=0
>>> dev.em.0.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x15d9
>>> subdevice=0x10d3 class=0x020000
>>> dev.em.0.%parent: pci1
>>> dev.em.0.nvm: -1
>>> dev.em.0.debug: -1
>>> dev.em.0.rx_int_delay: 0
>>> dev.em.0.tx_int_delay: 66
>>> dev.em.0.rx_abs_int_delay: 66
>>> dev.em.0.tx_abs_int_delay: 66
>>> dev.em.0.rx_processing_limit: 100
>>> dev.em.0.flow_control: 3
>>> dev.em.0.link_irq: 1096
>>> dev.em.0.mbuf_alloc_fail: 0
>>> dev.em.0.cluster_alloc_fail: 0
>>> dev.em.0.dropped: 0
>>> dev.em.0.tx_dma_fail: 0
>>> dev.em.0.rx_overruns: 0
>>> dev.em.0.watchdog_timeouts: 0
>>> dev.em.0.device_control: 1477444168
>>> dev.em.0.rx_control: 67141634
>>> dev.em.0.fc_high_water: 18432
>>> dev.em.0.fc_low_water: 16932
>>> dev.em.0.queue0.txd_head: 923
>>> dev.em.0.queue0.txd_tail: 923
>>> dev.em.0.queue0.tx_irq: 18016443069
>>> dev.em.0.queue0.no_desc_avail: 0
>>> dev.em.0.queue0.rxd_head: 620
>>> dev.em.0.queue0.rxd_tail: 619
>>> dev.em.0.queue0.rx_irq: 24617484192
>>> dev.em.0.mac_stats.excess_coll: 0
>>> dev.em.0.mac_stats.single_coll: 0
>>> dev.em.0.mac_stats.multiple_coll: 0
>>> dev.em.0.mac_stats.late_coll: 0
>>> dev.em.0.mac_stats.collision_count: 0
>>> dev.em.0.mac_stats.symbol_errors: 0
>>> dev.em.0.mac_stats.sequence_errors: 0
>>> dev.em.0.mac_stats.defer_count: 0
>>> dev.em.0.mac_stats.missed_packets: 2290
>>> dev.em.0.mac_stats.recv_no_buff: 2063
>>> dev.em.0.mac_stats.recv_undersize: 0
>>> dev.em.0.mac_stats.recv_fragmented: 0
>>> dev.em.0.mac_stats.recv_oversize: 0
>>> dev.em.0.mac_stats.recv_jabber: 0
>>> dev.em.0.mac_stats.recv_errs: 0
>>> dev.em.0.mac_stats.crc_errs: 0
>>> dev.em.0.mac_stats.alignment_errs: 0
>>> dev.em.0.mac_stats.coll_ext_errs: 0
>>> dev.em.0.mac_stats.xon_recvd: 0
>>> dev.em.0.mac_stats.xon_txd: 34
>>> dev.em.0.mac_stats.xoff_recvd: 0
>>> dev.em.0.mac_stats.xoff_txd: 2281
>>> dev.em.0.mac_stats.total_pkts_recvd: 70347571042
>>> dev.em.0.mac_stats.good_pkts_recvd: 70347568752
>>> dev.em.0.mac_stats.bcast_pkts_recvd: 49354826
>>> dev.em.0.mac_stats.mcast_pkts_recvd: 21430
>>> dev.em.0.mac_stats.rx_frames_64: 24097227332
>>> dev.em.0.mac_stats.rx_frames_65_127: 26282000524
>>> dev.em.0.mac_stats.rx_frames_128_255: 117491895
>>> dev.em.0.mac_stats.rx_frames_256_511: 397131263
>>> dev.em.0.mac_stats.rx_frames_512_1023: 1048868288
>>> dev.em.0.mac_stats.rx_frames_1024_1522: 18404849450
>>> dev.em.0.mac_stats.good_octets_recvd: 32288605684532
>>> dev.em.0.mac_stats.good_octets_txd: 59508100377248
>>> dev.em.0.mac_stats.total_pkts_txd: 53257111032
>>> dev.em.0.mac_stats.good_pkts_txd: 53257108716
>>> dev.em.0.mac_stats.bcast_pkts_txd: 21098
>>> dev.em.0.mac_stats.mcast_pkts_txd: 28465
>>> dev.em.0.mac_stats.tx_frames_64: 1243827849
>>> dev.em.0.mac_stats.tx_frames_65_127: 12126816593
>>> dev.em.0.mac_stats.tx_frames_128_255: 260192405
>>> dev.em.0.mac_stats.tx_frames_256_511: 196901153
>>> dev.em.0.mac_stats.tx_frames_512_1023: 565384449
>>> dev.em.0.mac_stats.tx_frames_1024_1522: 38863986268
>>> dev.em.0.mac_stats.tso_txd: 0
>>> dev.em.0.mac_stats.tso_ctx_fail: 0
>>> dev.em.0.interrupts.asserts: 571
>>> dev.em.0.interrupts.rx_pkt_timer: 0
>>> dev.em.0.interrupts.rx_abs_timer: 0
>>> dev.em.0.interrupts.tx_pkt_timer: 0
>>> dev.em.0.interrupts.tx_abs_timer: 0
>>> dev.em.0.interrupts.tx_queue_empty: 0
>>> dev.em.0.interrupts.tx_queue_min_thresh: 0
>>> dev.em.0.interrupts.rx_desc_min_thresh: 0
>>> dev.em.0.interrupts.rx_overrun: 0
>>> dev.em.1.%desc: Intel(R) PRO/1000 Network Connection 7.1.9
>>> dev.em.1.%driver: em
>>> dev.em.1.%location: slot=0 function=0
>>> dev.em.1.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x15d9
>>> subdevice=0x10d3 class=0x020000
>>> dev.em.1.%parent: pci2
>>> dev.em.1.nvm: -1
>>> dev.em.1.debug: -1
>>> dev.em.1.rx_int_delay: 0
>>> dev.em.1.tx_int_delay: 66
>>> dev.em.1.rx_abs_int_delay: 66
>>> dev.em.1.tx_abs_int_delay: 66
>>> dev.em.1.rx_processing_limit: 100
>>> dev.em.1.flow_control: 3
>>> dev.em.1.link_irq: 3
>>> dev.em.1.mbuf_alloc_fail: 0
>>> dev.em.1.cluster_alloc_fail: 0
>>> dev.em.1.dropped: 0
>>> dev.em.1.tx_dma_fail: 0
>>> dev.em.1.rx_overruns: 0
>>> dev.em.1.watchdog_timeouts: 0
>>> dev.em.1.device_control: 1477444168
>>> dev.em.1.rx_control: 67141634
>>> dev.em.1.fc_high_water: 18432
>>> dev.em.1.fc_low_water: 16932
>>> dev.em.1.queue0.txd_head: 78
>>> dev.em.1.queue0.txd_tail: 78
>>> dev.em.1.queue0.tx_irq: 17831483878
>>> dev.em.1.queue0.no_desc_avail: 0
>>> dev.em.1.queue0.rxd_head: 104
>>> dev.em.1.queue0.rxd_tail: 103
>>> dev.em.1.queue0.rx_irq: 49440805
>>> dev.em.1.mac_stats.excess_coll: 0
>>> dev.em.1.mac_stats.single_coll: 0
>>> dev.em.1.mac_stats.multiple_coll: 0
>>> dev.em.1.mac_stats.late_coll: 0
>>> dev.em.1.mac_stats.collision_count: 0
>>> dev.em.1.mac_stats.symbol_errors: 0
>>> dev.em.1.mac_stats.sequence_errors: 0
>>> dev.em.1.mac_stats.defer_count: 0
>>> dev.em.1.mac_stats.missed_packets: 0
>>> dev.em.1.mac_stats.recv_no_buff: 0
>>> dev.em.1.mac_stats.recv_undersize: 0
>>> dev.em.1.mac_stats.recv_fragmented: 0
>>> dev.em.1.mac_stats.recv_oversize: 0
>>> dev.em.1.mac_stats.recv_jabber: 0
>>> dev.em.1.mac_stats.recv_errs: 0
>>> dev.em.1.mac_stats.crc_errs: 0
>>> dev.em.1.mac_stats.alignment_errs: 0
>>> dev.em.1.mac_stats.coll_ext_errs: 0
>>> dev.em.1.mac_stats.xon_recvd: 0
>>> dev.em.1.mac_stats.xon_txd: 0
>>> dev.em.1.mac_stats.xoff_recvd: 0
>>> dev.em.1.mac_stats.xoff_txd: 0
>>> dev.em.1.mac_stats.total_pkts_recvd: 49440891
>>> dev.em.1.mac_stats.good_pkts_recvd: 49440891
>>> dev.em.1.mac_stats.bcast_pkts_recvd: 49419308
>>> dev.em.1.mac_stats.mcast_pkts_recvd: 21444
>>> dev.em.1.mac_stats.rx_frames_64: 49419319
>>> dev.em.1.mac_stats.rx_frames_65_127: 21536
>>> dev.em.1.mac_stats.rx_frames_128_255: 1
>>> dev.em.1.mac_stats.rx_frames_256_511: 11
>>> dev.em.1.mac_stats.rx_frames_512_1023: 13
>>> dev.em.1.mac_stats.rx_frames_1024_1522: 11
>>> dev.em.1.mac_stats.good_octets_recvd: 3165480294
>>> dev.em.1.mac_stats.good_octets_txd: 58735098276348
>>> dev.em.1.mac_stats.total_pkts_txd: 50500079972
>>> dev.em.1.mac_stats.good_pkts_txd: 50500079972
>>> dev.em.1.mac_stats.bcast_pkts_txd: 0
>>> dev.em.1.mac_stats.mcast_pkts_txd: 5
>>> dev.em.1.mac_stats.tx_frames_64: 1267032327
>>> dev.em.1.mac_stats.tx_frames_65_127: 9722353368
>>> dev.em.1.mac_stats.tx_frames_128_255: 265847363
>>> dev.em.1.mac_stats.tx_frames_256_511: 198177596
>>> dev.em.1.mac_stats.tx_frames_512_1023: 568826323
>>> dev.em.1.mac_stats.tx_frames_1024_1522: 38477842995
>>> dev.em.1.mac_stats.tso_txd: 0
>>> dev.em.1.mac_stats.tso_ctx_fail: 0
>>> dev.em.1.interrupts.asserts: 4
>>> dev.em.1.interrupts.rx_pkt_timer: 0
>>> dev.em.1.interrupts.rx_abs_timer: 0
>>> dev.em.1.interrupts.tx_pkt_timer: 0
>>> dev.em.1.interrupts.tx_abs_timer: 0
>>> dev.em.1.interrupts.tx_queue_empty: 0
>>> dev.em.1.interrupts.tx_queue_min_thresh: 0
>>> dev.em.1.interrupts.rx_desc_min_thresh: 0
>>> dev.em.1.interrupts.rx_overrun: 0
>>>
>>> hostb0 at pci0:0:0:0: class=0x060000 card=0x00008086 chip=0x34068086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'QuickPath Architecture I/O Hub to ESI Port'
>>> class = bridge
>>> subclass = HOST-PCI
>>> pcib1 at pci0:0:1:0: class=0x060400 card=0x00008086 chip=0x34088086 rev=0x22
>>> hdr=0x01
>>> vendor = 'Intel Corporation'
>>> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 1'
>>> class = bridge
>>> subclass = PCI-PCI
>>> pcib2 at pci0:0:2:0: class=0x060400 card=0x00008086 chip=0x34098086 rev=0x22
>>> hdr=0x01
>>> vendor = 'Intel Corporation'
>>> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 2'
>>> class = bridge
>>> subclass = PCI-PCI
>>> pcib3 at pci0:0:3:0: class=0x060400 card=0x00008086 chip=0x340a8086 rev=0x22
>>> hdr=0x01
>>> vendor = 'Intel Corporation'
>>> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 3'
>>> class = bridge
>>> subclass = PCI-PCI
>>> pcib4 at pci0:0:5:0: class=0x060400 card=0x00008086 chip=0x340c8086 rev=0x22
>>> hdr=0x01
>>> vendor = 'Intel Corporation'
>>> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 5'
>>> class = bridge
>>> subclass = PCI-PCI
>>> pcib5 at pci0:0:7:0: class=0x060400 card=0x00008086 chip=0x340e8086 rev=0x22
>>> hdr=0x01
>>> vendor = 'Intel Corporation'
>>> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 7'
>>> class = bridge
>>> subclass = PCI-PCI
>>> ioapic0 at pci0:0:19:0: class=0x080020 card=0x00000000 chip=0x342d8086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'QuickPath Architecture I/O Hub I/OxAPIC Interrupt Controller'
>>> class = base peripheral
>>> subclass = interrupt controller
>>> bar [10] = type Memory, range 32, base 0xfec8a000, size 4096, enabled
>>> none0 at pci0:0:20:0: class=0x080000 card=0x00000000 chip=0x342e8086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'QuickPath Architecture I/O Hub System Management Registers'
>>> class = base peripheral
>>> subclass = interrupt controller
>>> none1 at pci0:0:20:1: class=0x080000 card=0x00000000 chip=0x34228086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'QuickPath Architecture I/O Hub GPIO and Scratch Pad Registers'
>>> class = base peripheral
>>> subclass = interrupt controller
>>> none2 at pci0:0:20:2: class=0x080000 card=0x00000000 chip=0x34238086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'QuickPath Architecture I/O Hub Control Status and RAS Registers'
>>> class = base peripheral
>>> subclass = interrupt controller
>>> none3 at pci0:0:20:3: class=0x080000 card=0x00000000 chip=0x34388086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'QuickPath Architecture I/O Hub Throttle Registers'
>>> class = base peripheral
>>> subclass = interrupt controller
>>> none4 at pci0:0:22:0: class=0x088000 card=0x000715d9 chip=0x34308086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'DMA Engine'
>>> class = base peripheral
>>> bar [10] = type Memory, range 64, base 0xfbed8000, size 16384, enabled
>>> none5 at pci0:0:22:1: class=0x088000 card=0x000715d9 chip=0x34318086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'DMA Engine'
>>> class = base peripheral
>>> bar [10] = type Memory, range 64, base 0xfbedc000, size 16384, enabled
>>> none6 at pci0:0:22:2: class=0x088000 card=0x000715d9 chip=0x34328086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'DMA Engine'
>>> class = base peripheral
>>> bar [10] = type Memory, range 64, base 0xfbee0000, size 16384, enabled
>>> none7 at pci0:0:22:3: class=0x088000 card=0x000715d9 chip=0x34338086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'DMA Engine'
>>> class = base peripheral
>>> bar [10] = type Memory, range 64, base 0xfbee4000, size 16384, enabled
>>> none8 at pci0:0:22:4: class=0x088000 card=0x000715d9 chip=0x34298086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'DMA Engine'
>>> class = base peripheral
>>> bar [10] = type Memory, range 64, base 0xfbee8000, size 16384, enabled
>>> none9 at pci0:0:22:5: class=0x088000 card=0x000715d9 chip=0x342a8086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'DMA Engine'
>>> class = base peripheral
>>> bar [10] = type Memory, range 64, base 0xfbeec000, size 16384, enabled
>>> none10 at pci0:0:22:6: class=0x088000 card=0x000715d9 chip=0x342b8086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'DMA Engine'
>>> class = base peripheral
>>> bar [10] = type Memory, range 64, base 0xfbef0000, size 16384, enabled
>>> none11 at pci0:0:22:7: class=0x088000 card=0x000715d9 chip=0x342c8086
>>> rev=0x22
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'DMA Engine'
>>> class = base peripheral
>>> bar [10] = type Memory, range 64, base 0xfbef4000, size 16384, enabled
>>> none12 at pci0:0:26:0: class=0x0c0300 card=0x000715d9 chip=0x3a378086
>>> rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'USB UHCI Controller *4'
>>> class = serial bus
>>> subclass = USB
>>> none13 at pci0:0:26:1: class=0x0c0300 card=0x000715d9 chip=0x3a388086
>>> rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'USB UHCI Controller *5'
>>> class = serial bus
>>> subclass = USB
>>> none14 at pci0:0:26:2: class=0x0c0300 card=0x000715d9 chip=0x3a398086
>>> rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'USB UHCI Controller *6'
>>> class = serial bus
>>> subclass = USB
>>> none15 at pci0:0:26:7: class=0x0c0320 card=0x000715d9 chip=0x3a3c8086
>>> rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'USB EHCI Controller *2'
>>> class = serial bus
>>> subclass = USB
>>> none16 at pci0:0:29:0: class=0x0c0300 card=0x000715d9 chip=0x3a348086
>>> rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'USB UHCI Controller *1'
>>> class = serial bus
>>> subclass = USB
>>> none17 at pci0:0:29:1: class=0x0c0300 card=0x000715d9 chip=0x3a358086
>>> rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'USB UHCI Controller *2'
>>> class = serial bus
>>> subclass = USB
>>> none18 at pci0:0:29:2: class=0x0c0300 card=0x000715d9 chip=0x3a368086
>>> rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'USB UHCI Controller *3'
>>> class = serial bus
>>> subclass = USB
>>> none19 at pci0:0:29:7: class=0x0c0320 card=0x000715d9 chip=0x3a3a8086
>>> rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'USB EHCI Controller *1'
>>> class = serial bus
>>> subclass = USB
>>> pcib6 at pci0:0:30:0: class=0x060401 card=0x000715d9 chip=0x244e8086
>>> rev=0x90
>>> hdr=0x01
>>> vendor = 'Intel Corporation'
>>> device = '82801 Family (ICH2/3/4/5/6/7/8/9,63xxESB) Hub Interface to PCI
>>> Bridge'
>>> class = bridge
>>> subclass = PCI-PCI
>>> isab0 at pci0:0:31:0: class=0x060100 card=0x000715d9 chip=0x3a188086
>>> rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'LPC Interface Controller'
>>> class = bridge
>>> subclass = PCI-ISA
>>> atapci0 at pci0:0:31:2: class=0x01018f card=0x000715d9 chip=0x3a208086
>>> rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'SATA2(4Port2) (ICH10 Family)'
>>> class = mass storage
>>> subclass = ATA
>>> bar [10] = type I/O Port, range 32, base 0xbc00, size 8, enabled
>>> bar [14] = type I/O Port, range 32, base 0xb880, size 4, enabled
>>> bar [18] = type I/O Port, range 32, base 0xb800, size 8, enabled
>>> bar [1c] = type I/O Port, range 32, base 0xb480, size 4, enabled
>>> bar [20] = type I/O Port, range 32, base 0xb400, size 16, enabled
>>> bar [24] = type I/O Port, range 32, base 0xb080, size 16, enabled
>>> none20 at pci0:0:31:3: class=0x0c0500 card=0x000715d9 chip=0x3a308086
>>> rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'SMB controller (50011458)'
>>> class = serial bus
>>> subclass = SMBus
>>> bar [10] = type Memory, range 64, base 0xfbefa000, size 256, enabled
>>> bar [20] = type I/O Port, range 32, base 0x400, size 32, enabled
>>> atapci1 at pci0:0:31:5: class=0x010185 card=0x000715d9 chip=0x3a268086
>>> rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'SATA2(2Port2) (ICH10 Family)'
>>> class = mass storage
>>> subclass = ATA
>>> bar [10] = type I/O Port, range 32, base 0xac00, size 8, enabled
>>> bar [14] = type I/O Port, range 32, base 0xa880, size 4, enabled
>>> bar [18] = type I/O Port, range 32, base 0xa800, size 8, enabled
>>> bar [1c] = type I/O Port, range 32, base 0xa480, size 4, enabled
>>> bar [20] = type I/O Port, range 32, base 0xa400, size 16, enabled
>>> bar [24] = type I/O Port, range 32, base 0xa080, size 16, enabled
>>> em0 at pci0:1:0:0: class=0x020000 card=0x10d315d9 chip=0x10d38086 rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'Intel 82574L Gigabit Ethernet Controller (82574L)'
>>> class = network
>>> subclass = ethernet
>>> bar [10] = type Memory, range 32, base 0xfbbe0000, size 131072, enabled
>>> bar [18] = type I/O Port, range 32, base 0xcc00, size 32, enabled
>>> bar [1c] = type Memory, range 32, base 0xfbbdc000, size 16384, enabled
>>> em1 at pci0:2:0:0: class=0x020000 card=0x10d315d9 chip=0x10d38086 rev=0x00
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> device = 'Intel 82574L Gigabit Ethernet Controller (82574L)'
>>> class = network
>>> subclass = ethernet
>>> bar [10] = type Memory, range 32, base 0xfbce0000, size 131072, enabled
>>> bar [18] = type I/O Port, range 32, base 0xdc00, size 32, enabled
>>> bar [1c] = type Memory, range 32, base 0xfbcdc000, size 16384, enabled
>>> mps0 at pci0:4:0:0: class=0x010700 card=0x040015d9 chip=0x00721000 rev=0x02
>>> hdr=0x00
>>> vendor = 'LSI Logic (Was: Symbios Logic, NCR)'
>>> class = mass storage
>>> subclass = SAS
>>> bar [10] = type I/O Port, range 32, base 0xe000, size 256, enabled
>>> bar [14] = type Memory, range 64, base 0xfbd3c000, size 16384, enabled
>>> bar [1c] = type Memory, range 64, base 0xfbd40000, size 262144, enabled
>>> vgapci0 at pci0:6:1:0: class=0x030000 card=0x000715d9 chip=0x0532102b
>>> rev=0x0a
>>> hdr=0x00
>>> vendor = 'Matrox Electronic Systems Ltd.'
>>> class = display
>>> subclass = VGA
>>> bar [10] = type Prefetchable Memory, range 32, base 0xf9000000, size
>>> 16777216, enabled
>>> bar [14] = type Memory, range 32, base 0xfaffc000, size 16384, enabled
>>> bar [18] = type Memory, range 32, base 0xfb000000, size 8388608, enabled
>>> hostb1 at pci0:255:0:0: class=0x060000 card=0x80868086 chip=0x2c708086
>>> rev=0x02
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb2 at pci0:255:0:1: class=0x060000 card=0x80868086 chip=0x2d818086
>>> rev=0x02
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb3 at pci0:255:2:0: class=0x060000 card=0x80868086 chip=0x2d908086
>>> rev=0x02
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb4 at pci0:255:2:1: class=0x060000 card=0x80868086 chip=0x2d918086
>>> rev=0x02
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb5 at pci0:255:2:2: class=0x060000 card=0x80868086 chip=0x2d928086
>>> rev=0x02
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb6 at pci0:255:2:3: class=0x060000 card=0x80868086 chip=0x2d938086
>>> rev=0x02
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb7 at pci0:255:2:4: class=0x060000 card=0x80868086 chip=0x2d948086
>>> rev=0x02
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb8 at pci0:255:2:5: class=0x060000 card=0x80868086 chip=0x2d958086
>>> rev=0x02
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb9 at pci0:255:3:0: class=0x060000 card=0x80868086 chip=0x2d988086
>>> rev=0x02
>>> hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb10 at pci0:255:3:1: class=0x060000 card=0x80868086 chip=0x2d998086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb11 at pci0:255:3:2: class=0x060000 card=0x80868086 chip=0x2d9a8086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb12 at pci0:255:3:4: class=0x060000 card=0x80868086 chip=0x2d9c8086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb13 at pci0:255:4:0: class=0x060000 card=0x80868086 chip=0x2da08086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb14 at pci0:255:4:1: class=0x060000 card=0x80868086 chip=0x2da18086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb15 at pci0:255:4:2: class=0x060000 card=0x80868086 chip=0x2da28086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb16 at pci0:255:4:3: class=0x060000 card=0x80868086 chip=0x2da38086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb17 at pci0:255:5:0: class=0x060000 card=0x80868086 chip=0x2da88086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb18 at pci0:255:5:1: class=0x060000 card=0x80868086 chip=0x2da98086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb19 at pci0:255:5:2: class=0x060000 card=0x80868086 chip=0x2daa8086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb20 at pci0:255:5:3: class=0x060000 card=0x80868086 chip=0x2dab8086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb21 at pci0:255:6:0: class=0x060000 card=0x80868086 chip=0x2db08086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb22 at pci0:255:6:1: class=0x060000 card=0x80868086 chip=0x2db18086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb23 at pci0:255:6:2: class=0x060000 card=0x80868086 chip=0x2db28086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>> hostb24 at pci0:255:6:3: class=0x060000 card=0x80868086 chip=0x2db38086
>>> rev=0x02 hdr=0x00
>>> vendor = 'Intel Corporation'
>>> class = bridge
>>> subclass = HOST-PCI
>>>
>>> Thank you in advance sirs!
>>> Jason Wolfe
>>> _______________________________________________
>>> freebsd-net at freebsd.org mailing list
>>> http://lists.freebsd.org/mailman/listinfo/freebsd-net
>>> To unsubscribe, send any mail to "freebsd-net-unsubscribe at freebsd.org"
>>>
>>
>>
> _______________________________________________
> freebsd-net at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscribe at freebsd.org"
>