LSI2008 and SAS3 backplane
Andrew Vylegzhanin
avv314 at gmail.com
Tue Nov 7 03:57:32 UTC 2017
This is another matter!
B____T SAS Address Handle Parent Device Speed Enc Slot
Wdt
500304801ebe58bf 0009 0001 SMP Target 6.0 0002 00
4
500304801ea4db3f 000a 0009 SMP Target 12 0003 00
0
500304801ebe58bd 000b 0009 SEP Target 12 0002 20
0
5000c50093bb2775 000c 000a SAS Target 6.0 0003 00
0
5000c50093bb2291 000d 000a SAS Target 6.0 0003 01
0
5000c50093bb3209 000e 000a SAS Target 6.0 0003 02
0
5000c50093bb24ed 000f 000a SAS Target 6.0 0003 03
0
5000c50093bb3721 0010 000a SAS Target 6.0 0003 04
0
5000c50093bb3159 0011 000a SAS Target 6.0 0003 05
0
5000c50093bb345d 0012 000a SAS Target 6.0 0003 06
0
5000c50093b33e05 0013 000a SAS Target 6.0 0003 07
0
5000c50093bb2489 0014 000a SAS Target 12 0003 08
0
5000c50093bb3105 0015 000a SAS Target 12 0003 09
0
5000c50093bb31f1 0016 000a SAS Target 12 0003 10
0
5000c50093b0b049 0017 000a SAS Target 12 0003 11
0
5c81f660f99a8d01 0018 000a SAS Initiator 6.0
0
5000c50093bb1ff5 0019 000a SAS Target 12 0003 12
0
5000c50093bb3301 001a 000a SAS Target 12 0003 13
0
5000c50093bb271d 001b 000a SAS Target 12 0003 14
0
5000c50093bb33a9 001c 000a SAS Target 12 0003 15
0
5000c50093bb1fb5 001d 000a SAS Target 12 0003 16
0
5000c50093bb3411 001e 000a SAS Target 12 0003 17
0
5000c50093b31d65 001f 000a SAS Target 12 0003 18
0
5000c50093bb27c5 0020 000a SAS Target 12 0003 19
0
500304801ea4db3d 0022 000a SEP Target 12 0003 24
0
500304801ea4db3f 0023 0002 SMP Target 6.0 0004 00
4
00 61 5000c50093bb2775 0024 0023 SAS Target 6.0 0004 00
0
00 62 5000c50093bb2291 0025 0023 SAS Target 6.0 0004 01
0
00 63 5000c50093bb3209 0026 0023 SAS Target 6.0 0004 02
0
00 64 5000c50093bb24ed 0027 0023 SAS Target 6.0 0004 03
0
00 65 5000c50093bb3721 0028 0023 SAS Target 6.0 0004 04
0
00 66 5000c50093bb3159 0029 0023 SAS Target 6.0 0004 05
0
00 67 5000c50093bb345d 002a 0023 SAS Target 6.0 0004 06
0
00 68 5000c50093b33e05 002b 0023 SAS Target 6.0 0004 07
0
00 69 5000c50093bb2489 002c 0023 SAS Target 12 0004 08
0
00 70 5000c50093bb3105 002d 0023 SAS Target 12 0004 09
0
00 71 5000c50093bb31f1 002e 0023 SAS Target 12 0004 10
0
00 72 5000c50093b0b049 002f 0023 SAS Target 12 0004 11
0
500304801ebe58bf 0030 0023 SMP Target 12 0005 00
0
00 73 5000c50093bb1ff5 0031 0023 SAS Target 12 0004 12
0
00 74 5000c50093bb3301 0032 0023 SAS Target 12 0004 13
0
00 75 5000c50093bb271d 0033 0023 SAS Target 12 0004 14
0
00 76 5000c50093bb33a9 0034 0023 SAS Target 12 0004 15
0
00 77 5000c50093bb1fb5 0035 0023 SAS Target 12 0004 16
0
00 78 5000c50093bb3411 0036 0023 SAS Target 12 0004 17
0
00 79 5000c50093b31d65 0037 0023 SAS Target 12 0004 18
0
00 80 5000c50093bb27c5 0038 0023 SAS Target 12 0004 19
0
00 83 500304801ea4db24 0039 0023 SATA Target 0004 20
0
00 81 500304801ea4db3d 003a 0023 SEP Target 12 0004 24
0
5c81f660f99a8d00 003b 0030 SAS Initiator 6.0
0
00 82 500304801ebe58bd 003c 0030 SEP Target 12 0005 20
0
How to interpret this? Not many docs :(
--
Andrew
2017-11-07 6:44 GMT+03:00 Scott Long <scottl at samsco.org>:
> Sorry, you need
>
> mpsutil -u 1 show devices
>
> Scott
>
> Sent from my iPhone
>
> On Nov 6, 2017, at 8:43 PM, Andrew Vylegzhanin <avv314 at gmail.com> wrote:
>
>
>
> 2017-11-07 3:26 GMT+03:00 Scott Long <scottl at samsco.org>:
>
>> Hi,
>>
>>
> Hi,
>
> If you’re using FreeBSD 11 or later, try running the following:
>
>
>> mpsutil show devices
>>
>
>
> It's empty:
>
> [root at zc-dtrs-s1 ~]# freebsd-version
> 11.1-RELEASE-p2
> [root at zc-dtrs-s1 ~]# mpsutil show devices
> B____T SAS Address Handle Parent Device Speed Enc Slot
> Wdt
>
> [root at zc-dtrs-s1 ~]#
>
> --
> Andrew
>
>
>
>>
>> That will show what speed the drives are actually negotiated to. This
>> might shed some
>> light on the problem.
>>
>> Scott
>>
>> > On Nov 6, 2017, at 3:37 PM, Andrew Vylegzhanin <avv314 at gmail.com>
>> wrote:
>> >
>> > Hi!
>> >
>> > I have a problem with low transfer speed (150MB/sec instead of
>> 600Mb/sec)
>> > on SAS2 controller to SAS3 drive via SAS3 backplane.
>> >
>> > Hardware config is follows:
>> >
>> > Dell R720 box with Dell SAS HBA 6Gbps connected with Supermicro 45-bay
>> JBOD
>> > with two SAS-3 expanders (LSI SAS3x40 and LSI SAS3x36). All drives (20
>> pcs)
>> > are SEAGATE ST6000NM0095 E002.
>> >
>> > So, partial dmesg out:
>> > ...
>> > mps1: <Avago Technologies (LSI) SAS2008> port 0x9c00-0x9cff mem
>> > 0xd0ff0000-0xd0ffffff,0xd0f80000-0xd0fbffff irq 66 at device 0.0
>> > numa-domain 1 on pci16
>> > mps1: Firmware: 07.15.08.00, Driver: 21.02.00.00-fbsd
>> > mps1: IOCCapabilities:
>> > 185c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR>
>> > ....
>> > ses1 at mps1 bus 0 scbus8 target 81 lun 0
>> > ses1: <LSI SAS3x40 0601> Fixed Enclosure Services SPC-3 SCSI device
>> > ses1: 150.000MB/s transfers
>> > ses1: Command Queueing enabled
>> > ses1: SCSI-3 ENC Device
>> > ses2 at mps1 bus 0 scbus8 target 82 lun 0
>> > ses2: <LSI SAS3x36 0601> Fixed Enclosure Services SPC-3 SCSI device
>> > ses2: 150.000MB/s transfers
>> > ses2: Command Queueing enabled
>> > ses2: SCSI-3 ENC Device
>> > ses1: da0: Element descriptor: 'Slot00'
>> > ....
>> > da0 at mps1 bus 0 scbus8 target 61 lun 0
>> > da3 at mps1 bus 0 scbus8 target 64 lun 0
>> > ...
>> > da0: <SEAGATE ST6000NM0095 E002> Fixed Direct Access SPC-4 SCSI device
>> > da0: Serial Number ZAD119P20000C730KZK3
>> > da0: 150.000MB/s transfers
>> > da0: Command Queueing enabled
>> > da0: 5723166MB (11721045168 512 byte sectors)
>> >
>> > Some additional info.
>> > There is two identical system with same problem.
>> > System is under load now, and there is no erros, timeouts on disk i/o,
>> so
>> > it seems to be not cable/hardware problem.
>> > I've tried other vendor SATA3 drive, got same 150MB/s.
>> > This server works on full speed (600MB/s transfers) with SAS2 JBOD (Dell
>> > MD1220) w/o problems.
>> >
>> > Any ideas?
>> >
>> > --
>> > Andrew
>> > _______________________________________________
>> > freebsd-scsi at freebsd.org mailing list
>> > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi
>> > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe at freebsd.org"
>>
>>
>
More information about the freebsd-scsi
mailing list