Help to make iSER working

[Ben RUBSON]

Hi,

I went with a fresh new install to have a clean status.

What I did :

// FreeBSD 11-RC1 installation
# echo "WITH_OFED=YES" > /etc/make.conf
# cd /usr/src/ ; make buildkernel KERNCONF=GENERIC ; make installkernel KERNCONF=GENERIC
# cd /usr/src/sys/modules/mlx4 ; make ; make install
# cd /usr/src/sys/modules/mlxen ; make ; make install
# cd /usr/src/sys/modules/iser ; make ; make install
# echo "mlx4_load=YES" >> /boot/loader.conf
# echo "mlxen_load=YES" >> /boot/loader.conf
# echo "iser_load=YES" >> /boot/loader.conf
# reboot

Everything went fine, no code modition needed or whatever, perfect.

# iscsictl -A -t iqn.2012-06.com.test:target1 -p 192.168.2.2
On the target, I get :
tgtd[1912]: tgtd: login_start(502) Target iqn.2012-06.com.test:target1 is RDMA, but conn cid:0 from iqn.1994-09.org.freebsd:srv1 is TCP
Perfect, the target is correctly iSER enabled.

# iscsictl -A -t iqn.2012-06.com.test:target1 -p 192.168.2.2 -r
I still get the following error :
iscsid[1062]: 192.168.2.2 (iqn.2012-06.com.test:target1): failed to connect to 192.168.2.2 using ICL kernel proxy: ISCSIDCONNECT: Input/output error
kernel: INFO: iser_free_ib_conn_res: freeing conn 0xfffff80147771000 cma_id 0 qp 0
kernel: DEBUG: iser_conn_connect: before cv_wait: 0xfffff80147771000
kernel: INFO: iser_cma_handler: event 1 status -19 conn 0xfffff80147771000 id 0xfffff8005f0e5400
kernel: ERROR: iser_connect_error: conn 0xfffff80147771000
kernel: DEBUG: iser_conn_connect: after cv_wait: 0xfffff80147771000
iscsid[853]: child process 1062 terminated with exit status 1

Waiting for your instructions, would really be nice to have it working for 11 release.

Many thanks !

Best regards,

Ben



> On 12 Aug 2016, at 09:38, Hans Petter Selasky <hanss at mellanox.com> wrote:
> 
> Hi,
> 
> Error 19 means ENODEV. Possibly something is not supported.
> 
> Meny: I wonder if it is better if Ben install our infiniband patches to bring the IB code up to v3.2?
> 
> --HPS
> 
> -----Original Message-----
> From: Max Gurtovoy 
> Sent: Friday, August 12, 2016 1:51 AM
> To: Ben RUBSON <ben.rubson at gmail.com>; freebsd-scsi at freebsd.org
> Cc: Oren Duer <oren at mellanox.com>; Oded Shanoon <odeds at mellanox.com>; Meny Yossefi <menyy at mellanox.com>; Hans Petter Selasky <hanss at mellanox.com>; Roy Shterman <roysh at mellanox.com>
> Subject: Re: Help to make iSER working
> 
> Hi,
> 
> On 8/11/2016 11:43 PM, Ben RUBSON wrote:
>> Here are the tests with udaddy from FreeBSD, trying to connect to Linux :
>> 
>> # udaddy -s 192.168.2.2
>> libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'.
>> libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'.
>> udaddy: starting client
>> udaddy: connecting
>> libibverbs: Warning: couldn't open config directory '/etc/ibverbs/'.
>> udaddy: event: RDMA_CM_EVENT_ADDR_ERROR, error: -19
> 
> yes, you got the same event in iser (event 1).
> There is a configuration issue with your setup.
> Once you overcome this, iSER should work for you.
> 
> Meny/Hans,
> can you assist here ?
> 
> Thanks,
> Max.