Cannot log into iscsi target

Issue

• When trying to activate my RHV hypervisor, there is a storage related error.
• In the vdsm logs we see:

2019-07-24 14:04:45,648+1000 ERROR (jsonrpc/7) [storage.HSM] Could not connect to storageServer (hsm:2384)
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/hsm.py", line 2381, in connectStorageServer
    conObj.connect()
  File "/usr/share/vdsm/storage/storageServer.py", line 433, in connect
    iscsi.addIscsiNode(self._iface, self._target, self._cred)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/iscsi.py", line 220, in addIscsiNode
    iscsiadm.node_new(iface.name, target.address, target.iqn)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/iscsiadm.py", line 282, in node_new
    raise IscsiNodeError(rc, out, err)
IscsiNodeError: (6, [], ['iscsiadm: Could not stat /var/lib/iscsi/nodes//,3260,-1/default to delete node: No such file or directory', 'iscsiadm: Error while adding record: encountered iSCSI database failure'])

 

Resolution

• Check for and remove any empty iscsi records:

-rw-------. 1 root root 2016 Jun  5 14:02 /var/lib/iscsi/nodes/iqn.2019-01.com.example:hestore/10.0.0.10,3260,1/default
-rw-------. 1 root root 2019 Jun  5 14:02 /var/lib/iscsi/nodes/iqn.2019-01.com.example:rheva/10.0.0.10.163,3260,1/default
-rw-------. 1 root root    0 Jun  5 14:02 /var/lib/iscsi/nodes/iqn.2019-01.com.example:rhevb/10.0.0.10.163,3260,1/default

 

 

 

 

• Restart the host

In this case, the last record is empty and causing the problem. The first two are fine, and probably logging in correctly

 

Diagnostic Steps

ls -l  /var/lib/iscsi/nodes/*/*/*
grep -i iscsi /var/log/messages