LIO iSCSI Target for Windows Server 2016 Cluster disk – device is not ready

high-availabilityiscsiwindows-clusterwindows-server-2016zfs

I have a LIO iSCSI Target configured on a Fedora 22 machine exporting 1 LUN to 2 Windows Server 2016 machines, both of these are able to access the disk without issues.

These servers are part of a HA Cluster and when I attempt to add the disk to the cluster, I get the error stating that "the device is not ready". The validation tool says that the storage does not pass because of SCSI-3 Persistent Reservations but from my research, this should give a different error than what I'm receiving.

   Creating the physical disk resource for 'Cluster Disk 1'.

Bringing the resource for 'Cluster Disk 1' online.

There was an error creating, configuring, or bringing online the Physical Disk resource (disk) 'Cluster Disk 1'.

The following errors occurred while adding storage to the cluster:

The resource 'Cluster Disk 1' did not come online.

The desired state change for 'Cluster Disk 1' did not occur before the timeout expired.

This is my iSCSI Target:

o- / ........................................................................................................... [...]
  o- backstores ................................................................................................ [...]
  | o- block .................................................................................... [Storage Objects: 1]
  | | o- ha1 ................................................ [/dev/delta/volpool/ha1 (200.0GiB) write-thru activated]
  | o- fileio ................................................................................... [Storage Objects: 0]
  | o- pscsi .................................................................................... [Storage Objects: 0]
  | o- ramdisk .................................................................................. [Storage Objects: 0]
  | o- user ..................................................................................... [Storage Objects: 0]
  o- iscsi .............................................................................................. [Targets: 1]
  | o- iqn.2017-12.net.hirstgroup.adx.delta:storage.target00 ............................................... [TPGs: 1]
  |   o- tpg1 ................................................................................. [no-gen-acls, no-auth]
  |     o- acls ............................................................................................ [ACLs: 4]
  |     | o- iqn.1991-05.com.microsoft:dc1.adx.hirstgroup.net ....................................... [Mapped LUNs: 1]
  |     | | o- mapped_lun0 ..................................................................... [lun0 block/ha1 (rw)]
  |     | o- iqn.1991-05.com.microsoft:dc2.adx.hirstgroup.net ....................................... [Mapped LUNs: 1]
  |     | | o- mapped_lun0 ..................................................................... [lun0 block/ha1 (rw)]
  |     | o- iqn.2017-12.net.hirstgroup.adx.dc1:dc1 ................................................. [Mapped LUNs: 1]
  |     | | o- mapped_lun0 ..................................................................... [lun0 block/ha1 (rw)]
  |     | o- iqn.2017-12.net.hirstgroup.adx.delta:iqn.1991-05.com.microsoft:dc2.adx.hirstgroup.net .. [Mapped LUNs: 1]
  |     |   o- mapped_lun0 ..................................................................... [lun0 block/ha1 (rw)]
  |     o- luns ............................................................................................ [LUNs: 1]
  |     | o- lun0 ............................................................... [block/ha1 (/dev/delta/volpool/ha1)]
  |     o- portals ...................................................................................... [Portals: 1]
  |       o- 0.0.0.0:3260 ....................................................................................... [OK]
  o- loopback ........................................................................................... [Targets: 0]
  o- vhost .............................................................................................. [Targets: 0]

So, I'm not sure what I'm doing wrong here, everything seems to work except the disk will not add to the cluster. One thing I did see in my research is that SCSI-3 Persistant Reservations are required for this to work, but from my understanding LIO does support this. My block device is actually a thin provisioned zvol as I am running ZFS on this machine.

Hopefully someone can help clarify what is going wrong here.

Best Answer

You might want to try clearing SCSI-3 Persistent Reservations as LIO could "forget" to update them after LUN ownership changed.

Clear-ClusterDiskReservation

Related Topic