Slow Read/Write Performance over iSCSI SAN

vmware-esxvmware-vsphere

This is a new setup of ESXi 4.0 running VMs off of a Cybernetics miSAN D iSCSI SAN.

Doing a high data read test on a VM, it took 8 minutes vs 1.5 minutes on the
the same VM located on a slower VMWare Server 1.0 Host with the VMs located on
local disk. I'm watching my read speeds from the SAN, and
it's getting just over 3MB/s max read, and Disk Usage on the VM matches at just over 3MB/s….horribly slow.

The server and SAN are both connected to the same 1GB Switch. I have followed this guide

virtualgeek.typepad.com/virtual_geek/2009/09/a-multivendor-post-on-using-iscsi-w
ith-vmware-vsphere.html

to get multipathing setup properly, but I'm still not getting good
performance with my VMs. I know the SAN and the network
should be able to handle over 100MB/s, but I'm just not getting
it. I have two GB NICs on the SAN multipathed to two GB NICs on the
ESXi Host. One NIC per VMkernel. Is there something else I can check
or do to improve my speed? Thanks in advance for any tips.

Best Answer

That SAN hardware is certified for Vmware so get your support to look into it. Common causes for bad performance are overload the interface of the SAN hardware, because if you have multiple connections to the same SAN not all can be served at the maximum speed.

Also your local disk will always be faster than your SAN in your setup, because even a SATA disk will have a maximum of 3Gb/s bandwidth, so your SAN will never match the speed of your local disks. You probably are also using ethernet instead of fibre which is also not help performance.

You use a SAN not only because of the speed, but to have a central managed place where you can put all your importante data and make sure a suitable RAID level is being applied. There are also certain features like replication which is one of the advantages of having a SAN.