I was wondering if anyone had any specific experience using Intel DC3700 SSDs (or similar) in the HP (DL380p) Gen8 servers?
I'm upgrading a set of database servers that use direct-attached storage. Typically, we use HP-branded everything in our server configs, and beyond a few SSD'd desktops (all of which have worked flawlessly), I have not otherwise used SSDs – certainly not in a server.
The servers we're upgrading run SQL Server (2005) on Windows. We're moving to SQL 2012. Current boxes host a single 200GB database on DL370 G6 provisioned with 72GB 15K SFF drives in RAID 1+0 as follows: OS (2 spindles), tempdb (4 spindles), t-logs (8 spindles), data (20 spindles). Performance is not an issue (CPU load is typically 20% / peak 30%, disk queues are typ = 1). The data volume disks are running in MSA50s off a P800 – so there's probably 5K IOPS there tops. The hardware is approaching 4 years old, and so it's time for a refresh.
Data usage, as reported by the individual hard disks, shows write volume of < 100TB since deployment on the data volume; < 10TB write on the transaction log volume; and ~ 1TB on tempdb.
That's the use case. Now consider a new, identical disk subsystem. It's going to run ~ $15K per server (34x 15K HDD @ $250 + 2x D2700 shelf + Smart array P421 for the external storage).
Consider a similar SSD deployment, say 6x 200GB SSD for the data volume, and 2 each (100GB) for OS, tempdb, and logging. Perhaps overkill, but using Intel DC S3700 for all with a second array card brings me in around $5K per server. Plus, it fits in one 2U box (use the expansion cage on the DL380p) and saves several hundred dollars in electricity every year. With the increased SSD performance, this might even cover some sloppy queries ;-).
An equivalent "no-worries" HP SSD solution is going to run ~ $10.5K. Twice the price with less warranty, lower endurance, but guaranteed performance and manageability.
Certainly, there are loads of in-between solutions that could work. I'm also quite aware of the vendor supported solution vs. 3rd party trade-offs. What I don't have is experience integrating these specific products to help quantify those trade-offs. I'm hoping someone out there does, and is willing to share his experience.
Questions that come to my mind are:
Does the S3700 play well in the Proliant environment with the Array P42x/P822 cards?
If using the S3700, would there be an advantage to using a 3rd party card, say the LSI 9270-8i?
How (well, easily) are firmware upgrades or management alerts accomplished with the third party solution as I've outlined?
If there are particular issues with the assembly, how have you worked around them – assuming you have?
With the changes that SSDs has introduced into the storage arena, storage solutions are way less straightforward than even a few years ago. I'm sure they will be very different in another few years, and we had expected to wait another cycle before seriously considering using SSDs in any server application.
Before I head too far down this road, is there anyone who would share their relevant experience with any of this? Please tell us why we're smart, crazy, or something in between.
Best Answer
I've covered SSD interoperability and compatibility issues with HP servers several times here.
Check these posts:
HP D2700 enclosure and SSDs. Will any SSD work?
Are there any SAN vendors that allow third party drives?
So, the move from G6 and G7 HP ProLiants to the Gen8 variants forced a disk carrier form-factor change. HP went to the SmartDrive carrier with the Gen8 product, and that's created a whole set of issues that impact SSD compatibility.
I like the idea of choosing the most appropriate options for my environments and applications, within reason. With G7's, I could use HP's SanDisk/Pliant SAS enterprise SSDs when needed, but also Intel or other low-cost SandForce-based SSDs where it made sense. If using an external enclosure like a D2700 or D2600, I could also use sTec SSDs (which offer another quality SAS SSD option). Drive carriers for the old form-factor were easily obtained.
With Gen8 servers, much of this isn't possible. From the difficult access to the SmartDrive carriers to restrictive firmware and disk validation techniques to the obscenely high price of the HP-branded SSDs ($2500+ per drive), I think HP have priced themselves out of the market.
Their rebranded drives aren't stellar performers, but have tremendous endurance. That's not needed in every environment. Getting the best performance out of HP SSDs on current HP Smart Array controller also requires tuning or even additional HP SmartPath licensing. Previous controllers like the Smart Array P410 were limited by IOPS and other constraints.
A good development that may affect your application on Gen8 servers is the HP SmartCache SSD tiering. Much like LSI's Cachecade, this allows you to add SSD read caching and benefit from lower latencies where it matters. Also see: How effective is LSI CacheCade SSD storage tiering?
In general, I'm not concerned about SSD reliability in RAID setups with disk form-factors. PCIe-based SSDs introduce other concerns. I haven't had any endurance problems, but check: Are SSD drives as reliable as mechanical drives (2013)?
So what can you do?
The D2700 external enclosure may be key here. It uses the older G7 disk carriers. It's also a very solid unit and compatible with old and new generation controllers. You can stuff Intel/sTec/cheapo disks in it all day and be fine. Connect that to the adapter in your hosts, and that will give you the flexibility you require. Use a DL360p instead of a DL380p to save a rack unit.
Intel disks inside of the Gen8 server... I wouldn't do it, if for any reason than to avoid the
POST 1709errors. Plus you'll be self-supporting in a way that impacts the main server unit. I just had a customer try to fill a 25-bay DL380p Gen8 with Intel SSDs and eBay drive carriers. He had to return the Intel drives and use low-end HP SATA disks for the system to even work.The HP ProLiant DL380p Gen8 is offered in 8-bay, 12-bay15, 16-bay and 25-bay units.
The 8-bay has been fine. It's a good platform, especially if you add external storage.
The 16-bay Gen8 has no SAS expander card (and is incompatible with the excellent HP SAS Expander), so you need two internal RAID controllers to use it. As a result, your logical drives cannot span the two 8-bay drive cages. This is a departure from the G7s, where 16-bays/disks in one array was no problem.
The 25-bay unit has a concerning design flaw. The SAS expander is embedded on the 25-drive backplane. This backplane requires a P420i controller with FBWC cache to function. Fine. I had three RAID controller DIMMs die in a 60-day period, though. On the 8-bay units, this just disables write cache. On the 25-bay server, a cache failure makes the Smart Array a "zero-memory" controller and disables all access to the disks!! Avoid this model unless you can accept that risk. My failure rate on 2GB cache modules is far higher than 1GB modules, so I downgrade to the 1GB modules for this specific platform.