Some points I didn't see in other answers so far:
- A high end server SSD will ge bood for about 30.000 IO. RealSSD go up to 50.000
- As such, you CAN use RAID 5. Point. Your bottleneck is very likely going to be the RAID controller which simply is not made with SSD IOPS in mind, so it will max out it's CPU.
In general, SSD are about 100 times as fast as SAS drives in random IO. Some more. Depending on your requirements it is totally feasible to replace a RAID 10 of SAS with a RAID 5 of SSD and still get ahead - significnatly - both in IOPS as well as price.
Optimal stripe size is typical multiple of 64k - especially as SSD read / write in these segments anyway. TRIM is not necessarily needed then (no partial writes)... but it would be really nice to have that.
MS has some papars on SSD in databases which apply to oracle as well (same principle - optimizion IOPS). Oracle should have some, too.
Potential Issues
I have a couple points of issue with using SSDs for production databases at the present time
- The majority of database transactions on a the majority of websites are reads not writes. As Dave Markle said, you maximize this performance with RAM first.
- SSDs are new to the mainstream and enterprise markets and no admin worth his salt is going to move a production database that currently requires 15K RPM U320 disks in RAID5 communicating via fibrechannel to an unproven technology.
- The cost of the research and testing of moving to this new technology, vetting it in their environment, updating the operating procedures, and so forth is a larger up front cost, both in terms of time and money, than most shops have to spare.
Proposed Benefits
That said, there are a number of items, at least on paper, in favor of SSDs in the future:
- Lower power consumption compared to a HDD
- Much lower heat generation
- Higher performance per watt compared to a HDD
- Much higher throughput
- Much lower latency
- Most current generation SSDs have on the order of millions of cycles of write endurance, so write endurance is not an issue as it once was. See a somewhat dated article here
So for a given performance benchmark, when you factor total cost of ownership including direct power and indirect cooling costs, the SSDs could become very attractive. Additionally, depending on the particulars of your environment, the reduction in the number of required devices for a given level of performance could also result in a reduction of staffing requirements, reducing labor costs.
Cost and Performance
You've added that you have a cost constraint under $50K USD and you really want to keep it under $10K. You've also stated in a comment that you can get some "cheap" SSDs, eluding that the SSDs will be cheaper than the DBAs or consultants. This may be true depending on the number of hours you would need a DBA and whether it is a reoccuring cost or not. I can't do the cost analysis for you.
However, one thing you must be very careful of is the kind of SSD you get. Not all SSDs are created equal. By and large the "cheap" SSDs you see for sale in the $200-400 dollar (2008/11/20) are intended for low power/heat environments like laptops. These drives actually have lower performance levels compared to a 10K or 15K RPM HDD - especially for writes. The enterprise level drives that have the killer performance you speak of - like the Mtron Pro series - are quite expensive. Currently they are around:
- 400 USD for 16GB
- 900 USD for 32GB
- 1400 USD for 64GB
- 3200 USD for 128GB
Depending on your space, performance, and redundancy requirements, you could easily blow your budget.
For example, if your requirements necessitated a total of 128GB of available storage then RAID 0+1/10 or RAID 5 with 1 hotspare would be ~$5600
If you needed a TB of available storage however, then RAID 0+1/10 would be ~$51K and RAID 5 with 2 hotspares would be ~$32K.
Big Picture
That said, the installation, configuration, and maintenance of a large production database requires a highly skilled individual. The data within the DB and the services provided from that data are of extremely high value to companies with this level of performance requirements. Additionally, there are many things that just cannot be solved by throwing hardware at the problem. An improperly configured DBMS, a poor database schema or indexing strategy can /wreck/ a DB's performance. Just look at the issues Stackoverflow experienced in their migration to SQL Server 2008 here and here. The fact of the matter is, a database is a strenuous application on not only disk but RAM and CPU as well. Balancing the multi-variate performance issue along with data integrity, security, redundancy, and backup is a tricky bit.
In summary, while I do think any and all improvements to both the hardware and software technology are welcomed by the community, large scale database administration - like software development - is a hard problem and will continue to require skilled workers. A given improvement may not reap the labor reduction costs you or a company might hope for.
A good jumping point for some research might be Brent Ozar's website/blog here. You might recognize his name - he's the one who has assisted the stackoverflow crew with their MS SQL Server 2008 performance issues. His blog and resources he links to offer quite a bit of breadth and depth.
Update
Stackoverflow themselves are going the consumer SSD-based route for their storage. Read about it here: http://blog.serverfault.com/post/our-storage-decision/
References
Best Answer
A few things... I'm assuming this is a 64-bit edition of Windows Server 2003 and that your storage setup is a RAID 1 with online spare. Is there any chance Windows 2008 would manage resources better? This seems to be more of an application profiling problem. Are you assuming that using SSDs will help pagefile performance? Do you have any evidence that that's a bottleneck? How are things performing now? Why not try moving the pagefiles to a lower-cost SATA SSD to test the theory before jumping into enterprise SSD drives?
As to your question about the HP-branded SSD drives, the OEM is Sandisk/Pliant. These drives are extremely overpriced at the moment. To be honest, these disks require a deep queue in order to perform well. They fall short in performance in many of my applications. I would recommend a different drive for your application if you're concerned about the cost of the part number you noted. The best performance will come from a STEC-branded SSD, but at an even higher cost. A nice alternative that would run well under a variety of conditions is the Seagate Pulsar SAS SSD offering. The Pulsar.2 in 200GB is a great MLC drive that would come in at half the cost of the HP/Pliant disk.
Other notes... This server has an HP SmartArray P400 controller. It's only a 3G SAS controller. You may want to consider using a 6G-capable controller like the HP SmartArray P410 if you do end up using enterprise SSD drives. Also, do you have a battery-backed RAID cache on the existing controller?
Also, why replace the OS drives? You can add another logical drive comprised of the new disks.