Hard disk performance is limited by mechanical parts velocity and there is no solution for this issue.
Servers are using RAID for redundancy and for performance. Thanks to RAID technology it is possible to scale single hard disk performance.
The team of disks works faster, but applications are needing increased improvements as over periods technical evolutions.
There are storage offers using DDR RAM or SLC Flash that claim 2-20 GB/s throughput or 100K to millions of random IO/sec
But the cost of such systems are extremely high.
Recently RAID controller vendors like LSI and Adaptec offer SSD cache options. If the applications require higher random IO/sec such solutions are worth looking into.
Adaptec claims 8 times faster IO than HDD-only arrays.
LSI claims even 50 times faster IO. They have simulated web servers that re-read hot spot activity. With CacheCade enabled reached at 14,896 IO/sec and compared to 273 IO/sec with disabled CacheCade.
Such SATA/SSD hybrid can significantly improve applications with random IO patterns. They work with single SSD as a minimum , the solution is relatively inexpensive.
Adaptec maxCache™ 64GB SSD Cache Performance Kit SRP = $1,795
And LSI CacheCade software pack has a suggested retail price of $270 plus X25-E Extreme 64GB cost $700 makes about $1,000.
Very interesting will be to know what kind of random IO/ps can be reached if we use SSD only. We have created RAID 5 with 4 * INTEL X25-M SATA SSD. The RAID 5 was fully initialized then the IOmeter test was started.
Results below:
RAID 5 with 4* INTEL X25-M SATA SSD 120GB
Transfer Request Size | Percent Sequential | Percent Random | Percent Write | Percent Read | MB / second | IO / second |
2KB | 0 | 100 | 100 | 0 | 17 | 8707 |
2KB | 0 | 100 | 0 | 100 | 40 | 20266 |
4KB | 0 | 100 | 100 | 0 | 29 | 7259 |
4KB | 0 | 100 | 0 | 100 | 56 | 14266 |
64KB | 0 | 100 | 100 | 0 | 99 | 1580 |
64KB | 0 | 100 | 0 | 100 | 220 | 3524 |
In order to be in a position to appreciate the above results we have run the same test pattern with RAID 5 with 12 * HDD SAS 15K (SEAGATE ST373455SS )
Results below:
RAID 5 with 12* SAS 15K
Transfer Request Size | Percent Sequential | Percent Random | Percent Write | Percent Read | MB / second | IO / second |
2KB | 0 | 100 | 100 | 0 | 4.4 | 2300 |
2KB | 0 | 100 | 0 | 100 | 4.8 | 2470 |
4KB | 0 | 100 | 100 | 0 | 8.4 | 2220 |
4KB | 0 | 100 | 0 | 100 | 10 | 2630 |
64KB | 0 | 100 | 100 | 0 | 72 | 1140 |
64KB | 0 | 100 | 0 | 100 | 98 | 1570 |
So:
Random Write IO/sec with 2k block is | 3.8 | times better |
Random Read IO/sec with 2k block is | 8.2 | times better |
Random Write IO/sec with 4k block is | 3.3 | times better |
Random Read IO/sec with 4k block is | 5.4 | times better |
and:
Random Write MB/sec with 2k block is | 3.9 | times better |
Random Read MB/sec with 2k block is | 8.3 | times better |
Random Write MB/sec with 4k block is | 3.5 | times better |
Random Read MB/sec with 4k block is | 5.6 | times better |
And the comparison was not quit fair because the HDD array has 12 drives and SSD array only 4.
We are using cheaper (MLC) non-enterprise version of the SSD. The main problem with MLC SSD is the write endurance which is about 11TB for 120GB drive and 15TB for 160GB.
If drives are in a RAID 5 the write endurance can be multiplied by n-1. Also there is option to leave some spare space for the Wear Leveling mechanism. For example 10% reserved space expands write endurance by 2.8 times.
So 4 * 160GB SSD in RAID 5 with 10% reserved space = 3 (n-1) * 2.8 * 15 TB = 126 TB write endurance. If your application is not needing heavy duty write orientations then you can consider it for production.
If the application is heavy duty write oriented you need to consider Enterprise SSD. Here is the write endurance comparison:
Model | Endurance | Price |
INTEL X25-M SATA SSD 120GB | 15 TB | $400 |
INTEL X25-E Extreme 32GB | 1 PB (1024 TB) |
$370 |
INTEL X25-E Extreme 64GB | 2 PB ( 2048 TB) |
$720 |
WD SiliconDrive N1x 128 GB | 701 GB/day | $1500 |
How much is 15TB. Sustain write 24/7 with 20MB/sec, so 15TB will be written in about 9 days.
How much is 2PB. Sustain write 24/7 with 20MB/sec, so 2PB will be written in about 3.4 years.
The RAID 5 array with 4 * Intel X25-E 64GB drives will cost $2880 and is about $15 per GB.
The RAID 5 array with 4 * Intel X25-E 120GB drives will cost $1600and is about $4.4 per GB.
In comparison to 15k SAS HDD, the RAID 5 array with 4 * Seagate 148GB (15k) makes 4 * $300 = $1200 and is about $1.3 per GB.
This shows about 12 times more expensive but at least 3 to 8 times faster with random IO.
We did not test the enterprise SSD but mainstream SSD only. The random IO with enterprise SDD would be even better.
7 Comments
Aadam /
12, 02 2018 10:15:26SSD is quite expensive compared to hard disk but in the coming generations, SSD will be quite common.
Anyways, Good explanation though.