Hard disk performance is limited by mechanical parts velocity and there is no solution for this issue.

Servers are using RAID for redundancy and for performance. Thanks to RAID technology it is possible to scale single hard disk performance.

The team of disks works faster, but applications are needing increased improvements as over periods technical evolutions.

There are storage offers using DDR RAM or SLC Flash that claim 2-20 GB/s throughput or 100K to millions of random IO/sec

But the cost of such systems are extremely high.

Recently RAID controller vendors like LSI and Adaptec offer SSD cache options. If the applications require higher random IO/sec such solutions are worth looking into.

Adaptec claims 8 times faster IO than HDD-only arrays.

LSI claims even 50 times faster IO. They have simulated web servers that re-read hot spot activity. With CacheCade enabled reached at 14,896 IO/sec and compared to 273 IO/sec with disabled CacheCade.

Such SATA/SSD hybrid can significantly  improve applications with random IO patterns. They work with single SSD as a minimum , the solution is relatively inexpensive.

Adaptec maxCache™ 64GB SSD Cache Performance Kit SRP = $1,795

And  LSI CacheCade software pack has a suggested retail price of $270 plus X25-E Extreme 64GB cost $700 makes about $1,000.

Very interesting will be to know what kind of random IO/ps can be reached if we use SSD only.  We have created RAID 5 with 4 * INTEL X25-M SATA SSD. The RAID 5 was fully initialized then the IOmeter test was started.

Results below:

RAID 5 with 4* INTEL X25-M SATA SSD 120GB

Transfer Request Size Percent Sequential Percent Random Percent Write Percent Read MB / second IO / second
2KB 0 100 100 0 17 8707
2KB 0 100 0 100 40 20266
4KB 0 100 100 0 29 7259
4KB 0 100 0 100 56 14266
64KB 0 100 100 0 99 1580
64KB 0 100 0 100 220 3524

In order to be in a position to appreciate the above results we have run the same test pattern with RAID 5 with 12 * HDD SAS 15K (SEAGATE ST373455SS )

Results below:

RAID 5 with 12* SAS 15K

Transfer Request Size Percent Sequential Percent Random Percent Write Percent Read MB / second IO / second
2KB 0 100 100 0 4.4 2300
2KB 0 100 0 100 4.8 2470
4KB 0 100 100 0 8.4 2220
4KB 0 100 0 100 10 2630
64KB 0 100 100 0 72 1140
64KB 0 100 0 100 98 1570

So:

Random Write IO/sec with 2k block is 3.8 times better
Random Read IO/sec with 2k block is 8.2 times better
Random Write IO/sec with 4k block is 3.3 times better
Random Read IO/sec with 4k block is 5.4 times better

and:

Random Write MB/sec with 2k block is 3.9 times better
Random Read MB/sec with 2k block is 8.3 times better
Random Write MB/sec with 4k block is 3.5 times better
Random Read MB/sec with 4k block is 5.6 times better

And the comparison was not quit fair because the HDD array has 12 drives and SSD array only 4.

We are using cheaper (MLC) non-enterprise version of the SSD. The main problem with MLC SSD is the write endurance which is about 11TB for 120GB drive and 15TB for 160GB.

If drives are in a RAID 5 the write endurance can be multiplied by n-1. Also there is option to leave some spare space for the Wear Leveling mechanism. For example 10% reserved space expands write endurance by 2.8 times.

So 4 * 160GB SSD in RAID 5 with 10% reserved space = 3 (n-1)  * 2.8 * 15 TB = 126 TB write endurance. If your application is not needing heavy duty write orientations then you can consider it for production.

If the application is heavy duty write oriented you need to consider Enterprise SSD. Here is the write endurance comparison:

Model Endurance Price
INTEL X25-M SATA SSD 120GB 15 TB $400
INTEL X25-E Extreme 32GB 1 PB (1024 TB)
$370
INTEL X25-E Extreme 64GB 2 PB ( 2048 TB)
$720
WD SiliconDrive N1x 128 GB 701 GB/day $1500

How much is 15TB. Sustain write 24/7 with 20MB/sec, so 15TB will be written in about 9 days.

How much is 2PB. Sustain write 24/7 with 20MB/sec, so 2PB will be written in about 3.4 years.

The RAID 5 array with 4 * Intel X25-E 64GB drives will cost $2880 and is about $15 per GB.

The RAID 5 array with 4 * Intel X25-E 120GB drives will cost $1600and is about  $4.4 per GB.

In comparison to 15k SAS HDD, the RAID 5 array with 4 * Seagate 148GB (15k) makes 4 * $300 = $1200  and is about $1.3 per GB.

This shows about 12 times more expensive but at least 3 to 8 times faster with random IO.

We did not test the enterprise SSD but mainstream SSD only. The random IO with enterprise SDD would be even better.

7 Comments

  • Aadam /

    12, 02 2018 10:15:26

    SSD is quite expensive compared to hard disk but in the coming generations, SSD will be quite common.
    Anyways, Good explanation though.

    Reply

Leave a Comment