Toshiba & Open-E’s Long-Lasting Data Storage Setup

The Technology Experience Lab at NTT Global Data Centers provides data center managers and their teams the room and infrastructure to explore innovative approaches to building servers and storage for their clients. It enables businesses to evaluate the efficacy of private or hybrid clouds, distributed architectures, and alternative methods of delivering IT services in a low-risk environment. Its community of users also provides support and ideas through meetups, boot camps, webinars, and hackathons.

Back in 2017, there were several challenges that needed to be faced:
  • The desired net storage had to have 102TB.
  • The raw storage had to have 240TB.
  • The system had to use ZFS.
  • The software had to offer high availability, no single point of failure, and high flexibility, with consistent snapshots and instant restore points when required.
  • The hardware to support it had to be reliable and high-performing to take full advantage of the software and had to support several iSCSI block storage targets ranging from 10TB to 40TB, some with shared file folders.
case-study brochure icon
Download full Case Study

.PDF file, 666.1 KB

The Chosen Solution

To find something that matched all the requirements, NTT Global Data Centers turned to Open-E’s partner, Toshiba, for a solution. In order to form the 102TB of net storage necessary, the team selected Toshiba’s 4 TB, 3.5″ SAS Enterprise Capacity Drives. Open-E JovianDSS was chosen as the supporting software. The MTTF (mean time to failure) of the hardware, 1,400,000 hours, and a non-recoverable error rate of just ten errors per 1016 bits read were ideal for achieving the reliability required. The 7,200 rpm drives achieved a Zpool read performance rating of 12.9 x single disk and 8.5 x single disk for writes. For the ZFS write logs and read caches, reliable 10 DWPD, SAS Enterprise SSDs with 1.6 TB storage from KIOXIA (formerly Toshiba Memory) were selected.

Metro High Availability Failover Cluster Solution

To oppose the HDDs’ heat, AIC’s J4060-01 Dual Expander, 12 GB/s, 60 bay toploader JBOD was chosen. The 1400 W 1+1 hot-swap redundant 80+ Platinum power supply ensured electrical efficiency while also fulfilling the reliability requirements.The four 80 x 38 mm hot-swap fans in the JBOD made certain that the system never showed more than just a 4°C difference between the coolest and warmest drive temperatures. The Microchip Adaptec® RAID Adapter ASR-8885 provided connectivity to the JBOD with 8 internal and 8 external ports, run in HBA mode. This model was highlighted as a top choice back in 2017.

Achieved Results

The system has been running failure-free for four years now and is still going. The plan is to continue running the system to explore its reliability further – even a year after the supplier warranty ends for most of the enterprise-grade hardware components. Based on over 20 years of Open-E’s general experience as well as its specific experience gained in the field with Toshiba Enterprise HDDs, the team expects that the storage unit will have many more years of failure-free functionality to offer its owner.

Hardware details

Configuration
Server: Supermicro X10 Series Server, 2U
Power supply: 1400 W 1+1 hot-swap redundant 80+ Platinum power
Processor: 2x Intel® Xeon® Series CPU
RAM: 128GB RAM, Registered ECC
HBA: 8 x internal 8 x external ports Microchip Adaptec® RAID Adapter ASR-8885
Network interfaces: 10Gbit/sec RJ45 Ethernet, 2 x Supermicro AOC-STG-I2T Network Card, 10Gbit/sec RJ45 Ethernet, X540 chip
Read Cache: 2x 1.6TB Enterprise SSD
Write Cache (ZFS Intent Log): 2x 1.6TB Enterprise SSD

Storage configuration

Licence: Open-E JovianDSS
Features: Single Node
JBOD: AIC’s J4060-01 Dual Expander, 12 GB/s, 60 bay toploader
HDD: 60x Toshiba HDD MG04SCA40EA, 4TB 7200rpm SAS 12GB/s
zPool: 30 x 2-way Mirror (2 Discs per group)
Spare storage capacity: 10x KIOXIA DWPD SAS Enterprise SSDs with 1.6 TB

About Toshiba

Toshiba is a world leader and an innovator in pioneering high technology. It is a diversified manufacturer and a marketer of advanced electronic and electrical products spanning from information & communications systems to digital consumer products. It’s also involved in electronic devices and components, power systems, industrial and social infrastructure systems as well as home appliances. Toshiba Electronics Europe GmbH, Storage Products Division, in Düsseldorf, Germany, markets hard disk drives with a particular focus on consumers and retailers in Europe. For over 50 years, Toshiba has been developing and manufacturing storage solutions used by most major IT and consumer electronics brands.

About NTT

Global Data Centers is a division of NTT Ltd. Their global platform is one of the largest in the world. NTT is ranked as one of the top three leaders worldwide by IDC in their Colocation and Interconnection Services MarketScape, which spans more than 20 countries and regions including North America, Europe, Africa, India and the APAC. As a neutral operator, they offer access to multiple cloud providers, a large variety of Internet Exchanges and a plethora of telecommunication network providers including their own IPv6 compliant, tier 1 global IP network. Their clients benefit from tailored infrastructure and experience consistent best practices in design and operations across all of their reliable, scalable and customizable data centers.

Give us your feedback