RAIDIX Based Storage Implemented in RIKEN Center of Computational Sciences (Japan)

November 20, 2018

With its storage solutions, consolidated efforts of RAIDIX and Core Micro Systems add more potential to computing environment giving more opportunities to knowledge intensive industries.

So far the largest RAIDIX based storage (Core Micro Systems Integrated Storage Appliance/HyperSTOR Flex) consists out of 11 high-availability clusters. Total volume of the project is outstanding: 65PB, including 51.4PB of usable volume relying on 6 512 drives, 10TB capacity each. The storage system is loaded with data originated by High Performance Computing Infrastructure, implemented as part of massive Japanese project named Academic Cloud accelerating countrywide exchange of academic data.

Active phase of the project took about 12 months of hard work by Core Micro Systems specialists and RAIDIX team — the project was developed throughout a year followed by thorough supervision on the matter of stability for another year. Results obtained matched targeted values and now we might report this project successful and present team victory, much significant for us.

RIKEN Center for Computational Science storage was considered to have not less than 50PB of usable storage due to hyper productivity of computing landscape. Severe requirements to storage access speed were established in order to ensure effective joint access to HPCI environment.

The actual deployment of the system ran smoothly and was divided into two stages. Core Micro Systems engineers carried out each stage of testing very carefully and accurately, gradually increasing system scale. First phase of deployment was completed in August 2017: that time the system volume reached 18PB. Second phase was implemented the same year in October with the system volume increasing up to record 51PB.

RAIDIX based storage was integrated with Gfarm file system that hosts HPC Infrastructure. Gfarm creates virtual file system using resources of multiple storage servers and basically unifies disparate storage clusters into single name space for joint access. Not only the developing team managed to build scalable storage in conjunction with Gfarm but also expand other functional characteristics of the software. Thus, it was crucial to develop and implement technology of Automatic Write-Through as soon as possible in order to meet requirements of technical specifications.

RAIDIX demonstrated consistently high performance and efficiency that was proved by long tests, inspections and modifications. Success in implementation of such long and laborious project was feasible by collaborative work with Core Micro Systems team and close interaction of all participants of the project.

About the project

HPCI is powered by SINET (The Science Information Network) which is the baseline network for exchanging scientific data between Japanese universities and research centers. Currently SINET brings together about 850 colleges and universities, creating enormous opportunities for information exchange in the fields of nuclear physics, astronomy, surveying, seismology and computer science. It aligns with the concept of united information space, where HPC professionals from different research centers have access to HPC recourses, used for fundamental, theoretical and applied tasks.

Core Micro Systems Inc. supplies server hardware, storage systems and virtualization solutions for companies in various industries. The company is leading RAIDIX strategic partner & exclusive distributor in Japan.

Raidix develops software for data storage systems being used in 30 + countries around the world. RAIDIX software is a great tool to accelerate workflow in enterprise businesses, video production companies, HPC and other industries.