Supermicro Introduces Rack Scale Total Solution for AI Storage

SAN JOSE, CA, Jan 28, 2024 – Supermicro, Inc., a total IT solution manufacturer for AI, cloud, storage, and 5G/Edge, is launching full stack optimized storage solution for AI and ML data pipelines from data collection to high performance data delivery. This new solution maximizes AI time-to-value by keeping GPU data pipelines fully saturated. For AI training, massive amounts of raw data at petascale capacities can be collected, transformed, and loaded into an organization’s AI workflow pipeline. This multi-tiered Supermicro solution has been proven to deliver multi-petabyte data for AIOps and MLOps in production environments. The entire multi-rack scale solution from Supermicro is designed to reduce implementation risks, enable organizations to train models faster, and quickly use the resulting data for AI inference.

Turn-Key Data Storage Solution for large scale AI training and inference

“With 20 PB per rack of high-performance flash storage driving four application-optimized NVIDIA HGX H100 8-GPU based air-cooled servers or eight NVIDIA HGX H100 8-GPU based liquid-cooled servers, customers can accelerate their AI and ML applications running at rack scale,” said Charles Liang, president and CEO of Supermicro. “This solution can deliver 270 GB/s of read throughput and 3.9 million IOPS per storage cluster as a minimum deployment and can easily scale up to hundreds of petabytes. Using the latest Supermicro systems with PCIe 5.0 and E3.S storage devices and WEKA Data Platform software, users will see significant increases in the performance of AI applications with this field-tested rack scale solution. Our new storage solution for AI training enables customers to maximize the usage of our most advanced rack scale solutions of GPU servers, reducing their TCO and increasing AI performance.”

For more information about the Supermicro Storage Solutions for AI, please visit https://www.supermicro.com/en/products/storage

Petabytes of unstructured data used in large-scale AI training processing must be available to the GPU servers with low latencies and high bandwidth to keep the GPUs productive. Supermicro’s extensive portfolio of Intel and AMD based storage servers is a crucial element of the AI pipeline. These include the Supermicro Petascale All-Flash storage servers, which have a capacity of 983.04* TB per server of NVMe Gen 5 flash capacity and deliver up to 230 GB/s of read bandwidth and 30 million IOPS. This solution also includes the Supermicro SuperServer 90 drive bay storage servers for the capacity object tier. This complete and tested solution is available worldwide for customers in ML, GenAI, and other computationally complex workloads.

The new storage solution consists of:

“The high performance and large flash capacity of Supermicro’s All-Flash Petascale Storage Servers perfectly complement WEKA’s AI-native data platform software. Together, they provide the unparalleled speed, scale, and simplicity demanded by today’s enterprise AI customers,” said Jonathan Martin, president at WEKA.

Learn More about All Supermicro Storage Systems.

*Raw value is based on vendor raw base capacity of 30.72TB. TB is base-10 decimal. Availability of 30.72TB E3.S SSD is subject to vendor availability.

About Super Micro Computer, Inc.

Supermicro is a global leader in application-optimized total IT solutions. Founded and operating in San Jose, CA, Supermicro is committed to delivering first to market innovation for enterprise, cloud, AI, and 5G Telco/Edge IT infrastructure. They are a Total IT Solutions manufacturer with server, AI, storage, IoT, switch systems, software, and support services. Supermicro’s motherboard, power, and chassis design expertise further enables their development and production, enabling next generation innovation from cloud to edge for their global customers. Their products are designed and manufactured in-house (in the US, Taiwan, and the Netherlands), leveraging global operations for scale and efficiency and optimized to improve TCO and reduce environmental impact (Green Computing). The award-winning portfolio of Server Building Block Solutions allows customers to optimize for their exact workload and application by selecting from a broad family of systems built from their flexible and reusable building blocks that support a comprehensive set of form factors, processors, memory, GPUs, storage, networking, power, and cooling solutions (air-conditioned, free air cooling or liquid cooling).

For more information, visit www.supermicro.com.