Data-intensive workflows in Research, Government, Energy and Earth Sciences are driving analytics and modeling to extreme levels of fidelity in areas like materials modeling, ignition, brain mapping, climate studies, forecasting and more.
Exponential growth in data inputs is required to fuel every significant step taken to close the gap between a model and the physical world. This data growth profile puts storage infrastructure squarely in the critical path – driving requirements for extreme, dependable performance that scales.
Developed to overcome the toughest storage and data management challenges in extreme, data-intensive environments, DDN EXAScaler appliances scale up and/or out, leveraging a SSD-accelerated, hyper-converged, parallel architecture to deliver industry-leading performance and efficiency for HPC Big Data workflows.
EXTREME PERFORMANCE AND SCALE, NEW TECHNOLOGIES AND OPEN SOURCE
Researchers are the most demanding user community in HPC. To boost research productivity, advanced high performance sites are moving to centralized storage models. A centralized storage approach allows them to provide data access speeds to feed more concurrent projects at higher data rates, incorporate best-of-breed open source and new technology wherever possible, and improve cost-effectiveness and management overhead. A primary requirement when building centralized storage infrastructure is the power to grow to support site-wide data needs, even over multiple clusters or generations of clusters.
DDN EXAScaler – THE INDUSTRY’S MOST ADVANCED LUSTRE APPLIANCE
DDN builds on the experience of over a decade of Lustre development, system design, implementation and support to deliver the EXAScaler line of Lustre appliances. EXAScaler combines the industry’s most powerful storage architecture with the leading Lustre distribution, DDN integration tools, system monitoring tools and deep bench of Lustre experts across engineering, pre-sales and support. The result is the industry’s fastest, most advanced Lustre appliance, proven in the most demanding environments in HPC.
DDN ENTERPRISE LUSTRE DISTRIBUTION
DDN has been working with the core Lustre development team and delivering Lustre solutions for 15 years. To provide our end users with the best Lustre experience bar none, we build EXAScaler Enterprise Lustre Distribution on top of the supported community branch, hardening it for months through extensive automated testing to enhance stability, uptime, and performance. EXAScaler comes with a time-proven and tested approach to high availability in Lustre, and with an extensive set of tools that simplify deployment, maintenance, and support.
DDN is a very active member of the Lustre community and has contributed many performance, scalability and management features including development or lead test owner on all major features in the recent Lustre 2.10 release. DDN contributes all core Lustre enhancements to the community and has never forked Lustre. Because we can incorporate them in our own release faster, DDN developed features are often available to DDN customers exclusively for a period of time before they are incorporated into the main branch.
DDN EXAScaler - Moving Lustre Forward
At SC17, Carlos A Thomaz of DDN provides an update for DDN EXAScaler and an overview of where Lustre is headed. He also touches on key DDN contributions for Lustre, and how DDN is enhancing its reliability, resiliency, uptime, internal development and support capabilities.
Webinar: Lustre’s Road Ahead
Watch this webinar recording to discover what DDN is doing with Lustre: from substantial features, tools, and Enterprise support to how we're working closely with the Lustre community.
EXAScaler Configurations & Specifications
EXAScaler is factory built-to-order parallel file system and arrives to your data center, tuned, optimized and ready to deploy. Below you will find more information on the components that make-up the solution and allow for flexibility in configuration. Our team of Sales Engineers and Solution Architects will work with you to create the exact configuration that meets your environment’s unique performance, capacity and business requirements.
ES200NV™ and ES400NV™
- 100% NVMe storage with multiple high-speed connectivity options
- Sequential read performance up to 48GB/s
- Sequential write performance up to 25GB/s
- Up to 1.5M IOPs per appliance
- Sequential read performance up to 24GB/s
- Sequential write performance up to 20GB/s
- Up to 700,000 IOPs per appliance
- Easy to deploy server-less, embedded Lustre Parallel File System Appliance
- Performance for mixed workloads: Up to 61GB/s per Appliance
- Starts under 100TB, scales to 12PB per Rack
- Multiple systems support over 1TB/s and dozens of Petabytes
- The world’s most advanced Lustre appliance
- Performance: Up to 50GB/s per Base Enclosure
- Capacity: Up to 17.5PB of capacity in just 2 racks
- Scale: Start under 100 TB and scale to 100s of PB
EXTERNAL SERVER Choices
The power of the Lustre File System in a flexible configuration of 1U servers
|Protocols||Linux and Windows Parallel FS Clients|
|Lustre||IDDN Enterprise Lustre, based on Lustre 2.10|
|Performance||Up to 55GB/s (with ES14KX)|
|Metadata||Supports embedded metadata servers on DDN SFA Appliances, or external scale-out metadata server using Lustre DNE|
|Host Connectivity||EDR InfiniBand, 40/100GbE, and Omnipath (number of connections varies by appliance)|
|Data and System Management||Quotas (users and groups); Optional DDN Insight monitoring solution; Optional automatic data migration form any file system to any storage device; Optional Policy-based tiered storage and data migration with mirroring, replication, encryption|
|Custom Configurations||Custom configurations of EXAScaler are available with external OSSs|