SCALE-OUT, FLASH-NATIVE
DATA CACHE COST-EFFECTIVELY
SOLVES I/O SCALE &
BOTTLENECK CHALLENGES

PRODUCT FAMILY

Infinite Memory Engine®

BREAK FREE FROM THE CHALLENGES AND INEFFICIENCIES CAUSED BY I/O BOTTLENECKS

CONFIG & SPECSHOW TO BUY

DDN’s Infinite Memory Engine® (IME®) is a scale-out, software-defined, flash storage platform that streamlines the data path for application I/O. IME interfaces directly to applications and secures I/O via a data path that eliminates file system bottlenecks. With IME, architects can realize true flash-cache economics with a storage architecture that separates capacity from performance.

THE NEED FOR A NEW APPROACH TO FAST I/O

Several key factors, both technological and commercial are creating demand for a new approach to high performance I/O. New non-volatile memory (NVM) device technologies are proliferating and media capacities are increasing rapidly. Diverse many-core processor strategies are pushing higher I/O volumes and more demanding I/O profiles. A new generation of high-business-value markets are taking advantage of analytics and machine learning and further stressing performance boundaries. Traditional file systems only crudely manage flash at scale whereas HDD performance degrades as concurrency increases. IME introduces a new layer, above the file system that:

  • Maximizes flash media performance and longevity
  • Improves the efficiency of network and storage through adaptive I/O and data coalescing
  • Efficiently feeds the diverse I/O requirements of modern workloads and mixed CPU/GPU environments
  • Delivers the data rates needed across commercial analytics in machine learning

IME delivers predictable job performance, provides faster computation against data sets too large to fit in memory, accelerates I/O-intensive applications and provides a safe, cost and space-efficient landing space for bursty data.

RESOURCES

Icon

DDN IME: Overcoming Flash Performance Barriers At-Scale
Icon

IME Datasheet

Modern workloads in AI, Big Data and HPC are creating demand for a new approach to high performance storage. DDN’s Infinite Memory Engine (IME®) is the first and only scale-out, software-defined file system that streamlines the data path for application I/O. IME software interfaces directly to applications and secures your data via a data path that eliminates file system bottlenecks. With IME, architects can realize true flash-cache economics with a storage architecture that separates capacity from performance.

Icon

IME Whitepaper: Scale-Out Storage Cache for the Flash Era

VIEW ALL RESOURCES

IME is well suited for a variety of use cases

  • Machine Learning and Analytics: Massive, flash cache with over 600K read IOPs in 2U and 20GB/s to support large scale data sets at speed
  • Application Ensembles: Multiple, simultaneous applications use cache to support communication throughout the job
  • Application Workflows: Cache stores a common dataset used by a succession of independent applications
  • In-situ Analysis: Real-time output of an application’s data in cache analyzed in-situ
  • Application Pre-Processing: Pre-processing job places output in cache, ready for main run
  • Application Post-Processing: Main run outputs to cache, post-processing commences in-situ
  • Checkpointing: Stores checkpoints faster than a parallel file system and keeps them in cache to support restarts

IME Test Beds and Major Deployments

jcahpc-210
ornl-210
ichec-210
tacc-210
tokyoTech-210
julich-210
kisti-210
cscs-210
sdsc-210
ncar-210
nersc-210
ohio-210
univ-tokyo-210
agronne-210
  • Software-Defined Flash Platform
  • Scale-Out Cache from TBs to PBs
  • Reduces Performance Infrastructure Footprint
  • Removes File System Bottlenecks
  • Delivers Predictable Run Times
  • Accelerate One Application or all I/O
  • Compute, Storage, and Network Agnostic
  • Supports Infiniband, Omni-Path, and Ethernet
  • Flexible Data Protection Options

IME DEPLOYMENT OPTIONS

ime-software-box-r

IME SOFTWARE-ONLY

For environments that want the maximum deployment flexibility, IME is available as software-only. IME software-only is ideal for those environments with IT-based limitations on supported hardware; that want the flexibility to repurpose existing hardware; and that have open-platform requirements. Most importantly, whether you decide to use IME240, or software-only, IME is the industry’s only flash-native cache that is not locked into a specific server or storage hardware vendor. With DDN’s IME, the choice is yours.

IME240-Front-View
ime140-front

I/O PERFORMANCE-OPTIMIZED COMMODITY SERVERs

For an integrated appliance, DDN offers the IME140™ and IME240™. The IME240 is built on a best-of-breed 2U commodity storage server that delivers over 20GB/s of bandwidth and over 1M IOPs direct to applications. IME240 has up to 23 NVMe SSD drives for data and flexible N+K erasure coding. The IME140 supports extreme file performance in a small 1U flash data appliance. Each appliance can deliver more than 11GB/s write and 20GB/s read throughputs and more than 1M file IOPs (read and write). Starting with a resilient solution as small as 4 units, the IME140 allows organizations to cost-effectively scale performance independent of amount of capacity required.

SPECIFICATIONS