Today, the performance demanded by applications and computing has outpaced the performance delivered by storage technologies, creating storage and file system I/O bottlenecks.
As the speed and scale of environments and applications grow, the negative effects of I/O contention and latency are magnified. In HPC, the parallel file system bottleneck has been so significant, — it has prevented clustered compute environments from being able to realize the significant acceleration that wide deployments of SSDs have provided most other workloads.
Because of that, spinning disk drives remain the primary way HPC sites provision the massive amounts of bandwidth and IOPS performance required by performance-intensive applications. This approach is highly inefficient, often resulting in an overprovisioning of capacity as well as hardware sprawl.
Additionally, there’s a number of other factors that can bring the performance of entire compute clusters and their parallel file systems to their knees: mixed I/O, fragmented data patterns of “problem applications,” and large datasets that force applications to run out of core.
IME DELIVERS A GAME CHANGING, TECHNOLOGICAL BREAKTHROUGH
To combat these challenges, DDN IME revolutionizes how information is saved and accessed by compute. IME software allows data to reside next to compute in a very fast, shared pool of non-volatile memory (NVMe).
This new data adjacency significantly reduces latency by allowing IME software’s revolutionary, fast data communication layer to pass data without the file locking contention inherent in today’s parallel file systems.
To ease integration, IME utilizes common protocols, making it transparent to both applications and the parallel file system. Therefore, IME requires no code modifications.
IME IS A POWERFUL BURST BUFFER AND A MULTI-DIMENSIONAL SOLUTION, DESIGNED TO DELIVER NEW ACCELERATION & EFFICIENCIES
With IME, large scale, data-intensive environments now have the tools to leverage untapped compute cycles and are able to run more applications. This increase of efficiency and performance is achieved by minimizing I/O bottlenecks and accelerating applications and file systems; all while reducing the erratic performance often found within storage clusters.
- A Write Accelerating Burst Buffer absorbing the bulk application data into the IME14K NVMe solid state cache significantly faster than the file system can absorb it
- A File System Accelerator and Application Optimizer as IME reorders application I/O to optimize flushing the cache to long term storage (enabling purchasing as little expensive cache possible).
- A Read-optimized Application-I/O Accelerator that enables out-of-band API configuration of the IME appliance to optimize both reads and writes, allowing more simultaneous job runs, shortening the job queue and enabling significantly faster application run time to the user. The API integrates IME with the job schedulers and pre-stages / warms the cache for new jobs, accelerating first read.
IME14KX™ RACK SCALE FLASH ARRAY ZERO-COMPROMISE, PERFORMANCE-FIRST DESIGN PHILOSOPHY
The IME14KX is built upon our newest high-performance, hyper-converged SFA14K® hardware platform, which utilizes the industry’s newest components to maximize I/O performance. The result is high-speed tiering with non-volatile local and distributed memory pools, leveraging new multi-core processors, interconnects and memory technology. The IME14KX also incorporates the industry’s most extensive collection of PCIe fabric with a non-blocking architecture that is purpose-built to accelerate I/O and to maximize the performance acceleration of both the IME intelligent software and NVMe SSDs.
This highly innovative solution is designed to achieve significantly higher efficiency from applications, workflows, and computing environments by intelligent and predictive tie-ins to job scheduling services.
Each IME14KX can be configured to start with a small number of NVMe drives and scale up to 48NVMe SSDs, delivering an expected performance of starting at 10GB/sec for entry performance and scaling up to 50GB/sec in each 4U appliance. Scale multiple appliances to provide multiple TB/s of bandwidth to the most data intensive workloads on the globe.
IME240™ I/O PERFORMANCE-OPTIMIZED COMMODITY SERVER THE START SMALL, SCALE-OUT BUILDING BLOCK FOR IME SOFTWARE
The IME240 utilizes a standard 2U commodity storage server chassis that has been modified to remove I/O-performance-blocking components and adds ultra low latency InfiniBand connectivity. This platform has been tested and verified for compatibility.
The IME240 allows sites to realize the benefits of accelerating I/O, applications and file systems that IME delivers, but in a smaller 20GB/s bandwidth building block than the IME14K (listed in the section above)
Now, for environments that want the maximum deployment flexibility, IME is available as software only. IME software-only is ideal for those environments with IT-based limitations on supported hardware; that want the flexibility to repurpose existing hardware; and that have open-platform requirements. Most importantly, whether you decide to use IME14KX, IME240, or software-only, IME is the industry’s only burst buffer that is not locked into a specific server or storage hardware vendor. With DDN’s IME, the choice is yours.
3 POWERFUL, BUT SIMPLE BENEFITS
SPEEDS TIME TO RESULTS
Speeds Time to Results by accelerating workflows, applications and bottlenecked I/O.
INCREASES COMPUTE ROI
Increases Compute ROI by eliminating I/O wait times that can now be utilized for more computation.
EASES DATA GROWTH
Eases Data Growth by reducing traditional storage hardware.