Scaling to tens of petabytes and thousands of clients – considered a best file system for storage by many – Lustre is a high performance storage architecture for clusters. The central component of this architecture is the Lustre shared file system, which is currently available for Linux, providing a POSIX-compliant UNIX® file system interface. RAID Inc. offers custom Lustre solutions with installation & 24/7 support.
Today, HPC is a key technology for enterprises of all sizes. Getting maximum performance from HPC and data-intensive applications is a necessity that requires storage infrastructure that scales endlessly and delivers unmatched I/O levels. In partnering with DDN Enterprise Edition for Lustre software, RAID Inc. unleashes the performance and scalability of the Lustre parallel file system for HPC workloads, including technical ‘big data’ applications.
RAID Inc.'s Lustre FS offers unparalleled scalability with tens of petabytes and thousands of clients – a high performance file system virtually without limits.
The scalability offered by Lustre deployments has made them popular in the oil and gas, manufacturing, rich media, and finance sectors. Most interestingly, a Lustre file system is used as a general-purpose, datacenter back-end file system at a variety of sites, from Internet service providers (ISPs) to large financial institutions. With upcoming enhancements to wide-area support in Lustre networking (LNET) and storage software, the deployments in these market segments should become even more important.
Lustre file system high availability features include a robust failover and recovery mechanism, making server failures and reboots transparent. Version interoperability between successive minor versions of the Lustre software enables a server to be upgraded by taking it offline (or failing it over to a standby server), performing the upgrade, and restarting it, while all active jobs continue to run, experiencing a delay while the backup server takes over the storage. Lustre to also reduces the need to deploy many separate file systems, such as one for each cluster. Lustre HSM provides capability to have a primary tier and an archive tier of storage. The ability to migrate things from the, typically more expensive, primary tier to the, typically less performant, archive tier and leave a stub so that files can be restored to primary is an important part of balancing high availability and performance.
The Lustre architecture was first developed at Carnegie Mellon University as a research project in 1999 and experienced groundbreaking I/O performance as soon as it went into production. Lustre FS is developed and maintained as open source software with an open networking protocol and POSIX file system semantics, ensuring broad support for industry-standard platforms and heterogeneous networking environments. Because Lustre software is open source software, it has been adopted by a number of other computing companies and integrated with their offerings. Both Red Hat and Novell (SUSE) offer kernels with Lustre patches for easy deployment. Some 10,000 downloads of Lustre software occurs every month. Hundreds of clusters supported Lustre software, with probably many more unsupported installations.
Storage Systems with Lustre File-System
Enterprises are focused on addressing challenges with data that is expanding at a faster rate like never before. It has become a challenge for industries to perform data utilization at speeds that help faster innovation. Those that can deliver insights faster while managing rapid infrastructure growth are the leaders in their industry. An organization’s underlying storage must support both new-era big data and traditional applications with security, reliability and high-performance. RAID Inc. storage systems optimizes Lustre FS to meet your specific HPC needs and challenges. As a high-performance solution for managing data at scale with the distinctive ability to perform archive and analytics in place.
Case Studies & Other Resources
To deliver our tailored HPC solutions, RAID Inc.'s consultative sales and system design process is customized every step of the way. From the initial sales call to installation day, RAID Inc. works closely with clients to assess their unique computing and storage requirements by examining every facet of their computing needs. To learn more about our
6-Step Holistic Approach, click here.