Page History
Cloud Edition - Documentation
The above link will take you to comprehensive documentation outlining specifics about the Amazon Web Services platform as well as how lustre is deployed and used. For more direct instructions for getting started follow the Launching Cloud Edition on AWS instructions below.
Frequently Asked Questions (FAQ)
Our FAQ covers questions that we commonly get from customers. Check here first for general inquiries, then contact us directly if you still have questions regarding the product or usage.
Launching Cloud Edition on AWS
Step 1 - Subscribe to a Product Version
The first step in using CE on AWS is to navigate to the Amazon Marketplace and subscribe to the
product you will be using. The following products are available on the marketplace:
Subscribe: Cloud Edition -
Subscribe:
DDN-Whamcloud Lustre AMI is designed to be used with a CloudFormation template that defines all the resources needed by the Lustre filesystem. The templates provided below have a minimal number of a parameters to simplify deployment. To get started you only need to set the KeyName to your ssh-key, and set the LustreAZ to the specific Availability Zone in the region you are using. There is also a Filesystem Name parameter which defaults to "scratch" but this can be changed.
Launch: Cloud Formation Templates -
Launch:
Self Support (with Free Evaluation Instances)
Step 3 - Setup Client Machines to Mount Lustre
The final step is installing the Lustre client on each of the compute nodes. This will allow them to mount and connect to the Lustre filesystem.
Product Versions & Features
There are currently three product versions available on AWS. Below is a listing of the versions as well as the associated features.
Global
Premier Support (
HVM)8x5 U.S. - Pacific Time)
This The instance types that support hardware assisted virtualization (HVM) provide higher performance on AWS. Consequently, this product offering is our high-end option with support for both from the Lustre experts at Whamcloud. It includes IPSec over-the-wire encryption, EBS encryption, Enhanced Networking, and the C3 and C4 compute optimized instances as well as m4.10xlarge instances. Enhanced Networking provides SRIOV, which allows an physical device to be virtualized and connected directly to a virtual machine. This provides lower latency and more consistent performance.
Global Support
The Global Support offering is intended for use with HPC workloads. With HA and EBS storage enabled, this product can recover the filesystem after a Lustre server is terminated. In addition to supporting EBS for more resilient storage, this version also supports higher end instance types (M3) which enable a higher performance filesystem.
Community Version
The Community Version offering is an entry level product offered on Marketplace which can be used for proof-of-concept and development testing. We only offer ephemeral storage templates for this product, so our recommendation is to limit use to scratch filesystems (data will be lost if one of the Lustre servers is terminated). Support is not included with this version, so we recommend moving to a product which includes Global Support once you have evaluated the product.
Self Support (with T2 Evaluation Instances)
This product offering provides the same features as the Premier Support product, but without the included support from Whamcloud. It includes IPSec over-the-wire encryption, EBS encryption, Enhanced Networking, and C4, and M5 instances. Also includes Enhanced Networking (SRIOV), and provides lower latency and consistent performance.
The self support product can now be used with "Free Tier" T2 instances for product evaluation. Please note that performance of the T2 instances will be much lower than that of other instance types. Because of this, it's recommended that production performance analysis be done on C4 instances for best results.
| Features | Self Support | Premier Support (8x5) |
|---|---|---|
| Whamcloud Support | none | yes, 8x5 PST |
| Free Eval Instances | T2 | none |
| Std Instance Types | C4, M5 | C4, M5 |
| EBS Storage | yes | yes |
| EBS Encryption | yes | yes |
| IPSec Encryption |
| yes | yes | |
| VPC* |
| yes | yes |
| Enhanced Networking |
| * |
| * |
| yes | yes |
* Contact Intel Whamcloud support for information on using these features
** Enhanced Networking is only supported in VPC with C3 and I2 C4 instances
Support Details
Product versions containing Global Premier Support are supported by the Lustre * experts at Intel®Whamcloud. Product support includes 8x5 PST phone & email support for filing tickets as well as the latest software updates, patches, and fixes to ensure a stable, flexible, and robust storage environment that leverages the benefits of cloud-based infrastructure.
To
To file a support ticket:
- Or contact us by Email
- Or create a new support ticket
- directly by requesting a JIRA account and filing your ticket in the AWSP project
Please provide your name, AWS ID, contact information, and a description of your issue and : https://jira.hpdd.intel.com/secure/Dashboard.jspa and our support team will work to resolve your issue promptly. Please provide your Amazon ID and a description of the issue when filing a ticket.
For other questions please contact us at hpdd-cloud-lustre@intelinfo@whamcloud.com
Overview
Content Tools