Versions Compared

Old Version 16

changes.mady.by.user Andreas Dilger

Saved on

compared with

New Version Current

changes.mady.by.user Keith Mannthey

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

A Lustre filesystem uses modified versions of e2fsprogs and tar. Managing a large Lustre filesystem is a task that is simplified by community and vendor supported tools. Details of these tools are available at the COMMUNITY PAGE OF THE WIKI

Practical considerations.

Lustre currently has two actively developed and maintained branches. These the are 1.8.x and 2.1 releases. Lustre 1.8.x is used in production environments around the world. It is mature and stable. Lustre 2.1 introduces SMP scaling enhancements to exploit machines with large numbers of sockets, cores and threads.  There are also feature releases of Lustre that are available to try out new features of Lustre, but will not have long term maintenance releases.

The Metadata Server (MDS) is crucial to overall performance of the Lustre filesystem. Increasing memory on the MDS will increase the cache available and increase performance for filesystems with many files. It is common to see production MDS machines boast 24GB or 48GB per core.

If your environment is biased toward heavy write, or fast write operations, 16GB is recommenced per Object Storage Server (OSS). If reading is of primary concern, increasing OSS memroy to 48GB will enable significant read caching and greatly increase performance.

Further reading

...