Versions Compared

Old Version 15

changes.mady.by.user Richard Henwood

Saved on

compared with

New Version Current

changes.mady.by.user Joseph Gmitter

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

In addition to the Lustre code, a number of tools exist to help maintain a Lustre filesystem. These are:

e2fsprogs

e2fsprogs is a set of utilities for maintaining ext2, ext3 and ext4 filesystems. Patches are available to enable e2fsprogs to work with Lustre filesystems.

Getting e2fsprogs

Lustre servers using ldiskfs require a customized the Lustre-specific version of e2fsprogs to create and check ldiskfs filesystems because of features that have not yet landed into the upstream e2fsprogs.   The filefrag utility included in the Lustre e2fsprogs is also useful on the client to report file block allocations for striped files (the standard filefrag utility can work with 1-stripe files).

Getting e2fsprogs

We recommend using the latest binary check filesystems. Binary, pre-built RPMs are available from the source and pre-built RPMs Whamcloud download site.

Installing e2fsprogs

e2fsprogs and e2fsprogs-libs must be simultaneously installed with rpm -U option. This is because you will almost certainly have an existing version of e2fsprogs will be installed.

Rebuilding e2fsprogs

If you need to rebuild the binary rpms for your system then you will need the source rpm (SRPM) and a Lustre source tree. The source RPM can then be rebuilt. The path to the Lustre source tree must be passed as an argument to rpmbuild:

:

Code Block
rpm -Uvh ./e2fsprogs-1.41.90.wc2-7.el6.x86_64.rpm  ./e2fsprogs-libs
No Format

$ rpmbuild -D "extra_config_flags --with-lustre=/path/to/lustre"  --rebuild e2fsprogs-1.41.90.wc2-7.el6.srcx86_64.rpm

lustre-tar

Lustre-tar is a modified version of tar, patched to work with a lustre filesystem.
NOTE RHEL6 version of tar includes these patches out-of-the-box. Thanks Redhat!enhance tar on a Lustre filesystem.
Whamcloud provide a tar 1.19 with specific patches.
These patches include:

  • Support for xattrs - necessary to record file and directory striping information.
  • fix for: --sparse fails to restore file names longer than 100 chars from PAX header LU-504.
  • Optimization for Lustre-tar on completely sparse files LU-682.

NOTE RHEL 6.{0,1,2} package a version of tar includes xattr patches necessary to record striping. However, depending on your use case, you may wish to use the Whamcloud build on RHEL 6.{0,1,2}.

Info
titletar from RHEL 6.3

The release of RHEL 6.3 includes tar version tar 1.26, which has support for backup and restore of xattrs and sparse files optimization. Using the RHEL 6.3 or later version of tar alleviates the needs for the Lustre-specific version available below.

Getting lustre-tar

Lustre-tar is available as source and pre-built x86 and x86_64 RPMs for RHEL and SuSE.

lustre-diagnostics

Lustre-diagnostics is a tool to that enables system debugging. The tool works by collecting relevant system and Lustre configuration information. The information is saved into a standard format.

Getting lustre-diagnostics

Lustre-diagnostics is available as source and pre-built RPMsfrom the Whamcloud download site. The code consists of a series of scripts.

...

Lustre-iokit is a suite of tools for benchmarking Lustre systems, from the underlying disks, to the OST filesystem, the network, through to the client.

Getting lustre-iokit

Lustre-iokit is available as an RPM from the source and pre-built RPMsThe installation and source rpms for lustre-iokit are available in the RPMS and SRPMS directories for each Lustre release, available from the Whamcloud download site.