The Lustre file system is a distributed parallel file system designed to let many compute clients access a shared file namespace and large datasets. It separates namespace and file metadata operations from bulk file-content transfer. A Lustre metadata server manages naming and metadata on metadata targets; a Lustre object storage server serves data objects on object storage targets. Clients use the metadata to locate file content and then communicate with the storage services.[ref]
A large file can be striped over several storage targets, letting different portions be transferred in parallel. This differs from making independent copies: the stripe layout distributes pieces of one file. Aggregate bandwidth can grow with storage services and clients, but small-file workloads may instead be limited by metadata operations or network latency. Understanding the separate paths explains why adding bulk-storage capacity does not necessarily speed every directory-heavy workload.

Ancestors (4)

  1. File system
  2. Operating system
  3. Computer science
  4. Home

Incoming links (5)

View article source

Discussion (0) New discussion

There are no discussions about this article yet.

Articles by others on the same topic (0)

There are currently no matching articles.
See all articles in the same topic Create my own version