Understanding Lustre Internals [electronic resource]

Saved in:
Bibliographic Details
Online Access: Online Access
Main Authors: Huang, He (Author), Shipman, Galen M (Author), Oral, H Sarp (Author), Wang, Feiyi (Author), Drokin, Oleg (Author), Wang, Di (Author)
Corporate Author: Oak Ridge National Laboratory (Researcher)
Format: Government Document Electronic eBook
Language:English
Published: Washington, D.C. : Oak Ridge, Tenn. : United States. Department of Energy. Office of Science ; distributed by the Office of Scientific and Technical Information, U.S. Department of Energy, 2009.
Subjects:

MARC

LEADER 00000nam a22000003u 4500
001 b7054317
003 CoU
005 20130604225844.6
006 m o d f
007 cr |||||||||||
008 150804e20090401||| ot f0|||||eng|d
035 |a (TOE)ost951297 
035 |a (TOE)951297 
040 |a TOE  |c TOE 
049 |a GDWR 
072 7 |a 97  |2 edbsc 
072 7 |a 99  |2 edbsc 
086 0 |a E 1.99:ornl/tm-2009/117 
086 0 |a E 1.99:ornl/tm-2009/117 
088 |a ornl/tm-2009/117 
245 0 0 |a Understanding Lustre Internals  |h [electronic resource] 
260 |a Washington, D.C. :  |b United States. Department of Energy. Office of Science ;  |a Oak Ridge, Tenn. :  |b distributed by the Office of Scientific and Technical Information, U.S. Department of Energy,  |c 2009. 
336 |a text  |b txt  |2 rdacontent. 
337 |a computer  |b c  |2 rdamedia. 
338 |a online resource  |b cr  |2 rdacarrier. 
500 |a Published through SciTech Connect. 
500 |a 04/01/2009. 
500 |a "ornl/tm-2009/117" 
500 |a "KJ0502000" 
500 |a "ERKJZN1" 
500 |a Huang, He; Shipman, Galen M; Oral, H Sarp; Wang, Feiyi; Drokin, Oleg; Wang, Di. 
520 3 |a Lustre was initiated and funded, almost a decade ago, by the U.S. Department of Energy (DoE) Office of Science and National Nuclear Security Administration laboratories to address the need for an open source, highly-scalable, high-performance parallel filesystem on by then present and future supercomputing platforms. Throughout the last decade, it was deployed over numerous medium-to-large-scale supercomputing platforms and clusters, and it performed and met the expectations of the Lustre user community. As it stands at the time of writing this document, according to the Top500 list, 15 of the top 30 supercomputers in the world use Lustre filesystem. This report aims to present a streamlined overview on how Lustre works internally at reasonable details including relevant data structures, APIs, protocols and algorithms involved for Lustre version 1.6 source code base. More importantly, it tries to explain how various components interconnect with each other and function as a system. Portions of this report are based on discussions with Oak Ridge National Laboratory Lustre Center of Excellence team members and portions of it are based on our own understanding of how the code works. We, as the authors team bare all responsibilities for all errors and omissions in this document. We can only hope it helps current and future Lustre users and Lustre code developers as much as it helped us understanding the Lustre source code and its internal workings. 
536 |b DE-AC05-00OR22725. 
650 7 |a L Codes.  |2 local. 
650 7 |a Algorithms.  |2 local. 
650 7 |a Supercomputers.  |2 local. 
650 7 |a Parallel Processing.  |2 local. 
650 7 |a Operation.  |2 local. 
650 7 |a Documentation.  |2 local. 
650 7 |a Mathematics And Computing.  |2 edbsc. 
650 7 |a General And Miscellaneous//Mathematics, Computing, And Information Science.  |2 edbsc. 
700 1 |a Huang, He  |4 aut. 
700 1 |a Shipman, Galen M  |4 aut. 
700 1 |a Oral, H Sarp  |4 aut. 
700 1 |a Wang, Feiyi  |4 aut. 
700 1 |a Drokin, Oleg  |4 aut. 
700 1 |a Wang, Di  |4 aut. 
710 2 |a Oak Ridge National Laboratory.  |4 res. 
710 1 |a United States.  |b Department of Energy.  |b Office of Science.  |4 spn. 
710 1 |a United States.  |b Department of Energy.  |b Office of Scientific and Technical Information.  |4 dst. 
856 4 0 |u http://www.osti.gov/servlets/purl/951297/  |z Online Access 
907 |a .b70543173  |b 03-07-23  |c 04-03-12 
998 |a web  |b 08-04-15  |c f  |d m   |e p  |f eng  |g    |h 0  |i 3 
956 |a Information bridge 
999 f f |i ee818a57-4743-509f-aedb-eb38f724a7c1  |s 442f5bb0-91c4-5892-a985-315e5db3cf4d 
952 f f |p Can circulate  |a University of Colorado Boulder  |b Online  |c Online  |d Online  |e E 1.99:ornl/tm-2009/117  |h Superintendent of Documents classification  |i web  |n 1