Lustre File Joining for Effective Collective IO

[07/05/28]
DOI Bookmarkを訂正しました。
==========
[07/05/26]
"Exploiting Lustre File Joining for Effective Collective IO",
　Weikuan Yu, Oak Ridge National Laboratory
　Jeffrey Vetter, Oak Ridge National Laboratory
　R. Shane Canon, Oak Ridge National Laboratory
　Song Jiang, Wayne State University
　Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).
　http://doi.ieeecomputersociety.org/10.1109/CCGRID.2007.51
Abstractより
"To mitigate striping overhead and benefit collective IO, we propose two techniques: split writing and hierarchical striping."

"Experimental results indicate that split writing and hierarchical striping can significantly improve the performance of Lustre collective IO in terms of both data transfer and management operations. On a Lustre file system configured with 46 object storage targets, our implementation improves collective write performance of a 16-process job by as much as 220%."


Oak Ridege Future Technologies Groupのリーダ Jeffrey Vetter博士が含まれていますが、今回の報告は PCクラスターとなっています。
いずれ Jaguar (Cray XT4)でも試されでしょう。
　Song Jiang助教授はディスクのキャッシュアルゴリズム等を研究されている方です。

Weikuan Yu
　Future Technologies Group/Technology Integration Group
　Computer Science and Mathematics Division, Oak Ridge National Laboratory
　http://ft.ornl.gov/~wyu/
Jeffrey Vetter, Group Leader
　Future Technologies Group
　Computer Science and Mathematics Division, Oak Ridge National Laboratory
　http://ft.ornl.gov/~vetter/
Song Jiang, Assistant Professor
　Department of Electrical and Computer Engineering, Wayne State Universit
　http://www.ece.eng.wayne.edu/~sjiang/


Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid2007), May 14-17, 2007
　http://ccgrid07.lncc.br/


並列ファイルシステムの IBM GPFSとベースとなる MPI-IOは Scalable I/O Project, Lawrence Livermore National Laboratory等で鍛えられて (？)、
パフォーマンスが向上しましたので、Lusterにもこのような報告がどんどん出てくることを期待します。
Scalable I/O Project, Lawrence Livermore National Laboratory
　http://www.llnl.gov/icc/lc/siop/
==========
http://blog.goo.ne.jp/topography/s/Luster