ACCRE is developing a new high-performance data archiving system called Logistical Storage, or L-Store. See our performance graphs from SuperComputing 2006 where L-Store achieved sustained data transfers at 3.3 GigaBytes/s . This work is supported with funding from NSF grant PHY-0619847 (REDDnet) and by the Vanderbilt Center for the Americas.
L-Store provides a flexible logistical storage framework for distributed, scalable, and secure access to data for a wide spectrum of users. L-Store is planned to be used on the REDDnet infrastructure. It is designed to provide: virtually unlimited scalability in both raw storage and associated file system metadata; a decentralized management system; security; fault tolerant metadata support; user controlled replication and striping of data on a file and directory level; scalable performance in both raw data movement and metadata queries; a virtual file system interface in both a web and command line form; and support for the concept of geographical locations for data migration to facilitate quicker access. These features are accomplished using two fundamental technologies designed to handle such wide-ranging data storage and access needs: