Large FOSS filesystems, was Re: [Beowulf] 512 nodes Myrinet cluster Challanges

[Warren Turkal]

On Friday 05 May 2006 12:00, Dan Stromberg wrote:
> > I expect that xfs would work just fine.  The question is, how can you
> > access it?  You can export it with NFS, but the performance doesn't
> > scale.
>
> If it'd be at least semi reliable, this application would probably be
> fine with that.

I am running this with 3+ TiB of storage. I know that isn't close to what you 
are running, but it is above the 2 TiB mark that can cause problems. Mine 
seems to be running pretty stable. The storage is ultimately on a Coraid 
device. It's like a SAN over ethernet. It even supports be connected and 
driven by more than one computer at once, and it's block level storage.

If you have a cluster running kernel 2.6.16, you could try OCFS2. When Debian 
Etch upgrades to kernel 2.6.16, I will probably start messing with it.

wt
-- 
Warren Turkal, Research Associate III/Systems Administrator
Colorado State University, Dept. of Atmospheric Science