[Beowulf] Station wagon full of tapes

[Chris Dagdigian]

Hate to promote commercial efforts here but this thread has a timely  
link to an Amazon AWS event happening in NYC this week. For people in  
the area who are interested in grilling the AWS product people and  
techies about their offerings this is probably a good forum to do so.  
I know from past experience that feedback they get from the audience  
at these sorts of meetups does make it back to product managers and  
engineers.

Details can be found here:
http://aws.amazon.com/startupproject/

... and the NYC event is on Thursday the 28th.

Disclaimer: I'm going to be one of the speakers but I'm just giving a  
short 10-minute presentation on how we use EC2 and S3 in our work.

-Chris





On May 26, 2009, at 10:35 AM, Bogdan Costescu wrote:

> On Tue, 26 May 2009, Gerry Creager wrote:
>
>> How can I get sufficient cloud resources for computing... ... that  
>> will handle reasonable weather models with their small message MPI  
>> chatter, and lots of file I/O?
>
> By asking Amazon to equip their cloud nodes with a HPC interconnect  
> or to have fat nodes (=many cores, use only shared memory for MPI).  
> How would you do it differently for you own cluster ? Do you really  
> think that Amazon has the magic powder to pour over Gigabit Ethernet  
> and turn it into 1microsecond latency interconnect ?
>
>> However, getting data into S3 for availability, when a daily multi- 
>> gigabyte dataset is used for initiation, and another is created as  
>> output, is going to be expensive, and likely slow.
>
> I haven't tried to access S3; is the bandwidth limitation per  
> account, per connection, per access node or some other way ?  
> Striping comes to mind as a way to use several accounts/connections/ 
> access nodes to move data.
>
>> Another potential use: A company or research group doesn't know if  
>> they want to dip into HPC.
>
> Argh, if they do this they might never dip into HPC ;-)