... more stuff
at
php-app-engine.com

Archive for the ‘Storage’ Category

Linux Cloud Drive

Thursday, January 28th, 2010

http://www.smestorage.com/?p=static&page=labs


You should now see your SMEStorage data and also see the mount point on your visual file system. This then enables you to access your files from all the clouds we support, which includes GMail, Email, FTP, Microsoft SkyDrive, Microsoft Live Mesh, WebDav, MobileMe, Amazon S3, RackSpace CloudFiles, and box.net

EC2 filesystem performance

Wednesday, January 27th, 2010

http://winnersdontlose.com/?tag=ec2-filesystem-performance

I’ve been posting lately about a tool named bonnie++, which will run a suite of tests against your linux filesystem to determine metrics in 3 important areas: data read/write speed, max random seeks, and max metadata operations. Last time I posted about profiling one of Linode.com’s “Linode 360″ instances. In this article I will profile a m1.small instance on Amazon Web Services’ (AWS) Elastic Compute Cloud (EC2) service.

Review my software: Keyspace consistently replicated key-value store (scalien.com)

Thursday, January 7th, 2010

http://news.ycombinator.com/item?id=705977

scalien.com

Keyspace

This is the document that the interested programmer or engineer should read first:

This paper describes the design and architecture of Keyspace, a distributed key-value store offering strong consistency, fault-tolerance and high availability. The source code is released as free, open-source software under the BSD license.

PaxosLease

PaxosLease is a Paxos-based, diskless algorithm for negotiating leases in a distributed system. It is used for master leases in Keyspace.

This paper describes PaxosLease, a distributed algorithm for lease negotiation. PaxosLease is based on Paxos, but does not require disk writes and does not make clock synchrony and skew assumptions. PaxosLease is used for master lease negotation in the open-source Keyspace replicated key-value store.

How to increase the size of vol on AWS

Wednesday, January 6th, 2010

http://www.aroxo.com/blog/mattr/2009/11/20/how-to-increase-the-size-of-vol-on-aws/

So here’s the scenario: you’re hosted using Amazon Web-Services EC2 platform. You’ve created a volume to store your data on, and you’ve run out of space. How do you increase the space on /vol using AWS?

Here are the steps which after a lot of messing around and a lot of help about I eventually found to work, some of this is based on this post. This might not be the most efficient way and some steps might be unnecessary and it’s based on a Debian install, maybe that makes a difference, maybe it doesn’t:

mounting an s3 bucket in ec2 and using transparently as a mnt point

Saturday, December 26th, 2009

http://stackoverflow.com/questions/956904/mounting-an-s3-bucket-in-ec2-and-using-transparently-as-a-mnt-point

I’m not using EC2, but I do have my S3 bucket permanently mounted on my Linux server. The way I did it is with Jungledisk. It isn’t a non-commercial solution, but it’s very inexpensive.

First I setup the jungledisk as normal. Then I make sure fuse is installed. Mostly you just need to create the configuration file with your secret keys and such. Then just add a line to your fstab something like this

HOWTO Mount S3 bucket into EC2 instance

Sunday, December 6th, 2009

http://solutions.amazonwebservices.com/connect/thread.jspa?threadID=39361&tstart=0

I would like to share my experience mounting a S3 bucket into a Linux EC2 instance.

The steps I followed were:

Installing FUSE + s3fs and sshfs on Ubuntu

Tuesday, December 1st, 2009

http://xentek.net/articles/448/installing-fuse-s3fs-and-sshfs-on-ubuntu/

Fuse is a program to mount ‘foreign’ filesystems to your computer. This is how I got an Amazon S3 (simple storage service) bucket mounted on my Ubuntu server as if it were a local folder:

How to mount S3 Storage as a filesystem

Monday, October 12th, 2009

http://developer.amazonwebservices.com/connect/message.jspa?messageID=95362

(there is also s3fs and several other FUSE solutions)