Category Archives: cloud-computing

“Easily” setup a monitored Hadoop / Hive Cluster in EC2 with PoolParty

By Nate Murray | Published: July 8, 2009
Summary Setting up a scalable Hadoop cluster isn’t easy, but PoolParty makes it easier and manageable. By the time we’re done with this tutorial you’ll have a Hadoop cluster consisting of one master node and two slaves. The slaves are formatted with HDFS and process MapReduce jobs that are delegated to them from the master. The whole [...]
Posted in cloud-computing | Tagged , | 1 Comment

PoolParty s3fs Plugin

By Nate Murray | Published: February 10, 2009
Goal A new plugin install and mount s3fs volume on an instance using PoolParty. Getting it git clone git://github.com/jashmenn/poolparty-s3fs-plugin.git Usage NOTICE You must have already created your S3 bucket. This plugin will not create it for you. cloud(:app) ... s3fs(:bucket => "my-fun-bucket") ... end This will be mounted at /mnt/my-fun-bucket You can mount multiple buckets and/or change the mount point: s3fs do [...]
Posted in cloud-computing | Tagged , | Leave a comment

PoolParty MRTG Plugin

By Nate Murray | Published: February 3, 2009
I’ve created a PoolParty plugin that makes it dead-simple to install
Posted in cloud-computing | Tagged , , | Leave a comment