Crunching Numbers in the Cloud with Spot Instances

Brian McCallion 0 Comments

Hadoop Map Reduce, parallel data loads, fan-out clusters work great on Amazon Web Services.

High Performance, Real Time Data Processing Delivers on the Promise of Cloud Computing

AWS Spot Instances can save you money in ways not possible even in the largest corporate data centers

Parallel Processing
Even the largest compute or data processing job can be broken down into steps. And when these steps are delegated to a fleet of nodes for processing we become keenly aware how cloud is different.

Imagine a portfolio scenario that usually requires two weeks to run.
When run on a fleet of nodes in the cloud this work can be completed by running a fleet of 500 instances for an hour — at a far lower total cost. How is this possible?

In the Cloud compute is on demand, and costs are linear. Because you only pay for what you use, you can also use what you need. In the data center even if you maintain a stable of thousands, tens of thousands of compute nodes each of these nodes still requires care and feeding when its not employed. Further no matter what number you have, the number is finite. In the Cloud resources can be used far more efficiently.

Spot instances on AWS enable customers to purchase and run fleets of instances at 90% cost savings. It’s easier than ever to bid for and acquire fleets of spot instances at AWS.

AWS Spot Instances Fleet Management