Michael Cochez

Assistant Professor at Vrije Universiteit Amsterdam

Cloud computing - Cloud Services

Goal

In this exercises we will look at the different products offered by a cloud service provider. In particular each group will try out different products and present their findings in the final lecture.

Prerequisites

Find out what availability zones are in aws . Try to log in to aws. First you need to get your personal password from http://jyu-aws.appspot.com.

Task

Your task is depending on what topic your group picks. While you are doing the task you have to keep the following things in mind:

  • How does it work?
  • What do you have to pay? How is the pricing? Are there hidden costs?
  • How expensive is this particular thing?

Then you make a cost estimate and add it to the README.txt file in the repository for this week. Also add all code artifacts to the repository.

During the last review session, each group is supposed to give a short presentation about the what the service is, how much it costs and what you did with it.

Depending on the task you will work in a given availability zone. Choose all identifiers such that your group is identifiable.

  • AWS OpsWorks DevOpsApplication Management Service
    • Make a set-up similar to the one described in the getting started video
    • Host a simple PHP webpage which displays a form in which the user can enter a date. After submitting the form the user sees the number of days since that date.
    • Availability Zone : US East (N. Virginia)
    • 1-2 groups (6 and 7)
  • Amazon CloudFront Global content delivery framework
    • Get a video stream from Amazon CloudFront working from S3 using the JW Player
    • Availability Zone : US West (Oregon)
    • 1 group (8)
  • Elastic MapReduce Managed Hadoop framework
    • Implement a map reduce job on top of this infrastructure
    • You can base your application on this article with a word count example but you should use another problem and a custom reducer.
    • Use a dataset with a size big enough to have a realistic running time for instance from freely available data sets
    • Availability Zone : US West (N. California)
    • 1-3 groups (5 and 9)
  • Elastic Transcoder Media transcoding in the cloud
    • Transcode video using pipelines, jobs and presets
    • Create a website on which the user can upload a video and ask for transcoding.
    • Availability Zone : EU (Ireland)
    • 1 group (10)
  • SQS Message queue service
    • Create two applications (a publisher and a consumer)
    • Communicate between the two using the queuing system
    • Availability Zone : Asia Pacific (Singapore)
    • 2 groups (1 and 2)
  • Amazon SWF Amazon Simple Workflow Service
    • Implement a workflow with 5 workers and 4 deciders. (amounts are flexible)
    • Availability Zone : Asia Pacific (Tokyo)
    • 2 groups (4 and 12)
  • Amazon CloudSearch
    • Configure a search domain
    • Add data from one of the freely available data sets (Keep the size within limits)
    • Provide a small web-interface to perform searches
    • Availability Zone : Asia Pacific (Sydney)
    • 1 group (11)
  • Elasticache In memory cache in the cloud
    • Try both Memcached and Redis caching
    • Write a simple application which is using this cache and an S3 or other database solution as a back-end.
    • Availability Zone : South America (São Paulo)
    • 2 groups

Returning the task###

  • Code in the repo
  • Presentation in class

Hints

  • Be creative