2019 Edition Archive

HPC in the Cloud (2019)

From the 2019 edition, preserved as written

AWS

High Performance Computing in the Cloud with AWS.

  • This is work I have done at the High Performance Computing Center at the University of California, Riverside.

Introduction

Getting started using HPCC and Amazon Web Service (AWS) to quickly create an on-demand cluster private to you.

AWS Cluster benefits.

  • Build a private cluster in 10 min.
  • Any number of nodes, auto scaling (up and down), limit 20 to start
  • Any type of compute nodes
    • High memory
    • High CPU single/multi node
    • GPUs
  • For only as long as you need it - delete when done
  • Familiar interface and job scheduler
  • Build as many of these clusters as you need (even at the same time)
  • Pay for only the time you use it - per/min billing

Example Cast

This is an simple example of a full HPC workflow using AWS.

The original asciinema recording is no longer hosted at its source.

Presentation on HPCC AWS Cluster