×
Your report request could not be saved. Please try again.
You GPU Usage Custom Report Request is Being Processed

Request a Custom GPU Cloud Spend Report

Fill-out the form below to request a custom analysis report of your projected cloud gpu costs

AWS GPU Cost Calculator

Author: Josh Patterson
Date: 2/24/2021


This is a calculator to give you a rough estimate for what your team's GPU costs on AWS for Deep Learning based on their usage patterns. Obviously there can be more factors involved, but this is meant to give you a ballpark figure to start a conversation from to estimate costs.

See our blog post on "Forecasting Your AWS GPU Cloud Spend for Deep Learning" for more detailed discussion around how we make our estimations and calculations.

Team Label Data Scientist (DS) Count GPU Hours per Month per DS GPU Instance Type SageMaker Multiple GPU Hours per Year Group AWS Subtotal Cost per Year
1. 0 $0.00
2. 0 $0.00
3. 0 $0.00

Total AWS GPU Spend per Year: $0.00

Free GPU Cloud Spend Analysis

Would you like a customized cloud GPU spend analysis for your organization? Reach out and we’ll provide your company this GPU usage analysis report free of charge.

AWS P3 Instance Pricing

In the table below we show AWS' pricing for the p3 instances.

Instance Size

GPUs - Tesla V100

GPU Peer to Peer

GPU Memory (GB)

vCPUs

Memory (GB)

Network Bandwidth

EBS Bandwidth

On-Demand Price/hr*

1-yr Reserved Instance Effective Hourly*

3-yr Reserved Instance Effective Hourly*

Blended Price Avg(OnDemand and 1yr Reserved)

p3.2xlarge

1

N/A

16

8

61

Up to 10 Gbps

1.5 Gbps

$3.06

$1.99

$1.05

$2.53

p3.8xlarge

4

NVLink

64

32

244

10 Gbps

7 Gbps

$12.24

$7.96

$4.19

$10.10

p3.16xlarge

8

NVLink

128

64

488

25 Gbps

14 Gbps

$24.48

$15.91

$8.39

$20.20

p3dn.24xlarge

8

NVLink

256

96

768

100 Gbps

19 Gbps

$31.22

$18.30

$9.64

$24.76


We've added a column at the end where we've averaged the price of On-Demand instance pricing and 1-Year Reserved Instances. For this cost model this is the hourly cost we use for instances because we want to account for the fact that some AWS resources will be used by good forecasting and 1-Year Reserved instances at the lower price. However, we also want to account for users who will end up using On-Demand instances, so we average the two prices together.