← All instances

inf2.xlarge

⚡ 1x GPU • 32.0 GB

Part of the INF2 Accelerated Computing family — Hardware accelerators (GPUs, FPGAs) for specialized compute.

Name:infAWS Inferentia Acceleratorsinf = AWS Inferentia AcceleratorsPurpose-built AWS Inferentia silicon designed for ultra-low latency, high-throughput machine learning inference.22nd Generation2 = 2nd GenerationAWS 2nd generation hardware platform with updated CPU/system architecture.xlargeExtra Large (1x)xlarge = Extra Large (1x)4 vCPUs • 16.0 GiB RAM • EBS only • Up to 15 Gigabit Network • 1x GPU (32.0 GB VRAM)
Price (Linux)
$0.7582/ hr
~$553.49/mo
Compute
4vCPUs
2 cores • x86_64
Memory
16.0GiB
4.0 GiB / vCPU
Value
$0.1895/ vCPU-hr
$0.0474/GiB-hr
Network
15Gbps
Baseline: 2.083 Gbps
Storage & EBS
1,250MB/s
Max: 40,000 IOPS

Technical Specifications & Limits

Hardware specs, container thresholds, and system limits

Compute & Processor

ProcessorAMD EPYC 7R13 Processor
Architecturex86_64 (x86_64)
vCPUs / Threads4 vCPUs
Physical Cores2
Clock Speed2.95 GHz
Intel AVX / AVX2No
Intel Turbo BoostNo
Bare MetalNo (Virtualized)

Performance & Benchmarks

CoreMark Score79,657
CoreMark / vCPU19,914.4 / core
FFmpeg Transcoding34 FPS
CoreMark per Dollar105,061 score / $
Cost per vCPU-hr$0.1895
Cost per GiB-hr$0.0474

Containers & Kubernetes

EKS Max Pods58 pods
Max ECS Tasks20 tasks
Max ENIs4
IPv4/v6 per ENI15
Total Addressable IPs60 total IPs
CNI Prefix DelegationSupported (High Density)

Networking & Bandwidth

Network PerformanceUp to 15 Gigabit
Baseline Bandwidth2.083 Gbps
Burst / Peak Bandwidth15 Gbps
Enhanced NetworkingYes
EFA SupportNo
IPv6 SupportNative Dual-Stack Supported

Storage & EBS Optimization

Storage ConfigurationEBS only
Local NVMe DiskNone (EBS only)
EBS Baseline Throughput156.25 MB/s
EBS Max Throughput1250 MB/s
EBS Baseline IOPS6,000
EBS Max / Burst IOPS40,000
Dedicated EBS ThroughputUp to 10 Gbps

GPU & Hardware Acceleration

GPU ModelNVIDIA Accelerator
Accelerator Count1x GPU(s)
Total GPU Memory32.0 GB
Memory ArchitectureGDDR / HBM
CUDA Compute Capability—
Acceleration RuntimesCUDA, TensorRT, cuDNN, PyTorch, PyJAX

Platform & Architecture Details

Hypervisor / SystemAWS Nitro System (PCIe Offload)
Nitro EnclavesSupported (Isolated security enclaves)
Normalization Factor1
Generation StatusCurrent Generation (Recommended)
Date Introduced2023-04-13

Regional Pricing Matrix

Live on-demand rates across all global AWS cloud regions
Lowest Price Region
$0.7582/ hr
US East (N. Virginia) (us-east-1)
Highest Price Region
$1.2889/ hr
South America (Sao Paulo) (sa-east-1)
Global Fleet Average
$0.9830/ hr
Across all active regions
Regional Coverage
14regions
Available worldwide
Linux — Available in all 14 regions
Region NameRegion CodeOn-Demand Price
Asia Pacific (Mumbai)
ap-south-1$0.9857
Asia Pacific (Seoul)
ap-northeast-2$0.9098
Asia Pacific (Singapore)
ap-southeast-1$1.0615
Asia Pacific (Sydney)
ap-southeast-2$0.9857
Asia Pacific (Tokyo)
ap-northeast-1$1.1373
EU (Frankfurt)
eu-central-1$1.1373
EU (Ireland)
eu-west-1$0.9477
EU (London)
eu-west-2$1.1373
EU (Paris)
eu-west-3$1.0615
EU (Stockholm)
eu-north-1$0.8340
South America (Sao Paulo)Highest
sa-east-1$1.2889
US East (N. Virginia)Lowest
us-east-1$0.7582
US East (Ohio)Lowest
us-east-2$0.7582
US West (Oregon)Lowest
us-west-2$0.7582