inf1.24xlarge
⚡ 16x GPUPart of the INF1 Accelerated Computing family — Hardware accelerators (GPUs, FPGAs) for specialized compute.
Name:
infAWS Inferentia Acceleratorsinf = AWS Inferentia AcceleratorsPurpose-built AWS Inferentia silicon designed for ultra-low latency, high-throughput machine learning inference.11st Generation1 = 1st GenerationAWS 1st generation hardware platform with updated CPU/system architecture.24xlarge24 Extra Large24xlarge = 24 Extra Large96 vCPUs • 192.0 GiB RAM • EBS only • 100 Gigabit Network • 16x GPUPrice (Linux)
$4.7210/ hr
~$3,446.33/mo
Compute
96vCPUs
48 cores • x86_64
Memory
192.0GiB
2.0 GiB / vCPU
Value
$0.0492/ vCPU-hr
$0.0246/GiB-hr
Network
100Gbps
Baseline: 100 Gbps
Storage & EBS
2,375MB/s
Max: 80,000 IOPS
Technical Specifications & Limits
Hardware specs, container thresholds, and system limitsCompute & Processor
ProcessorIntel Xeon Platinum 8275CL (Cascade Lake)
Architecturex86_64 (x86_64)
vCPUs / Threads96 vCPUs
Physical Cores48
Clock Speed—
Intel AVX / AVX2No
Intel Turbo BoostNo
Bare MetalNo (Virtualized)
Performance & Benchmarks
CoreMark Score1,539,880
CoreMark / vCPU16,040.4 / core
FFmpeg Transcoding194 FPS
CoreMark per Dollar326,177 score / $
Cost per vCPU-hr$0.0492
Cost per GiB-hr$0.0246
Containers & Kubernetes
EKS Max Pods321 pods
Max ECS Tasks120 tasks
Max ENIs11
IPv4/v6 per ENI30
Total Addressable IPs330 total IPs
CNI Prefix DelegationSupported (High Density)
Networking & Bandwidth
Network Performance100 Gigabit
Baseline Bandwidth100 Gbps
Burst / Peak Bandwidth100 Gbps
Enhanced NetworkingNo
EFA SupportNo
IPv6 SupportNative Dual-Stack Supported
Storage & EBS Optimization
Storage ConfigurationEBS only
Local NVMe DiskNone (EBS only)
EBS Baseline Throughput2375 MB/s
EBS Max Throughput2375 MB/s
EBS Baseline IOPS80,000
EBS Max / Burst IOPS80,000
Dedicated EBS Throughput14000 Mbps
GPU & Hardware Acceleration
GPU ModelNVIDIA Accelerator
Accelerator Count16x GPU(s)
Total GPU Memory—
Memory ArchitectureGDDR / HBM
CUDA Compute Capability—
Acceleration RuntimesCUDA, TensorRT, cuDNN, PyTorch, PyJAX
Platform & Architecture Details
Hypervisor / SystemAWS Nitro System (PCIe Offload)
Nitro EnclavesSupported (Isolated security enclaves)
Normalization FactorNA
Generation StatusCurrent Generation (Recommended)
Date Introduced2019-12-03
Regional Pricing Matrix
Live on-demand rates across all global AWS cloud regionsLowest Price Region
$4.7210/ hr
US East (N. Virginia) (us-east-1)Highest Price Region
$7.8000/ hr
South America (Sao Paulo) (sa-east-1)Global Fleet Average
$5.7407/ hr
Across all active regionsRegional Coverage
22regions
Available worldwide| Region Name | Region Code | On-Demand Price |
|---|---|---|
Africa (Cape Town) | af-south-1 | $6.2490 |
Asia Pacific (Hong Kong) | ap-east-1 | $7.2740 |
Asia Pacific (Mumbai) | ap-south-1 | $4.9650 |
Asia Pacific (Seoul) | ap-northeast-2 | $5.8120 |
Asia Pacific (Singapore) | ap-southeast-1 | $6.3760 |
Asia Pacific (Sydney) | ap-southeast-2 | $5.9020 |
Asia Pacific (Tokyo) | ap-northeast-1 | $6.3760 |
AWS GovCloud (US-East) | us-gov-east-1 | $5.9530 |
AWS GovCloud (US-West) | us-gov-west-1 | $5.9530 |
Canada (Central) | ca-central-1 | $5.2600 |
EU (Frankfurt) | eu-central-1 | $5.9020 |
EU (Ireland) | eu-west-1 | $5.2600 |
EU (London) | eu-west-2 | $5.5300 |
EU (Milan) | eu-south-1 | $5.5300 |
EU (Paris) | eu-west-3 | $5.5170 |
EU (Stockholm) | eu-north-1 | $5.0160 |
Middle East (Bahrain) | me-south-1 | $5.7860 |
South America (Sao Paulo)Highest | sa-east-1 | $7.8000 |
US East (N. Virginia)Lowest | us-east-1 | $4.7210 |
US East (Ohio)Lowest | us-east-2 | $4.7210 |
US West (N. California) | us-west-1 | $5.6710 |
US West (Oregon)Lowest | us-west-2 | $4.7210 |
No regions matched your search filter.