Input / Prompt
$2.65/ 1M tokens
$0.0027 per 1K tokens
Output / Completion
$3.50/ 1M tokens
$0.0035 per 1K tokens
Prompt Cache Read
$0.66/ 1M tokens
Save 75% vs prompt
Batch Inference
$1.32/ 1M in
Save 50% via Batch API
Price Ratio
1 : 1.3
Prompt to completion factor
Regional Reach
7AWS Regions

Alternatives to Llama 3 70B

OptionPrice vs Llama 3 70BWhy look at it
Llama 3.1 405B Latency OptimizedCompare →
input+13%+$0.35/1M
output-14%-$0.50/1M
Standard tier, per 1M tokens
Next step down in price from Meta (flagship tier)
Llama 3.1 405BCompare →
input-9%-$0.25/1M
output-31%-$1.10/1M
Standard tier, per 1M tokens
Same Llama line, different version (flagship tier)
Llama 3.1 70B Latency OptimizedCompare →
input-66%-$1.75/1M
output-74%-$2.60/1M
Standard tier, per 1M tokens
Also from Meta
Llama 3.3 70BCompare →
input-73%-$1.93/1M
output-79%-$2.78/1M
Standard tier, per 1M tokens
Also from Meta

Llama 3 70B Spend Estimator

Model inference spend by prompt volume, cache hit rate, and batch processing.

Workload Presets:
M tokens
M tokens
30%
Estimated Monthly Spend
$0.00
Fresh Prompts:$0.00
Cached Prompts:$0.00
Completions:$0.00
Active: Input: $2.65/1M ยท Output: $3.50/1M

Key Cost Levers & Architecture

Practical mechanisms to reduce inference costs with Llama 3 70B on AWS
Prompt CachingSave ~75%

Caches repetitive system instructions, schemas, and document prefixes in memory with 5-minute and extended 1-hour TTL tiers.

  • Read Rate: $0.66 / 1M tokens
  • Write Rate (5m TTL): $3.31 / 1M tokens
  • Ideal for: Multi-turn conversations, RAG document queries, structured schemas
Batch InferenceSave 50%

Asynchronous bulk processing submitted via Amazon S3 with a standard 24-hour turnaround SLA.

  • Batch Input: $1.32 / 1M tokens
  • Batch Output: $1.75 / 1M tokens
  • Ideal for: Offline classification, synthetic data generation, benchmark evals
Cross-Region & Tiers7 Regions

AWS Bedrock supports standard on-demand inference, priority reserved throughput, and cross-region routing.

  • Standard: Lowest latency, pay-per-token with zero commitments
  • Cross-Region Routing: Automatically burst traffic to available regional capacity
  • GovCloud: Dedicated isolated compliance partitions with +20% uplift

Regional Pricing Matrix

Live rates across all 7 available AWS cloud regions
Baseline: $2.65/1M inGovCloud: $4.45/1M in7 Global Regions
Showing 6 benchmark regions
AWS RegionPrompt Input $/1MCompletion Output $/1MCache Read $/1MBatch Input $/1MPricing Tier
us-east-1
US East (N. Virginia)
$2.65$3.50โ€”โ€”Baseline
us-west-2
US West (Oregon)
$2.65$3.50โ€”โ€”Baseline
us-gov-west-1
AWS GovCloud (US-West)
$2.65$3.50โ€”โ€”GovCloud
ap-south-1
Asia Pacific (Mumbai)
$3.18$4.20โ€”โ€”+20% vs Baseline
ca-central-1
Canada (Central)
$3.05$4.03โ€”โ€”+15% vs Baseline
eu-west-2
EU (London)
$3.45$4.55โ€”โ€”+30% vs Baseline
sa-east-1
South America (Sao Paulo)
$4.45$5.88โ€”โ€”+68% vs Baseline

Developer Quickstart

Invoke Llama 3 70B via Amazon Bedrock Converse API
Python (boto3) ยท Amazon Bedrock Runtime
import boto3

# Amazon Bedrock Converse API invocation
client = boto3.client("bedrock-runtime", region_name="us-east-1")

response = client.converse(
    modelId="meta.llama-3-70b-v1:0",
    messages=[
        {
            "role": "user",
            "content": [{"text": "Summarize key features and cost levers of Llama 3 70B."}]
        }
    ],
    inferenceConfig={
        "maxTokens": 1024,
        "temperature": 0.7
    }
)

output_text = response["output"]["message"]["content"][0]["text"]
usage = response["usage"]
print(f"Response: {output_text}")
print(f"Usage: {usage['inputTokens']} in, {usage['outputTokens']} out")

Compare Llama 3 70B with Alternatives

Open Multi-Model Estimator →
Llama 3 70B vsJamba 1.5 LargeAI21 Labs
Input Rate:$2.00/1M
Output Rate:$8.00/1M
Compare Side-by-Side →
Llama 3 70B vsJamba 1.5 MiniAI21 Labs
Input Rate:$0.20/1M
Output Rate:$0.40/1M
Compare Side-by-Side →
Llama 3 70B vsJamba-InstructAI21 Labs
Input Rate:$0.50/1M
Output Rate:$0.70/1M
Compare Side-by-Side →