Foundation Model · Amazon BedrockLlama FamilyBalanced TierImage
Llama 2 Chat 70B
Amazon Bedrock token pricing and cost optimization reference for Llama 2 Chat 70B.Rates normalized to USD per 1 Million Tokens ($/1M) with prompt caching and batch API discounts across 2 AWS regions.
ProviderMeta
Maker HQMenlo Park, California, USA
Class / TierBalanced
ModalityImage
Prompt CachingSave 75%
Batch APISave 50%
AWS Regions2 Global
Bedrock Model ID
meta.llama-2-chat-70b-v1:0Input / Prompt
$1.95/ 1M tokens
$0.0019 per 1K tokens
Output / Completion
$2.56/ 1M tokens
$0.0026 per 1K tokens
Prompt Cache Read
$0.49/ 1M tokens
Save 75% vs prompt
Batch Inference
$0.97/ 1M in
Save 50% via Batch API
Price Ratio
1 : 1.3
Prompt to completion factor
Alternatives to Llama 2 Chat 70B
| Option | Price vs Llama 2 Chat 70B | Why look at it |
|---|---|---|
| Llama 2 Chat 13BCompare → | input-62%-$1.20/1M output-61%-$1.56/1M Standard tier, per 1M tokens | Next step down in price from Meta (lightweight tier) |
Llama 2 Chat 70B Spend Estimator
Model inference spend by prompt volume, cache hit rate, and batch processing.
M tokens
M tokens
30%
Estimated Monthly Spend
$0.00
Fresh Prompts:$0.00
Cached Prompts:$0.00
Completions:$0.00
Active: Input: $1.95/1M · Output: $2.56/1M
Key Cost Levers & Architecture
Practical mechanisms to reduce inference costs with Llama 2 Chat 70B on AWSPrompt CachingSave ~75%
Caches repetitive system instructions, schemas, and document prefixes in memory with 5-minute and extended 1-hour TTL tiers.
- Read Rate: $0.49 / 1M tokens
- Write Rate (5m TTL): $2.44 / 1M tokens
- Ideal for: Multi-turn conversations, RAG document queries, structured schemas
Batch InferenceSave 50%
Asynchronous bulk processing submitted via Amazon S3 with a standard 24-hour turnaround SLA.
- Batch Input: $0.97 / 1M tokens
- Batch Output: $1.28 / 1M tokens
- Ideal for: Offline classification, synthetic data generation, benchmark evals
Cross-Region & Tiers2 Regions
AWS Bedrock supports standard on-demand inference, priority reserved throughput, and cross-region routing.
- Standard: Lowest latency, pay-per-token with zero commitments
- Cross-Region Routing: Automatically burst traffic to available regional capacity
- GovCloud: Dedicated isolated compliance partitions with +20% uplift
Regional Pricing Matrix
Live rates across all 2 available AWS cloud regionsBaseline: $1.95/1M in2 Global Regions
Developer Quickstart
Invoke Llama 2 Chat 70B via Amazon Bedrock Converse APIPython (boto3) · Amazon Bedrock Runtime
import boto3
# Amazon Bedrock Converse API invocation
client = boto3.client("bedrock-runtime", region_name="us-east-1")
response = client.converse(
modelId="meta.llama-2-chat-70b-v1:0",
messages=[
{
"role": "user",
"content": [{"text": "Summarize key features and cost levers of Llama 2 Chat 70B."}]
}
],
inferenceConfig={
"maxTokens": 1024,
"temperature": 0.7
}
)
output_text = response["output"]["message"]["content"][0]["text"]
usage = response["usage"]
print(f"Response: {output_text}")
print(f"Usage: {usage['inputTokens']} in, {usage['outputTokens']} out")