Foundation Model · Amazon BedrockLlama FamilyLightweight TierImage
Llama 2 Chat 13B
Amazon Bedrock token pricing and cost optimization reference for Llama 2 Chat 13B.Rates normalized to USD per 1 Million Tokens ($/1M) with prompt caching and batch API discounts across 2 AWS regions.
ProviderMeta
Maker HQMenlo Park, California, USA
Class / TierLightweight
ModalityImage
Prompt CachingSave 75%
Batch APISave 50%
AWS Regions2 Global
Bedrock Model ID
meta.llama-2-chat-13b-v1:0Input / Prompt
$0.75/ 1M tokens
$0.0008 per 1K tokens
Output / Completion
$1.00/ 1M tokens
$0.0010 per 1K tokens
Prompt Cache Read
$0.19/ 1M tokens
Save 75% vs prompt
Batch Inference
$0.38/ 1M in
Save 50% via Batch API
Price Ratio
1 : 1.3
Prompt to completion factor
Alternatives to Llama 2 Chat 13B
| Option | Price vs Llama 2 Chat 13B | Why look at it |
|---|---|---|
| Llama 2 Chat 70BCompare → | input+160%+$1.20/1M output+156%+$1.56/1M Standard tier, per 1M tokens | Next step up in price from Meta (balanced tier) |
Llama 2 Chat 13B Spend Estimator
Model inference spend by prompt volume, cache hit rate, and batch processing.
M tokens
M tokens
30%
Estimated Monthly Spend
$0.00
Fresh Prompts:$0.00
Cached Prompts:$0.00
Completions:$0.00
Active: Input: $0.75/1M · Output: $1.00/1M
Key Cost Levers & Architecture
Practical mechanisms to reduce inference costs with Llama 2 Chat 13B on AWSPrompt CachingSave ~75%
Caches repetitive system instructions, schemas, and document prefixes in memory with 5-minute and extended 1-hour TTL tiers.
- Read Rate: $0.19 / 1M tokens
- Write Rate (5m TTL): $0.94 / 1M tokens
- Ideal for: Multi-turn conversations, RAG document queries, structured schemas
Batch InferenceSave 50%
Asynchronous bulk processing submitted via Amazon S3 with a standard 24-hour turnaround SLA.
- Batch Input: $0.38 / 1M tokens
- Batch Output: $0.50 / 1M tokens
- Ideal for: Offline classification, synthetic data generation, benchmark evals
Cross-Region & Tiers2 Regions
AWS Bedrock supports standard on-demand inference, priority reserved throughput, and cross-region routing.
- Standard: Lowest latency, pay-per-token with zero commitments
- Cross-Region Routing: Automatically burst traffic to available regional capacity
- GovCloud: Dedicated isolated compliance partitions with +20% uplift
Regional Pricing Matrix
Live rates across all 2 available AWS cloud regionsBaseline: $0.75/1M in2 Global Regions
Developer Quickstart
Invoke Llama 2 Chat 13B via Amazon Bedrock Converse APIPython (boto3) · Amazon Bedrock Runtime
import boto3
# Amazon Bedrock Converse API invocation
client = boto3.client("bedrock-runtime", region_name="us-east-1")
response = client.converse(
modelId="meta.llama-2-chat-13b-v1:0",
messages=[
{
"role": "user",
"content": [{"text": "Summarize key features and cost levers of Llama 2 Chat 13B."}]
}
],
inferenceConfig={
"maxTokens": 1024,
"temperature": 0.7
}
)
output_text = response["output"]["message"]["content"][0]["text"]
usage = response["usage"]
print(f"Response: {output_text}")
print(f"Usage: {usage['inputTokens']} in, {usage['outputTokens']} out")