Foundation Model · Amazon BedrockLlama FamilyFlagship TierText

Llama 3.1 405B Latency Optimized

Amazon Bedrock token pricing and cost optimization reference for Llama 3.1 405B Latency Optimized.Rates normalized to USD per 1 Million Tokens ($/1M) with prompt caching and batch API discounts across 1 AWS regions.

ProviderMeta

Maker HQMenlo Park, California, USA

Class / TierFlagship

ModalityText

Prompt CachingSave 75%

Batch APISave 50%

AWS Regions1 Global

Bedrock Model IDmeta.llama-3-1-405b-latency-optimized-v1:0

Input / Prompt

$3.00/ 1M tokens

$0.0030 per 1K tokens

Output / Completion

$3.00/ 1M tokens

$0.0030 per 1K tokens

Prompt Cache Read

$0.75/ 1M tokens

Save 75% vs prompt

Batch Inference

$1.50/ 1M in

Save 50% via Batch API

Price Ratio

1 : 1.0

Prompt to completion factor

Regional Reach

1AWS Regions

Compare 1 regions ↓

Alternatives to Llama 3.1 405B Latency Optimized

Option	Price vs Llama 3.1 405B Latency Optimized	Why look at it
Llama 3.1 405B Compare →	input-20%-$0.60/1M output-20%-$0.60/1M Standard tier, per 1M tokens	Next step down in price from Meta
Llama 3 70B Compare →	input-12%-$0.35/1M output+17%+$0.50/1M Standard tier, per 1M tokens	Next step up in price from Meta (balanced tier)
Llama 3.1 70B Latency Optimized Compare →	input-70%-$2.10/1M output-70%-$2.10/1M Standard tier, per 1M tokens	Same Llama line, different version (balanced tier)
Llama 3.3 70B Compare →	input-76%-$2.28/1M output-76%-$2.28/1M Standard tier, per 1M tokens	Also from Meta (balanced tier)

Llama 3.1 405B Latency Optimized Spend Estimator

Model inference spend by prompt volume, cache hit rate, and batch processing.

Prompt Tokens (Millions / month)

M tokens

Completion Tokens (Millions / month)

M tokens

Prompt Cache Hit Rate(75% discount on cached context)

30%

Batch API Mode50% discount on non-realtime async jobs via S3

Estimated Monthly Spend

$0.00

Fresh Prompts:$0.00

Cached Prompts:$0.00

Completions:$0.00

Active: Input: $3.00/1M · Output: $3.00/1M

Key Cost Levers & Architecture

Practical mechanisms to reduce inference costs with Llama 3.1 405B Latency Optimized on AWS

Prompt CachingSave ~75%

Caches repetitive system instructions, schemas, and document prefixes in memory with 5-minute and extended 1-hour TTL tiers.

Read Rate: $0.75 / 1M tokens
Write Rate (5m TTL): $3.75 / 1M tokens
Ideal for: Multi-turn conversations, RAG document queries, structured schemas

Batch InferenceSave 50%

Asynchronous bulk processing submitted via Amazon S3 with a standard 24-hour turnaround SLA.

Batch Input: $1.50 / 1M tokens
Batch Output: $1.50 / 1M tokens
Ideal for: Offline classification, synthetic data generation, benchmark evals

Cross-Region & Tiers1 Regions

AWS Bedrock supports standard on-demand inference, priority reserved throughput, and cross-region routing.

Standard: Lowest latency, pay-per-token with zero commitments
Cross-Region Routing: Automatically burst traffic to available regional capacity
GovCloud: Dedicated isolated compliance partitions with +20% uplift

Regional Pricing Matrix

Live rates across all 1 available AWS cloud regions

Baseline: $3.00/1M in1 Global Regions

AWS Region	Prompt Input $/1M	Completion Output $/1M	Cache Read $/1M	Batch Input $/1M	Pricing Tier
us-east-2 US East (Ohio)	$3.00	$3.00	—	—	Baseline

Developer Quickstart

Invoke Llama 3.1 405B Latency Optimized via Amazon Bedrock Converse API

Python (boto3) · Amazon Bedrock Runtime

import boto3

# Amazon Bedrock Converse API invocation
client = boto3.client("bedrock-runtime", region_name="us-east-1")

response = client.converse(
    modelId="meta.llama-3-1-405b-latency-optimized-v1:0",
    messages=[
        {
            "role": "user",
            "content": [{"text": "Summarize key features and cost levers of Llama 3.1 405B Latency Optimized."}]
        }
    ],
    inferenceConfig={
        "maxTokens": 1024,
        "temperature": 0.7
    }
)

output_text = response["output"]["message"]["content"][0]["text"]
usage = response["usage"]
print(f"Response: {output_text}")
print(f"Usage: {usage['inputTokens']} in, {usage['outputTokens']} out")