Models/Llama 3.1 405B Instruct
MetaMeta / Llama 3.1 405B Instruct
Released: 7/23/2024
texttext
Input: $3.00 / Output: $3.00

Llama 3.1 405B Instruct is an LLM that excels in multilingual dialogue, detailed instruction-following, and handling complex tasks across various domains.

Some other noteworthy features of Llama 3.1 405B Instruct include its extended context length and tool-calling capabilities.

MetricValue
Parameter Count405 billion
Mixture of ExpertsNo
Context Length128,000 tokens
MultilingualYes
Quantized*Yes
Quantization*FP8

*Quantization is specific to the inference provider and the model may be offered with different quantization levels by other providers.

Meta models available on Oxen.ai
ModalityPrice (1M tokens)
ModelInference providerInputOutputInputOutput
Fireworks AI
texttext$3.00$3.00
Together.ai
texttext$3.50$3.50
Fireworks AI
texttext$0.90$0.90
Together.ai
texttext$0.88$0.88
Groq
texttext$0.05$0.08
Fireworks AI
texttext$0.20$0.20
Together.ai
texttext$0.18$0.18
Together.ai
texttext$0.90$0.90
Groq
imagetext$0.18$0.18
Groq
texttext$0.04$0.04
Groq
texttext$0.06$0.06
Together.ai
texttext$0.06$0.06
Groq
imagetext$0.90$0.90
Fireworks AI
texttext$0.90$0.90
Together.ai
texttext$0.88$0.88
Groq
texttext$0.59$0.59
Groq
texttext$0.59$0.79
See all models available on Oxen.ai