Models/Llama 3.1 8B Instruct Turbo
MetaMeta / Llama 3.1 8B Instruct Turbo
Released: 7/23/2024
texttext
Input: $0.18 / Output: $0.18

Meta-Llama-3.1-8B-Instruct-Turbo is an 8 billion parameter LLM designed for multilingual dialogue use cases. It excels in providing fast and accurate responses across multiple languages, making it suitable for applications requiring quick turnaround times and multilingual support.

Some other noteworthy features of Meta-Llama-3.1-8B-Instruct-Turbo include its optimized performance for inference and its ability to maintain full accuracy compared to the reference implementation.

MetricValue
Parameter Count8 billion
Mixture of ExpertsNo
Context Length128,000 tokens
MultilingualYes
Quantized*Yes
Quantization*Unknown

*Quantization is specific to the inference provider and the model may be offered with different quantization levels by other providers.

Meta models available on Oxen.ai
ModalityPrice (1M tokens)
ModelInference providerInputOutputInputOutput
Fireworks AI
texttext$3.00$3.00
Together.ai
texttext$3.50$3.50
Fireworks AI
texttext$0.90$0.90
Together.ai
texttext$0.88$0.88
Groq
texttext$0.05$0.08
Fireworks AI
texttext$0.20$0.20
Together.ai
texttext$0.18$0.18
Together.ai
texttext$0.90$0.90
Groq
imagetext$0.18$0.18
Groq
texttext$0.04$0.04
Groq
texttext$0.06$0.06
Together.ai
texttext$0.06$0.06
Groq
imagetext$0.90$0.90
Fireworks AI
texttext$0.90$0.90
Together.ai
texttext$0.88$0.88
Groq
texttext$0.59$0.59
Groq
texttext$0.59$0.79
See all models available on Oxen.ai