Meta / Llama 3.1 8B Instruct Turbo
Released: 7/23/2024texttext
Input: $0.18 / Output: $0.18
Meta-Llama-3.1-8B-Instruct-Turbo is an 8 billion parameter LLM designed for multilingual dialogue use cases. It excels in providing fast and accurate responses across multiple languages, making it suitable for applications requiring quick turnaround times and multilingual support.
Some other noteworthy features of Meta-Llama-3.1-8B-Instruct-Turbo include its optimized performance for inference and its ability to maintain full accuracy compared to the reference implementation.
Metric | Value |
---|---|
Parameter Count | 8 billion |
Mixture of Experts | No |
Context Length | 128,000 tokens |
Multilingual | Yes |
Quantized* | Yes |
Quantization* | Unknown |
*Quantization is specific to the inference provider and the model may be offered with different quantization levels by other providers.
Meta models available on Oxen.ai
Modality | Price (1M tokens) | ||||
---|---|---|---|---|---|
Model | Inference provider | Input | Output | Input | Output |
Fireworks AI | text | text | $3.00 | $3.00 | |
Together.ai | text | text | $3.50 | $3.50 | |
Fireworks AI | text | text | $0.90 | $0.90 | |
Together.ai | text | text | $0.88 | $0.88 | |
Groq | text | text | $0.05 | $0.08 | |
Fireworks AI | text | text | $0.20 | $0.20 | |
Together.ai | text | text | $0.18 | $0.18 | |
Together.ai | text | text | $0.90 | $0.90 | |
Groq | image | text | $0.18 | $0.18 | |
Groq | text | text | $0.04 | $0.04 | |
Groq | text | text | $0.06 | $0.06 | |
Together.ai | text | text | $0.06 | $0.06 | |
Groq | image | text | $0.90 | $0.90 | |
Fireworks AI | text | text | $0.90 | $0.90 | |
Together.ai | text | text | $0.88 | $0.88 | |
Groq | text | text | $0.59 | $0.59 | |
Groq | text | text | $0.59 | $0.79 |