Meta / Llama 3.1 70B Instruct Turbo
Released: 7/23/2024texttext
Input: $0.88 / Output: $0.88
Meta-Llama-3.1-70B-Instruct-Turbo is an LLM that excels in multilingual dialogue, offering high-quality responses across various languages and tasks such as question answering, reasoning, and code generation.
Some other noteworthy features of Meta-Llama-3.1-70B-Instruct-Turbo include its ability to handle complex instructions and its optimized performance for faster inference.
Metric | Value |
---|---|
Parameter Count | 70 billion |
Mixture of Experts | No |
Context Length | 128,000 tokens |
Multilingual | Yes |
Quantized* | Yes |
Quantization* | Unknown |
*Quantization is specific to the inference provider and the model may be offered with different quantization levels by other providers.
Meta models available on Oxen.ai
Modality | Price (1M tokens) | ||||
---|---|---|---|---|---|
Model | Inference provider | Input | Output | Input | Output |
Fireworks AI | text | text | $3.00 | $3.00 | |
Together.ai | text | text | $3.50 | $3.50 | |
Fireworks AI | text | text | $0.90 | $0.90 | |
Together.ai | text | text | $0.88 | $0.88 | |
Groq | text | text | $0.05 | $0.08 | |
Fireworks AI | text | text | $0.20 | $0.20 | |
Together.ai | text | text | $0.18 | $0.18 | |
Together.ai | text | text | $0.90 | $0.90 | |
Groq | image | text | $0.18 | $0.18 | |
Groq | text | text | $0.04 | $0.04 | |
Groq | text | text | $0.06 | $0.06 | |
Together.ai | text | text | $0.06 | $0.06 | |
Groq | image | text | $0.90 | $0.90 | |
Fireworks AI | text | text | $0.90 | $0.90 | |
Together.ai | text | text | $0.88 | $0.88 | |
Groq | text | text | $0.59 | $0.59 | |
Groq | text | text | $0.59 | $0.79 |