Evaluations
Run models against your data
Introducing Evaluations, a powerful feature designed to enable you to effortlessly test and compare a selection of AI models against your datasets.
Whether you're fine-tuning models or evaluating performance metrics, Oxen evaluations simplifies the process, allowing you to quickly and easily run prompts through an entire dataset.
Once you're happy with the results, output the resulting dataset to a new file, another branch, or directly as a new commit.
121edff2-39df-4325-a8b4-7305eeca6016
Nous ResearchNous Research/ Hermes 3 70Btext → text
Mathias Barragan
mathias
3 months ago
{uuid} Imagine you are {role} what is a response you would give to the question about {product}? Only give the response, nothing else:

{question}
Hermes-3-70B
Hermes-3-70B
completed 1000 rows399746 tokens$ 0.0799 2 iterations
ce2ac11e-bbbf-48b6-8c79-4833a9ec499b
Nous ResearchNous Research/ Hermes 3 70Btext → text
Mathias Barragan
mathias
3 months ago
{uuid} Imagine you are {role}, what is a question you would ask about {product}? Answer with only the question, nothing else.
Hermes-3-70B
Hermes-3-70B
completed 1000 rows78615 tokens$ 0.0157 3 iterations
e10c2e0d-5b0e-42a4-b4cd-ca282bcb6366
Nous ResearchNous Research/ Hermes 3 70Btext → text
Mathias Barragan
mathias
3 months ago
{uuid} Imagine you are a {role} what is the most necessary software product you need for your job? Just answer with the product. No extra words or descriptions.
Hermes-3-70B
Hermes-3-70B
completed 1000 rows33234 tokens$ 0.0066 4 iterations
781f8b03-3fe4-410b-94ff-38000acb5fed
Nous ResearchNous Research/ Hermes 3 70Btext → text
Mathias Barragan
mathias
3 months ago
{uuid} Imagine you are a {role} what is the most necessary software product you need for your job? Just answer with the product. No extra words or descriptions.
Hermes-3-70B
completed 5 row sample337 tokens$ 0.0001 1 iteration
0acd0e8b-4bb4-45fe-98ff-ad5d2ec1e43c
MetaMeta/Llama 3.1 70B Instructtext → text
Mathias Barragan
mathias
3 months ago
{uuid} Imagine you are {role} what is a response you would give to the question about {product}? Only give the response, nothing else:

{question}
Llama-v3.1-70B
Llama-v3.1-70B
completed 1000 rows195286 tokens$ 0.1758 3 iterations
49a96fe5-3369-4c62-b272-17f48967b5e9
MetaMeta/Llama 3.1 70B Instructtext → text
Mathias Barragan
mathias
3 months ago
{uuid} Imagine you are {role}, what is a question you would ask about {product}? Answer with only the question, nothing else.
Llama-v3.1-70B
Llama-v3.1-70B
completed 1000 rows92150 tokens$ 0.0829 3 iterations
04f75190-395f-4b43-b480-2132b79b7576
MetaMeta/Llama 3.1 70B Instructtext → text
Mathias Barragan
mathias
4 months ago
{uuid} Imagine you are a {role} what is a question you would ask about {product} to see if its a good fit for your job?
completed 1000 rows302190 tokens$ 0.2720 4 iterations
b3783115-fc9e-42a6-949e-1a3a83455326
MetaMeta/Llama 3.1 70B Instructtext → text
Mathias Barragan
mathias
4 months ago
{uuid} Imagine you are a {role} what is a question you would ask about {product} to see if its a good fit for your job?
completed 1000 rows303331 tokens$ 0.2730 2 iterations
71cee76a-32a5-433e-84f1-f34d2d5c780e
MetaMeta/Llama 3.1 70B Instructtext → text
Mathias Barragan
mathias
4 months ago
{uuid} Imagine you are a {role} what is the most necessary software product you need for your job? Just answer with the product. No extra words or descriptions.
completed 1000 rows72965 tokens$ 0.0657 4 iterations