Evaluations
Run models against your data
Introducing Evaluations, a powerful feature designed to enable you to effortlessly test and compare a selection of AI models against your datasets.
Whether you're fine-tuning models or evaluating performance metrics, Oxen evaluations simplifies the process, allowing you to quickly and easily run prompts through an entire dataset.
Once you're happy with the results, output the resulting dataset to a new file, another branch, or directly as a new commit.
07f89098-1b93-41ae-9dde-a8fd963ee388
Mistral AI/Codestral 2405text → textLaurence
3 months agoWrite code to demonstrate the following:
# Section
{section}
# Relevant Question
{question}c16cb4ef-9e7d-4b17-8996-9eaeb7db2ee3
Qwen/Qwen 2.5 Coder 32B Instructtext → textLaurence
3 months ago<instructions>
Answer the question based on the given documentation section titled {title}.
</instructions>
<documentation>
{section}
</documentation>
<question>
{question}
</question>c238d094-1eef-4dce-a819-d79b75dd5e31
Meta/Llama 3.1 70B Instructtext → textLaurence
3 months agoYou are an expert in version control systems and data engineering. Take the following section from the documentation of Oxen AI, a data version control system, as well as a relevant question. If the question is answerable from the information present in the section, along with basic understanding of the systems being used, answer with "answerable"; if it is not, answer with "unanswerable". Do not include anything else in your answer.
Title: <section_title>{section_title}</section_title>
Section: <section>{section}</section>
Question: <question>{question}</question>
Is the question answerable based on the information in the section? If so, answer with "answerable" and otherwise answer with "unanswerable". Do not answer with anything besides answerable/unanswerable, and do not include any additional explanation.81883bc3-df7a-4150-b2a1-06b1ca62d725
Meta/Llama 3.1 8B Instructtext → textLaurence
3 months agoYou are an expert in version control systems and data engineering. Take the following section from the documentation of Oxen AI, a data version control system, as well as a relevant question. If the question is answerable from only the information present in the section, answer with "answerable"; if it is not, answer with "unanswerable". Do not include anything else in your answer. If the section is empty or missing, respond with "unanswerable", as this means there is no information in that section.
Title: <section_title>{section_title}</section_title>
Section: <section>{section}</section>
Question: <question>{question}</question>
Is the question answerable based on the information in the section? If so, answer with "answerable" and otherwise answer with "unanswerable". If the section is missing, answer with "unanswerable". Do not answer with anything besides answerable/unanswerable, and do not include any additional explanation.