Introducing Evaluations, a powerful feature designed to enable you to effortlessly test and compare a selection of AI models against your datasets.
Whether you're fine-tuning models or evaluating performance metrics, Oxen evaluations simplifies the process, allowing you to quickly and easily run prompts through an entire dataset.
Once you're happy with the results, output the resulting dataset to a new file, another branch, or directly as a new commit.
o1-Mini First Evaluation
9a894265-0e13-4c10-9e59-1d489dbd4478 5 row sample completed
Mathias Barragan
1 month ago
Prompt: Answer the following question only using facts from the facts given after the question.
Keep your answer grounded in the facts given.
If no facts given after the question, return 'None'.
Question:
{query}
Facts:
{context}
text → textOpenAI/o1 mini
Source:
embeddings
3874d584-6546-453f-b219-3bcde65c2928 5 row sample completed
Bessie
1 month ago
Prompt: query
1 iteration$ 0.0000
text → embeddingsGoogle/Text Embedding 004
Source:
d956c3ff-c6eb-4e5e-9b6c-d2148ac41404
d956c3ff-c6eb-4e5e-9b6c-d2148ac41404 200 rows completed
Bessie
1 month ago
Prompt: Are the following two answers equivalent? If the answers contain numeric values, only compare the numbers and not the words. Answer "true" or "false". All lowercase.
Answer 1: {answer}
Answer 2: {prediction}
text → textOpenAI/GPT-4o
Source:
gemini-flash-results
Target:
gemini-flash-results-judge
660bf91a-1dc4-42b8-b4ca-35bd32a12a64
660bf91a-1dc4-42b8-b4ca-35bd32a12a64 200 rows completed
Bessie
1 month ago
Prompt: What is the answer to the question given the context? Only reply with text that is contained in the context.
Question:
{query}
Context:
{context}
Answer:
text → textGoogle/Gemini 1.5 Flash
Source:
Target:
gemini-flash-results
Judge Answers w/ GPT-4o
521f0ef3-6bf8-4359-86fc-08d072ae99b6 200 rows completed
Bessie
1 month ago
Prompt: Are the following two answers equivalent? If the answers contain numeric values, only compare the numbers and not the words. Answer "true" or "false". All lowercase.
Answer 1: {answer}
Answer 2: {prediction}
text → textOpenAI/GPT-4o
Source:
openai-answer-extract
Target:
openai-answer-judgements
Answer Extraction w/ OpenAI gpt-4o-mini
aa5a77d7-7852-47df-bba4-0998fe94c176 200 rows completed
Bessie
1 month ago
Prompt: What is the answer to the question given the context? Only reply with text that is contained in the context.
Question:
{query}
Context:
{context}
Answer:
text → textOpenAI/GPT-4o mini
Source:
Target:
openai-answer-extract