Evaluations
Run models against your data
Introducing Evaluations, a powerful feature designed to enable you to effortlessly test and compare a selection of AI models against your datasets.
Whether you're fine-tuning models or evaluating performance metrics, Oxen evaluations simplifies the process, allowing you to quickly and easily run prompts through an entire dataset.
Once you're happy with the results, output the resulting dataset to a new file, another branch, or directly as a new commit.
70ef3b23-b9e1-4e4c-978a-dd0c2ff5553e

ox
2 months agomarkdown_text
59a4ee4a-3162-4ce3-ad3c-f5cfbc8cf2f1

ox
2 months agoSummarize the following text in a single sentence. {section}
5f4c7930-4cfd-4245-a25e-39ea7db5d329

ox
2 months agoanswer_relevance_questions
95d7dfb7-0bf9-40ef-9853-e3f283451051

ox
2 months agoquestion
b26c70c9-929f-488a-851b-4f41ed3b7d59

ox
3 months agoPlease extract relevant sentences from the provided context that can potentially help answer the following question. If no relevant sentences are found, or if you believe the question cannot be answered from the given context, return the phrase "Insufficient Information". While extracting candidate sentences you're not allowed to make any changes to sentences from given context. Question: {question} Context: {rag_context}
33d672d8-e463-4132-b895-1426d1b3c589

ox
3 months agoGenerate 3 questions for the given the answer. Generate the questions in an ordered list: 1. 2. 3. Answer: {answer}
error An exception occurred indexing, getting dataframe and running evaluation: %Req.TransportError{reason: :closed} 100 rows14131 tokens$ 0.0050 2 iterations
a2a8d567-ab5f-42da-9578-0ea3f2daecf9

ox
3 months agoConsider the given context and following statements, then determine whether they are supported by the information present in the context. Provide a brief explanation for each statement before arriving at the final verdict (Yes/No). Provide a final vertict for each statement in order at the end in the given format. Do not deviate from the specified format. Context: {context} Statements: {faithfulness_statements}
9246a591-d95b-4781-8eb4-8487c1a7dc63

ox
3 months agoGiven a question and an answer, create one or more statements from each sentence in the given answer. The statements should be in an ordered list such as 1. First Statement 2. Second Statement etc... question: {question} answer: {answer}
5235077a-645e-417d-9294-222971555232

ox
3 months agoConsider the given context and following statements, then determine whether they are supported by the information present in the context. Provide a brief explanation for each statement before arriving at the final verdict (Yes/No). Provide a final vertict for each statement in order at the end in the given format. Do not deviate from the specified format. Context: {section} Statements: {statements}
a0d21249-16f8-4ae5-a485-8590619cba79

ox
3 months agoGiven a question and an answer, create one or more statements from each sentence in the given answer. The statements should be in an ordered list such as 1. First Statement 2. Second Statement etc... question: {question} answer: {answer}
d70645d9-7bdd-4ff2-971c-b3b4680446b8

ox
3 months agoAnswer the following question as succinctly as possible given the context. If the question cannot be answered given the context, respond with not_answerable. Context: {section} Quetion: {question} Answer:
c783abcd-42c7-4cf0-8c6c-1e41680e7427

ox
3 months agoAnswer the following question as succinctly as possible given the context. If the question cannot be answered given the context, respond with not_answerable. Context: {section} Quetion: {question} Answer:
9bf059a9-9a44-47f9-99ee-390ed38d7eaa

ox
3 months agoAnswer the following question as succinctly as possible given the context. If the question cannot be answered given the context, respond with not_answerable. Context: {section} Question: {question} Answer:
168136aa-d514-4dd1-8117-f8fca5c8feae

ox
3 months agopaper_title
280b389a-2340-4514-a09b-de46921c872e

ox
3 months agosection