Evaluations/Filter Answerable Questions
main
data/05_answerable_questions.parquet
texttext
QwenQwen/Qwen 2.5 Coder 32B Instruct
Fireworks AI Fireworks AI
prediction
You are an expert in version control systems and data engineering. Take the following section from the documentation of Oxen AI, a data version control system, as well as a relevant question. If the question is answerable from the information present in the section, answer with "answerable"; if it is not, answer with "unanswerable". Do not include anything else in your answer.

Title: <section_title>{section_title}</section_title>
Section: <section>{section}</section>
Question: <question>{question}</question>

Is the question answerable based on the information in the section? If so, answer with "answerable" and otherwise answer with "unanswerable". Do not answer with anything besides answerable/unanswerable, and do not include any additional explanation.
Jan 21, 2025, 10:08 PM UTC
Jan 21, 2025, 10:08 PM UTC
25 row sample
9690 tokens$ 0.0087
25 rows processed, 9690 tokens used ($0.0087)
Estimated cost for all 68 rows: $0.0237
Sample Results completed
9 columns, 1-25 of 68 rows