Evaluations/Qwen 72B on Boolq Validation
main
boolq/super_glue_boolq_validation.parquet
text → text
Fireworks AI Fireworks AI
fireworks Qwen2.5 72B Instruct
qwen_prediction
According to the context, answer the question with only 1 or 0. 1 for yes and 0 for no
context:
{passage}
question:
{question}
2700 rows processed
of 3270 rows
83%
83%
Dec 6, 2024, 10:40 PM UTC
no case clause matching: {:error, "resource_not_found"}
2700 / 3270 rows
546534 tokens$ 0.4900
2700 rows processed, 546534 tokens used ($0.4900)
error
Error: no case clause matching: {:error, "resource_not_found"}
Loading...