Evaluations/Qwen on Commitment Bank Q
main
cb/super_glue_cb_validation.parquet
texttext
Fireworks AI Fireworks AI
fireworks Qwen2.5 72B Instruct
qwen_prediction
Based on the premise,determine whether to agree with the hypothesis. Respond with only 0, 1 or 2. 2 for Support, 0 for Oppose, or 1 for Neutral.
premise:
{premise}
hypothesis:
{hypothesis}
Dec 6, 2024, 10:56 PM UTC
Dec 6, 2024, 10:56 PM UTC
5 row sample
802 tokens$ 0.0007
5 rows processed, 802 tokens used ($0.0007)
Estimated cost for all 56 rows: $0.0081
Sample Resultscompleted
7 columns, 1-5 of 56 rows