Evaluations/llama 70B on Commitment Bank
main
cb/super_glue_cb_validation.parquet
texttext
Fireworks AI Fireworks AI
fireworks Llama v3.1 70B Instruct
llama_prediction
Based on the premise,determine whether to agree with the hypothesis. Respond with only 0, 1 or 2. 2 for Support, 0 for Oppose, or 1 for Neutral.
premise:
{premise}
hypothesis:
{hypothesis}
Dec 6, 2024, 11:19 PM UTC
Dec 6, 2024, 11:19 PM UTC
5 row sample
732 tokens$ 0.0007
5 rows processed, 732 tokens used ($0.0007)
Estimated cost for all 56 rows: $0.0074
Sample Resultscompleted
7 columns, 1-5 of 56 rows