Evaluations/Qwen on Commitment Bank Q
main
cb/super_glue_cb_validation.parquet
texttext
QwenQwen/Qwen2.5 72B Instruct
Fireworks AI Fireworks AI
qwen_prediction
Based on the premise,determine whether to agree with the hypothesis. Respond with only 0, 1 or 2. 2 for Support, 0 for Oppose, or 1 for Neutral.
premise:
{premise}
hypothesis:
{hypothesis}
Dec 6, 2024, 10:56 PM UTC
Dec 6, 2024, 10:56 PM UTC
00:00:01
5 row sample
802 tokens$ 0.0007
5 rows processed, 802 tokens used ($0.0007)
Estimated cost for all 56 rows: $0.0081
Sample Results completed
7 columns, 1-5 of 56 rows
premise
hypothesis
Valence the void-brain, Valence the virtuous valet. Why couldn't the figger choose his own portion of titanic anatomy to shaft? Did he think he was helping?
Valence was helping
``Who knows? The point is, do we go with it or not?'' Do we assume there is a shipment?
there is a shipment
``But my father always taught me never to be afraid of pointing out the obvious. I'm sure you have noticed the implication of the letter, that the writer has in fact observed Jenny undressing for bed?'' I just wondered if you also knew as I'm sure you do that her bedroom's at the rear of the house?
Jenny's bedroom's at the rear of the house
A: so I don't know if I wasn't drug tested based on that or because the man who hired me didn't request the drug test, because I know that my company does drug testing on occasion. B: Right. Well, for instance, does the company you worked for before have the right or do they have the ability to say, hey, we've already drug tested her and she came up negative. A: Well, no, I don't think they can force another company to not drug test me just by saying that I didn't, I mean,
they can force another company to not drug test her
A: for the moment, and that's what really is getting me about what George Bush's stand on the budget is right now is that he is saying, I am going to give you this ludicrous little tax cut so that you'll be happy come November, and you'll elect me again B: Uh-huh. Uh-huh. A: and then I'm going to go on and just forget everything that I said B: Uh-huh. A: or you know, it doesn't seem that it's going to make much of a difference.
it's going to make much of a difference