Repository evaluations - datasets/ChartQA

Evaluations/Llama 11B Conclusion

llama-3.2-11B-cot-separate-steps

val_100_ex.json

Type: image → text

Model:

Meta/Llama 3.2 11B Vision

Provider:

Groq

Target field: conclusion

Prompt

{imgname}

I have an image and a question that I want you to answer. Take the following summary, caption, and reasoning to come up with a final conclusion.

Give the final answer in a direct format, and it must be concise match the correct answer exactly.

If it's a multiple choice question, the conclusion should only include the option without repeating what the option is.

Question:
{query}

Summary:
{summary}

Caption:
{caption}

Reasoning:
{reasoning}

Conclusion:

Queued: Dec 6, 2024, 5:20 PM UTC

Completed: Dec 6, 2024, 5:20 PM UTC

00:00:03

5 row sample

4225 tokens$ 0.0008

5 rows processed, 4225 tokens used ($0.0008)

Estimated cost for all 100 rows: $0.0152

Sample Results completed

9 columns, 1-5 of 100 rows