Evaluations/Llama 90B Conclusions
llama-90B-CoT-separate-steps
val_100_ex.json
image → text
Groq Groq
groq Llama 3.2 11B Vision (Preview)
conclusion
{imgname}

I have an image and a question that I want you to answer. Take the following summary, caption, and reasoning to come up with a final conclusion.

Give the final answer in a direct format, and it must be concise match the correct answer exactly. Do not ramble, just give the final answer, no other words. If it is a numeric value just answer with the number.

If it's a multiple choice question, the conclusion should only include the option without repeating what the option is.

Question:
{query}

Summary:
{summary}

Caption:
{caption}

Reasoning:
{reasoning}

Conclusion:
1 rows processed
of 100 rows
1%
1%
Dec 6, 2024, 5:23 PM UTC
no case clause matching: {:error, "An exception occurred indexing, getting dataframe and running evaluation: %FunctionClauseError{module: String, function: :replace, arity: 4, kind: nil, args: nil, clauses: nil}", 0, 0}
1 / 100 rows
1984 tokens$ 0.0000
1 row processed, 1984 tokens used ($0.0000)
error
Error: no case clause matching: {:error, "An exception occurred indexing, getting dataframe and running evaluation: %FunctionClauseError{module: String, function: :replace, arity: 4, kind: nil, args: nil, clauses: nil}", 0, 0}