llama-90B-CoT-separate-steps
val_100_ex.json
image → text
Groq
Llama 3.2 11B Vision (Preview)
conclusion
{imgname} I have an image and a question that I want you to answer. Take the following summary, caption, and reasoning to come up with a final conclusion. Give the final answer in a direct format, and it must be concise match the correct answer exactly. Do not ramble, just give the final answer, no other words. If it is a numeric value just answer with the number. If it's a multiple choice question, the conclusion should only include the option without repeating what the option is. Question: {query} Summary: {summary} Caption: {caption} Reasoning: {reasoning} Conclusion:
1 rows processed
of 100 rows
Dec 6, 2024, 5:23 PM UTC
no case clause matching: {:error, "An exception occurred indexing, getting dataframe and running evaluation: %FunctionClauseError{module: String, function: :replace, arity: 4, kind: nil, args: nil, clauses: nil}", 0, 0}
1 / 100 rows
1984 tokens$ 0.0000
1 row processed, 1984 tokens used ($0.0000)
error
Error: no case clause matching: {:error, "An exception occurred indexing, getting dataframe and running evaluation: %FunctionClauseError{module: String, function: :replace, arity: 4, kind: nil, args: nil, clauses: nil}", 0, 0}