model, wrong titles, hallucinated titles, wrong authors
ChatGPT 4.5, 2, 1, 6
Gemini 2.5 Pro, 1, 0, 2
Claude 3.7 Sonnet, 5, 4, 9
Grok 3 thinking, 5, 3, 8
model, wrong titles, hallucinated titles, wrong authors
ChatGPT 4.5, 2, 1, 6
Gemini 2.5 Pro, 1, 0, 2
Claude 3.7 Sonnet, 5, 4, 9
Grok 3 thinking, 5, 3, 8
This is a shelf of books. Please analyze the image for books and create a csv file in the format:
book_title, author, edition (if applicable)
<insert row>...
…
This is a shelf of books. Please analyze the image for books and create a csv file in the format:
book_title, author, edition (if applicable)
<insert row>...
…
Retested using o3 and it nailed it. Every title, author, and edition was perfect.
Retested using o3 and it nailed it. Every title, author, and edition was perfect.