Can AI tools fact-check images? The Tow Center tested 10 images, asking AI tools to: 𝗰𝗼𝗻𝗳𝗶𝗿𝗺 𝘄𝗵𝗲𝘁𝗵𝗲𝗿 𝗲𝗮𝗰𝗵 𝗶𝗺𝗮𝗴𝗲 𝗶𝘀 𝗿𝗲𝗮𝗹 and identify its 𝗹𝗼𝗰𝗮𝘁𝗶𝗼𝗻, 𝗱𝗮𝘁𝗲, and 𝘀𝗼𝘂𝗿𝗰𝗲.

Results were...well, there's a lot of red on this chart.

Read the research here:
www.cjr.org/tow_center/w...

“AI search” has a citation problem.

Latest from @towcenter.bsky.social

www.cjr.org/tow_center/w...

It turns out this problem extends to many other chatbots too. In @towcenter.bsky.social's tests, they often cited the wrong article, and sometimes also fabricated links & cited syndicated or plagiarized articles instead of the original.

This builds on prior tests showing that ChatGPT frequently cited the wrong source article, but rarely expressed uncertainty. If it didn't know the answer (at least to the kinds of questions we asked), it confidently made one up. cjr.org/tow_center/how-chatgpt-misrepresents-publisher-content.php

Are you using Generative AI tools as your search engine? @towcenter.bsky.social ran a test to see how often they cite news articles correctly given direct quotes from them.

Results are troubling.

www.cjr.org/tow_center/w...

Great work by @aisvarya17.bsky.social and @klaudia.bsky.social