@boydgraber.bsky.social
In 2021, we proposed using IRT to find bad examples and to create more targeted leaderboards (Evaluation
Examples Are Not Equally Informative: How Should That Change NLP Leaderboards?).
From my reading, the big difference seems to be that they're also using the agent's skill, which is super cool!
Examples Are Not Equally Informative: How Should That Change NLP Leaderboards?).
From my reading, the big difference seems to be that they're also using the agent's skill, which is super cool!
September 18, 2025 at 8:19 PM
In 2021, we proposed using IRT to find bad examples and to create more targeted leaderboards (Evaluation
Examples Are Not Equally Informative: How Should That Change NLP Leaderboards?).
From my reading, the big difference seems to be that they're also using the agent's skill, which is super cool!
Examples Are Not Equally Informative: How Should That Change NLP Leaderboards?).
From my reading, the big difference seems to be that they're also using the agent's skill, which is super cool!
Today's the deadline to apply for an AI-specific teaching track position at UMD:
umd.wd1.myworkdayjobs.com/UMCP/job/Uni...
Please join us!
umd.wd1.myworkdayjobs.com/UMCP/job/Uni...
Please join us!
August 22, 2025 at 3:47 PM
Today's the deadline to apply for an AI-specific teaching track position at UMD:
umd.wd1.myworkdayjobs.com/UMCP/job/Uni...
Please join us!
umd.wd1.myworkdayjobs.com/UMCP/job/Uni...
Please join us!
We had our first human–computer cooperative AI tournament at the UMD. Key takeaways: 1) computers are getting better at trivia 2) they still suck at calibration 3) our teaming mechanic kept the games competitive and mostly fun (at least that’s what the players said).
June 17, 2025 at 3:35 PM
We had our first human–computer cooperative AI tournament at the UMD. Key takeaways: 1) computers are getting better at trivia 2) they still suck at calibration 3) our teaming mechanic kept the games competitive and mostly fun (at least that’s what the players said).
Today is the deadline to sign up for our Human-Computer trivia competition held on June 14, 2024 in College Park, MD. $150 prize for the team who can answer the most questions with the help of an AI.
![QANTA: Question Answering is not a Trivial Activity Logo [Two humans working with a computer to answer a question]](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:fl42ibvzjfunee4t4zqvxurf/bafkreigcvckbbculrr5g3emigdt67avtojtcf24x6tjdfk6uwbqny6pilu@jpeg)
June 10, 2025 at 4:23 PM
Today is the deadline to sign up for our Human-Computer trivia competition held on June 14, 2024 in College Park, MD. $150 prize for the team who can answer the most questions with the help of an AI.
Do you like trivia? Can you spot when AI is feeding you BS? Or can you make AIs turn themselves inside out? Then on June 14 at College Park (or June 21 online), we have a competition for you.
June 5, 2025 at 4:17 PM
Do you like trivia? Can you spot when AI is feeding you BS? Or can you make AIs turn themselves inside out? Then on June 14 at College Park (or June 21 online), we have a competition for you.