Joseph Chang
@josephc.bsky.social
Reposted by Joseph Chang
@josephc.bsky.social @mariaa.bsky.social and I are at poster #21
findings from large scale survey of 800 researchers on how they use LMs in their research #colm2025
findings from large scale survey of 800 researchers on how they use LMs in their research #colm2025
October 8, 2025 at 8:12 PM
@josephc.bsky.social @mariaa.bsky.social and I are at poster #21
findings from large scale survey of 800 researchers on how they use LMs in their research #colm2025
findings from large scale survey of 800 researchers on how they use LMs in their research #colm2025
Joint work with Amanpreet Singh @arnaik19.bsky.social @sergeyf.bsky.social @paopow.bsky.social @kylelo.bsky.social @dougdowney.bsky.social Dan Weld and more. Please check it out and give us feedback : )
Can AI really help with literature reviews? 🧐
Meet Ai2 ScholarQA, an experimental solution that allows you to ask questions that require multiple scientific papers to answer. It gives more in-depth and contextual answers with table comparisons and expandable sections 💡
Try it now: scholarqa.allen.ai
Meet Ai2 ScholarQA, an experimental solution that allows you to ask questions that require multiple scientific papers to answer. It gives more in-depth and contextual answers with table comparisons and expandable sections 💡
Try it now: scholarqa.allen.ai
January 21, 2025 at 9:32 PM
Joint work with Amanpreet Singh @arnaik19.bsky.social @sergeyf.bsky.social @paopow.bsky.social @kylelo.bsky.social @dougdowney.bsky.social Dan Weld and more. Please check it out and give us feedback : )
Reposted by Joseph Chang
Can AI really help with literature reviews? 🧐
Meet Ai2 ScholarQA, an experimental solution that allows you to ask questions that require multiple scientific papers to answer. It gives more in-depth and contextual answers with table comparisons and expandable sections 💡
Try it now: scholarqa.allen.ai
Meet Ai2 ScholarQA, an experimental solution that allows you to ask questions that require multiple scientific papers to answer. It gives more in-depth and contextual answers with table comparisons and expandable sections 💡
Try it now: scholarqa.allen.ai
January 21, 2025 at 7:31 PM
Can AI really help with literature reviews? 🧐
Meet Ai2 ScholarQA, an experimental solution that allows you to ask questions that require multiple scientific papers to answer. It gives more in-depth and contextual answers with table comparisons and expandable sections 💡
Try it now: scholarqa.allen.ai
Meet Ai2 ScholarQA, an experimental solution that allows you to ask questions that require multiple scientific papers to answer. It gives more in-depth and contextual answers with table comparisons and expandable sections 💡
Try it now: scholarqa.allen.ai
Reposted by Joseph Chang
🤔Giving complex tasks to AI agents is easy—getting them to do exactly what you want isn’t. How can human-AI collaboration give us more reliable & steerable agents?
🍫Introducing Cocoa, our new interaction paradigm for balancing human & AI agency in complex human-AI workflows. 🧵
🍫Introducing Cocoa, our new interaction paradigm for balancing human & AI agency in complex human-AI workflows. 🧵
January 16, 2025 at 3:19 PM
🤔Giving complex tasks to AI agents is easy—getting them to do exactly what you want isn’t. How can human-AI collaboration give us more reliable & steerable agents?
🍫Introducing Cocoa, our new interaction paradigm for balancing human & AI agency in complex human-AI workflows. 🧵
🍫Introducing Cocoa, our new interaction paradigm for balancing human & AI agency in complex human-AI workflows. 🧵
How do scholars of diff backgrounds use LLMs as research tools? How do we perceive the risks & benefits of this new practice? Are we willing to disclose to peers and reviewers?
We conducted a large-scale survey of verified authors of different fields, race, gender, seniority to find out - results🧵
We conducted a large-scale survey of verified authors of different fields, race, gender, seniority to find out - results🧵
Hi everyone, I am excited to share our large-scale survey study with 800+ researchers, which reveals researchers’ usage and perceptions of LLMs as research tools, and how the usage and perceptions differ based on demographics.
See results in comments!
🔗 Arxiv link: arxiv.org/abs/2411.05025
See results in comments!
🔗 Arxiv link: arxiv.org/abs/2411.05025
LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptions
The rise of large language models (LLMs) has led many researchers to consider their usage for scientific work. Some have found benefits using LLMs to augment or automate aspects of their research pipe...
arxiv.org
December 2, 2024 at 10:19 PM
How do scholars of diff backgrounds use LLMs as research tools? How do we perceive the risks & benefits of this new practice? Are we willing to disclose to peers and reviewers?
We conducted a large-scale survey of verified authors of different fields, race, gender, seniority to find out - results🧵
We conducted a large-scale survey of verified authors of different fields, race, gender, seniority to find out - results🧵
Reposted by Joseph Chang
I'm recruiting 1-2 PhD students to work with me at the University of Colorado Boulder! Looking for creative students with interests in #NLP and #CulturalAnalytics.
Boulder is a lovely college town 30 minutes from Denver and 1 hour from Rocky Mountain National Park 😎
Apply by December 15th!
Boulder is a lovely college town 30 minutes from Denver and 1 hour from Rocky Mountain National Park 😎
Apply by December 15th!
November 19, 2024 at 10:38 AM
I'm recruiting 1-2 PhD students to work with me at the University of Colorado Boulder! Looking for creative students with interests in #NLP and #CulturalAnalytics.
Boulder is a lovely college town 30 minutes from Denver and 1 hour from Rocky Mountain National Park 😎
Apply by December 15th!
Boulder is a lovely college town 30 minutes from Denver and 1 hour from Rocky Mountain National Park 😎
Apply by December 15th!
Reposted by Joseph Chang
1/ Introducing ᴏᴘᴇɴꜱᴄʜᴏʟᴀʀ: a retrieval-augmented LM to help scientists synthesize knowledge 📚
@uwnlp.bsky.social & Ai2
With open models & 45M-paper datastores, it outperforms proprietary systems & match human experts.
Try out our demo!
openscholar.allen.ai
@uwnlp.bsky.social & Ai2
With open models & 45M-paper datastores, it outperforms proprietary systems & match human experts.
Try out our demo!
openscholar.allen.ai
November 19, 2024 at 4:30 PM
1/ Introducing ᴏᴘᴇɴꜱᴄʜᴏʟᴀʀ: a retrieval-augmented LM to help scientists synthesize knowledge 📚
@uwnlp.bsky.social & Ai2
With open models & 45M-paper datastores, it outperforms proprietary systems & match human experts.
Try out our demo!
openscholar.allen.ai
@uwnlp.bsky.social & Ai2
With open models & 45M-paper datastores, it outperforms proprietary systems & match human experts.
Try out our demo!
openscholar.allen.ai
Reposted by Joseph Chang
Excited to share ✨ Contextualized Evaluations ✨!
Benchmarks like Chatbot Arena contain underspecified queries, which can lead to arbitrary eval judgments. What happens if we provide evaluators with context (e.g who's the user, what's their intent) when judging LM outputs? 🧵↓
Benchmarks like Chatbot Arena contain underspecified queries, which can lead to arbitrary eval judgments. What happens if we provide evaluators with context (e.g who's the user, what's their intent) when judging LM outputs? 🧵↓
November 13, 2024 at 2:16 PM
Excited to share ✨ Contextualized Evaluations ✨!
Benchmarks like Chatbot Arena contain underspecified queries, which can lead to arbitrary eval judgments. What happens if we provide evaluators with context (e.g who's the user, what's their intent) when judging LM outputs? 🧵↓
Benchmarks like Chatbot Arena contain underspecified queries, which can lead to arbitrary eval judgments. What happens if we provide evaluators with context (e.g who's the user, what's their intent) when judging LM outputs? 🧵↓
Lit reviews often involves comparing sets of papers using common aspects in tables or spreadsheets -
@benn9.bsky.social & Yoonjoo Lee's #EMNLP paper explored ways to create such tables using LLMs, and how to evaluate them against a large set of lit review tables we extracted from arXiv.
@benn9.bsky.social & Yoonjoo Lee's #EMNLP paper explored ways to create such tables using LLMs, and how to evaluate them against a large set of lit review tables we extracted from arXiv.
✨EMNLP Paper! ✨
Have you ever constructed a table to organize your literature review process? Can we use LMs to generate these automatically?
We are excited to present ArxivDIGESTables 🍽️ a study of collecting, generating, and evaluating 🎓 scientific literature review tables 📃!
Have you ever constructed a table to organize your literature review process? Can we use LMs to generate these automatically?
We are excited to present ArxivDIGESTables 🍽️ a study of collecting, generating, and evaluating 🎓 scientific literature review tables 📃!
November 14, 2024 at 12:57 AM
Lit reviews often involves comparing sets of papers using common aspects in tables or spreadsheets -
@benn9.bsky.social & Yoonjoo Lee's #EMNLP paper explored ways to create such tables using LLMs, and how to evaluate them against a large set of lit review tables we extracted from arXiv.
@benn9.bsky.social & Yoonjoo Lee's #EMNLP paper explored ways to create such tables using LLMs, and how to evaluate them against a large set of lit review tables we extracted from arXiv.
Reposted by Joseph Chang
🚨 #CHI24 Paper Alert! 🚨
We introduce #meronymity, a novel design paradigm to mitigate social barriers in public social interactions by revealing aspects of identity to balance credibility & privacy. @axz.bsky.social @jbragg.bsky.social @josephc.bsky.social @karger.bsky.social
We introduce #meronymity, a novel design paradigm to mitigate social barriers in public social interactions by revealing aspects of identity to balance credibility & privacy. @axz.bsky.social @jbragg.bsky.social @josephc.bsky.social @karger.bsky.social
March 25, 2024 at 6:56 PM
🚨 #CHI24 Paper Alert! 🚨
We introduce #meronymity, a novel design paradigm to mitigate social barriers in public social interactions by revealing aspects of identity to balance credibility & privacy. @axz.bsky.social @jbragg.bsky.social @josephc.bsky.social @karger.bsky.social
We introduce #meronymity, a novel design paradigm to mitigate social barriers in public social interactions by revealing aspects of identity to balance credibility & privacy. @axz.bsky.social @jbragg.bsky.social @josephc.bsky.social @karger.bsky.social
Larrabee state park sunset
August 17, 2023 at 6:13 PM
Larrabee state park sunset
Pretty sure I don’t follow enough people here because my feed is 90% @cats.bsky.social now 😆
July 11, 2023 at 3:57 AM
Pretty sure I don’t follow enough people here because my feed is 90% @cats.bsky.social now 😆
Oyster Dome sunset 🙂
June 27, 2023 at 10:17 PM
Oyster Dome sunset 🙂