James Michaelov
@jamichaelov.bsky.social
Postdoc at MIT. Research: language, the brain, NLP.
jmichaelov.com
jmichaelov.com
Reposted by James Michaelov
I’m in Vienna all week for @aclmeeting.bsky.social and I’ll be presenting this paper on Wednesday at 11am (Poster Session 4 in HALL X4 X5)! Reach out if you want to chat about multilingual NLP, tokenizers, and open models!
✨New pre-print✨ Crosslingual transfer allows models to leverage their representations for one language to improve performance on another language. We characterize the acquisition of shared representations in order to better understand how and when crosslingual transfer happens.
July 27, 2025 at 3:29 PM
I’m in Vienna all week for @aclmeeting.bsky.social and I’ll be presenting this paper on Wednesday at 11am (Poster Session 4 in HALL X4 X5)! Reach out if you want to chat about multilingual NLP, tokenizers, and open models!
New paper accepted at ACL Findings! TL;DR: While language models generally predict sentences describing possible events to have a higher probability than impossible (animacy-violating) ones, this is not robust for generally unlikely events and is impacted by semantic relatedness. 1/3
June 12, 2025 at 5:54 PM
New paper accepted at ACL Findings! TL;DR: While language models generally predict sentences describing possible events to have a higher probability than impossible (animacy-violating) ones, this is not robust for generally unlikely events and is impacted by semantic relatedness. 1/3
Reposted by James Michaelov
My paper with @tylerachang.bsky.social and @jamichaelov.bsky.social will appear at #ACL2025NLP! The updated preprint is available on arxiv. I look forward to chatting about bilingual models in Vienna!
✨New pre-print✨ Crosslingual transfer allows models to leverage their representations for one language to improve performance on another language. We characterize the acquisition of shared representations in order to better understand how and when crosslingual transfer happens.
June 5, 2025 at 2:18 PM
My paper with @tylerachang.bsky.social and @jamichaelov.bsky.social will appear at #ACL2025NLP! The updated preprint is available on arxiv. I look forward to chatting about bilingual models in Vienna!
Reposted by James Michaelov
✨New pre-print✨ Crosslingual transfer allows models to leverage their representations for one language to improve performance on another language. We characterize the acquisition of shared representations in order to better understand how and when crosslingual transfer happens.
March 7, 2025 at 4:34 PM
✨New pre-print✨ Crosslingual transfer allows models to leverage their representations for one language to improve performance on another language. We characterize the acquisition of shared representations in order to better understand how and when crosslingual transfer happens.
Reposted by James Michaelov
With all the new people here on Bluesky, I think it’s a good time to (re-)introduce myself. I’m a postdoc at MIT carrying out research at the intersection of the cognitive science of language and AI. Here are some of the things I’ve worked on in the last year 🧵:
November 10, 2024 at 7:34 PM
With all the new people here on Bluesky, I think it’s a good time to (re-)introduce myself. I’m a postdoc at MIT carrying out research at the intersection of the cognitive science of language and AI. Here are some of the things I’ve worked on in the last year 🧵:
Excited to be at #EMNLP #EMNLP2024 this year! Especially interested in chatting about the intersection of cognitive science/psycholinguistics and AI/NLP, training dynamics, robustness/reliability, meaning, and evaluation
Also, I’m going to be attending EMNLP next week - reach out if you want to meet/chat
November 11, 2024 at 7:03 PM
Excited to be at #EMNLP #EMNLP2024 this year! Especially interested in chatting about the intersection of cognitive science/psycholinguistics and AI/NLP, training dynamics, robustness/reliability, meaning, and evaluation
With all the new people here on Bluesky, I think it’s a good time to (re-)introduce myself. I’m a postdoc at MIT carrying out research at the intersection of the cognitive science of language and AI. Here are some of the things I’ve worked on in the last year 🧵:
November 10, 2024 at 7:34 PM
With all the new people here on Bluesky, I think it’s a good time to (re-)introduce myself. I’m a postdoc at MIT carrying out research at the intersection of the cognitive science of language and AI. Here are some of the things I’ve worked on in the last year 🧵:
In the interest of actually posting about my research on here: We know that the predictions that language models make are similar to those that humans make as we process language, but how similar? aclanthology.org/2022.conll-1... 🧵:
April 2, 2024 at 7:21 PM
In the interest of actually posting about my research on here: We know that the predictions that language models make are similar to those that humans make as we process language, but how similar? aclanthology.org/2022.conll-1... 🧵:
Looking forward to the final day of EMMLP! Let me know if you want to chat about our Findings paper: “Emergent inabilities? Inverse scaling over the course of pretraining” arxiv.org/abs/2305.14681 #EMNLP #EMNLP2023
December 10, 2023 at 1:07 AM
Looking forward to the final day of EMMLP! Let me know if you want to chat about our Findings paper: “Emergent inabilities? Inverse scaling over the course of pretraining” arxiv.org/abs/2305.14681 #EMNLP #EMNLP2023
Presenting this at the 2pm poster session today! #EMNLP #EMNLP2023
Excited to present our paper "Structural Priming Demonstrates Abstract Grammatical Representations in Multilingual Language Models" at EMNLP next week! arxiv.org/abs/2311.09194
Structural Priming Demonstrates Abstract Grammatical...
Abstract grammatical knowledge - of parts of speech and grammatical patterns - is key to the capacity for linguistic generalization in humans. But how abstract is grammatical knowledge in large...
arxiv.org
December 8, 2023 at 1:08 AM
Presenting this at the 2pm poster session today! #EMNLP #EMNLP2023
Excited to present our paper "Structural Priming Demonstrates Abstract Grammatical Representations in Multilingual Language Models" at EMNLP next week! arxiv.org/abs/2311.09194
Structural Priming Demonstrates Abstract Grammatical...
Abstract grammatical knowledge - of parts of speech and grammatical patterns - is key to the capacity for linguistic generalization in humans. But how abstract is grammatical knowledge in large...
arxiv.org
December 1, 2023 at 12:53 AM
Excited to present our paper "Structural Priming Demonstrates Abstract Grammatical Representations in Multilingual Language Models" at EMNLP next week! arxiv.org/abs/2311.09194