Dr. Claire Le Goues
@clegoues.bsky.social
Prof@SCS@CMU, scientist, software engineer, “heartless wench”, mama. It's pronounced "Le Gwess". Mostly academia, tech/SE, PGH. She/her
Pinned
Dr. Claire Le Goues
@clegoues.bsky.social
· Nov 26
I’ve been lurking for a bit, but with the influx of academics, good time for a quick (re-)intro? CS prof at Carnegie Mellon, specialty Software Engineering, especially all kinds of code transformation/program repair (so yes, a lot of AI codegen these days), plus SE4robotics sometimes. 1/
Reposted by Dr. Claire Le Goues
www.cics.umass.edu/news/fse-tes...
Incredibly honored to receive the ACM International Conference on the Foundations of Software Engineering 2025 Test of Time Award honorable mention for our work on overfitting in automated program repair. with Ted, @clegoues.bsky.social, Earl.
Incredibly honored to receive the ACM International Conference on the Foundations of Software Engineering 2025 Test of Time Award honorable mention for our work on overfitting in automated program repair. with Ted, @clegoues.bsky.social, Earl.
June 30, 2025 at 2:26 PM
www.cics.umass.edu/news/fse-tes...
Incredibly honored to receive the ACM International Conference on the Foundations of Software Engineering 2025 Test of Time Award honorable mention for our work on overfitting in automated program repair. with Ted, @clegoues.bsky.social, Earl.
Incredibly honored to receive the ACM International Conference on the Foundations of Software Engineering 2025 Test of Time Award honorable mention for our work on overfitting in automated program repair. with Ted, @clegoues.bsky.social, Earl.
Hoping this isn’t a sign of a streak, as the second conference in a row where my travel home is fubar (bumped from first flight; still technically possible to make my second, we’ll see).
Am accepting thoughts and prayers at this time.
Am accepting thoughts and prayers at this time.
June 28, 2025 at 4:01 AM
Hoping this isn’t a sign of a streak, as the second conference in a row where my travel home is fubar (bumped from first flight; still technically possible to make my second, we’ll see).
Am accepting thoughts and prayers at this time.
Am accepting thoughts and prayers at this time.
Reposted by Dr. Claire Le Goues
Claire Le Goues @clegoues.bsky.social gave a fantastic ISSTA @issta.bsky.social 2025 keynote this morning on software correctness in the age of generative AI.
June 26, 2025 at 9:24 AM
Claire Le Goues @clegoues.bsky.social gave a fantastic ISSTA @issta.bsky.social 2025 keynote this morning on software correctness in the age of generative AI.
Reposted by Dr. Claire Le Goues
Successfully defended my thesis today! Call me Doctor now :D
Big thank you to my advisors @vhellendoorn.bsky.social and @clegoues.bsky.social! :)
Big thank you to my advisors @vhellendoorn.bsky.social and @clegoues.bsky.social! :)
April 4, 2025 at 7:44 PM
Successfully defended my thesis today! Call me Doctor now :D
Big thank you to my advisors @vhellendoorn.bsky.social and @clegoues.bsky.social! :)
Big thank you to my advisors @vhellendoorn.bsky.social and @clegoues.bsky.social! :)
SUP fellow yinzers flying back from Cancun tomorrow: let the record show that I DID pay an extra $120/ticket to carefully select seats such that my spouse and I were seated next to our 4 and 6 yo minor children, and it was American Airlines that decided to separate us. 🙃
March 8, 2025 at 3:22 AM
SUP fellow yinzers flying back from Cancun tomorrow: let the record show that I DID pay an extra $120/ticket to carefully select seats such that my spouse and I were seated next to our 4 and 6 yo minor children, and it was American Airlines that decided to separate us. 🙃
Reposted by Dr. Claire Le Goues
‘You Can’t Let This Happen,’ Says Fundraising Email From Sitting U.S. Congressperson
February 12, 2025 at 5:00 PM
‘You Can’t Let This Happen,’ Says Fundraising Email From Sitting U.S. Congressperson
I dearly wish that the MSM would give Ted Cruz’s stupid list the primetime mockery coverage it deserves. Turns out if you search for the word “inequality” you get….Math proposals. Very woke and neo-Marxist. 🙄
February 13, 2025 at 12:18 AM
I dearly wish that the MSM would give Ted Cruz’s stupid list the primetime mockery coverage it deserves. Turns out if you search for the word “inequality” you get….Math proposals. Very woke and neo-Marxist. 🙄
Reposted by Dr. Claire Le Goues
all I know is that had President Biden forced out the FAA chief under pressure from his top adviser and his corrupt motives, and then the next week there was a plane crash that killed more than 60 people, Republicans would be howling that it was an impeachable offense.
January 30, 2025 at 7:15 PM
all I know is that had President Biden forced out the FAA chief under pressure from his top adviser and his corrupt motives, and then the next week there was a plane crash that killed more than 60 people, Republicans would be howling that it was an impeachable offense.
Reposted by Dr. Claire Le Goues
Apparently all the PhD researchers holding prestigious NSF-funded research fellowships are having their salaries withheld until some unspecified time when the leadership figures out how to eliminate any grant funding that doesn’t align with the president’s political ideology.
It’s official: all funding requests made on Tuesday by postdocs for their salaries have been unilaterally rejected by NSF.
January 30, 2025 at 9:24 PM
Apparently all the PhD researchers holding prestigious NSF-funded research fellowships are having their salaries withheld until some unspecified time when the leadership figures out how to eliminate any grant funding that doesn’t align with the president’s political ideology.
Reposted by Dr. Claire Le Goues
Government by ever growing katamari damacy ball of awful, incompetent, evil shitheads is going well.
January 30, 2025 at 10:18 PM
Government by ever growing katamari damacy ball of awful, incompetent, evil shitheads is going well.
Reposted by Dr. Claire Le Goues
Not gonna lie I did kinda expect our Democratic politicians to have something like a plan to counter the 920-page detailed fascist blueprint that was published in April 2023
January 29, 2025 at 4:25 PM
Not gonna lie I did kinda expect our Democratic politicians to have something like a plan to counter the 920-page detailed fascist blueprint that was published in April 2023
Void shout: want a student to run experiments via OpenAI. Can't get to Tier 2 until 7 days after buying $50 credit. Can't get to 3 until actually using $50, waiting 7 more days (it's kinda hard to spend $50 at Tier 1, for the record). Can't add more than $50 at once. Their "support" is ChatGPT. 1/
January 29, 2025 at 9:06 PM
Void shout: want a student to run experiments via OpenAI. Can't get to Tier 2 until 7 days after buying $50 credit. Can't get to 3 until actually using $50, waiting 7 more days (it's kinda hard to spend $50 at Tier 1, for the record). Can't add more than $50 at once. Their "support" is ChatGPT. 1/
In professional news: one of the things Biden signed his last week of office was a recognition of a set of PECASE awardees. Unbelievably honored (not to mention completely dumbfounded) to have been included on that list. 1/
www.cmu.edu/news/stories...
www.cmu.edu/news/stories...
CMU Researchers Receive Presidential Early Career Awards
Carnegie Mellon University's Ismaila Dabo, Claire Le Goues and Aaditya Ramdas are among the recipients of the Presidential Early Career Award for Scientists and Engineers (PECASE), the highest accolad...
www.cmu.edu
January 24, 2025 at 9:31 PM
In professional news: one of the things Biden signed his last week of office was a recognition of a set of PECASE awardees. Unbelievably honored (not to mention completely dumbfounded) to have been included on that list. 1/
www.cmu.edu/news/stories...
www.cmu.edu/news/stories...
Check out what my soon-to-graduate student Kush has been up to with the FAIR team! I particularly like how TestGenEval incorporates multiple metrics of test suite adequacy. 😊
Thrilled to announce our new work TestGenEval, a benchmark that measures unit test generation and test completion capabilities. This work was done in collaboration with the FAIR CodeGen team.
Preprint: arxiv.org/abs/2410.00752
Leaderboard: testgeneval.github.io/leaderboard....
Preprint: arxiv.org/abs/2410.00752
Leaderboard: testgeneval.github.io/leaderboard....
December 19, 2024 at 10:58 PM
Check out what my soon-to-graduate student Kush has been up to with the FAIR team! I particularly like how TestGenEval incorporates multiple metrics of test suite adequacy. 😊
Gave the last lecture of the semester yesterday, so of course 6 hours later I was down with a chest cold, and as of today/next day, I’ve totally lost my voice. #proflife
December 6, 2024 at 2:02 AM
Gave the last lecture of the semester yesterday, so of course 6 hours later I was down with a chest cold, and as of today/next day, I’ve totally lost my voice. #proflife
In parenting wins, I’m pleased to report that my 3-yo son’s consistent, natural, uncoached/unprompted reaction to seeing a cybertruck in the wild is to burst out laughing, point, and say, “that’s so silly!”
November 29, 2024 at 3:30 PM
In parenting wins, I’m pleased to report that my 3-yo son’s consistent, natural, uncoached/unprompted reaction to seeing a cybertruck in the wild is to burst out laughing, point, and say, “that’s so silly!”
BTW, if you’re interested in leakage in LLM-based SE results — this other paper doesn’t focus on leakage, but takes a bit of a side quest on the subject, related to the BigVul dataset and vulnerability detection.
We have other recent results on LLM-based security vulnerability detection that includes similarly alarming indications of leakage on BigVul, even though that’s not the main point of the study…(s/o to the student, Aidan, not On Here.)
arxiv.org/abs/2406.05892
So…yeah…we may have a problem. 😅 /fin
arxiv.org/abs/2406.05892
So…yeah…we may have a problem. 😅 /fin
November 26, 2024 at 6:53 PM
BTW, if you’re interested in leakage in LLM-based SE results — this other paper doesn’t focus on leakage, but takes a bit of a side quest on the subject, related to the BigVul dataset and vulnerability detection.
Reposted by Dr. Claire Le Goues
Live view of professors joining Bluesky.
a woman is opening the trunk of a blue hyundai car
ALT: a woman is opening the trunk of a blue hyundai car
media.tenor.com
November 17, 2024 at 5:27 PM
Live view of professors joining Bluesky.
Reposted by Dr. Claire Le Goues
I'd like to thank that one student in the corner who nodded along with me all semester. You make it all possible.
November 19, 2024 at 8:49 PM
I'd like to thank that one student in the corner who nodded along with me all semester. You make it all possible.
And now that we’re all here, some work!🚨 Are Large Language Models Memorizing Bug Benchmarks? 🚨
There’s growing concern that LLMs for SE are prone to data leakage, but no one has quantified it... until now. 🕵️♂️ 1/
There’s growing concern that LLMs for SE are prone to data leakage, but no one has quantified it... until now. 🕵️♂️ 1/
arxiv.org
November 26, 2024 at 4:06 PM
And now that we’re all here, some work!🚨 Are Large Language Models Memorizing Bug Benchmarks? 🚨
There’s growing concern that LLMs for SE are prone to data leakage, but no one has quantified it... until now. 🕵️♂️ 1/
There’s growing concern that LLMs for SE are prone to data leakage, but no one has quantified it... until now. 🕵️♂️ 1/
I’ve been lurking for a bit, but with the influx of academics, good time for a quick (re-)intro? CS prof at Carnegie Mellon, specialty Software Engineering, especially all kinds of code transformation/program repair (so yes, a lot of AI codegen these days), plus SE4robotics sometimes. 1/
November 26, 2024 at 1:32 PM
I’ve been lurking for a bit, but with the influx of academics, good time for a quick (re-)intro? CS prof at Carnegie Mellon, specialty Software Engineering, especially all kinds of code transformation/program repair (so yes, a lot of AI codegen these days), plus SE4robotics sometimes. 1/
Reposted by Dr. Claire Le Goues
In my opinion "Twitter" is whichever place most embodies the poster's spirit, and that's here now
November 17, 2024 at 2:35 AM
In my opinion "Twitter" is whichever place most embodies the poster's spirit, and that's here now
Reposted by Dr. Claire Le Goues
The Onion should buy Elsevier next
November 14, 2024 at 8:28 PM
The Onion should buy Elsevier next
I’m not sure how active everyone is yet, but it’s nice to see what feels like a critical mass of CS/SE/PL academia moving over here.
November 16, 2024 at 11:43 PM
I’m not sure how active everyone is yet, but it’s nice to see what feels like a critical mass of CS/SE/PL academia moving over here.