Jeremy Bradbury
@jeremybradbury.bsky.social
Professor (Computer Science) at #OntarioTech
Software Eng & CS Education Researcher
Passionate about applying #AI to SE & #CSEd
Views are mine👨🏻💻🇨🇦 (he/him)
🌐 www.seerlab.ca 🦋 @seerlab.bsky.social
Software Eng & CS Education Researcher
Passionate about applying #AI to SE & #CSEd
Views are mine👨🏻💻🇨🇦 (he/him)
🌐 www.seerlab.ca 🦋 @seerlab.bsky.social
Reposted by Jeremy Bradbury
🚀 Mark your calendars 🗓️! The IEEE CASCON 2025 call for contributions and proposals is open.
We look forward to your submissions!
#CASCON2025 will be held this year at vibrant Toronto, Second Student Centre, York University, 15 Library Lane, Toronto, ON, Canada
More details: cascon.ca
We look forward to your submissions!
#CASCON2025 will be held this year at vibrant Toronto, Second Student Centre, York University, 15 Library Lane, Toronto, ON, Canada
More details: cascon.ca
CASCON 2025
cascon.ca
April 9, 2025 at 6:29 PM
🚀 Mark your calendars 🗓️! The IEEE CASCON 2025 call for contributions and proposals is open.
We look forward to your submissions!
#CASCON2025 will be held this year at vibrant Toronto, Second Student Centre, York University, 15 Library Lane, Toronto, ON, Canada
More details: cascon.ca
We look forward to your submissions!
#CASCON2025 will be held this year at vibrant Toronto, Second Student Centre, York University, 15 Library Lane, Toronto, ON, Canada
More details: cascon.ca
Reposted by Jeremy Bradbury
SEER Lab’s Jeremy Bradbury & Riddhi More are in Naples, Italy 🇮🇹 attending the 18th IEEE Int’l Conference on Software Testing, Verification and Validation (#ICST2025) where they are presenting two research papers. Dr. Bradbury is also a member of the faculty panel at the ICST Doctoral Symposium.
April 2, 2025 at 10:09 AM
SEER Lab’s Jeremy Bradbury & Riddhi More are in Naples, Italy 🇮🇹 attending the 18th IEEE Int’l Conference on Software Testing, Verification and Validation (#ICST2025) where they are presenting two research papers. Dr. Bradbury is also a member of the faculty panel at the ICST Doctoral Symposium.
Today we had a successful 8th IEEE Int’l Workshop on Next Level of Test Automation (#NEXTA2025). Highlights included:
✅ KEYNOTE by Serge Demeyer
✅ TALKS
- Influence of Pure & Unit-Like Tests on SBFL
- Witness Test Program Generation
- Adaptive Testing for LLM-Based Applications
✅ DISCUSSION!
✅ KEYNOTE by Serge Demeyer
✅ TALKS
- Influence of Pure & Unit-Like Tests on SBFL
- Witness Test Program Generation
- Adaptive Testing for LLM-Based Applications
✅ DISCUSSION!
March 31, 2025 at 3:32 PM
Today we had a successful 8th IEEE Int’l Workshop on Next Level of Test Automation (#NEXTA2025). Highlights included:
✅ KEYNOTE by Serge Demeyer
✅ TALKS
- Influence of Pure & Unit-Like Tests on SBFL
- Witness Test Program Generation
- Adaptive Testing for LLM-Based Applications
✅ DISCUSSION!
✅ KEYNOTE by Serge Demeyer
✅ TALKS
- Influence of Pure & Unit-Like Tests on SBFL
- Witness Test Program Generation
- Adaptive Testing for LLM-Based Applications
✅ DISCUSSION!
Looking for evidence of data leakage in the #HumanEval code generation #LLM benchmark? Check out our analysis of a subset of HumanEval tasks vs comparable tasks on #ChatGPT, #Claude and #Llama. @riddhimore.bsky.social
March 7, 2025 at 3:22 PM
Looking for evidence of data leakage in the #HumanEval code generation #LLM benchmark? Check out our analysis of a subset of HumanEval tasks vs comparable tasks on #ChatGPT, #Claude and #Llama. @riddhimore.bsky.social
Human Brain vs. LLM Agent
🧠 vs. 🤖
Hardware…
Consciousness…
Learning style…
Creativity…
- Bang Liu, #SANER2025 Keynote
🧠 vs. 🤖
Hardware…
Consciousness…
Learning style…
Creativity…
- Bang Liu, #SANER2025 Keynote
March 7, 2025 at 3:05 PM
Human Brain vs. LLM Agent
🧠 vs. 🤖
Hardware…
Consciousness…
Learning style…
Creativity…
- Bang Liu, #SANER2025 Keynote
🧠 vs. 🤖
Hardware…
Consciousness…
Learning style…
Creativity…
- Bang Liu, #SANER2025 Keynote
The Large Language Model (#LLM) Lifecycle from #SANER2025 keynote by Dr. Bang Liu, University of Montreal
➡️ Pre-Training (e.g. data synthesis, model architecture)
➡️ Post-Training (e.g. instruction tuning, bias mitigation)
➡️ Serving (e.g. cloud deployment)
➡️ Utilization(e.g. prompt engineering, RAG)
➡️ Pre-Training (e.g. data synthesis, model architecture)
➡️ Post-Training (e.g. instruction tuning, bias mitigation)
➡️ Serving (e.g. cloud deployment)
➡️ Utilization(e.g. prompt engineering, RAG)
March 7, 2025 at 2:56 PM
The Large Language Model (#LLM) Lifecycle from #SANER2025 keynote by Dr. Bang Liu, University of Montreal
➡️ Pre-Training (e.g. data synthesis, model architecture)
➡️ Post-Training (e.g. instruction tuning, bias mitigation)
➡️ Serving (e.g. cloud deployment)
➡️ Utilization(e.g. prompt engineering, RAG)
➡️ Pre-Training (e.g. data synthesis, model architecture)
➡️ Post-Training (e.g. instruction tuning, bias mitigation)
➡️ Serving (e.g. cloud deployment)
➡️ Utilization(e.g. prompt engineering, RAG)
Yesterday Riddhi More presented our paper “Assessing Data Augmentation-Induced Bias in Training and Testing of Machine Learning Models” at the 1st Int’l Workshop on Fairness in Software Systems (#FAIRNESS2025) in Montreal, Canada. 🇨🇦
Paper preprint, slides & code/data available at: bit.ly/4brEBJm
Paper preprint, slides & code/data available at: bit.ly/4brEBJm
March 5, 2025 at 2:45 PM
Yesterday Riddhi More presented our paper “Assessing Data Augmentation-Induced Bias in Training and Testing of Machine Learning Models” at the 1st Int’l Workshop on Fairness in Software Systems (#FAIRNESS2025) in Montreal, Canada. 🇨🇦
Paper preprint, slides & code/data available at: bit.ly/4brEBJm
Paper preprint, slides & code/data available at: bit.ly/4brEBJm
“Code generation is just the tip of the iceberg towards automated software engineering!!” - Dr. Baishakhi Ray (Columbia University), #SANER2025 Keynote
March 5, 2025 at 2:36 PM
“Code generation is just the tip of the iceberg towards automated software engineering!!” - Dr. Baishakhi Ray (Columbia University), #SANER2025 Keynote
Reposted by Jeremy Bradbury
MSc student Riddhi More & Prof. Jeremy Bradbury are in Montreal, PQ this week attending the IEEE Int’l Conference on Software Analysis, Evolution and Reengineering (#SANER2025) and the 1st Int’l Workshop on Fairness in Software Systems (#FAIRNESS2025).
March 4, 2025 at 4:12 PM
MSc student Riddhi More & Prof. Jeremy Bradbury are in Montreal, PQ this week attending the IEEE Int’l Conference on Software Analysis, Evolution and Reengineering (#SANER2025) and the 1st Int’l Workshop on Fairness in Software Systems (#FAIRNESS2025).
A great keynote by Foutse Khomh (@swatlab.bsky.social) on “Navigating Fairness Challenges in Intelligent Software Systems” at #FAIRNESS2025. I appreciated the emphasis on #AI model transparency, auditing and governance as essential to the development of fair systems that mitigate bias.
March 4, 2025 at 3:13 PM
A great keynote by Foutse Khomh (@swatlab.bsky.social) on “Navigating Fairness Challenges in Intelligent Software Systems” at #FAIRNESS2025. I appreciated the emphasis on #AI model transparency, auditing and governance as essential to the development of fair systems that mitigate bias.
Reposted by Jeremy Bradbury
Today Dr. Michael Miljanovic presented our latest paper at #SIGCSE2025. The paper titled “How Effective and Efficient Are Student-Written Software Tests?”, is co-authored by Amanda Showler, Michael Miljanovic, and Jeremy Bradbury. 📄: www.sqrlab.ca/publications...
February 28, 2025 at 8:51 PM
Today Dr. Michael Miljanovic presented our latest paper at #SIGCSE2025. The paper titled “How Effective and Efficient Are Student-Written Software Tests?”, is co-authored by Amanda Showler, Michael Miljanovic, and Jeremy Bradbury. 📄: www.sqrlab.ca/publications...
Reposted by Jeremy Bradbury
Hello 🦋 world!
We're getting ready for IEEE SCAM 2025 in Auckland, New Zealand.
conf.researchr.org/home/scam-2025
We're getting ready for IEEE SCAM 2025 in Auckland, New Zealand.
conf.researchr.org/home/scam-2025
SCAM 2025
The aim of the IEEE International Conference on Source Code Analysis & Manipulation (SCAM) is to bring together researchers and practitioners working on theory, techniques and applications that concer...
conf.researchr.org
February 24, 2025 at 11:55 AM
Hello 🦋 world!
We're getting ready for IEEE SCAM 2025 in Auckland, New Zealand.
conf.researchr.org/home/scam-2025
We're getting ready for IEEE SCAM 2025 in Auckland, New Zealand.
conf.researchr.org/home/scam-2025
Thank you to the organizers of the #AI Meets Software Quality Int’l Colloquium for inviting Riddhi More & I to speak on Monday. If you're interested in #LLMs & #flakytests the preprints of the papers presented are available at bit.ly/40OvYUa (FlakyXbert) & bit.ly/4jILzNT (augmentation bias).
February 5, 2025 at 4:29 PM
Thank you to the organizers of the #AI Meets Software Quality Int’l Colloquium for inviting Riddhi More & I to speak on Monday. If you're interested in #LLMs & #flakytests the preprints of the papers presented are available at bit.ly/40OvYUa (FlakyXbert) & bit.ly/4jILzNT (augmentation bias).
Reposted by Jeremy Bradbury
Tomorrow Prof. Jeremy Bradbury & MSc student Riddhi More will be presenting "FlakyXbert: A Few-Shot Learning Framework for Detecting and Classifying Flaky Tests" at the AI Meets Software Quality International Colloquium (bit.ly/42DAZ4M)
#AI #LLM #testing #flakytests #dataaugmentation #bias
#AI #LLM #testing #flakytests #dataaugmentation #bias
February 2, 2025 at 8:34 PM
Tomorrow Prof. Jeremy Bradbury & MSc student Riddhi More will be presenting "FlakyXbert: A Few-Shot Learning Framework for Detecting and Classifying Flaky Tests" at the AI Meets Software Quality International Colloquium (bit.ly/42DAZ4M)
#AI #LLM #testing #flakytests #dataaugmentation #bias
#AI #LLM #testing #flakytests #dataaugmentation #bias
Our paper "Addressing #DataLeakage in #HumanEval Using Combinatorial Test Design" has been accepted for publication at the Int’l Conference on Software Testing, Verification & Validation (#ICST2025), Short Papers, Vision & Emerging Results.
co-author: Riddhi More
arxiv.org/abs/2412.01526
#benchmark
co-author: Riddhi More
arxiv.org/abs/2412.01526
#benchmark
January 30, 2025 at 5:01 PM
Our paper "Addressing #DataLeakage in #HumanEval Using Combinatorial Test Design" has been accepted for publication at the Int’l Conference on Software Testing, Verification & Validation (#ICST2025), Short Papers, Vision & Emerging Results.
co-author: Riddhi More
arxiv.org/abs/2412.01526
#benchmark
co-author: Riddhi More
arxiv.org/abs/2412.01526
#benchmark
I'm happy to share our paper "Assessing Data Augmentation-Induced Bias in Training and Testing of Machine Learning Models," has been accepted to the 1st International Workshop on Fairness in Software Systems (FAIRNESS 2025), co-located with #SANER2025! #ontariotech @riddhimore.bsky.social
December 31, 2024 at 3:56 PM
I'm happy to share our paper "Assessing Data Augmentation-Induced Bias in Training and Testing of Machine Learning Models," has been accepted to the 1st International Workshop on Fairness in Software Systems (FAIRNESS 2025), co-located with #SANER2025! #ontariotech @riddhimore.bsky.social
Are you working on #softwaretesting & passionate about test #automation and #AI testing? If so, consider submitting to the 8th IEEE Workshop on the Next level of Test Automation #NEXTA2025, co-located w/ #ICST2025
Submission Date: Jan 10, 2025 [UPDATED!]
bit.ly/nexta2025
Submission Date: Jan 10, 2025 [UPDATED!]
bit.ly/nexta2025
December 31, 2024 at 3:53 PM
Are you working on #softwaretesting & passionate about test #automation and #AI testing? If so, consider submitting to the 8th IEEE Workshop on the Next level of Test Automation #NEXTA2025, co-located w/ #ICST2025
Submission Date: Jan 10, 2025 [UPDATED!]
bit.ly/nexta2025
Submission Date: Jan 10, 2025 [UPDATED!]
bit.ly/nexta2025
I’m excited to share that our paper "An Analysis of #LLM Fine-Tuning & Few-Shot Learning for Flaky Test Detection & Classification" has been accepted for publication at the Int’l Conf on Software Testing, Verification & Validation (#ICST2025). This paper is first-authored by @riddhimore.bsky.social
December 20, 2024 at 2:26 AM
I’m excited to share that our paper "An Analysis of #LLM Fine-Tuning & Few-Shot Learning for Flaky Test Detection & Classification" has been accepted for publication at the Int’l Conf on Software Testing, Verification & Validation (#ICST2025). This paper is first-authored by @riddhimore.bsky.social
I had a great time today attending the #OntarioTech Cakes & #AI Winter Show-And-Tell event. A great opportunity to engage with researchers from across the university and establish interdisciplinary collaborations. Thanks to @petelewis.bsky.social for organizing! 🍰
December 20, 2024 at 2:21 AM
I had a great time today attending the #OntarioTech Cakes & #AI Winter Show-And-Tell event. A great opportunity to engage with researchers from across the university and establish interdisciplinary collaborations. Thanks to @petelewis.bsky.social for organizing! 🍰
The latest episode of the Front Burner podcast is worth a listen for anyone with a connection to Canadian #highered. 👇
Featuring an interview with @alexusherhesa.bsky.social on the current financial crisis facing Canadian universities & colleges. bit.ly/3B1FjiW
Featuring an interview with @alexusherhesa.bsky.social on the current financial crisis facing Canadian universities & colleges. bit.ly/3B1FjiW
The crisis facing Canada's colleges and universities | Front Burner | CBC Podcasts | CBC Listen
At the beginning of this year, immigration minister Marc Miller said the government was looking to rein in the number of international study permits it would be granting, in a bid to take pressure off the strained housing market. But that's been bad news for the post-secondary institutions for which a significant part of their operating budgets come from tuition fees from international students. Colleges in southern Ontario have been particularly hard hit, with many announcing cuts and consolidations — and there could be more to come. But it's only part of the problem. Alex Usher, the president of Higher Education Strategy Associates, explains the crisis Canadian universities and colleges are now dealing with: the result of years of cuts and a refusal to spend more on our post-secondary institutions. For transcripts of Front Burner, please visit: https://www.cbc.ca/radio/frontburner/transcripts [https://www.cbc.ca/radio/frontburner/transcripts]
bit.ly
December 3, 2024 at 2:25 PM
The latest episode of the Front Burner podcast is worth a listen for anyone with a connection to Canadian #highered. 👇
Featuring an interview with @alexusherhesa.bsky.social on the current financial crisis facing Canadian universities & colleges. bit.ly/3B1FjiW
Featuring an interview with @alexusherhesa.bsky.social on the current financial crisis facing Canadian universities & colleges. bit.ly/3B1FjiW
Thank you to Prof. Akramul Azim for giving a guest lecture today in my “Applications of #LLMs to Software Engineering” grad course. He talked about his #CASCON2024 paper “FaultLLAMA2: A Fine Tuned Large Language Model for Code Recommendations to Reduce Java Lock Contention” #OntarioTech #concurrency
December 2, 2024 at 7:34 PM
Thank you to Prof. Akramul Azim for giving a guest lecture today in my “Applications of #LLMs to Software Engineering” grad course. He talked about his #CASCON2024 paper “FaultLLAMA2: A Fine Tuned Large Language Model for Code Recommendations to Reduce Java Lock Contention” #OntarioTech #concurrency
It was great yesterday to have my colleague Cristiano Politowski speak to our graduate students and share his research experience at the intersection of Software Engineering and Game Development. #OntarioTech #softwareengineering #gamedev @crispolito87.bsky.social
November 30, 2024 at 2:44 PM
It was great yesterday to have my colleague Cristiano Politowski speak to our graduate students and share his research experience at the intersection of Software Engineering and Game Development. #OntarioTech #softwareengineering #gamedev @crispolito87.bsky.social
Reposted by Jeremy Bradbury
Interested in joining the Software Engineering & Education Research Lab? Find out more at bit.ly/3ARpCe8 #OntarioTech 🇨🇦
November 29, 2024 at 5:47 PM
Interested in joining the Software Engineering & Education Research Lab? Find out more at bit.ly/3ARpCe8 #OntarioTech 🇨🇦
Reposted by Jeremy Bradbury
Dear Google Labs -- notebookLLM creates nice, sunny podcasts on STEM papers---but...
Science, 4real, is -ve & adversarial. Please train another model, with data from actual grad students or faculty, so it creates more grumpy pods, which also criticize scope, methods, results etc of papers? 🔭🐡🧪
Science, 4real, is -ve & adversarial. Please train another model, with data from actual grad students or faculty, so it creates more grumpy pods, which also criticize scope, methods, results etc of papers? 🔭🐡🧪
November 27, 2024 at 7:46 PM
Dear Google Labs -- notebookLLM creates nice, sunny podcasts on STEM papers---but...
Science, 4real, is -ve & adversarial. Please train another model, with data from actual grad students or faculty, so it creates more grumpy pods, which also criticize scope, methods, results etc of papers? 🔭🐡🧪
Science, 4real, is -ve & adversarial. Please train another model, with data from actual grad students or faculty, so it creates more grumpy pods, which also criticize scope, methods, results etc of papers? 🔭🐡🧪
I'm happy to share that w/ Pooria Madani, Khalil El-Khatib & Natalija Vlajic we have been awarded a $382,000 grant from the National Cybersecurity Consortium to study "Transformative Adversaries: Leveraging Generative Pretrained Transformers for the Dev. of Next-Gen. Metamorphic Malware Engines"
Ontario Tech University AI experts secure funding for new cybersecurity research projects
Ontario Tech University’s cybersecurity research expertise is in the spotlight after the National Cybersecurity Consortium’s (NCC) announcement of nearly $560,000 in funding over four years for two ne...
news.ontariotechu.ca
November 27, 2024 at 3:29 PM
I'm happy to share that w/ Pooria Madani, Khalil El-Khatib & Natalija Vlajic we have been awarded a $382,000 grant from the National Cybersecurity Consortium to study "Transformative Adversaries: Leveraging Generative Pretrained Transformers for the Dev. of Next-Gen. Metamorphic Malware Engines"