Andrew Ho
@andrewdeanho.bsky.social
Charles William Elliot Professor of Education, Harvard
Testing, Measurement, Psychometrics, Statistics
Testing, Measurement, Psychometrics, Statistics
On Friday, I moderated a National Academy of Education panel on the state and future of education research, with Peggy Carr, @agamoran.bsky.social, Pam Grossman. Many calls for resilience, creativity, advocacy, engagement, and alliances for funding, data, freedom. Photo credit: @aadukia.bsky.social
November 10, 2025 at 4:50 PM
On Friday, I moderated a National Academy of Education panel on the state and future of education research, with Peggy Carr, @agamoran.bsky.social, Pam Grossman. Many calls for resilience, creativity, advocacy, engagement, and alliances for funding, data, freedom. Photo credit: @aadukia.bsky.social
Heading to DC realizing that I've been discussing "The Future of NAEP" for 15 years.
2012: nces.ed.gov/nationsrepor...
2022: nap.nationalacademies.org/resource/264...
NAEP is overdue for improvement. AI can help. But, say it with me: Protect Trend. andrewho.scholars.harvard.edu/sites/g/file...
2012: nces.ed.gov/nationsrepor...
2022: nap.nationalacademies.org/resource/264...
NAEP is overdue for improvement. AI can help. But, say it with me: Protect Trend. andrewho.scholars.harvard.edu/sites/g/file...
November 4, 2025 at 6:43 PM
Heading to DC realizing that I've been discussing "The Future of NAEP" for 15 years.
2012: nces.ed.gov/nationsrepor...
2022: nap.nationalacademies.org/resource/264...
NAEP is overdue for improvement. AI can help. But, say it with me: Protect Trend. andrewho.scholars.harvard.edu/sites/g/file...
2012: nces.ed.gov/nationsrepor...
2022: nap.nationalacademies.org/resource/264...
NAEP is overdue for improvement. AI can help. But, say it with me: Protect Trend. andrewho.scholars.harvard.edu/sites/g/file...
Well, he didn't use that word. You did. But I was happy to respond. Here's the court decision (see p9, etc.): law.justia.com/cases/texas/...
It's fair to ask whether TAC appointments and renewals truly protect TAC members from "influence," of course. But I never feel led about, let alone muzzled.
It's fair to ask whether TAC appointments and renewals truly protect TAC members from "influence," of course. But I never feel led about, let alone muzzled.
October 30, 2025 at 8:44 PM
Well, he didn't use that word. You did. But I was happy to respond. Here's the court decision (see p9, etc.): law.justia.com/cases/texas/...
It's fair to ask whether TAC appointments and renewals truly protect TAC members from "influence," of course. But I never feel led about, let alone muzzled.
It's fair to ask whether TAC appointments and renewals truly protect TAC members from "influence," of course. But I never feel led about, let alone muzzled.
When districts sued Texas for AI scoring, how did independent measurement experts help inform the case? At 1:45, I'm talking about the important, often unseen role of Technical Advisory Committees in evaluating testing (and AI) evidence. @ncme38.bsky.social #AIMECon www.xcdsystem.com/ncme/program...
October 29, 2025 at 4:12 PM
When districts sued Texas for AI scoring, how did independent measurement experts help inform the case? At 1:45, I'm talking about the important, often unseen role of Technical Advisory Committees in evaluating testing (and AI) evidence. @ncme38.bsky.social #AIMECon www.xcdsystem.com/ncme/program...
Liberty Munson's great keynote to open @ncme38.bsky.social's AIME-Con. I asked for examples of GenAI tests where we have evidence they're more 1) engaging, 2) precise, 3) predictive, and 4) impactful than traditional alternatives. She cited early evidence by Khan and Duolingo. With more at AIME-Con!
October 28, 2025 at 1:55 PM
Liberty Munson's great keynote to open @ncme38.bsky.social's AIME-Con. I asked for examples of GenAI tests where we have evidence they're more 1) engaging, 2) precise, 3) predictive, and 4) impactful than traditional alternatives. She cited early evidence by Khan and Duolingo. With more at AIME-Con!
Heading to @ncme38.bsky.social's sold-out AIME-Con in Pittsburgh. Kudos to Pres. Amy Hendrickson for growing this from a notion to a key signal of our field's advancement of new tech. www.ncme-aime.org/meetings/AIM...
And thanks to Chairs Joshua Wilson, Christopher Ormerod, & Maggie Beiting-Parrish!
And thanks to Chairs Joshua Wilson, Christopher Ormerod, & Maggie Beiting-Parrish!
October 27, 2025 at 7:38 PM
Heading to @ncme38.bsky.social's sold-out AIME-Con in Pittsburgh. Kudos to Pres. Amy Hendrickson for growing this from a notion to a key signal of our field's advancement of new tech. www.ncme-aime.org/meetings/AIM...
And thanks to Chairs Joshua Wilson, Christopher Ormerod, & Maggie Beiting-Parrish!
And thanks to Chairs Joshua Wilson, Christopher Ormerod, & Maggie Beiting-Parrish!
What's a TAC? Our new NCME initiative honors the service of 150+ experts who advise state testing programs. Together, they advance validity, precision, and fairness.
www.ncme.org/community/co...
We hope this list increases awareness of the role, the community, and the pipeline. @ncme38.bsky.social
www.ncme.org/community/co...
We hope this list increases awareness of the role, the community, and the pipeline. @ncme38.bsky.social
October 23, 2025 at 6:51 PM
What's a TAC? Our new NCME initiative honors the service of 150+ experts who advise state testing programs. Together, they advance validity, precision, and fairness.
www.ncme.org/community/co...
We hope this list increases awareness of the role, the community, and the pipeline. @ncme38.bsky.social
www.ncme.org/community/co...
We hope this list increases awareness of the role, the community, and the pipeline. @ncme38.bsky.social
I finally did it. Here is my TAC Bingo Card: bit.ly/tacbingo
I hope it will help folks anticipate and understand my most common requests and recommendations. It will also encourage me to learn new things and avoid becoming predictable.
I predict a round of drinks will be on me. @ncme38.bsky.social
I hope it will help folks anticipate and understand my most common requests and recommendations. It will also encourage me to learn new things and avoid becoming predictable.
I predict a round of drinks will be on me. @ncme38.bsky.social
October 22, 2025 at 8:44 PM
I finally did it. Here is my TAC Bingo Card: bit.ly/tacbingo
I hope it will help folks anticipate and understand my most common requests and recommendations. It will also encourage me to learn new things and avoid becoming predictable.
I predict a round of drinks will be on me. @ncme38.bsky.social
I hope it will help folks anticipate and understand my most common requests and recommendations. It will also encourage me to learn new things and avoid becoming predictable.
I predict a round of drinks will be on me. @ncme38.bsky.social
What's behind this map of measurement programs? Hundreds of faculty and students, all part of a networked community that @ncme38.bsky.social is proud to support.
www.ncme.org/students/con...
Thanks to our Educators of Measurement SIG and Graduate Student Issues Committee for supporting this effort!
www.ncme.org/students/con...
Thanks to our Educators of Measurement SIG and Graduate Student Issues Committee for supporting this effort!
October 21, 2025 at 2:59 PM
What's behind this map of measurement programs? Hundreds of faculty and students, all part of a networked community that @ncme38.bsky.social is proud to support.
www.ncme.org/students/con...
Thanks to our Educators of Measurement SIG and Graduate Student Issues Committee for supporting this effort!
www.ncme.org/students/con...
Thanks to our Educators of Measurement SIG and Graduate Student Issues Committee for supporting this effort!
Interested in measurement? NCME has expanded its list of PhD programs in North America (82 and counting). Our community is strong.
Landing page: www.ncme.org/students/con...
List: bit.ly/ncmephdprograms
Map: bit.ly/ncmephdmap
@ncme38.bsky.social
Landing page: www.ncme.org/students/con...
List: bit.ly/ncmephdprograms
Map: bit.ly/ncmephdmap
@ncme38.bsky.social
October 16, 2025 at 6:17 PM
Interested in measurement? NCME has expanded its list of PhD programs in North America (82 and counting). Our community is strong.
Landing page: www.ncme.org/students/con...
List: bit.ly/ncmephdprograms
Map: bit.ly/ncmephdmap
@ncme38.bsky.social
Landing page: www.ncme.org/students/con...
List: bit.ly/ncmephdprograms
Map: bit.ly/ncmephdmap
@ncme38.bsky.social
NCME keeps upping its swag game, now with AIME-Con-specific swag! (And plushies of course.) bit.ly/ncmeswag
(AIME-Con is our AI in measurement conference, at capacity with nearly 500 attendees!): www.xcdsystem.com/ncme/program... @ncme38.bsky.social
(AIME-Con is our AI in measurement conference, at capacity with nearly 500 attendees!): www.xcdsystem.com/ncme/program... @ncme38.bsky.social
October 15, 2025 at 6:26 PM
NCME keeps upping its swag game, now with AIME-Con-specific swag! (And plushies of course.) bit.ly/ncmeswag
(AIME-Con is our AI in measurement conference, at capacity with nearly 500 attendees!): www.xcdsystem.com/ncme/program... @ncme38.bsky.social
(AIME-Con is our AI in measurement conference, at capacity with nearly 500 attendees!): www.xcdsystem.com/ncme/program... @ncme38.bsky.social
EOP is hosting a (small) conference for quantitative research on educational opportunity at Stanford, February 5 & 6, 2026! We hope you'll submit your work and join us. Proposals are due 11/7. #SEDA forms.gle/jYfz9CasQ5c1...
October 14, 2025 at 4:10 PM
EOP is hosting a (small) conference for quantitative research on educational opportunity at Stanford, February 5 & 6, 2026! We hope you'll submit your work and join us. Proposals are due 11/7. #SEDA forms.gle/jYfz9CasQ5c1...
NCME responds to the IES RFI. We ask IES to invest in professional standards, NAEP, high-quality research, training grants, a robust infrastructure for high-quality measurement in education, and more. @ncme38.bsky.social
higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
October 10, 2025 at 3:59 PM
NCME responds to the IES RFI. We ask IES to invest in professional standards, NAEP, high-quality research, training grants, a robust infrastructure for high-quality measurement in education, and more. @ncme38.bsky.social
higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
I finally wrote up my advice to PhD applicants in FAQ format. It's only my unofficial, personal perspective for folks interested in working with me at Harvard @harvardeducation.bsky.social. I also plug other measurement programs at @ncme38.bsky.social! andrewho.scholars.harvard.edu/sites/g/file...
October 7, 2025 at 3:12 PM
I finally wrote up my advice to PhD applicants in FAQ format. It's only my unofficial, personal perspective for folks interested in working with me at Harvard @harvardeducation.bsky.social. I also plug other measurement programs at @ncme38.bsky.social! andrewho.scholars.harvard.edu/sites/g/file...
Should @harvard.edu shift norms on screen management and active learning in its large classrooms? Two interesting policy ideas emerged from a standing-room-only HILT plenary panel at @harvardeducation.bsky.social on Friday with Jal Mehta, Todd Rogers, Dave Deming, and Karen Thornber...
October 6, 2025 at 1:28 PM
Should @harvard.edu shift norms on screen management and active learning in its large classrooms? Two interesting policy ideas emerged from a standing-room-only HILT plenary panel at @harvardeducation.bsky.social on Friday with Jal Mehta, Todd Rogers, Dave Deming, and Karen Thornber...
Mid-COVID, I wrote my "Three Metrics" memo, encouraging states to use better metrics lest they mislead the public and themselves about educational progress. It's now published in TCR with a bit of "I told you so" context.
Let's keep improving aggregate reporting.
journals.sagepub.com/doi/10.1177/...
Let's keep improving aggregate reporting.
journals.sagepub.com/doi/10.1177/...
September 22, 2025 at 3:36 PM
Mid-COVID, I wrote my "Three Metrics" memo, encouraging states to use better metrics lest they mislead the public and themselves about educational progress. It's now published in TCR with a bit of "I told you so" context.
Let's keep improving aggregate reporting.
journals.sagepub.com/doi/10.1177/...
Let's keep improving aggregate reporting.
journals.sagepub.com/doi/10.1177/...
Glad to see Senate discussing K-12 education live on the hill. My colleague Marty West is testifying. www.help.senate.gov/hearings/the... @harvardeducation.bsky.social
September 18, 2025 at 2:25 PM
Glad to see Senate discussing K-12 education live on the hill. My colleague Marty West is testifying. www.help.senate.gov/hearings/the... @harvardeducation.bsky.social
It's great to see NAEP & NCES staffing up. Measurement requires rare expertise. I hope my qualified colleagues consider these important positions and the commitment to public service that they represent.
Note: Some applications are due today.
www.usajobs.gov/Search/Resul...
@ncme38.bsky.social
Note: Some applications are due today.
www.usajobs.gov/Search/Resul...
@ncme38.bsky.social
September 15, 2025 at 3:28 PM
It's great to see NAEP & NCES staffing up. Measurement requires rare expertise. I hope my qualified colleagues consider these important positions and the commitment to public service that they represent.
Note: Some applications are due today.
www.usajobs.gov/Search/Resul...
@ncme38.bsky.social
Note: Some applications are due today.
www.usajobs.gov/Search/Resul...
@ncme38.bsky.social
NCME submissions are due today for our annual meeting in LA, 4/8-11. The flurry of emails I've fielded (and sent) over the past few weeks has me very excited for the scholarship and symposia to come!
Now, I bravely enter the submission portal... @ncme38.bsky.social
Now, I bravely enter the submission portal... @ncme38.bsky.social
September 12, 2025 at 3:18 PM
NCME submissions are due today for our annual meeting in LA, 4/8-11. The flurry of emails I've fielded (and sent) over the past few weeks has me very excited for the scholarship and symposia to come!
Now, I bravely enter the submission portal... @ncme38.bsky.social
Now, I bravely enter the submission portal... @ncme38.bsky.social
The 8-12-80 Rule, an essay I share with my students this time of year: Only 8% of their learning happens in class, with me. 12% comes from their TAs. 80% comes from their time outside of class, with each other.
If we believe this, how should change how we teach and learn? medium.com/@harvardeduc...
If we believe this, how should change how we teach and learn? medium.com/@harvardeduc...
September 8, 2025 at 3:27 PM
The 8-12-80 Rule, an essay I share with my students this time of year: Only 8% of their learning happens in class, with me. 12% comes from their TAs. 80% comes from their time outside of class, with each other.
If we believe this, how should change how we teach and learn? medium.com/@harvardeduc...
If we believe this, how should change how we teach and learn? medium.com/@harvardeduc...
These short courses in AI and Educational Measurement look fantastic. I need to update my syllabus. #LifelongLearning
Upcoming at NCME's AIME-Con in Pittsburgh, 10/27-29, program here: www.xcdsystem.com/ncme/program...
Registration: ncme.site-ym.com/events/Event...
@ncme38.bsky.social
Upcoming at NCME's AIME-Con in Pittsburgh, 10/27-29, program here: www.xcdsystem.com/ncme/program...
Registration: ncme.site-ym.com/events/Event...
@ncme38.bsky.social
September 5, 2025 at 3:33 PM
These short courses in AI and Educational Measurement look fantastic. I need to update my syllabus. #LifelongLearning
Upcoming at NCME's AIME-Con in Pittsburgh, 10/27-29, program here: www.xcdsystem.com/ncme/program...
Registration: ncme.site-ym.com/events/Event...
@ncme38.bsky.social
Upcoming at NCME's AIME-Con in Pittsburgh, 10/27-29, program here: www.xcdsystem.com/ncme/program...
Registration: ncme.site-ym.com/events/Event...
@ncme38.bsky.social
As the school year begins with AI looming, here again are my notes encouraging us to administer oral exams: bit.ly/andrewhoccl
Oral exams were great even before AI. Now, I think they're essential. Here's where I talk about this in my @ncme38.bsky.social address: www.youtube.com/watch?v=QDQx...
Oral exams were great even before AI. Now, I think they're essential. Here's where I talk about this in my @ncme38.bsky.social address: www.youtube.com/watch?v=QDQx...
September 2, 2025 at 2:30 PM
As the school year begins with AI looming, here again are my notes encouraging us to administer oral exams: bit.ly/andrewhoccl
Oral exams were great even before AI. Now, I think they're essential. Here's where I talk about this in my @ncme38.bsky.social address: www.youtube.com/watch?v=QDQx...
Oral exams were great even before AI. Now, I think they're essential. Here's where I talk about this in my @ncme38.bsky.social address: www.youtube.com/watch?v=QDQx...
I love this "NCME Regional Meetup" initiative by President Amy Hendrickson to build community and momentum towards AIME-Con and our Annual Meeting in LA.
I'm tempted to make a trip down to Yardley myself. Or maybe host a rival meetup in Boston? ;-) @ncme38.bsky.social
I'm tempted to make a trip down to Yardley myself. Or maybe host a rival meetup in Boston? ;-) @ncme38.bsky.social
August 28, 2025 at 5:19 PM
I love this "NCME Regional Meetup" initiative by President Amy Hendrickson to build community and momentum towards AIME-Con and our Annual Meeting in LA.
I'm tempted to make a trip down to Yardley myself. Or maybe host a rival meetup in Boston? ;-) @ncme38.bsky.social
I'm tempted to make a trip down to Yardley myself. Or maybe host a rival meetup in Boston? ;-) @ncme38.bsky.social
NCME is a strong organization with a great board. Colleagues, please nominate those eager and ready to lead us forward, together. Link (due 11/14): form.jotform.com/252314794748...
We welcome your questions and look forward to your engagement. @ncme38.bsky.social @derekbriggs.bsky.social
We welcome your questions and look forward to your engagement. @ncme38.bsky.social @derekbriggs.bsky.social
August 26, 2025 at 10:41 AM
NCME is a strong organization with a great board. Colleagues, please nominate those eager and ready to lead us forward, together. Link (due 11/14): form.jotform.com/252314794748...
We welcome your questions and look forward to your engagement. @ncme38.bsky.social @derekbriggs.bsky.social
We welcome your questions and look forward to your engagement. @ncme38.bsky.social @derekbriggs.bsky.social
Terrible analysis. The Post wants NY to unfairly punish students who get harder questions. NY's approach follows standards, see Ch 5 www.testingstandards.net/uploads/7/6/...
Plenty of reasons to critique/improve state testing. This isn't one of them. Our TAC comment www.linkedin.com/posts/new-yo...
Plenty of reasons to critique/improve state testing. This isn't one of them. Our TAC comment www.linkedin.com/posts/new-yo...
August 18, 2025 at 2:21 PM
Terrible analysis. The Post wants NY to unfairly punish students who get harder questions. NY's approach follows standards, see Ch 5 www.testingstandards.net/uploads/7/6/...
Plenty of reasons to critique/improve state testing. This isn't one of them. Our TAC comment www.linkedin.com/posts/new-yo...
Plenty of reasons to critique/improve state testing. This isn't one of them. Our TAC comment www.linkedin.com/posts/new-yo...