I'm quoted in this morning's @bostonglobe.com editorial about why middle school is likely the right age to begin tracking math classes. By middle grades, the range of math skills in a given cohort is too large to be taught effectively in a single class. www.bostonglobe.com/2026/08/03/o...
Matt Makel
@mattmakel.bsky.social
educational researcher focusing on academic talent (identification and development) and open science research practices (implementation and assessment). Now in Canada @UCalgary
Take 1 minute to read this intuitive and incisive review of our study on the portability of teacher effectiveness by @nctq.bsky.social's Sarah Almy. Beautiful policy writing in my opinion. www.nctq.org/research-ins...
Does great teaching travel from school to school? It’s complicated. - National Council on Teacher Quality
Do great teachers perform as well after switching schools? New research on a $20,000 transfer incentive program shows the answer is complicated—and prep matters.
nctq.org
New preprint w/ Leo Tiokhin & @lakens.bsky.social! Registered Reports (RRs) are great for science b/c publication is guaranteed before results are known, reducing publication bias & QRPs. This feature supposedly also makes them great for *scientists*. But is that really true? 1/ tinyurl.com/4sy993rr
Career incentives make Registered Reports unattractive under realistic academic conditions
Registered Reports are a publication format designed to reduce publication bias by guaranteeing publication before results are known. This guarantee is considered attractive in the prevailing ‘publish...
tinyurl.com
"I'd like to see state and federal policymakers place a stronger emphasis on making student growth and improvement measures publicly available and giving them the kind of attention we've historically given measures like student 'proficiency'" www.newsweek.com/map-reveals-...
Map reveals states with best and worst public schools
A new ranking lists New York as the state with the best public schools, while Arizona ranks at the bottom.
newsweek.com
within every [academic] there are 2 [reasons we agree to review] 1) sounds interesting & we wanna know about it...bc we are huge nerds 2) sounds problematic & we wanna make sure someone is sufficiently critical...bc we are huge nerds (ok ok & sometimes we wanna do the editor a solid) #AcademicSky
I had the honor of giving a keynote at the International Conference on Machine Learning last week. I addressed the widespread anxiety about how we should adapt as AI capabilities increase. I was thrilled by the talk’s reception, so I have made my slides available www.cs.princeton.edu/~arvindn/tal...
What will be left for us to work on?
ICML 2026 invited keynote — slides and edited transcript, presented click-by-click as delivered. Arvind Narayanan, Princeton University.
cs.princeton.edu
New article from @mattmakel.bsky.social, Melanie Meyer, and Mary Pei about qualitative replication.
Replication is possible, can be relevant, and is useful in qualitative research
In 2022, we argued that replication is relevant to qualitative research. In this manuscript, we update and clarify that idea to make three more specific claims about replication in qualitative rese...
doi.org
Ethicists: I'm sorry but we gotta stop citing scientific claims to solo-authored books. The citation has to be the actual paper with a zillion authors and a clunky title and ugly graphs that actually proves the result. I know it sucks but please the philosophers of science are laughing at us
I had many thoughts about that NYT grade inflation op-ed from a couple days ago. Here are some of them. // It's Gonna Be Much Harder Than People Think to Change the Narratives About Testing and Grades edpolicyhub.substack.com/p/its-going-...
It's Gonna Be Much Harder Than People Think to Change the Narratives About Testing and Grades
A Response to Kalil and Rury
edpolicyhub.substack.com
What can large-scale studies tell us about reproducibility? In our webinar on April 16, researchers from COS, I4R, and META-REP will discuss findings from three papers—one from the recently published SCORE effort—and insights on reproducibility, transparency, and credibility cos-io.zoom.us/webin...
New: "Effect of Artificial Intelligence on Learning: A Meta-Meta-Analysis" by Wagenmakers and colleagues revealing evidence for "severe publication bias and extreme between-study heterogeneity" in existing meta-analyses of the effects of AI on learning: osf.io/preprints/ps...
OSF
osf.io
New blog post, inspired by the excellent recent qualitative paper by Makel and colleagues: On the reliability and reproducibility of qualitative research. I reflect on how I will incorporate realist ontologies in my own qualitative research. daniellakens.blogspot.com/2026/02/on-r...
On the reliability and reproducibility of qualitative research
With my collaborators, I am increasingly performing qualitative research. I find qualitative research projects a useful way to improve my un...
daniellakens.blogspot.com
New #RSOS paper: ‘Don’t hate the players, hate the game’: qualitative insights from education researchers on questionable and open research practices. Read more: doi.org/10.1098/rsos... @mattmakel.bsky.social @sarahcaroleo.bsky.social @jesse-fleming.bsky.social @bryancook.bsky.social
54 weeks later, this preprint is now published: royalsocietypublishing.org/rsos/article...
‘Don’t hate the players, hate the game’: qualitative insights from education researchers on questionable and open research practices
Abstract. Both questionable (e.g. p-hacking) and open (e.g. pre-registration) research practices are prevalent in education research. We sought to understa
royalsocietypublishing.org
“Why do you think this practice should or shouldn’t be used?” We asked education researchers about #QuestionableResearchPractices (e.g., selectively reporting results) and about #OpenScience practices like preregistration, open data, and replication. #Preprint osf.io/preprints/ed...
Need some tips for searching PsyArXiv? Wrote a blog post blog.psyarxiv.com/2026/01/27/h...
How to search for PsyArXiv preprints on the OSF platform – PsyArXiv Blog
PsyArXiv is hosted on the Open Science Framework (OSF) platform, and over the years their interface and search syntax has changed. Guidance on how to search is a snapshot in time. Presently, the searc...
blog.psyarxiv.com
New Publication alert: Making a List Requires Checking it Twice: A Call for Empirical Evidence in Characteristics Lists [https://journals.sagepub.com/doi/10.1177/00169862251392934] #OpenAccess
Job opportunity — Junior Professorship in Psychological Metascience @zpid.bsky.social leibniz-psychology.onlyfy.jobs/job/10kku5n7 h/t @bethclarke.bsky.social
🏆 Individual: @simine.com, psychologist at @unimelb.bsky.social & editor-in-chief of Psychological Science, is recognized for pioneering methodological rigor, reproducibility & collaborative research, driving initiatives such as @improvingpsych.org & the journal Collabra @ucpress.bsky.social. (2/5)
Job posting alert! Open Science Specialist at the University of Calgary (in Canada!) #job #OpenScience careers.ucalgary.ca/jobs/1704502...
Specialist, Open Science, Research Services in Calgary, AB, ...
Specialist, Open Science, Research Services in Calgary, AB, ...
careers.ucalgary.ca
📅 Mark your calendars for SIPS 2026! 📅 The SIPS 2026 in-person conference will take place in Washington, DC, June 8-10, 2026. The conference will be at the George Mason University Arlington, Virginia campus (thanks to @natonge.bsky.social, our 2026 local host!)
Job opportunity: postdoc for the National Center for Research on Advanced Education: apply.interfolio.com/175953 PhD in education or a related field? Have strong quantitative and mixed methods methodological skills? Experience with advanced education, gifted education, or talent development? Apply!
Apply - Interfolio {{$ctrl.$state.data.pageTitle}} - Apply - Interfolio
apply.interfolio.com
If colleagues or students share a dataset with you and you make this face, consider sharing these resources with them. ☺️ datamgmtinedresearch.com 1. Organizing data (Ch. 3) 2. Naming variables and files (Ch. 9) 3. Documenting data (Ch. 8) 4. Cleaning data (Ch. 14)
a man is covering his mouth with his hands and the word schitts creek is on the bottom right
ALT: a man is covering his mouth with his hands and the word schitts creek is on the bottom right
media.tenor.com
Hi all! I'm on sabbatical this year and have bandwidth to zoom into lab meetings to talk about open science in cog psych and speech research and/or how to implement practices that reduce research errors! (www.carleton.edu/perception-l...). Email me if that sounds fun to you too!
Error Tight - Carleton College
No one is immune from making mistakes. However, it is possible to set up our labs and research systems in ways that reduce the likelihood that we will make mistakes…
carleton.edu
JOB OPPORTUNITY: @pkp.sfu.ca is looking for a Managing Director! This is a rare opportunity to lead a highly impactful #scholcomm organization. Role works closely with me (Scientific Director) to provide strategic and operational leadership. Help us spread the word! pkp.sfu.ca/2025/09/17/h...
PKP is hiring a Managing Director - Public Knowledge Project
The Public Knowledge Project, a Core Research Facility of SFU, invites applications for the position of Managing Director
pkp.sfu.ca
If my experience in academia has taught me anything it's that logging in to my same account on my same computer requires 2FA *every time* lest someone hack in and see my course schedule, but the forgery-proof method for approving things is to paste in a JPG of one's signature into a Word document.
@elisabethbik.bsky.social if you need any recruits, she looks like she's got some serious skills www.instagram.com/reel/DHtAcJ-...
Login • Instagram
Welcome back to Instagram. Sign in to check out what your friends, family & interests have been capturing & sharing around the world.
instagram.com
Children vary! We see this variation everywhere - within households, classrooms, and schools, but also in cross-cultural comparisons. We even see substantial variation within individual children from day to day. How can we measure and understand this variability? That's the goal of LEVANTE.
Our position paper is now out: "Learning Variability Network Exchange (LEVANTE): A Global Framework for Measuring Children's Learning Variability Through Collaborative Data Sharing". srcd.onlinelibrary.wiley.com/doi/10.1111/... (preprint: osf.io/preprints/ps...) What is LEVANTE? 🧵