Tessera
Folgen

Klint Kanopka

@klint.bsky.social

Assistant Professor of Applied Statistics at NYU ASH Psychometrician and sandwich lover Reluctant dog account klintkanopka.com

127 Posts7780 Follower517 Folgt
Klint Kanopka@klint.bsky.social · last mo.

If you're trying to include LLM-generated item responses in psychometric work, you should check out my mixedsubjectsirt package that's now available on CRAN! Importantly, this is a statistical and LLM-agnostic approach with strong efficiency guarantees (a thread). klintkanopka.com/mixedsubject...

Item Response Theory Calibration with a Mixed Subjects Design

Integrates large language model generated item responses into psychometric calibration studies through a mixed-subjects design for unidimensional two-parameter and one-parameter logistic item response...

klintkanopka.com

Klint Kanopka@klint.bsky.social · 9mo ago

Tomorrow at the PRIISM seminar: @crahal.com is going to talk to use about potential pitfalls and sources of error caused by psuedorandom number generation in social science research. Talk is at 11a eastern time on Zoom and open to anyone. RSVP here: steinhardt.nyu.edu/events/respo...

PRIISM | Responsible use of Pseudo-Random Number Generators in Applied Scientific Research

Join PRIISM and Dr. Charles Rahal to learn how to use pseudo-random number generators (PRNGs) responsibly in research.

steinhardt.nyu.edu

Klint Kanopka@klint.bsky.social · 11mo ago

Wanted to hype up a software package I'm debuting today. If you do computer adaptive testing (CAT) research and are developing your own item selection/parameter update/exposure control algorithms, take a look at meow - a unified framework to make CAT simulation easier! klintkanopka.com/meow/

Unified Framework for Computer Adaptive Testing Simulations

Provides an extensible framework for conducting simulations to compare data generating processes, item selection algorithms, parameter update algorithms, and stopping rules in computer adaptive testin...

klintkanopka.com

Klint Kanopka@klint.bsky.social · 12mo ago

Apparently some people like listening to me blather on about things! Thanks to @crahal.com for inviting me, this seminar has some amazing speakers lined up and brilliant attendees.

Charlie Rahal@crahal.com · last yr.

💡🤖🔥The talk by @klint.bsky.social at metrics-and-models.github.io was truly brilliant. Important work; a clean/intuitive computational design & empirical application from the @itemrespwarehouse.bsky.social! *Next:* Juan Carlos Perdomo on "The relative value of prediction" (v. excited about this)💡🤖🔥

Klint Kanopka@klint.bsky.social · last yr.

Incredibly proud of the work @ruitings.bsky.social did, and it’s even more impressive that she just finished the first year of her master’s program!

Ruiting Shen@ruitings.bsky.social · last yr.

I gave my first conference paper presentation at IMPS 2025 on process data analysis (credits to my amazing advisor @klint.bsky.social for all his support and advice) I also did my first data challenge and got a third prize (credits to my wonderful teammates Jessie and Na) #IMPS2025 #Psychometrics

Wanjing Anya Ma@anyawma.bsky.social · last yr.

Thank you @psychonomicsociety.bsky.social for featuring our study! @jyeatman.bsky.social @klint.bsky.social

Psychonomic Society@psychonomicsociety.bsky.social · last yr.

Assessing reading skills for an entire school’s worth of children is challenging and time-consuming – unless you’re using ROAR-CAT! 📚🦁Computerized Adaptive Testing (CAT) to assess reading abilities. Post by Anthony Cruz; #psynomBRM paper by @anyawma, @KlintKanopka and colleagues buff.ly/IuhWKaB

Charlie Rahal@crahal.com · last yr.

🔥Coming July 2: 'Metrics and Models'!🔥 A new seminar series on advanced modelling w/ impact across health/society. 🌍 Open to *ALL*! 🕑 Weds 2pm UK alternating weeks (online) 🔗 metrics-and-models.github.io 📬 metrics_and_models-subscribe@maillist.ox.ac.uk Brilliant speakers. *Please share*!

Klint Kanopka@klint.bsky.social · last yr.

Join us for our last (hybrid) PRIISM seminar of the academic year on 5/7! @austin-van-loon.bsky.social will present an experiment looking at how generative AI in admission essays may reshape the demographics of admitted students and how merit is evaluated. RSVP: steinhardt.nyu.edu/events/compe...

Competitive Self-Presentation and GAI | PRIISM

Join PRIISM and Dr. Austin van Loon to learn about an ongoing online experiment investigating how generative AI in college admission essays may reshape the demographic makeup of admitted students and ...

steinhardt.nyu.edu

Klint Kanopka@klint.bsky.social · last yr.

Join us at the intersection of causal inference and psychometrics as we host Josh Gilbert (@jbgilbert.bsky.social) at the PRIISM Seminar. Wednesday @ 10a: Estimating heterogeneous treatment effects with item-level data: Insights from Item Response Theory steinhardt.nyu.edu/events/estim...

PRIISM | Estimating heterogeneous treatment effects with item-level data

Join PRIISM and Josh Gilbert to learn how to unmask hidden treatment effects within individual test items using Item Response Theory and to understand how to overcome the limitations of traditional si...

steinhardt.nyu.edu

Klint Kanopka@klint.bsky.social · last yr.

Incredibly excited to have this finally come out! Model evaluation should be about comparisons, so we have a metric that puts comparisons in predictive performance on a common scale. I can’t make a thread about this better than @crahal.com, so I’ll let him take it away.

Charlie Rahal@crahal.com · last yr.

1/5 📄✨ITS FINALLY HERE!📄✨. After _five_ years, our new model evaluation metric — The InterModel Vigorish (IMV) — is now published (@plosone.org). Paper: bit.ly/3RlqrQH Preprint: bit.ly/41LzGjm Code: github.com/intermodelvigorish ‘What’s the vig on this action?’ (bit.ly/4hPoZ3Z). ⬇️⬇️⬇️

Klint Kanopka@klint.bsky.social · last yr.

I've said this before, but the single greatest force holding back psychometric research is data availability. Researching innovative assessments requires response data, but those data are owned by those who own the assessments. This gives them carte blanche to gatekeep who can do this work. 1/2

Andrew Ho@andrewdeanho.bsky.social · last yr.

Research with restricted-use data is more precise, powerful, and relevant. Faculty and staff will be working through the weekend to answer important research questions before we no longer can. This is not normal, necessary, or efficient.

AERA@aeraedresearch.bsky.social · last yr.

AERA has just learned that all restricted-use NCES data licenses will be cancelled, possibly as early as March 20. We urgently request that all AERA members and others in the research community with restricted-use licenses take these two actions: www.aera.net/Research-Pol...

Klint Kanopka@klint.bsky.social · last yr.

The loss of the NAEP restricted-use process data is crushing. It was the most reasonable to acquire dataset that is useful for actual measurement work (as opposed to nonsense mining). The data hoarding practice of private ed and testing companies harms research and students. They must fill the gap.

AERA@aeraedresearch.bsky.social · last yr.

AERA has just learned that all restricted-use NCES data licenses will be cancelled, possibly as early as March 20. We urgently request that all AERA members and others in the research community with restricted-use licenses take these two actions: www.aera.net/Research-Pol...

Klint Kanopka@klint.bsky.social · last yr.

Can AI-powered textbots improve survey interviews? Join PRIISM and @soubhikbarari.bsky.social to examine how they can enhance response quality and scalability, while considering challenges in bias and respondent experience. If you're in NYC, join us in person! steinhardt.nyu.edu/events/ai-as...

PRIISM | AI-Assisted Conversational Interviewing: Effects on Data Quality and User Experience

Can AI-powered textbots improve survey interviews? Join PRIISM and Soubhik Barari to examine how they can enhance response quality and scalability, while considering challenges in bias and respondent ...

steinhardt.nyu.edu