I can't reply, so trying this way. I've found it helpful for a few years now in a class where kids are writing code to have them submit short (usually 5 minutes or less) screencasts (really easy to make with Quicktime on the mac or Loom, etc). You can immediately tell what they actually understand.
I can’t figure out how to teach one of my spring courses. It is project and problem set based. The project topic is vaguely ChatGPT proof (though I need to tighten up the execution) but my problem sets… Two years ago I gave a couple q’s to ChatGPT and the answers were garbage. Today not so much.