Neil Defty
@neildefty.bsky.social
Head of Customer Relations, No More Marking Ltd. Director, Defty Consulting Ltd. Occasional charity work Obsessive runner
Great Substack from mad Ming Moonraker (2,4,7)
Daisy Christodoulou@daisychristo.bsky.social · 2mo agoOur start of term Substack is on the relative difficulty of the Guardian cryptic crossword over the last century. Comparative Judgement is amazing at measuring the difficulty of tests over time, so this was an obvious case study! substack.nomoremarking.com/p/the-diffic...
The knockout stage has kicked off! Who do you think will be lifting the Jules Rimet trophy? Help us work that one out with a bit of comparative judgement...
Daisy Christodoulou@daisychristo.bsky.social · 4mo agoWe have another Comparative Judgement World Cup task - for the knockout stages! 31 teams (we've taken out SA who lost yesterday). Get judging before this evening's matches and we'll share the results! I can tell you so far Mexico are rating very highly... au.nomoremarking.com/judging/sign...
OK, final results of our World Cup judging. Top ten are: Spain, France, England, Argentina, Brazil, Germany, Portugal, Netherlands, Belgium, Croatia. View the whole distribution here. www.dropbox.com/scl/fi/anwis...
Help us find out which team will win the FIFA World Cup 2026! Open your laptop or tablet, follow the link to sign up, then start judging by clicking the purple Left or Right button to choose the better team... au.nomoremarking.com/judging/sign... @nomoremarking.bsky.social @daisychristo.bsky.social
One of the advantages of our assessment model is that it uses AI to reduce workload BUT it also ensures every script is seen twice by a human. We can reduce the time it takes to assess a class set of essays down to about 15 minutes. It's all explained here. help.nomoremarking.com/en/article/h...
The power and simplicity of comparative judgement has given us The Nation's Favourite Easter Egg! Despite some stiff competition, the winner is.... The Maltesers Bunnies Easter Egg! @nomoremarking.bsky.social @daisychristo.bsky.social
There's still time to help us find The Nation's Favourite Easter Egg (with the help of comparative judgement)! Link below. Results announced tomorrow... 🐣
Neil Defty@neildefty.bsky.social · 7mo agoThe comparative judgement way to find The Nation's Favourite Easter Egg! Open your laptop/tablet, follow the link to sign up: au.nomoremarking.com/judging/sign... Start judging by clicking the purple Left/Right buttons to choose your favourite... @nomoremarking.bsky.social @daisychristo.bsky.social
Will you be twirling or twixing tomorrow? Help us find The Nation's Favourite Easter Egg - open your laptop, follow the link to sign up: au.nomoremarking.com/judging/sign... Then judge by clicking the Left/Right button to choose your favourite... @nomoremarking.bsky.social @daisychristo.bsky.social
The comparative judgement way to find The Nation's Favourite Easter Egg! Open your laptop/tablet, follow the link to sign up: au.nomoremarking.com/judging/sign... Start judging by clicking the purple Left/Right buttons to choose your favourite... @nomoremarking.bsky.social @daisychristo.bsky.social
"Of course you get better at something if you practice it. That is a good thing, and that is why education works!" Spot on! (I just wish that was the case for my football skills.)
Daisy Christodoulou@daisychristo.bsky.social · 9mo agoSelective schools & universities use entrance tests. Can you create an entrance test that is "tutor-proof"? Would you even want to? Are non-verbal reasoning tests the answer? substack.nomoremarking.com/p/is-it-poss...
Now we have AI judges. Ho ho ho! (A reference to which - definitely Christmas - movie?)
Daisy Christodoulou@daisychristo.bsky.social · 11mo ago130 judges have taken part in our Christmas film quote judging task so far - and the level of agreement with the AI is surprisingly high at 65%! Have a go yourself - read more here substack.nomoremarking.com/p/using-ai-t... And see what you think of the AI feedback...
We've now assessed over 200,000 pieces of writing using this Comparative Judgement plus AI model! Here's what we’ve learned...
Daisy Christodoulou@daisychristo.bsky.social · 12mo agoIn this post we explain 3 new things we've learned from our AI assessments this term. - More data showing AI judges agree with humans - AI is better at Comparative Judgement than absolute judgement - AI can judge subject content essays substack.nomoremarking.com/p/updates-fr...
🎧What’s working and what’s broken in AI assessments of learning? Libby Hills and Owen Henkel explore with Daisy Christodoulou MBE, EdTechnical’s very first guest from two years ago. @libbylhhills.bsky.social @daisychristo.bsky.social #EdTech boldscience.org/whats-workin...
What’s working and what’s broken in AI assessments of learning? – BOLD
Libby and Owen discuss the promises and pitfalls of AI assessment with Daisy Christodoulou from No More Marking.
boldscience.org
Latest on our Substack - What kind of student feedback do teachers think is best? Turns out they are quite keen on summaries of their class's performance... We've created AI-generated "examiner's reports" to help them. substack.nomoremarking.com/p/what-kind-...
What kind of student feedback do teachers think is best?
The tension between personalised and in-person education
substack.nomoremarking.com
How long does it take to mark a set of essays with Comparative Judgement? Human CJ halves the time compared with traditional marking. AI CJ reduces it by a further 90%! Watch our explainer video & read more on our website. vimeo.com/1121894082/2... help.nomoremarking.com/en/article/h...
"Cars are faster than humans, but we still teach PE at school." And other marathon-related metaphors...
Daisy Christodoulou@daisychristo.bsky.social · last yr.Generative AI has a lot of applications in the workplace, & it is very good at producing readable text. But writing isn't just about communication - it's about thinking. It's a powerful tool for expanding the limits of working memory. substack.nomoremarking.com/p/what-is-th...
Latest from us - we've completed some more AI assessment projects and are yet to find an AI error. All the big human-AI disagreements are human error. Take a look at a couple of examples and see who you agree with... substack.nomoremarking.com/p/can-you-fi...
Some big news from us. We're launching our first ever national history assessment - Year 7, autumn term, Battle of Hastings. It's AI-assisted so it'll be super quick. And it's free! (But not for long!) Read more & sign up here. www.nomoremarking.com/products/cjh...
There's still time for schools to sign up for our free Y6 redrafting assessment! And who doesn't love a good plot twist?
Daisy Christodoulou@daisychristo.bsky.social · 2y agoDo students respond to feedback? In our latest post, we share examples of students responding to feedback when redrafting their writing. In one example the writing improves. In the other it doesn't! substack.nomoremarking.com/p/do-student...
If you have heard about our AI marking projects and are intrigued, then you can take part in one for free this summer and see if you agree with the AI. CJ Dynamo is our Y6 project. CJ Lightning for Y9. Places are free but limited, so sign up asap! www.nomoremarking.com?countryCode=GB
Using AI to judge student writing 'has the potential to revolutionise assessment and decimate workload', say @daisychristo.bsky.social and @nomoremarking.bsky.social after their trail of the approach schoolsweek.co.uk/using-ai-to-...
Using AI to judge writing could 'revolutionise' assessment
No More Marking says its trial found AI is 'very good at judging student writing'
schoolsweek.co.uk
We think this has the potential to revolutionise assessment and decimate workload! (And in addition, I've learned the historical meaning of 'decimate' today.)
Daisy Christodoulou@daisychristo.bsky.social · 2y agoWe've been sceptical about AI marking. Not any more! When the facts change, we change our minds. We think this is really big. substack.nomoremarking.com/p/so-can-ai-...
How Better Feedback Can Revolutionize Education www.econtalk.org/how-better-f... A great discussion between No More Marking's Daisy Christodoulou @daisychristo.bsky.social and EconTalk's Russ Roberts (even including a brief comparison of their respective marathon results half way through!)
How Better Feedback Can Revolutionize Education (with Daisy Christodoulou) - Econlib
Feedback on exams and papers–grades and comments–should be more than an assessment. It should point the way to improvement. So argues educational consultant Daisy Christodoulou, emphasizing that actio...
econtalk.org
Last week we published the latest results of our Australian writing assessment project. You can read a summary of all the results here. We had over 13k participating students from schools in every Australian state & territory! aus.nomoremarking.com/assessing-wr...
Our new AI assessment project starts at the end of Feb and it is already proving very popular! It's a Year 7 writing assessment and it is free for any secondary in England & Wales. You'll get to try 2 new features - AI judging & AI audio feedback. Read more here. https://buff.ly/41goQl6
Comparative judgement has helped us find the nation's favourite Beatles song! The winner was decided yesterday, and despite the stiff competition from Hey Jude, Eleanor Rigby and Let It Be, the winner was indeed decided as... 🥁🥁🥁🥁🥁🥁🥁🥁 Yesterday Top 10 here:
Last couple of days to take part in our comparative judgement task to find the nation's favourite Beatles song! Follow the link to sign up: au.nomoremarking.com/judging/sign... Then start judging by clicking the Left/Right buttons to choose! @nomoremarking.bsky.social @daisychristo.bsky.social
We have a new Year 7 AI assessment project any secondary school in England can take part in for free. Deadline 28 Feb. Details here. https://buff.ly/3Q54pkx Intro webinar here. https://buff.ly/3Q2Z4Kw Theory behind it here. https://buff.ly/3WJ643f
CJ Lightning: Free AI Enhanced Project for Secondary Schools
Our Free Year 7 Writing Assessment with AI Integration provides schools following the English curriculum with a powerful combination of artificial intelligence and human judgment to evaluate student…
buff.ly
No More Marking transforming the world? Or at least, the world of assessment? Possibly, as long as we recognise that we still need the “human in the loop”...
Daisy Christodoulou@daisychristo.bsky.social · 2y agoWe have a new Year 7 AI assessment project any secondary school in England can take part in for free. Deadline 28 Feb. Details here. https://buff.ly/3Q54pkx Intro webinar here. https://buff.ly/3Q2Z4Kw Theory behind it here. https://buff.ly/3WJ643f
