3/3 That’s why I’ve backed @stellacreasy's amendment to the Representation of the People Bill to cap political donations at £100,000. This would be a vital safeguard against billionaire capture of our politics and a important step towards rebuilding trust in our democracy.
Chapter 11 of my TDDA book is now available to read for free at book.tdda.info/book/11 This covers the specifics of testing analytical code with reference tests, supposed by the library. #books #testing #tdda #datascience
11 Reference Tests for Analytical Pipelines
Test-Driven Data Analysis by Nicholas J. Radcliffe — the online edition of the book.
book.tdda.info
Throwaway thought, but it’s wildly unhelpful to use AI as a catch all for everything from transformer-based sequence models to agentic coding assistants to LLM generated docs. I suspect sentiment varies a ton across those and lumping them together doesn’t make for a productive conversation
Testing Pyramid or Testing Trophy? Read about these in Chapter 10 of Test-Driven Data Analysis, now free to read online at book.tdda.info/10. #tdda #books
The first chapter of Part II of the TDDA Book, on reference testing, is now openly available online at book.tdda.info A reference test is a semantic regression test, i.e. one that checks that current outputs are meaningfully the same as previous, expected outputs. #tdda #books #testing
I consistently voice concerns about the idea drilling rosebank would be good for either the climate or the cost of living crisis - in the coming days as this debate returns I will continue to be a voice for prioritising the transition to clean energy for the sake of our pockets and our planet.
Nice overview! I always liked the CSVY approach, but it doesn't seem to have caught on, only findable on archive.org now. web.archive.org/web/20240303...
CSVY yaml frontmatter for csv file format
web.archive.org
Part I of Test-Driven Data Analysis, covering Data Validation, is now completely open access at book.tdda.info/book. Chapter 8, released today, focuses on "serial data" (CSVs), an often overlooked topic, including tdda.serial, CSVW, and Frictionless. #book #tdda #csv #datavalidation
Test-Driven Data Analysis
Test-Driven Data Analysis by Nicholas J. Radcliffe — the online edition of the book.
book.tdda.info
Please don't step on a bee *any* day
Today is National Don't Step on a Bee Day! Bees are responsible for pollinating roughly one-third of the world's food supply. Bees are also responsible for inspiring a love of words in millions of students every year. All bees must be protected at all costs. 🐝❤️
Delving deep with Mishal Husain on eve of new political era: youtube.com/watch?v=08WC...
Taming Labour, Facing Down Farage: Steve Richards on Burnham's Plan | The Mishal Husain Show
YouTube video by Bloomberg Podcasts
youtube.com
Chapter 7, of the TDDA Book—Practical Constraints—is now up: book.tdda.info/book/7 This completes 'data validation', and includes non-tabular data, spreadsheets, regularising measurements and the alternative libraries Pandera and Great Expectations. #tdda #book #ML #AI #datascience #polars
7 Practical Considerations
Test-Driven Data Analysis by Nicholas J. Radcliffe — the online edition of the book.
book.tdda.info
Issue 51 of #rdmweekly is out! ➡️ The Open Science Utopia: How Transparency Can Improve Science @heidiseibold.bsky.social ➡️ Why Repositories Matter More Than Ever! @coar-repositories.bsky.social ➡️ Data Management for Beginners @jenrichmondphd.bsky.social rdmweekly.substack.com/p/rdm-weekly...
RDM Weekly - Issue 051
A weekly roundup of Research Data Management resources.
rdmweekly.substack.com
This is another really insightful podcast from @steverichards.bsky.social, making a compelling case that mid-term prime ministers have a bad habit of picking the wrong chancellor for foolish reasons. Happily, in this case, Burnham's obvious choice is also the right one...
Latest podcast- Who should be Andy Burnham’s chancellor? podcasts.apple.com/gb/podcast/r...
Chapter 6 of the TDDA Book, Custom Constraints, is now open at book.tdda.info/book/6 including constraints for - Individual values - Records (per-row) - Fields (per-column) - Datasets - Grouped Roll-Ups. #book #books #tdda #testing #data #AI #ML
6 Custom Constraints
Test-Driven Data Analysis by Nicholas J. Radcliffe — the online edition of the book.
book.tdda.info
Lots of good stuff here from @mazzucatom.bsky.social: www.theguardian.com/commentisfre...
Labour has abandoned the missions that brought it to power. Here's how Burnham could revive them. | Mariana Mazzucato
With a new prime minister incoming, Labour faces a fundamental question about its economic vision, says economics professor Mariana Mazzucato
theguardian.com
Say it louder for the dinosaurs- childcare 👏is 👏economic infrastructure and those making it harder to balance work and family life are harming our productivity and prosperity. Share this and let’s make sure they know we won’t be silenced- as today shows it’s a price we can’t afford to pay.
Incredibile and dramatic #heatwave in #Europe as seen from space. The #Copernicus #Sentinel3 Land (not air!) Surface Temperatures map of June 24 shows peaks of 55°C in #Spain and over 50°C (in purple) in #France. #climateemergency
I should have done this a couple of days ago. Here are Edinburgh’s climate stripes, in graph form showyourstripes.info/c/europe/uni... #climatestripes #climate #sustainability
Show Your Stripes
Visualising how the climate has changed for every country across the globe
showyourstripes.info
Chapter 5 of my #book, Test-Driven Data Analysis, is up: book.tdda.info/book/chapter.... The chapter, Constraint Discovery and Validation, discusses automatic constraint generation from believed-to-be-good data and their use for validating new data. #tdda #data #testing #datavalidation #ML #AI
Species-level suicidal behavior
Big Tech's emissions increased 150% in just 4 years, "thanks" to the exploding electricity demands of slop-bucket LLMs that boil lakes to rephrase the internet Generative AI is worse than useless; it is making it impossible for us to limit climate change www.energymonitor.ai/news/interna...
All the places where I've lived, including Northern California, Hong Kong, NYC, Miami, Honolulu, Paris, and London, have warmed substantially. But this is the coolest that those places will be in our lifetimes. Today is #ShowYourStripes day. Get yours here: www.ShowYourStripes.info
As is the annual tradition, we hope many of you will take the opportunity to use the Climate Stripes this week to start important conversations about the risks from, and solutions to, climate change. Officially, #ShowYourStripes for 2026 is on Sat 20th June. www.ShowYourStripes.info
My tutorial on Test-Driven Data Analysis (TDDA) from #PyDataLondon2026 is up: youtu.be/EH0WpGFAV_g There are a few details at www.tdda.info/pydata-londo... and the slides are at stochasticsolutions.com/pdf/tdda-lon... #pydata #python #tdda #testing #tutorial #video
Nick Radcliffe - Test-Driven Data Analysis | Pydata London 26
YouTube video by PyData
youtu.be
Remembering this WSJ graphic from 2007. Been thinking about "reverse statistics" lately, which means deriving the minimal set of assumptions that justify a result. Here I wonder if there is any function of the data that when max/min would produce such a curve. Ordinary Worst Squares?
A) This a properly brilliant piece of investigative journalism by BBC & @hopenot.bsky.social Huge kudos to all involved for doing the job the UK police & CPS failed to do: naming the alleged spymaster & clearly showing Kremlin’s role. www.bbc.co.uk/news/article...
Russia was behind arson attacks targeting PM, BBC reveals
Evidence shows Russians directing the plot and stoking tensions with fake far-right and Muslim groups.
bbc.co.uk
As is the annual tradition, we hope many of you will take the opportunity to use the Climate Stripes this week to start important conversations about the risks from, and solutions to, climate change. Officially, #ShowYourStripes for 2026 is on Sat 20th June. www.ShowYourStripes.info
The serialization of my book, Test-Driven Data Analysis, has reached chapter 4, which is available online at book.tdda.info/book/chapter4.h… Profiling shows the shape of the data, and auditing shows gaps, outliers etc. #tdda #book #books #testing #data #dataanalysis #visualization #python
If you're within striking distance of Edinburgh, I'm speaking at EdinbR tonight, after Mayuko Morgan: The thrifty data chef’s guide to cook up insight on a shoestring. Free tickets available at: luma.com/vv57xyii Do come along! #data #datascience #documents #reprodicibility #rlang #python #books