For #UofT researcher Nicolas Papernot, the secret to strengthening cybersecurity in the age of AI is transparency – sharing information about threats & allowing researchers to probe these systems before attackers do. 💻 uoft.me/cE4
Nicolas Papernot
@nicolaspapernot.bsky.social
Security and Privacy of Machine Learning at UofT, Vector Institute, and Google 🇨🇦🇫🇷🇪🇺 Co-Director of Canadian AI Safety Institute (CAISI) Research Program at CIFAR. Opinions mine
What do new AI capabilities mean for Canada's critical digital infrastructure, economy, & national security? Join @nicolaspapernot.bsky.social, @alexposadzki.bsky.social, Avi Goldfarb (@utoronto.ca), Kathryn Hume (@vectorinstitute.ai ), & Samir Chhabra (ISED) to find out! Register: shorturl.at/RSOhK
The submission server for #SaTML2027 is now open! There are also some changes to the Call for Papers, diffs are indicated on the website. Dates: Mandatory abstract deadline: Sep 22 Paper deadline: Sep 29 satml.org
How is AI changing the cybersecurity threat landscape? Join @nicolaspapernot.bsky.social and @alexposadzki.bsky.social in-person on Sept. 10 to find out! 📅 Sept. 10, 2026 🕓 4:00 PM – 5:30 PM 📍 Schwartz Reisman Innovation Campus Limited seats available! Register: nicolaspapernot.rsvpify.com
On top of our Call for Papers, #SaTML2027 has a Call for Competitions and a Call for Workshops (first time ever!!). Dates (easy to remember, same for both) Deadline: August 28, 2026 Notifications: September 18, 2026 Topics can be anything in trustworthy and secure ML!
We're pleased to announce that #SaTML2027 will be in Reykjavik, Iceland! Thanks to General Chair Giovanni Apruzzese for making the arrangements. The conference will be in early May 2027. Get your submissions ready: the deadline will be September 29, 2026. Details on the new website: satml.org
We discovered that it is possible to create an AI-driven computer worm using an open-weight AI model that anyone can download. This research was conducted in a lab walled off from the outside world, and shared only after removing details that could aid bad actors. www.nytimes.com/2026/06/02/t...
Scientists Find Way to Supercharge Dangerous Computer ‘Worms’ With A.I.
nytimes.com
SaTML is looking for a host for #SaTML2027! If you're interested in bringing SaTML to a city near you, please fill out this form by April 15! 🏘️🏙️🏡🌆 docs.google.com/forms/d/e/1F...
Thank you to Samsung for the AI Researcher of 2025 award! I'm privileged to collaborate with many talented students & postdoctoral fellows @utoronto.ca @vectorinstitute.ai . This would not have been possible without them! It was a great honour to receive the award from @yoshuabengio.bsky.social !
Three weeks to go until the SaTML 2026 deadline! ⏰ We look forward to your work on security, privacy, and fairness in AI. 🗓️ Deadline: Sept 24, 2025 We have also updated our Call for Papers with a statement on LLM usage, check it out: 👉 satml.org/call-for-pap... @satml.org
Thank you to @schmidtsciences.bsky.social for funding our lab's work on cryptographic approaches for verifiable guarantees in ML systems and for connecting us to other groups working on these questions!
How can we build AI systems the world can trust? AI2050 Early Career Fellow Nicolas Papernot explores how cryptographic audits and verifiability can make machine learning more transparent, accountable, and aligned with societal values. Read the full perspective: buff.ly/JjTnRjm
📄 Selective Prediction Via Training Dynamics Paper ➡️ arxiv.org/abs/2205.13532 Workshop ➡️ 3rd Workshop on High-dimensional Learning Dynamics (HiLD) Poster ➡️ West Meeting Room 118-120 on Sat 19 Jul 10:15 a.m. — 11:15 a.m. & 4:45 p.m. — 5:30 p.m.
📄 Suitability Filter: A Statistical Framework for Classifier Evaluation in Real-World Deployment Settings (✨ oral paper ✨) Paper ➡️ arxiv.org/abs/2505.22356 Poster ➡️ E-504 on Thu 17 Jul 4:30 p.m. — 7 p.m. Oral Presentation ➡️ West Ballroom C on Thu 17 Jul 4:15 p.m. — 4:30 p.m.
📄 Confidential Guardian: Cryptographically Prohibiting the Abuse of Model Abstention TL;DR ➡️ We show that a model owner can artificially introduce uncertainty and provide a detection mechanism. Paper ➡️ arxiv.org/abs/2505.23968 Poster ➡️ E-1002 on Wed 16 Jul 11 a.m. — 1:30 p.m.
Secure Noise Sampling for Differentially Private Collaborative Learning (Olive Franzese, Congyu Fang, Radhika Garg, Somesh Jha, Nicolas Papernot, Xiao Wang, Adam Dziedzic) ia.cr/2025/1025
Excited to share the first batch of research projects funded through the Canadian AI Safety Institute's research program at CIFAR! The projects will tackle topics ranging from misinformation to safety in AI applications to scientific discovery. Learn more: cifar.ca/cifarnews/20...
📢 New ICML 2025 paper! Confidential Guardian: Cryptographically Prohibiting the Abuse of Model Abstention 🤔 Think model uncertainty can be trusted? We show that it can be misused—and how to stop it! Meet Mirage (our attack💥) & Confidential Guardian (our defense🛡️). 🧵1/10
If you are submitting to @ieeessp.bsky.social this year, a friendly reminder that there is an abstract submission deadline this Thursday May 29 (AoE). More details: sp2026.ieee-security.org/cfpapers.html
As part of the theme Societal Aspects of Securing the Digital Society, I will be hiring PhD students and postdocs at #MPI-SP, focusing in particular on the computational and sociotechnical aspects of technology regulations and the governance of emerging tech. Get in touch if interested.
🌍 Help shape the future of SaTML! We are on the hunt for a 2026 host city - and you could lead the way. Submit a bid to become General Chair of the conference: forms.gle/vozsaXjCoPzc...
Bid to host SaTML 2026
Thank you for considering to host SaTML! SaTML has been organized as a 3 day conference so far. We are looking for volunteers interested in finding a venue to host the conference in 2026. By submitti...
forms.gle
Excited to be in Singapore for ICLR, presenting our work on privacy auditing (w/ Aurélien & @nicolaspapernot.bsky.social). If you are interested in differential privacy/privacy auditing/security for ML, drop by (#497 26 Apr 10-12:30 pm) or let's grab a coffee! ☕ openreview.net/forum?id=xzK...
Tighter Privacy Auditing of DP-SGD in the Hidden State Threat Model
Machine learning models can be trained with formal privacy guarantees via differentially private optimizers such as DP-SGD. In this work, we focus on a threat model where the adversary has access...
openreview.net
👋 Welcome to #SaTML25! Kicking things off with opening remarks --- excited for a packed schedule of keynotes, talks and competitions on secure and trustworthy machine learning.
Karina Vold says the rapid development of AI systems has left both philosophers & computer scientists grappling with difficult questions. #UofT 💻 uoft.me/bsp
Congratulations again, Stephan, on this brilliant next step! Looking forward to what you will accomplish with @randomwalker.bsky.social & @msalganik.bsky.social!
Starting off this account with a banger: In September 2025, I will be joining @princetoncitp.bsky.social at Princeton University as a Postdoc working with @randomwalker.bsky.social & @msalganik.bsky.social! I am very excited about this opportunity to continue my work on trustworthy/reliable ML! 🥳
The Canadian AI Safety Institute (CAISI) Research Program at CIFAR is now accepting Expressions of Interest for Solution Networks in AI Safety under two themes: * Mitigating the Safety Risks of Synthetic Content * AI Safety in the Global South. cifar.ca/ai/ai-and-so...
I will be giving a talk at the MPI-IS @maxplanckcampus.bsky.social in Tübingen next week (March 12 @ 11am). The talk will cover my group's overall approach to trust in ML, with a focus on our work on unlearning and how to obtain verifiable guarantees of trust. Details: is.mpg.de/events/speci...
For Canadian colleagues, CIFAR and the CPI at UWaterloo are sponsoring a special issue "Artificial Intelligence Safety and Public Policy in Canada" in Canadian Public Policy / Analyse de politiques More details: www.cpp-adp.ca
English Menu
The December issue is available. o
cpp-adp.ca
One of the first components of the CAISI (Canadian AI Safety Institute) research program has just launched: a call for Catalyst Grant Projects on AI Safety. Funding: up to 100K for one year Deadline to apply: February 27, 2025 (11:59, AoE) More details: cifar.ca/ai/cifar-ai-...
CIFAR AI Catalyst Grants - CIFAR
Encouraging new collaborations and original research projects in the field of machine learning, as well as its application to different sectors of science and society.
cifar.ca
The list of accepted papers for @satml.org 2025 is now online: 📃 satml.org/accepted-pap... If you’re intrigued by secure and trustworthy machine learning, join us April 9-11 in Copenhagen, Denmark 🇩🇰. Find more details here: 👉 satml.org/attend/
Accepted Papers
satml.org
If you work at the intersection of security, privacy, and machine learning, or more broadly how to trust ML, SaTML is a small-scale conference with highly-relevant work where you'll be able to have high-quality conversations with colleagues working in your area.