All AI evaluations embed assumptions about what "good" behavior looks like. Our #FAccT2026 paper explores how we can center the perspectives of impacted communities - specifically, subjects of AI-generated media - in designing LLM-as-a-judge evaluation rubrics.

Very important updates from our #FAccT2027 Program Chairs. Our next reviewing cycle will run on a different schedule from previous years. ⚠️ Abstract Deadline: Oct 27, 2026 ⚠️ Paper Deadline: Nov 3, 2026 Please read this blog post from the PCs for more info: facct-blog.github.io/2026-06-24/s...

It's almost time for this year's conference! 🎉 To follow along with all things #FAccT2026, you can "pin" this feed to your homepage. It matches all uses of the hashtag, tags of @facct.bsky.social, and use of the text string "FAccT" (not case sensitive). Enjoy! bsky.app/profile/did:...

I'll be at #FAccT2026 in Montréal this Thursday and Friday. Two papers I'm lucky to be part of are being presented. They share the common theme of human-centered evaluation of generative AI, specifically bringing stakeholder expertise into how we define and measure what these systems do...

At #CHI2026? Check out @sachnishal.bsky.social's talk this Tuesday on how LLM-infused writing tools reshape journalists’ agency — their ability to exercise independent judgment in alignment with their values — in editorial decision making. programs.sigchi.org/chi/2026/pro...

Come work with me!!!!

Hanna Wallach@hannawallach.bsky.social · 6mo ago

Microsoft Research NYC is hiring a researcher in the space of AI and society!

Microsoft Research NYC is hiring a researcher in the space of AI and society!

Come work with me!!!!

Hanna Wallach@hannawallach.bsky.social · 6mo ago

Microsoft Research NYC is hiring a researcher in the space of AI and society!

Announcements for #FAccT2026! 📣 #FAccT2026 will be on June 27-30 at the Hotel Bonaventure in Montréal! Keep reading for important information about submitting papers! ⬇️ 1/n

I’m not very into podcasts, but I listened to this one! WiML has meant a lot to me, and it was great to get this backstory. I especially appreciated the conversation about career changes and academia vs industry.

Jenn Wortman Vaughan@jennwv.bsky.social · 8mo ago

In case you missed it in the flurry of NeurIPS activity, @hannawallach.bsky.social and I recorded a (video) podcast on women in ML, friendship, research, and careers.

In case you missed it in the flurry of NeurIPS activity, @hannawallach.bsky.social and I recorded a (video) podcast on women in ML, friendship, research, and careers.

Jenn Wortman Vaughan@jennwv.bsky.social · 8mo ago

On my way to San Diego for #NeurIPS and the 20th anniversary of #WiML! To celebrate, @hannawallach.bsky.social and I recorded a podcast discussing WiML’s journey, our friendship and collaborations, research we're excited about, & advice we'd give our younger selves! www.microsoft.com/en-us/resear...

On my way to San Diego for #NeurIPS and the 20th anniversary of #WiML! To celebrate, @hannawallach.bsky.social and I recorded a podcast discussing WiML’s journey, our friendship and collaborations, research we're excited about, & advice we'd give our younger selves! www.microsoft.com/en-us/resear...

Ideas: Community building, machine learning, and the future of AI

As the Women in Machine Learning Workshop (WiML) marks its 20th annual gathering, cofounders, friends, and collaborators Jenn Wortman Vaughan and Hanna Wallach reflect on WiML’s evolution, navigating ...

microsoft.com

Our work on supporting industry computing researchers in assessing, articulating, and addressing the potential negative societal impact of their work (with @wesleydeng.bsky.social and @s010n.bsky.social) is featured in this edition of Research Focus.

Microsoft Research@msftresearch.bsky.social · 8mo ago

In the latest issue of Research Focus: Fara-7B brings efficient agentic computer use to small models; new tools help computing researchers assess societal impact; and more. msft.it/6017tbeFf

Don’t miss this podcast🎙️with @jennwv.bsky.social and @hannawallach.bsky.social! They reflect on #WiML20Years and share their journey, collaborations, and advice in a special conversation on Microsoft Research’s Ideas podcast💙

Hanna Wallach@hannawallach.bsky.social · 8mo ago

I'm super excited about the 20th @wimlworkshop.bsky.social, which is taking place tomorrow in San Diego, co-located with @neuripsconf.bsky.social!!! 🎉 To celebrate, @jennwv.bsky.social and I recorded a podcast episode! Check it out here: www.microsoft.com/en-us/resear...

I'm super excited about the 20th @wimlworkshop.bsky.social, which is taking place tomorrow in San Diego, co-located with @neuripsconf.bsky.social!!! 🎉 To celebrate, @jennwv.bsky.social and I recorded a podcast episode! Check it out here: www.microsoft.com/en-us/resear...

Ideas: Community building, machine learning, and the future of AI

As the Women in Machine Learning Workshop (WiML) marks its 20th annual gathering, cofounders, friends, and collaborators Jenn Wortman Vaughan and Hanna Wallach reflect on WiML’s evolution, navigating ...

microsoft.com

On my way to San Diego for #NeurIPS and the 20th anniversary of #WiML! To celebrate, @hannawallach.bsky.social and I recorded a podcast discussing WiML’s journey, our friendship and collaborations, research we're excited about, & advice we'd give our younger selves! www.microsoft.com/en-us/resear...

Ideas: Community building, machine learning, and the future of AI

As the Women in Machine Learning Workshop (WiML) marks its 20th annual gathering, cofounders, friends, and collaborators Jenn Wortman Vaughan and Hanna Wallach reflect on WiML’s evolution, navigating ...

microsoft.com

I'm beyond thrilled to give a keynote at the 20th WiML workshop! 😍 I've given opening remarks before, but this is my first RESEARCH talk at WiML. It's a dream. Join us! I'll talk about supporting appropriate reliance, human agency, & critical thought with GenAI. sites.google.com/wimlworkshop...

WiML Workshop @ NeurIPS 2025 - Program

Program

sites.google.com

Three exciting opportunities at @msftresearch.bsky.social in NYC!!! 🎉 Internship w/ FATE: apply.careers.microsoft.com/careers/job?... Internship w/ STAC on AI evaluation and measurement: apply.careers.microsoft.com/careers/job?... Postdoc w/ FATE: apply.careers.microsoft.com/careers/job?...

Jenn Wortman Vaughan@jennwv.bsky.social · 9mo ago

FATE internships: apply.careers.microsoft.com/careers/job?... FATE postdocs: apply.careers.microsoft.com/careers/job?... And internships with our close collaborators at STAC: apply.careers.microsoft.com/careers/job?...

Spread the word! 📢 The FATE (Fairness, Accountability, Transparency, and Ethics) group at @msftresearch.bsky.social in NYC is hiring interns and postdocs to start in summer 2026! 🎉 Apply by *December 15* for full consideration.

I was lucky to get a sneak preview of Advait’s talk and it is SO GOOD. I wish everyone building AI would watch this.

Microsoft Research@msftresearch.bsky.social · 9mo ago

Microsoft senior researcher, Advait Sarkar, recently presented at TED AI Vienna, where he spoke about AI’s role in elevating human thought.

I cannot wait to celebrate TWENTY YEARS of #WiML at #NeurIPS in San Diego this December! 🎉🥳 Fun fact: The first #WiML was held in San Diego back in 2006! ❤️ Share your memories below, and come hang out on Dec 2! I will be there! I will be speaking! And have I mentioned I AM EXCITED?!?!?!

Women in Machine Learning (WiML)@wimlworkshop.bsky.social · 9mo ago

WiML turns 20! 🎉 For two decades, WiML has connected, inspired, and supported women around the world who are advancing the field of ML. As we celebrate this incredible milestone, we want to hear your story. 💜 ➡️ Share your reflections: shorturl.at/lxWM2 #WiML #WiML20Years #WiML20th

I cannot wait to celebrate TWENTY YEARS of #WiML at #NeurIPS in San Diego this December! 🎉🥳 Fun fact: The first #WiML was held in San Diego back in 2006! ❤️ Share your memories below, and come hang out on Dec 2! I will be there! I will be speaking! And have I mentioned I AM EXCITED?!?!?!

Women in Machine Learning (WiML)@wimlworkshop.bsky.social · 9mo ago

WiML turns 20! 🎉 For two decades, WiML has connected, inspired, and supported women around the world who are advancing the field of ML. As we celebrate this incredible milestone, we want to hear your story. 💜 ➡️ Share your reflections: shorturl.at/lxWM2 #WiML #WiML20Years #WiML20th

I’m taking a break after this year, I swear. If you are partying along the marathon route Sunday (which you should! it’s fun!), you can find us in wave 4.

Looking for news on @msftresearch.bsky.social FATE internships & postdocs? YES, we will have positions, but bear with us — we expect postings to go up in mid-November and I will post an update here as soon as they do.

If you're at #CSCW2025, be sure to say hi to @wesleydeng.bsky.social! Wesley will be representing our work on assessing the potential negative societal impact of industry computing research bright and early Wednesday morning!

Wesley Hanwen Deng@wesleydeng.bsky.social · 10mo ago

𝐒𝐨𝐜𝐢𝐞𝐭𝐚𝐥 𝐈𝐦𝐩𝐚𝐜𝐭 𝐀𝐬𝐬𝐞𝐬𝐬𝐦𝐞𝐧𝐭 𝐟𝐨𝐫 𝐈𝐧𝐝𝐮𝐬𝐭𝐫𝐲 𝐂𝐨𝐦𝐩𝐮𝐭𝐢𝐧𝐠 𝐑𝐞𝐬𝐞𝐚𝐫𝐜𝐡𝐞𝐫𝐬 🏅 Best Paper Honorable Mention (Top 3% Submissions) 🔗 dl.acm.org/doi/10.1145/... 📆 Wed, 22 Oct | 9:00 AM, CET: Toward More Ethical and Transparent Systems and Environments

If you’re reading this post and wondering whether #FAccT2026 is the right venue for you, we strongly encourage you to submit your best work and join the community! Especially scholars and practitioners in the humanities, law, philosophy, policy, the social sciences, and more!

If you are at #COLM2025, come by the Workshop on the Application of LLM Explainability to Reasoning and Planning TODAY at 2:40 ET to see my talk on challenges in human-agent communication and how the interpretability community can help address them! xllm-reasoning-planning-workshop.github.io

I’ve been lucky to get the chance to work with some incredibly creative and talented undergrad researchers through this program! Help us spread the word to students who might be interested!

Microsoft Research@msftresearch.bsky.social · 11mo ago

The Microsoft Research Undergraduate Internship Program offers 12-week internships in our Redmond, NYC, or New England labs for rising juniors and seniors who are passionate about technology. Apply by October 6: msft.it/6015scgSJ

Rare and exciting opportunity to join a team of world-class social scientists to study the social, political, and cultural dynamics that shape technologies and their consequences. MSR New England (our sister lab!) is an interdisciplinary environment with endless possibility for real-world impact. 👇👇

Nancy Baym@nancybaym.bsky.social · last yr.

We may have the chance to hire an outstanding researcher 3+ years post PhD to join Tarleton Gillespie, Mary Gray and me in Cambridge MA bringing critical sociotechnical perspectives to bear on new technologies. jobs.careers.microsoft.com/global/en/jo...

Feeling so excited + grateful to be representing this paper at #ICML! Please stop by to talk about how to do more valid measurement for evaling gen AI systems! Work led by the incomparable @hannawallach.bsky.social and @azjacobs.bsky.social as a part of Microsoft’s AI and Society initiative!!

Hanna Wallach@hannawallach.bsky.social · last yr.

If you're at @icmlconf.bsky.social this week, come check out our poster on "Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge" presented by the amazing @afedercooper.bsky.social from 11:30am--1:30pm PDT on Weds!!! icml.cc/virtual/2025...