Yoshitomo Matsubara

@yoshitomo-matsubara.net

Sr. Research Scientist at Yahoo! / ML OSS developer PhD in Computer Science at UC Irvine Research: ML, NLP, Computer Vision, Information Retrieval EiC: TMLR Technical Chair: CVPR, ECCV, ICCV, WACV Open Source/Science matters https://yoshitomo-matsubara.net

"Thank you for the rebuttal. I'll keep my score." As an AC of #NeurIPS2026 E&D track, I asked the reviewer to clarify No response so far How could authors expect them to respond if they don't even reply to an AC? We should set our bar highier and treat it highly irresponsible

Kudos to #ICLR2027 PCs for taking strong actions 👏 I like they keep it open to new people, mitigating a risk of "AI slop" Submission cap should be much lower, say 5 papers per author, unless their contribution is significant and they offer quality review workforce accordingly

BildBild
Gautam Kamath@gautamkamath.com · 7d ago

ICLR 2027 has authorship quotas: - No more than 20 submissions per author - No more than 1 submission where no author has a paper previously accepted to a major ML conference From iclr.cc/Conferences/...

Finished all initial meta-reviews for #NeurIPS2026 E&D track🥱 While I'm still supportive of this experiment and potentially making it a standard, we should reduce assignments for ACs, say 4-5 papers per AC to help them do better jobs

Yoshitomo Matsubara@yoshitomo-matsubara.net · 2w ago

Writing initial meta-reviews for #NeurIPS2026 It's extra work for ACs, but authors can check how much effort their ACs made for the papers, and flag issues in their assessments if necessary Lazy ACs are more problematic than lazy reviewers I experienced it as an author as well

Came up w/ a crazy idea from #NeurIPS2026 complaints Create "AI-permissive" and "Legacy/Classic" tracks, expanding the idea of ICML'26 review policy The latter uses "AI-content" detectors w/ thresholds tuned to maximize recall for papers and reviews, and takes strong actions (DR, ban, etc) WDYT?

It may not be a new problem, but amplified by "AI-generated" artifacts People pursue "good points" e.g., paper accepted / served at top venues and tend to close their eyes to "bad points" e.g., accountability for their papers, reviews, and consuming/wasting community resource

Gautam Kamath@gautamkamath.com · 2w ago

Radical proposal: if you want to submit your work for review by other humans, it must first be publicly and permanently posted somewhere with your name on it.

Writing initial meta-reviews for #NeurIPS2026 It's extra work for ACs, but authors can check how much effort their ACs made for the papers, and flag issues in their assessments if necessary Lazy ACs are more problematic than lazy reviewers I experienced it as an author as well

Yoshitomo Matsubara@yoshitomo-matsubara.net · 2mo ago

#ICML2026 appeal failed 1. Escalated reviewer's policy violation to AC 2. AC kept silent 3. Escalated it to track chairs 4. Chairs kept silent 5. AC did the same violation in meta-review 6. Reminded chairs 7. Chairs got defensive, didn't acknowledge any What's the last resort?

Call for emergency reviewers #NeurIPS2026 I'm looking for two emergency reviewers: - Multimodal (text + vision) benchmark - AI for Science (text-focused) benchmark If you have experience in either domains, send me a DM including your OpenReview profile and Google Scholar links

Excited and honored to serve as a (Co-)Editor-in-Chief of @tmlrorg.bsky.social with great EiCs to run TMLR and improve its peer review system! It was not on my bingo card, but a surprising journey '21: Beta tester '23: First paper accepted '24: Reviewer '24-'26: Action Editor '26-: Co-EiC🆕

Transactions on Machine Learning Research@tmlrorg.bsky.social · last mo.

We're pleased to announce our newest Editor-in-Chief, Yoshitomo Matsubara (@yoshitomo-matsubara.net)! He started his term July 1, 2026. He has long been one of our most committed and thoughtful Action Editors, and we know he'll do a great job as a leader of the journal.

Majority of reviews I saw last 1-2 years including those I see as a #NeurIPS2026 E&D AC fall into one of the following patterns with some variations like bulleted instead of numbered Those comments come without any summary/justification for their score Do you see such a trend?

Bild

#CVPR2026 made my last week very productive. I discussed the peer-review systems and future conferences with previous / current / future organizers It was a great honor working as Technical Chair closely with especially PCs, Workshop Chairs, and IEEE team! Thank you all!

#CVPR2026@cvprconference.bsky.social · 2mo ago

A huge thank you to the entire Organizing Committee for their hard work in making this conference a success. A special thank you to the Program Chairs for their tireless efforts in delivering an outstanding program. Your work is deeply appreciated! @cvprconference.bsky.social

#ICML2026 appeal failed 1. Escalated reviewer's policy violation to AC 2. AC kept silent 3. Escalated it to track chairs 4. Chairs kept silent 5. AC did the same violation in meta-review 6. Reminded chairs 7. Chairs got defensive, didn't acknowledge any What's the last resort?

Yoshitomo Matsubara@yoshitomo-matsubara.net · 3mo ago

TIL the importance of diligent ACs in the peer-review process (again), unfortunately as an author #ICML2026 No response to our repeated appeals against reviewer policy/guideline violation On top of that, the AC did the same violation as the reviewer I flagged What's next?

Just curious who'd benefit from indexing such "papers" on arXiv At least I would not look for such works at arXiv I feel that this type of work is more suitable for tech blogs, which I find more beneficial for both the authors and readers

TThomas Dietterich@tdietterich.bsky.social · 2mo ago

At @arxiv.bsky.social, we are receiving a new type of paper that I call an "I did this experiment" paper. These papers typically report some experiment with an LLM or LLM "agentic" workflow. They are the kind of experiments an "insider" engineer would run to optimize a system. 1/

I support this change! To be honest, it could go further We should use this opportunity to rethink authorship and accountability

TThomas Dietterich@tdietterich.bsky.social · 3mo ago

We are implementing a similar policy at @arxiv.bsky.social. If there is incontrovertible evidence of LLM slop in a paper, this means the authors did not take the time to read the LLM output and we can't trust anything else in the paper. Penalty is 1 year ban from arXiv followed by...

📜 Some of you may have heard about the desk-rejected papers from the ACL'26/ARR Jan 2026 or October 2025 cycles because of hallucinated references. These cases were detected post-commitment. ACL Program chairs have an official statement on this: 2026.aclweb.org/acl_statement/ #ACL2026NLP #NLProc

ACL Statement on Desk Rejecting Papers with Hallucinated References

Official website for the 64th Annual Meeting of the Association for Computational Linguistics

2026.aclweb.org