Our book review of @ehudreiter.bsky.social 's book on Natural Language Generation is finally out: direct.mit.edu/coli/article... #NLProc
Natural Language Generation by Ehud Reiter
direct.mit.edu
Emiel van Miltenburg
@evanmiltenburg.bsky.social
Assistant professor in computational linguistics/nlp. Interested in research methodology, ethics, multimodality, and accessibility.
Our book review of @ehudreiter.bsky.social 's book on Natural Language Generation is finally out: direct.mit.edu/coli/article... #NLProc
Natural Language Generation by Ehud Reiter
direct.mit.edu
This week the decisions for #COLM are out (8th of July) and the #EMNLP author response period has started (July 7-13). If you're looking for an alternative #NLProc venue: please consider #INLG! (Either via ARR or direct submissions.) Submission deadline is July 15. See: 2026.inlgmeeting.org
INLG2026
The 19th International Natural Language Generation Conference is scheduled to be held in Utrecht, the Netherlands from October 17 to 21, 2026.
2026.inlgmeeting.org
Good to know * INLG also welcomes dual submissions. * The conference is held right before & relatively close to EMNLP, so you could attend both. * You can either submit directly (deadline: July 15) or commit a reviewed paper from ARR.
INLG (@inlg.bsky.social) submissions are now open! Please submit all of your work on Natural Language Generation. Submit systems, demos, experiments, position papers, squibs, linguistic analyses, as long as it is NLG-related. For more information, see: 2026.inlgmeeting.org #NLProc
INLG (@inlg.bsky.social) submissions are now open! Please submit all of your work on Natural Language Generation. Submit systems, demos, experiments, position papers, squibs, linguistic analyses, as long as it is NLG-related. For more information, see: 2026.inlgmeeting.org #NLProc
INLG2026
The 19th International Natural Language Generation Conference is scheduled to be held in Utrecht, the Netherlands from October 17 to 21, 2026.
2026.inlgmeeting.org
📣 Announcing the release of the 🕊️ Annotated Encyclical 🕊️ from the ethics & society folks at @hf.co. Includes citations to relevant academic work. Very much a WIP. Please add work we haven't added yet! huggingface.co/spaces/socie...
The Annotated Encyclical - a Hugging Face Space by society-ethics
Magnifica Humanitas, annotated with AI-ethics research
huggingface.co
It is somewhat disappointing that the flagship journals of NLP (CL and TACL) only publish PDFs. It would be great if we could somehow move to include HTML publications as well. More generally, the accessibility of documents in the ACL Anthology is limited. We're building massive technical debt.
The International conference on Natural Language Generation (INLG) just issued the first Call For Papers: 2026.inlgmeeting.org/calls.html #nlproc
INLG2026
The 19th International Natural Language Generation Conference is scheduled to be held in Utrecht, the Netherlands from October 17 to 21, 2026.
2026.inlgmeeting.org
In a post-CHI blog post, I talk about what I believe technology like the Anthropic Interviewer will mean for qualitative research. doomscrollingbabel.manoel.xyz/p/qualitativ...
New paper on LLMs and research methodology: Justify your prompts! direct.mit.edu/coli/article... #nlproc
Justify Your Prompts!
Abstract. When you use a large language model (LLM) in your research, you often need to formulate a prompt to elicit some relevant output from the LLM. This step is challenging since (1) LLMs are know...
direct.mit.edu
Noce paper on how well benchmarks cover what people do at work arxiv.org/abs/2603.01203 Quote "these observations suggest that agent benchmarking effort is driven less by alignment with real-world employment structure or economic value, and more by methodological convenience."
How Well Does Agent Development Reflect Real-World Work?
AI agents are increasingly developed and evaluated on benchmarks relevant to human work, yet it remains unclear how representative these benchmarking efforts are of the labor market as a whole. In thi...
arxiv.org
@ai2.bsky.social I'm confused by the OLMoTrace paper. The paper says that the trace feature is useful for "Fact checking" (see image), but the Limitations section notes: "The retrieved documents should not be interpreted as [...] supporting evidence or citations for the LM output." A contradiction?
Article is in Dutch, but maybe understandable via Google Translate. TL;DR: AI poetry is used in 3 different ways. 1. To study progress in creative computing; 2. To explore new literary forms and to see how people interpret those; 3. To (deceptively) market AI with appeals to its 'humanity.'
Nieuw artikel over Poëzie en kunstmatige intelligentie: www.aup-online.com/content/jour... (Open-access versie hier: research.tilburguniversity.edu/en/publicati...)
New article on the evaluation of task-oriented chatbots: nejlt.ep.liu.se/article/view... #NLProc #AI
Evaluating Task-oriented Dialogue Systems: A Systematic Review of Measures, Constructs and their Operationalisations | Northern European Journal of Language Technology
nejlt.ep.liu.se
Nieuw artikel over Poëzie en kunstmatige intelligentie: www.aup-online.com/content/jour... (Open-access versie hier: research.tilburguniversity.edu/en/publicati...)
Poëzie en Kunstmatige Intelligentie: Toetssteen, Proeftuin, Marketingtruc | Amsterdam University Press Journals Online
Abstract Automatically generated poetry has a long history, dating back at least to John Peter’s (1677) algorithm that was able to produce almost 600,000 Latin lines of poetry. Attention to this topic...
aup-online.com
I should have known this: not all innovations are improvements.
PSA: Today I learned that quizzes created in the Canvas learning management system using the New Quiz Builder don't allow you to export all student answers to Excel/CSV. This has been a problem since 2021. Don't use the new quiz builder. Use the old one. community.instructure.com/en/discussio...
PSA: Today I learned that quizzes created in the Canvas learning management system using the New Quiz Builder don't allow you to export all student answers to Excel/CSV. This has been a problem since 2021. Don't use the new quiz builder. Use the old one. community.instructure.com/en/discussio...
Export All Quiz Answers from All Students as a CSV or EXCEL spreadsheet or XML data structure - Instructure Community
We are developing new psychometric methods for student response data analysis. Is there a way to export the individual responses of all students to all questions for a quiz such as a CSV or EXCEL or X...
community.instructure.com
Surprising omission: the @aclrollingreview.bsky.social website does not have an easily findable button to sign up as a reviewer. Seems like a missed opportunity.
Some years ago, I bought Joseph Weizenbaum's book on Computer Power and Human Reason for a couple of dollars. Nice to have a classic work on computers and society. Following the AI boom, the price of secondhand copies has skyrocketed: more than 100 dollars for a used copy!
Nice essay on AI ethics by @frank.computer: www.frank.computer/blog/2025/05...
Stop saying that AI is just a tool and it only matters how it is used
I’m tired of this phrase and this simple way of thinking about tools. This blog post is a wandering train of thought on the topic of what tools are and why it matters to be even slightly more mature i...
frank.computer
We just published a position paper on the evaluation of dialog systems, roughly asking: 1. Why don't we talk more about usage requirements for evaluation metrics? 2. Should we only adapt metrics to dialog, or can we also adapt dialog to suit metrics? URL: aclanthology.org/2025.gem-1.18/ #NLProc
Measure only what is measurable: towards conversation requirements for evaluating task-oriented dialogue systems
Emiel Van Miltenburg, Anouck Braggaar, Emmelyn Croes, Florian Kunneman, Christine Liebrecht, Gabriella Martijn. Proceedings of the Fourth Workshop on Generation, Evaluation and Metrics (GEM²). 2025.
aclanthology.org
I'm looking for studies on the mood/atmosphere/affective dimensions of photographs, but it's hard to find relevant work. Any recommendations?
The first papers are already submitted, but for anyone hoping for an extra week to work on their paper, I have very good news! The deadline for submitting to #INLG2025 has been extended until July 18th (end of the day anywhere on earth, AoE). Submit your work on generation! 2025.inlgmeeting.org
INLG2025
The 18th International Natural Language Generation Conference is scheduled to be held in Hanoi, Vietnam from October 29 to November 2, 2025.
2025.inlgmeeting.org
Just over a month left to submit to INLG2025, hosted in Hanoi, Vietnam! INLG is the annual @siggen.bsky.social conference for research on any aspect of Natural Language Generation: (large) language models, rule-based generation, applications, human/automatic evaluation of output quality, etc.
New open access textbook (in Dutch): tiu.trialanderror.org/projects/wer... It's all about quantitative content analysis, and how to analyse existing data in a responsible manner.
Werkboek inhoudsanalyse | Open Press Tilburg University
Werkboek Inhoudsanalyse is een praktische handleiding om te leren hoe je op een betrouwbare en verantwoordelijke manier kunt analyseren hoe mensen met elkaar communiceren. Dit boek richt zich op het o...
tiu.trialanderror.org
Curious new #NLProc/#NLP paper aiming to quantify the extent to which a language model can potentially generate all valid strings from a language without generating strings that do not belong to the language: arxiv.org/abs/2504.14370 Very similar to generative linguistics, but Chomsky is not cited.
Density Measures for Language Generation
The recent successes of large language models (LLMs) have led to a surge of theoretical research into language generation. A recent line of work proposes an abstract view, called language generation i...
arxiv.org
Mijn opiniestuk over domme AI-hype-stukjes op (o.a.) televisie, perfect verbeeld door Klöppings verhaal over ChatGPT als psycholoog. Wat zulk commentaar dom maakt is niet eens zozeer een verkeerd begrip van de technologie zélf, maar totale onkunde over de echte wereld. www.trouw.nl/opinie/opini...
Opinie: AI wordt alleen té slim, als we onszelf dom voordoen
Wie denkt dat ChatGPT een therapeut kan vervangen, onderschat onze complexe sociale werkelijkheid, betoogt filosoof Marijn Sax.
trouw.nl
Ik was gisterenavond een beetje boos hierover en toen heb ik snel een opiniestukje geschreven dat als het goed is binnenkort in een landelijk dagblad staat. Rage writing best writing.
INLG2025 will be in Hanoi, Vietnam. If you work on Natural Language Generation #NLG, please consider submitting! It's a really fun conference with attention for both #LLMs and more traditional natural language generation techniques. More information via: 2025.inlgmeeting.org #NLProc
INLG2025
The 18th International Natural Language Generation Conference is scheduled to be held in Hanoi, Vietnam from October 29 to November 2, 2025.
2025.inlgmeeting.org