Pick of the week @fbk-mt.bsky.social Super interesting paper on the limitations of quantization, demonstrating how post-training quantization scales poorly in data. arxiv.org/abs/2411.04330

Scaling Laws for Precision

Low precision training and inference affect both the quality and cost of language models, but current scaling laws do not account for this. In this work, we devise "precision-aware" scaling laws for b...

arxiv.org

🎓 Come and join our group! 🎓 We offer 2 fully funded PhD positions: 🌍 Human-Centred Evaluation Frameworks for Multilingual Technologies (A6) 🤖 Multimedia Personalization with Multimodal Large Language Models (A7) ⏰ Deadline: 15 May 2026 🔗 Details: iecs.unitn.it/education/ad...

🎓 Today we attended the FBK PhD Day, and our amazing students presented their research lines: @apierg.bsky.social: gender-inclusive MT @linaconti.bsky.social: explainable speech translation @zhihangxie.bsky.social: long-form SpeechLLMs @uzumakidhairya.bsky.social: resource-efficient translation

Last week at the @fbk-mt.bsky.social seminars, we hosted Elizabeth Salesky from Google DeepMind, presenting her work on "Translation and Language Modeling with Pixels" #NLProc #tokenization #MT

Pick of the week @fbk-mt.bsky.social : How Does Quantization Affect Multilingual LLMs? Quantization has become a widely adopted technique for model compression. This work investigates the impact of quantization on different languages in multilingual LLMs. aclanthology.org/2024.finding...

Happy to welcome our new PhD student Dhairya Suman, who will be researching model efficiency in machine translation! #nlproc @uzumakidhairya.bsky.social