🏆ONEBench accepted to ACL main! ✨ Stay tuned for the official leaderboard and real-time personalised benchmarking release! If you’re attending ACL or are generally interested in the future of foundation model benchmarking, happy to talk! #ACL2025NLP #ACL2025 @aclmeeting.bsky.social

Adhiraj Ghosh@adhirajghosh.bsky.social · 2y ago

🚨Looking to test your foundation model on an arbitrary and open-ended set of capabilities, not explicitly captured by static benchmarks? 🚨 Check out ✨ONEBench✨, where we show how sample-level evaluation is the solution. 🔎 arxiv.org/abs/2412.06745

The Practitioner's Guide to Continual Multimodal Pretraining @dziadzio.bsky.social @confusezius.bsky.social @vishaalurao.bsky.social @bayesiankitten.bsky.social

📄 New Paper: "How to Merge Your Multimodal Models Over Time?" arxiv.org/abs/2412.06712 Model merging assumes all finetuned models are available at once. But what if they need to be created over time? We study Temporal Model Merging through the TIME framework to find out! 🧵

How to Merge Your Multimodal Models Over Time?

Model merging combines multiple expert models - finetuned from a base foundation model on diverse tasks and domains - into a single, more capable model. However, most existing model merging approaches...

arxiv.org

Come chat to us at NeurIPS about continual multimodal pretraining and some interesting follow-ups 👀

Karsten Roth@confusezius.bsky.social · 2y ago

😵‍💫 Continually pretraining large multimodal models to keep them up-to-date all-the-time is tough, covering everything from adapters, merging, meta-scheduling to data design and more! So I'm really happy to present our large-scale study at #NeurIPS2024! Come drop by to talk about all that and more!

🚨Looking to test your foundation model on an arbitrary and open-ended set of capabilities, not explicitly captured by static benchmarks? 🚨 Check out ✨ONEBench✨, where we show how sample-level evaluation is the solution. 🔎 arxiv.org/abs/2412.06745

The changing of the guard ceremony in Vancouver is complete

How I use LLMs when writing papers: 1. Write a sentence. 2. Copy it to an LLM for edits, add a prompt explaining in simple words what I'm trying to say. 3. Realise my simple word explanation is actually what I need. 4. Copy it over to the paper, move on to the next sentence.

🤔 Can you turn your vision-language model from a great zero-shot model into a great-at-any-shot generalist? Turns out you can, and here is how: arxiv.org/abs/2411.15099 Really excited to this work on multimodal pretraining for my first bluesky entry! 🧵 A short and hopefully informative thread:

I went to a fitness class and the trainer finished it with capitalist affirmations?? He was like "you are a person who gets things done, people like to work with you" lmao

I've found starter packs on NLP, vision, graphics, etc. But personally, I would love to know and hear from researchers working on vision-language. So, let me know if you'd like to join this starter pack, would be happy to add! go.bsky.app/TENRRBb

Berlin autumn means weather is glitching (pics are 3h apart)

enjoying this app so far, my only issue is that I can't prevent my polish brain from pronouncing Bluesky like brewsky or kowalski

Here's a fledgling starter pack for the AI community in Tübingen. Let me know if you'd like to be added! go.bsky.app/NFbVzrA

Tübingen AI

Join the conversation

go.bsky.app

Hello all: It is with a heavy heart that I remove my Starter Pack of "Trustworthy Mesopotamian Copper Ingot Merchants Within the City-State of Ur." I have been informed about some pretty unfortunate oversights on my part and ultimately platformed some creators who should not have been platformed.