What’s the right resolution for such ontologies? 1,000-10,000 seems like the sweet spot. H/t @aneeshsathe.com aneeshsathe.com/2025/01/15/d...

Domain Ontologies: Indispensable for Knowledge Graph Construction

AI slop is all around and increasingly extraction of useful information will face difficulties as we start to feed more noise into the already noisy world of knowledge. We are in an era of unpreced…

aneeshsathe.com

About to send my last DLCT email of the year today (in 2 hours). Join the 7-year-old mailing list if you haven't heard of it. (And if you have heard of it but haven't joined, I trust that it's a well thought decision that suits you the best.) groups.google.com/g/deep-learn...

The recording of my #NeurIPS2024 workshop talk on multimodal iterative refinement is now available to everyone who registered: neurips.cc/virtual/2024... My talk starts at 1:10:45 into the recording. I believe this will be made publicly available eventually, but I'm not sure when exactly!

Paul Vicol@paulvicol.bsky.social · 2y ago

@sedielem.bsky.social speaking now on Multimodal Iterative Refinement at the Adaptive Foundation Models workshop!

One of the best tutorials for understanding Transformers! 📽️ Watch here: www.youtube.com/watch?v=bMXq... Big thanks to @giffmana.ai for this excellent content! 🙌

[M2L 2024] Transformers - Lucas Beyer

YouTube video by Mediterranean Machine Learning (M2L) summer school

youtube.com

Anne Gagneux, Ségolène Martin, @quentinbertrand.bsky.social Remi Emonet and I wrote a tutorial blog post on flow matching: dl.heeere.com/conditional-... with lots of illustrations and intuition! We got this idea after their cool work on improving Plug and Play with FM: arxiv.org/abs/2410.02423

congratulations, @ian-goodfellow.bsky.social, for the test-of-time award at @neuripsconf.bsky.social! this award reminds me of how GAN started with this one email ian sent to the Mila (then Lisa) lab mailing list in May 2014. super insightful and amazing execution!

Trying to build a "books you must read" list for my lab that everyone gets when they enter. Right now its: - Sutton and Barto - The Structure of Scientific Revolutions - Strunk and White - Maybe "Prediction, Learning, and Games", TBD Kinda curious what's missing in an RL / science curriculum

This is a simple and good paper, which somehow nobody working on these things cites, or even seems to be aware of arxiv.org/abs/2406.05213 It is simple idea that seems useful; it formulates the subjective uncertainty for natural language generation in a decision-theoretic setup.

On Subjective Uncertainty Quantification and Calibration in Natural Language Generation

Applications of large language models often involve the generation of free-form responses, in which case uncertainty quantification becomes challenging. This is due to the need to identify task-specif...

arxiv.org

A real-time (or very fast) open-source txt2video model dropped: LTXV. HF: huggingface.co/Lightricks/L... Gradio: huggingface.co/spaces/Light... Github: github.com/Lightricks/L... Look at that prompt example though. Need to be a proper writer to get that quality.

Perhaps an unpopular opinion, but I don't think the problem with Large Language Model evaluations is the lack of error bars.

let me say it once more: "the gap between OAI/Anthropic/Meta/etc. and a large group of companies all over the world you've never cared to know of, in terms of LM pre-training? tiny"

The return of the Autoregressive Image Model: AIMv2 now going multimodal. Excellent work by @alaaelnouby.bsky.social & team with code and checkpoints already up: arxiv.org/abs/2411.14402

Interesting paper on arxiv this morning: arxiv.org/abs/2411.13683 It's a video masked autoencoder in which you learn which tokens to mask to process fewer of them and scale to longer videos. It's a #NeurIPS2024 apparently. I wonder if there could be such strategy in the pure generative setup.

Extending Video Masked Autoencoders to 128 frames

Video understanding has witnessed significant progress with recent video foundation models demonstrating strong performance owing to self-supervised pre-training objectives; Masked Autoencoders (MAE) ...

arxiv.org

I’m not getting notifications for comments here, anyone facing the same issue?

You might enjoy this list I have:

What softwares do I actually use on my Mac as a software enthusiast? • Mimansa Jaiswal

With several years of using a Mac, it took me time to settle down on a set of apps and softwares that I can heartily recommend. I try almost 30 a month, but end up using around 20 in total for everyth...

mimansajaiswal.github.io

Discrete diffusion has become a very hot topic again this year. Dozens of interesting ICLR submissions and some exciting attempts at scaling. Here's a bibliography on the topic from the Kuleshov group (my open office neighbors). github.com/kuleshov-gro...

GitHub - kuleshov-group/awesome-discrete-diffusion-models: A curated list for awesome discrete diffusion models resources.

A curated list for awesome discrete diffusion models resources. - kuleshov-group/awesome-discrete-diffusion-models

github.com

I only got to know today this awesome diffusion starter pack exists! I’ll try to fill up my generative models pack with some complementary folks. :)

Sander Dieleman@sedielem.bsky.social · 2y ago

In a gratuitous attempt to acquire more followers myself 😁, I've made a start on a "starter pack". Hopefully as more people from 🐦 make it over to 🦋, we can extend this a bit. Suggestions welcome! I've noticed not all accounts seem to be eligible to be added, anyone know what's up with that? 🤔

Can people create accounts here without invite now? 🤔

I would miss not having a character limit since my rants grew larger, longer I’m in grad school! 😅

Started a list of some researchers working on image/video generation. (Not comprehensive at all) Reply with a paper link and TLDR to get added to the list! I request all grad students to not feel imposter-y and just reply if you work in this field! #computervision #diffusion go.bsky.app/SP1uWoE

www.astralcodexten.com/p/how-did-yo...

My growing list of #computervision researchers on Bsky. Missed you? Let me know. go.bsky.app/M7HGC3Y

I think we broke the app! I’m trying to retweet something and it’s not working! 😅

Importantly, starter packs are intended as a way for newcomers to the platform to conveniently get started with finding people from their community. They cannot and should not be considered authoritative “VIP lists.”

Need bookmarks features asap! 🥺 @bsky.app

I'm slowly putting my intro to ML course material on github, starting with the lab sessions: github.com/davidpicard/... These are self-contained notebooks in which you have to implement famous algorithms from the literature (k-NN, SVM, DT, etc), with a custom dataset that I (painstakingly) made!

What are some must-read multimodal generation papers? I am looking for vision-language models (preferably jointly trained from scratch). Some examples - Chameleon - arxiv.org/abs/2405.09818 Transfusion - arxiv.org/abs/2408.11039 JanusFlow - arxiv.org/abs/2411.07975 #computervision #multimodal

6 years ago, in the days of GAN art, I wrote an article called "Can Computers Create Art?", arguing that computers should not be considered artists, regardless of how good image generation gets. People sometimes ask if my views have changed. I say, 1/🧵 www.mdpi.com/2076-0752/7/...

Can Computers Create Art?

This essay discusses whether computers, using Artificial Intelligence (AI), could create art. First, the history of technologies that automated aspects of art is surveyed, including photography and an...

mdpi.com

Here's my attempt at assembling a starter pack of the still nascent computer vision community on Bluesky. Feel free to recommend other accounts that should be in this starter pack. :) #computervision (Do we use hashtags here? 😅) go.bsky.app/PkAKJu5