At NeurIPS this week? DM if you want to meet!

Happy to announce that I've joined Periodic Labs as member of technical staff. We're a mission driven startup aimed at accelerating scientific discovery using AI, with a strong focus on material science (discovery of new materials such as superconductors and such). We're hiring: periodic.com

Periodic Labs

From bits to atoms.

periodic.com

The fact that all LLM libraries don't have the same data format is as surprising as the fact that there is more than one sign language dialect

Ray is an excellent way of testing if all your `__repr__` are coded properly (but it shouldn't be)

Just stumbled upon RouteRL: a multiagent RL framework to facilitate the testing and development of efficient route choice strategies coexistence-project.github.io/RouteRL/ Looks pretty cool!

What is GGUF, Safetensors, PyTorch, ONNX? In this blog post, let's discover common formats for storing an AI model. huggingface.co/blog/ngxson/...

Common AI Model Formats

A Blog post by Xuan-Son Nguyen on Hugging Face

huggingface.co

Today we're opensourcing MLGym, an API for AI research agents. MLGym relies on a gym environment that wraps a docker image. Each env has a task specified as a YAML file, telling in plain english what you want your LLM to achieve 👇

A few tips I share when I talk about perf with PyTorch in eager mode (with focus on small models): 🪢

I stand by my point that the word "agent" should be avoided at all costs. At least in RL, anytime I see an "Agent" class it's meant to be a "whatever doesn't fit in any other bucket in my codebase".

Everyone's like "hey I just coded and trained a SOTA LLM in my garage last week, also wrote a blogpost about it and opensourced the repo" and the only thing I did in the meantime was fix a CI and configure a remote interpreter on a server... 😢

A new release of tensordict is out github.com/pytorch/tens... Thanks to all who have contributed!

Release v0.7.0: More robust composite distributions, TensorClass superclass · pytorch/tensordict

v0.7.0: More robust composite distributions, TensorClass superclass v0.7.0 brings a lot of new features and bug fixes. Thanks to the vibrant community to help us keeping this project alive! New Con...

github.com

Clap hands if you were doing RL before it was cool

You’ve never really understood PyTorch until you’ve figured out what torch.scatter exactly does. I’ve never really understood PyTorch.

Introducing playground.mujoco.org Combining MuJoCo’s rich and thriving ecosystem, massively parallel GPU-accelerated simulation, and real-world results across a diverse range of robot platforms: quadrupeds, humanoids, dexterous hands, and arms. Get started today: pip install playground

MuJoCo Playground

An open-source framework for GPU-accelerated robot learning and sim-to-real transfer

playground.mujoco.org

One of the bests Mindscape episodes I've heard! I've always been interested in the epistemology of controversial scientific concepts such as emergence or consciousness. Vaguely defined concepts (or diverging definitions) are often at the root of many pointless debates. Kudos on clarifying things!

Sean Carroll@seanmcarroll.bsky.social · 2y ago

Mindscape 295 | Solo: Emergence and Layers of Reality. Finally sorting out what this emergence stuff is all about, we can all carry on now. #MindscapePodcast www.preposterousuniverse.com/podcast/2024...

New Year’s resolutions: - eat healthier - exercise more - no more “is all you need” papers

Yesterday the hyped Genesis simulator released. But it's up to 10x slower than existing GPU sims, not 10-80x faster or 430,000x faster than realtime since they benchmark mostly static environments blog post with corrected open source benchmarks & details: stoneztao.substack.com/p/the-new-hy...

Wrong answers only: What does this `Human-computer` sticker seen at neurips hide?

Check out Motivo, a behavioral foundation model for humanoid control by FAIR. It's a one-of-its-kind unsupervised RL project, and it comes with a demo that is SO fun to play with! metamotivo.metademolab.com (for the record, they use compile and cudagraphs -> github.com/facebookrese...)

I’m 100% sure this button never does anything

PyTorch has released torchcodec yesterday, a powerful video decoding toolbox pytorch.org/blog/torchco... github.com/pytorch/torc...

torchcodec: Easy and Efficient Video Decoding for PyTorch

We are pleased to officially announce torchcodec, a library for decoding videos into PyTorch tensors. It is fast, accurate, and easy to use. When running PyTorch models on videos, torchcodec is our re...

pytorch.org

Tomorrow with Matteo Bettini we'll be presenting BenchMARL at #NeurIPS (@neuripsconf.bsky.social) in #Vancouver

I'm excited to be in #Vancouver for #NeurIPS 2024 where I brought a bunch of @LEGO_Group bricks in my bag! *no, I'm not Santa!

We’re looking for an intern (research scientist/PhD) to join the PyTorch team in NYC this summer and work on GPU kernel generation, more info here: www.metacareers.com/jobs/6044463... You’ll be working with @soumithchintala.bsky.social, @marksaroufim.bsky.social and myself

Research Scientist Intern, PyTorch Core (PhD)

Meta's mission is to build the future of human connection and the technology that makes it possible.

metacareers.com

There are two kinds of developers: - Those who know what they would have done differently had they known what a pain it was going to be - Those who change things accordingly and ruin everyone's life forever

My turn to go on the MLOps podcast! We talked about pytorch, compile, RL and lots of other stuff. Check it out wherever you listen to podcast, as they say 🍏 podcasts.apple.com/gb/podcast/m... ᯤ open.spotify.com/show/7wZygk3...

MLOps.community

Podcast · Demetrios Brinkmann · Weekly talks and fireside chats about everything that has to do with the new space emerging around DevOps for Machine Learning aka MLOps aka Machine Learning Operations...

open.spotify.com

define "amusingly"

bsky pro-tip: To check what lists you're part of: clearsky.app/%3Cid%3E.bsk... You're welcome!

👉 PyTorch starter pack! go.bsky.app/P3bo7mp