New paper 🚨 "Stable Deep Reinforcement Learning via Isotropic Gaussian Representations" Deep RL suffers from unstable training, representation collapse, and neuron dormancy. We show that a simple geometric insight, isotropic Gaussian representations, can fix this. Here's how 👇
Ivan Rubachev
@puhsu.bsky.social
ML Researcher at research.yandex.com | Working on DL for Tabular Data
To piggy-back a bit on foundation models for structured data discussion here My colleagues at Yandex Research just updated the GraphPFN paper. It's a Graph Foundation Model that works on graph datasets with tabular features, and shows SOTA results both in ICL regimes and when fine-tuned.
GraphPFN: A Prior-Data Fitted Graph Foundation Model
Graph foundation models face several fundamental challenges including transferability across datasets and data scarcity, which calls into question the very feasibility of graph foundation models. Howe...
arxiv.org
You’d think a large model for a tabular data is revolutionary, except we’ve been doing it for DECADES. techcrunch.com/2026/02/05/f...
if you’re going to use AI in your workflow, you have to get extremely good at self-discipline/focus because AI will literally tempt you to pursue every tiny whim/idea that enters your brain and thus will absolutely destroy you and your work if left unchecked slow down before it’s too late
“you can just do things” MAYBE YOU SHOULDN’T!!!!!
We are excited to announce that we can successfully use Rust's standard library from the GPU. This has never been done before. www.vectorware.com/blog/rust-st... Supporting Rust's standard library enables existing Rust code to work on the GPU and makes GPU programming feel normal.
Rust's standard library on the GPU
GPU code can now use Rust's standard library. We share the implementation approach and what this unlocks for GPU programming.
vectorware.com
I just completed "Historian Hysteria" - Day 1 - Advent of Code 2024 #AdventOfCode adventofcode.com/2024/day/1 (in zig btw)
Day 1 - Advent of Code 2024
adventofcode.com
The rejects were horribly misinformed self contradictory but extremely confident. PSGD, SOAP and friends are taking over regardless of academia.
Did you know that 99% of email today is spam? Your inbox isn’t 99% spam because AI is used to filter it. The same 99% will happen here too, but if AI researchers continue to get perma-banned for making available the datasets needed to filter it, it’s going to make this platform unusable.
Tabular DL and AutoML podcast just dropped. For sure watching this youtu.be/3qpQ-sMRafE
How AutoML Creates New Opportunities for Europe - Frank Hutter // CyberValley Podcast #5
YouTube video by Cyber Valley
youtu.be
Can deep learning finally compete with boosted trees on tabular data? 🌲 In our NeurIPS 2024 paper, we introduce RealMLP, a NN with improvements in all areas and meta-learned default parameters. Some insights about RealMLP and other models on large benchmarks (>200 datasets): 🧵
WIP starterpack w researchers on Table Representation Learning (TRL): all things related to representation learning and generative models for e.g. tables, DBs, spreadsheets! I'll curate but DM/reply w handle+some info welcome! Also follow @trl-research.bsky.social for updates 🤗 go.bsky.app/4SNSMRj
Table Representation Learning researchers
Join the conversation
go.bsky.app