Khurram Javed

@khurramjaved.com

Working on scalable and decentralized algorithms for real-time reinforcement learning. Research scientist @ Keen AGI Prev - PhD with Richard S. Sutton

A bunch of us are organizing a workshop at RLC. If your goal is to develop algorithms that allow agents to learn from complex data streams without relying on human data and human designers, then this workshop would be a good fit.

RL in Big Worlds@rlcbigworlds.bsky.social · 5mo ago

RL in Big Worlds is a workshop at @rl-conference.bsky.social about ideas that enable agents to achieve goals in environments vastly more complex than themselves. This requires giving agents the ability to learn continually and use approximate value functions, models, and policies effectively.

Olympiad problems are designed to have elegant solutions and new problems are often designed around old patterns. As language models get better we should expect them to conquer IMO/IOI problems. Simple problems not designed to have elegant solutions would prove harder for language models.

How to keep the AI hype cycle going: 1. Propose new knowledge based benchmarks and show existing LLMs do poorly on them. 2. Train LLMs on the knowledge required to do well on the new benchmarks. 3. Use improvements on the benchmarks as signs of rapid progress.

Almost all robotics startups are betting on learning from large supervised learning datasets collected by teleoperation. The odds of success for this strategy are small. Like the Sim2Real bubble, this bubble might not burst for years. At-least it's keeping the roboticists employed.

Despite significant growth of the AI community some promising research directions are untouched because we rely on a homogeneous set of tools (e.g., autograd). Ideas that are easy to implement with existing tools win the software lottery and are more thoroughly tested.

This year's (first-ever) RL conference was a breath of fresh air! And now that it's established, the next edition is likely to be even better: Consider sending your best and most original RL work there, and then join us in Edmonton next summer!

Reinforcement Learning Conference@rl-conference.bsky.social · 2y ago

The call for papers for RLC is now up! Abstract deadline of 2/14, submission deadline of 2/21! Please help us spread the word. rl-conference.cc/callforpaper...