Correll Lab
@correlllab.bsky.social
Correll Lab at the University of Colorado Boulder.
Any opinions on "Toward Data Science" moving off of Medium.com? Wonder how many authors have published on TDS because it was on Medium.
Medium: Read and write stories.
On Medium, anyone can share insightful perspectives, useful knowledge, and life wisdom with the world.
medium.com
End-to-end learning datasets should include negative examples, check out James Watson’s block-stacking dataset medium.com/correll-l...
Dataset to Improve Performance in Open World Manipulation
The transformer architecture has changed the field of Artificial Intelligence forever in a sweeping fashion by bringing forth a new…
medium.com
We tested out-of-the-box VLM reasoning for robotic block stacking with ChatGPT4o (95%) a huge step up, but symbolic planning is still needed medium.com/correll-l...
Embodied AI For Block Stacking Tasks
Embodied artificial intelligence is currently an active research frontier, foundation models like ChatGPT have demonstrated incredible…
medium.com
Robot end-to-end learning gets better when including force medium.com/correll-l...
Integrating Contact Force for Delicate Robot Grasping
Improving end-to-end learning with salient information
medium.com
More and more folks discover the power of tactile/force information in end-to-end learning manipulation medium.com/correll-l...
A review on tactile end-to-end robot policies
Can learning unify the tactile experience across different sensing modalities?
medium.com
Building CLIP from scratch to identify sport celebrities medium.com/correll-l...
Building CLIP from Scratch to Identify Sports Celebrities
Unsupervised Learning Approach for Identifying Sports Legends in Images.
medium.com
Check out Aritra and Himanshu’s attempt to solve BeliefMDPs with diffusion models medium.com/correll-l...
Draft — Using Diffusion Models for BeliefMDPs
Robotics has come so far, and there are many examples of people achieving incredible tasks with them — whether it’s self-driving cars…
medium.com
Two approaches of how to squeeze large (T)VLMs onto a 4090 medium.com/correll-l...
Bringing Tactile VLMs to Local GPUs
Scaling the size of the OCTOPI tactile VLM down to a more digestible size
medium.com
Spectrogram and Vision Transformers a powerful tool for time-series analysis medium.com/correll-l...
Spectrograms & Vision Transformers for Time Series Forecasting (Part 2)
An exploration of using multiple time series instead of one to improve financial time series forecasting.
medium.com
A tutorial on training multi-modal end-to-end robot policies with DROID medium.com/correll-l...
Training Multimodal Robot Models with DROID
In this article I’ll be going through training a robot policy step-by-step with the DROID policy learning repository with RLDS format data…
medium.com
Using ControlNets to condition diffusion to in-paint 3D point clouds for manipulation medium.com/correll-l...
Inpainting 3D Point Clouds Using Diffusion Networks
3D UNET Backbone With Adjusted Conditioning for Diffusion Networks on 3D Object Representation Generation
medium.com
Diffusion models are emerging as an universal frontend in robotic foundation models. Find out how they work in Yutong Zhang’s summary of the original robotic diffusion paper medium.com/correll-l...
Diffusion Policy: Applying Diffusion Model to Policy Learning
Explaining diffusion policy, a powerful imitation learning method and the building block for robotics foundation models
medium.com
More and more folks discover the power of tactile/force information in end-to-end learning manipulation medium.com/correll-l...
A review on tactile end-to-end robot policies
Can learning unify the tactile experience across different sensing modalities?
medium.com
End-to-end learning datasets should include negative examples, check out James Watson’s block-stacking dataset medium.com/correll-l...
Dataset to Improve Performance in Open World Manipulation
The transformer architecture has changed the field of Artificial Intelligence forever in a sweeping fashion by bringing forth a new…
medium.com
Robot end-to-end learning gets better when including force medium.com/correll-l...
Integrating Contact Force for Delicate Robot Grasping
Improving end-to-end learning with salient information
medium.com
Open-source implementation of robot policy with Flow Matching 🔥 github.com/HRI-EU/flow... Great work from Fan Zhang and Michael Gienger from Honda Research Institute EU!
i read five papers on tactile robot policies and wrote about them: medium.com/correll-lab/... the first step of me writing my prelim and i hope to have some more interesting synthesis soon. this is in no way a comprehensive review and i welcome recommendations of papers to read!
A review on tactile end-to-end robot policies
Can learning unify the tactile experience across different sensing modalities?
medium.com
Check out Praneeth Nemani’s work on using VLMs to provide scene understanding to symbolic planning medium.com/correll-l...
Contextual Reasoning Meets Structured Planning
Modeling Problem Statements with LLMs
medium.com
Neural networks do historically bad on sets, check out Himanshu Gupta’s review on set transformers medium.com/correll-l...
Paper Review: Set Transformers
A Framework for Attention-based Permutation-Invariant Neural Networks
medium.com
Follow and engage with our research on humanoid robots on medium.com/correll-lab
Toward Humanoids
Ongoing pre-publication research on humanoids and related technologies including paper reviews and tutorials.
medium.com
We tested out-of-the-box VLM reasoning for robotic block stacking with ChatGPT4o (95%) a huge step up, but symbolic planning is still needed medium.com/correll-l...
Embodied AI For Block Stacking Tasks
Embodied artificial intelligence is currently an active research frontier, foundation models like ChatGPT have demonstrated incredible…
medium.com
Check out how ChatGPT can provide common sense knowledge for better grasping medium.com/towards-d...
Grasping With Common Sense using VLMs and LLMs
How to leverage large language models for robotic grasping and code generation
medium.com
Learn how DALL-E 2 works by building and training it from scratch medium.com/correll-l...
DALL-E 2 from Scratch
Text-Conditioned Image Generation on FashionMNIST using CLIP Latents
medium.com
Here is how ChatGPT4o does on block stacking (spoiler: symbolic AI will not go away any time soon) medium.com/correll-lab/...
Embodied AI For Block Stacking Tasks
Embodied artificial intelligence is currently an active research frontier, foundation models like ChatGPT have demonstrated incredible…
medium.com
Interesting summary of the last three humanoid conferences by Aaron Prather www.linkedin.com/posts/amprat...
Aaron Prather on LinkedIn: Over the past three months, I have attended A3 - Association for Advancing… | 28 comments
Over the past three months, I have attended A3 - Association for Advancing Automation 𝐇𝐮𝐦𝐚𝐧𝐨𝐢𝐝 𝐑𝐨𝐛𝐨𝐭 𝐅𝐨𝐫𝐮𝐦 in Memphis, IEEE RAS HUMANOIDS… | 28 comments on LinkedIn
linkedin.com
Learn how to use pre-trained models like BERT and GPT2 to train CLIP on large models from scratch medium.com/correll-l...
CLIP Model — Ablation Study
In this ablation study, the “Building CLIP from Scratch” by Matt Nguyen was leveraged. The reference source can be found here…
medium.com
I created a mini-tutorial on PDDL for those interested in exploring euro-symbolic AI medium.com/towards-d...
Thinking, fast and slow with LLMs and PDDL
ChatGPT is never shy at pretending to perform deep thought, but — like our brain — might need better tools to reason accurately
medium.com
