Ever struggled with multi-sensor data from cameras, depth sensors, and other custom sensors? Meet AnySense—an iPhone app for effortless data acquisition and streaming. Working with multimodal sensor data will never be a chore again!

P3-PO is a great example of how simple human priors can facilitate significantly better generalizability for robot policies.

Lerrel Pinto@lerrelpinto.com · 2y ago

New paper! We show that by using keypoint-based image representation, robot policies become robust to different object types and background changes. We call this method Prescriptive Point Priors for robot Policies or P3-PO in short. Full project is here: point-priors.github.io

BAKU is fully open source and surprisingly effective. We found it easily adaptable for a host of visuotactile tasks in visuoskin.github.io

Lerrel Pinto@lerrelpinto.com · 2y ago

Modern policy architectures are unnecessarily complex. In our #NeurIPS2024 project called BAKU, we focus on what really matters for good policy learning. BAKU is modular, language-conditioned, compatible with multiple sensor streams & action multi-modality, and importantly fully open-source!

Robot utility models are not just among the first learned models that work zero-shot on a mobile manipulator, but also provide a nuanced discussion on what works and what doesn't in data-driven robot learning.

Lerrel Pinto@lerrelpinto.com · 2y ago

Since we are nearing the end of the year, I'll revisit some of our work I'm most excited about from the last year and maybe a sneak peek of what we are up to next. To start of, Robot Utility Models, which enables zero-shot deployment. In the video below, the robot hasnt seen these doors before.

I'll be presenting AnySkin at the Stanford Center for Design Research today at 2pm! Stop by for a chat and try the sensor out! More info: any-skin.github.io

I just joined bluesky, and would love to connect with folks interested in embodied AI and robotics. I am a postdoctoral researcher at NYU working at the intersection of sensing, machine learning and robotics. Hit me up if you'd like to chat! More about my research: raunaqbhirangi.github.io