Sign in to confirm you’re not a bot
This helps protect our community. Learn more

RSS’24 Workshop on Semantics for Robotics

Learning Systems and Robotics Lab
1.69K subscribers
<__slot-el>
<__slot-el>
869 views Streamed 8 months ago
Workshop Website: https://www.dynsyslab.org/rss24-works... Overview: For robots to safely interact with people and the real world, they need the capability to not only perceive but also understand their surroundings in a semantically meaningful way (i.e., understanding implications or pertinent properties associated with the objects in the scene). Advanced perception methods coupled with learning algorithms have made significant progress in enabling semantic understanding. Recent breakthroughs in foundation models have further exposed opportunities for robots to contextually reason about their operating environments. Semantics is  …...more
...more

Opening Remarks

8:45

Invited Talk – Oier Mees

9:00

Invited Talk – Angela Dai

9:20

Invited Talk – Masha Itkina

9:40

Coffee Break and Poster Session

10:00

Invited Talk – Manuel Keppler

10:30

Invited Talk – Federico Tombari

10:50

Invited Talk – Michael Milford

11:10

12:30: Morning Session Panel Discussion

11:30

Spotlight Talks

14:00

Invited Talk – Luca Carlone

14:30

Invited Talk – Marco Pavone

14:50

Invited Talk – Koushil Sreenath

15:10

Coffee Break and Poster Session

15:30

Invited Talk – Andrea Bajcsy

16:00

Afternoon Session Panel Discussion

16:20

Concluding Remarks

16:55

18:00: Social Gathering

17:00
RSS’24 Workshop on Semantics for Robotics
Workshop Website: https://www.dynsyslab.org/rss24-works... Overview: For robots to safely interact with people and the real world, they need the capability to not only perceive but also understand their surroundings in a semantically meaningful way (i.e., understanding implications or pertinent properties associated with the objects in the scene). Advanced perception methods coupled with learning algorithms have made significant progress in enabling semantic understanding. Recent breakthroughs in foundation models have further exposed opportunities for robots to contextually reason about their operating environments. Semantics is ingrained in every aspect of robotics, from perception to action; reliably exploiting semantic information in embodied systems requires tightly coupled perception, learning, and control algorithm design (e.g., a robot in a warehouse must recognize objects on the floor and reason whether it is safe to run over them). By organizing this workshop, we hope to foster discussions on innovative approaches that harness semantic understanding for the design and deployment of intelligent embodied systems. We aim to facilitate an interdisciplinary exchange between researchers in robot learning, perception, mapping, and control to identify the opportunities and pressing challenges when incorporating semantics into robotic applications. Our workshop comprises two general themes with invited talks from experts in each: Theme A – Environment Understanding and Reasoning: In this theme, we aim to provide an overview of the recent advances in 3D spatial understanding and reasoning in robotics. The invited talks will cover state-of-the-art methods enabling robots to derive semantically meaningful information from diverse sensor modalities and natural language instructions for effective downstream decision-making. The panel discussions will delve into opportunities and challenges related to geometric and semantic representations, uncertainty-aware perception, data-driven learning methods, and (safety) evaluation in practical applications. Theme B – Safe Interaction with the World: In this theme, we will highlight the seminal approaches towards planning and control in complex, interactive scenarios. The invited talks will encompass control-theoretic frameworks for safe learning-based decision-making under uncertainties, safe and compliant human-robot interaction, and high-level language instructions for non-expert robot operation. The panel discussion will facilitate discussions on strategies for incorporating semantic understanding into planning and control algorithms to enable robot interaction in complex environments and enhance safe operation in real-world deployment. Morning Session 08:45 – 09:00: Opening Remarks 09:00 – 09:20: Invited Talk – Oier Mees 09:20 – 09:40: Invited Talk – Angela Dai 09:40 – 10:00: Invited Talk – Masha Itkina 10:00 – 10:30: Coffee Break and Poster Session 10:30 – 10:50: Invited Talk – Manuel Keppler 10:50 – 11:10: Invited Talk – Federico Tombari 11:10 – 11:30: Invited Talk – Michael Milford 11:30 – 12:30: Morning Session Panel Discussion Afternoon Session 14:00 – 14:30: Spotlight Talks 14:30 – 14:50: Invited Talk – Luca Carlone 14:50 – 15:10: Invited Talk – Marco Pavone 15:10 – 15:30: Invited Talk – Koushil Sreenath 15:30 – 16:00: Coffee Break and Poster Session 16:00 – 16:20: Invited Talk – Andrea Bajcsy 16:20 – 16:55: Afternoon Session Panel Discussion 16:55 – 17:00: Concluding Remarks 17:00 – 18:00: Social Gathering

Follow along using the transcript.

Learning Systems and Robotics Lab

1.69K subscribers