Embodied-Agents

Charles F. Vardeman II

2024-10-04

Future Planning…

ROSA – The ROS Agent

“Nasa-Jpl/Rosa: ROSA 🤖 Is an AI Agent Designed to Interact with ROS1- and ROS2-Based Robotics Systems Using Natural Language Queries. ROSA Helps Robot Developers Inspect, Diagnose, Understand, and Operate Robots.” n.d. Accessed October 4, 2024. https://github.com/nasa-jpl/rosa.

Embodied Memory

Embodied RAG and non-parametric Memory, https://youtu.be/U-KM5wBOoI8?si=fxuAzJEPVSVbdVUK

Embodied RAG Memory

“Embodied-RAG: General Non-Parametric Embodied Memory for Retrieval and Generation.” n.d. Accessed October 4, 2024. https://quanting-xie.github.io/Embodied-RAG-web/.

Google Illuminate Summary

Embodied-RAG Framework

Embodied-RAG Reasoning

What’s Missing?

  • Cooperative Embodied Memory?
  • Dynamic Topology Generation?
  • Agentic Planning?
  • Agentic Reasoning?

https://la3d.github.io/nuggets/

Laboratory for Assured AI Application Development (LA3D)