Main content
The Conversation is the Command: Interacting with Real-World Autonomous Robots Through Natural Language (TCC-IRoNL)
- Nwankwo Linus
- Elmar Rueckert
Date created: | Last Updated:
: DOI | ARK
Creating DOI. Please wait...
Category: Project
Description: TCC-IRoNL synergically exploits the capabilities of pre-trained large language models (LLMs) and a multimodal vision-language model (VLM) to enable ROS based autonomous robots to interact naturally with humans or other entities through conversational dialogue. It leverages the LLMs to decode the high-level natural language instructions from humans and abstract them into precise robot actionable commands or queries. Further, it utilised the VLM to provide a visual and semantic understanding of the robot’s task environment. Refer to the paper for more details.
Add important information, links, or images here to describe your project.
Files
Files can now be accessed and managed under the Files tab.
Citation
Recent Activity
Start managing your projects on the OSF today.
Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.