New AI system lets robots understand and act on human commands in real time

Researchers linked large language models to the Robot Operating System to let robots convert text commands into executable steps.

The framework supports two execution modes: generating inline code snippets and building behavior trees for decision making.

Experiments across multiple robot platforms showed the approach can handle diverse real-world tasks and was validated using open-source models and code.