UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agents
TL;DR AI
2 min readKey summary
UI-KOBE is a framework that first explores a mobile app to build a graph of UI states and transitions.
At runtime, it uses that app-specific graph to help a lightweight agent choose actions from screenshots and task context.
This improves task planning and execution for mobile GUI agents without relying on large cloud models.
The approach can make on-device automation more reliable, cheaper, and more privacy-friendly.
