MCP-Persona: Benchmarking LLM Agents on Real-World Personal Applications via Environment Simulation

Researchers introduced MCP-Persona, a benchmark for evaluating LLM agents on personalized tools and real-world personal apps.

It uses simulated environments with individual accounts and local databases across platforms like Reddit, Xiaohongshu, Lark, and Slack.

Experiments show that even top agents perform poorly on these account-specific, data-dependent tasks.

The benchmark highlights a major gap in current LLM tool use and should help improve future evaluation and agent design.