Switch language한국어
Back to the list

WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation

TL;DR AI

Key summary

2 min read
  1. Researchers introduced WBench, a new benchmark for interactive video world models that uses 289 cases and 1,058 turns.

  2. It evaluates models across five dimensions, including quality, setting adherence, consistency, navigation, and physics compliance, with mixed control interfaces.

  3. Automatic metrics were validated for multi-turn scenarios, including first-person and third-person views and 6-DoF pose control.

  4. Testing 20 models showed no single system is strong across all tasks, with top models excelling in different areas.

Read the original