Switch language한국어
Back to the list

Which Way Did It Move? Diagnosing and Overcoming Directional Motion Blindness in Video-LLMs

TL;DR AI

Key summary

2 min read
  1. Researchers found many Video-LLMs perform near chance on simple left/right/up/down motion questions.

  2. The failure comes from a binding gap: models can detect motion signals but struggle to map them to the correct answer.

  3. They introduced MoDirect and DeltaDirect to improve motion-direction detection and generalization.

  4. The methods boost directional accuracy without hurting broader video understanding, highlighting a basic perception flaw in video AI.

Read the original