MODUS: Decoder-Only Any-to-Any Modeling of Diverse Modalities

MODUS, an arXiv paper, introduces a decoder-only framework for modeling multiple modality types.

The system is framed as an any-to-any architecture, designed to handle diverse inputs and outputs.

The approach could simplify multimodal AI by using one model design for many modality combinations.