NTT Overcomes the “Vocabulary Barrier” Between LLMs, Enabling Interoperability Across Different LLMs

NTT has developed a new inference technique that absorbs token vocabulary differences across large language models (LLMs).

The method reduces token vocabularies without sacrificing accuracy and lets different models work with outputs in a shared vocabulary.

This could expand model collaboration, knowledge integration, knowledge transfer, and ensemble-based approaches.