C2C improves AI model communication, reducing latency and errors
Summary
Researchers from Tsinghua University and other Chinese institutions have developed a new technique called Cache-to-Cache (C2C), which allows multi-LLM systems to exchange information directly through key-value (KV) caches instead of relying on text handoffs. This innovation, aimed at improving communication efficiency, was highlighted in their publication at ICLR 2026, where experiments showed that C2C enhanced accuracy by up to 11.9 percentage points and significantly reduced latency, outperforming traditional text-based methods. However, deploying C2C requires an inference stack that exposes the KV-cache internals, making it suitable primarily for teams with their own serving infrastructure and reflecting a broader trend in AI research that seeks direct exchanges of internal representations between models.