IndexCache, a new sparse attention optimizer, delivers 1.82x faster inference on long-context AI models

Researchers at Tsinghua University and Z.ai built IndexCache to eliminate redundant computation in sparse attention models ...

Google unveils TurboQuant, a new AI memory compression algorithm — and yes, the internet is calling it ‘Pied Piper’

Google’s TurboQuant has the internet joking about Pied Piper from HBO's "Silicon Valley." The compression algorithm promises ...
InfoWorld

Google targets AI inference bottlenecks with TurboQuant

Google says its new TurboQuant method could improve how efficiently AI models run by compressing the key-value cache used in LLM inference and supporting more efficient vector search. In tests on ...
The Verge

Meta’s new AI chips run faster than before

The next-generation MTIA chip could be expanded to train generative AI models. The next-generation MTIA chip could be expanded to train generative AI models. Meta promises the next generation of its ...

What is Google's new AI algorithm that has sent stocks of biggest memory makers plummeting?

Google's new TurboQuant algorithm drastically cuts AI model memory needs, impacting memory chip stocks like SK Hynix and ...