TurboQuant Cuts Memory Usage For AI Inference

In short, this new compression technique will enable lower memory usage by local AI models running on consumer hardware and anywhere else running (not training) AI models.

https://research.google/blog/turboquant-redefining-ai-efficiency-with-extreme-compression/