Show HN: TurboQuant for mlx-lm (Apple Silicon)

pythongiant1 pts1 comments

Hi HN,I built mlx-turboquant, an implementation of Google s TurboQuant KV-cache compression algorithm for Apple s MLX framework.The repository includes quality benchmarks, memory benchmarks, and a modular implementation so individual pieces (PolarQuant, QJL, packing, codebooks) can be studied independently.

turboquant apple implementation benchmarks show silicon

Related Articles