Show HN: Pulsys – Pull-through cache for Hugging Face built with io_uring

poshmosh1 pts1 comments

Pulsys is an open-source, self hosted, authenticated pull-through cache for Hugging Face. It acts as a drop-in replacement for existing HF clients and serves warm hits directly from disk, achieving up to 90 GB/s throughput (benchmarks are run on loopback on ec2) by bypassing standard syscalls in favor of io_uring (Linux) and sendfile (macOS).

pulsys pull through cache hugging face

Related Articles