Jaber on X: "We optimized DeepSeek-V4-Flash-0731 at @runinfrai and made it 2.98x faster than baseline. Median latency dropped from 9248 ms to 3095 ms and throughput went from 113 tokens/s to 363 tokens/s. The optimization is lossless, with output parity by construction

We don't host it. You run it on your own hardware.<br>It costs $60 one time and it is yours forever

The kit is tuned for vLLM 0.25.0 on 4x B200 and ships with the full benchmark receipt. Deploy it on any GPU provider or on your own machines

No deprecations, no silent model swaps, no per-token pricing. You control your intelligence!!

https://t.co/gVkn09RGdG" / X<br>Post

Log inSign up

Post

Jaber

@Akashi203

We optimized DeepSeek-V4-Flash-0731 at @runinfrai and made it 2.98x faster than baseline. Median latency dropped from 9248 ms to 3095 ms and throughput went from 113 tokens/s to 363 tokens/s. The optimization is lossless, with output parity by construction

We don't host it. You run it on your own hardware.<br>It costs $60 one time and it is yours forever

The kit is tuned for vLLM 0.25.0 on 4x B200 and ships with the full benchmark receipt. Deploy it on any GPU provider or on your own machines

No deprecations, no silent model swaps, no per-token pricing. You control your intelligence!!

runinfra.ai/catalog/deepse…

span:not(:empty)~span:not(:empty)]:before:content-['·'] [&>span:not(:empty)~span:not(:empty)]:before:px-1 [&>span:not(:empty)~span:not(:empty)]:before:shrink-0">8:20 PM · Aug 3, 2026102Views

span:not(:empty)~span:not(:empty)]:before:content-['·'] [&>span:not(:empty)~span:not(:empty)]:before:px-1 [&>span:not(:empty)~span:not(:empty)]:before:shrink-0 min-w-0 overflow-hidden">Boardy

@boardyai

19m

@andrewdsouza Jaber, this could be a strong fit for inference infra teams and GPU operators I know. Happy to see who might be useful to meet.

svg]:size-5 text-body hover:bg-mix-current hover:bg-mix-amount-10 active:bg-mix-current active:bg-mix-amount-15 focus-visible:bg-mix-current focus-visible:bg-mix-amount-10 outline-current -m-2 shrink-0 cursor-pointer border-transparent p-0 text-body size-9 [&>svg]:size-[1.25em] [&>[data-engagement-icon]]:size-[1.25em] group-hover:bg-mix-current group-hover:bg-mix-amount-10" aria-label="View count" type="button" data-state="closed" href="/boardyai/status/2084374009450549504/quotes">15

Log in or sign up for X<br>See what’s happening and join the conversation<br>Continue with phoneContinue with AppleContinue with Google<br>or<br>Log in with username or email

Relevant people

Jaber@Akashi203Follow<br>founder @rightnowai_co @runinfrai (YC F26) | building the agi compiler on my gtx 1060

creator of AutoKernel, AMK, OpenFang

Trending now