Jerry Liu on X: "https://t.co/FLiVbGVK1a" / X<br>Post
Log inSign up
Post
Jerry Liu
@jerryjliu0
The Best Model Routing is Task Specific
span:not(:empty)~span:not(:empty)]:before:content-['·'] [&>span:not(:empty)~span:not(:empty)]:before:px-1 [&>span:not(:empty)~span:not(:empty)]:before:shrink-0">11:36 PM · Jul 15, 202644.8KViews
14014<br>21021<br>2430243<br>4350435
span:not(:empty)~span:not(:empty)]:before:content-['·'] [&>span:not(:empty)~span:not(:empty)]:before:px-1 [&>span:not(:empty)~span:not(:empty)]:before:shrink-0 min-w-0 overflow-hidden">Sourav | Applied AI
@bongquisitive
Jul 16
recently read the Hugging face article from IBM on this-
huggingface.co<br>Model Routing Is Simple. Until It Isn’t.<br>A Blog post by IBM Research on Hugging Face
101<br>svg]:size-5 text-body hover:bg-mix-current hover:bg-mix-amount-10 active:bg-mix-current active:bg-mix-amount-15 focus-visible:bg-mix-current focus-visible:bg-mix-amount-10 outline-current -m-2 shrink-0 cursor-pointer border-transparent p-0 text-body size-9 [&>svg]:size-[1.25em] [&>[data-engagement-icon]]:size-[1.25em] group-hover:bg-mix-current group-hover:bg-mix-amount-10" aria-label="View count" type="button" data-state="closed" href="/bongquisitive/status/2077699569912353254/quotes">2510251
span:not(:empty)~span:not(:empty)]:before:content-['·'] [&>span:not(:empty)~span:not(:empty)]:before:px-1 [&>span:not(:empty)~span:not(:empty)]:before:shrink-0 min-w-0 overflow-hidden">Piotr (Peter) Mardziel<br>@piotrm0
Jul 16
My router:<br>Complicated coding task -> Fable<br>Highly philosophical ethical discussion -> Fable<br>Query about the weather -> Fable<br>Tips on saving money to pay for my tokens -> ....
101<br>svg]:size-5 text-body hover:bg-mix-current hover:bg-mix-amount-10 active:bg-mix-current active:bg-mix-amount-15 focus-visible:bg-mix-current focus-visible:bg-mix-amount-10 outline-current -m-2 shrink-0 cursor-pointer border-transparent p-0 text-body size-9 [&>svg]:size-[1.25em] [&>[data-engagement-icon]]:size-[1.25em] group-hover:bg-mix-current group-hover:bg-mix-amount-10" aria-label="View count" type="button" data-state="closed" href="/piotrm0/status/2077564206740836608/quotes">6080608
span:not(:empty)~span:not(:empty)]:before:content-['·'] [&>span:not(:empty)~span:not(:empty)]:before:px-1 [&>span:not(:empty)~span:not(:empty)]:before:shrink-0 min-w-0 overflow-hidden">Thibault Jaigu
@ThibaultJaigu
Jul 16
Benchmarked fusion on all our internal benchmarks and was 4x slower and 2.7x more expensive.
101<br>svg]:size-5 text-body hover:bg-mix-current hover:bg-mix-amount-10 active:bg-mix-current active:bg-mix-amount-15 focus-visible:bg-mix-current focus-visible:bg-mix-amount-10 outline-current -m-2 shrink-0 cursor-pointer border-transparent p-0 text-body size-9 [&>svg]:size-[1.25em] [&>[data-engagement-icon]]:size-[1.25em] group-hover:bg-mix-current group-hover:bg-mix-amount-10" aria-label="View count" type="button" data-state="closed" href="/ThibaultJaigu/status/2077804502439092423/quotes">1110111
New to X?<br>Sign up now to get your own personalized timeline!<br>Sign up with GoogleSign up with AppleCreate account<br>By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.
Relevant people<br>Jerry Liu@jerryjliu0Follow<br>Parsing the world's hardest PDFs @llama_index. cofounder/CEO
Careers: https://t.co/EUnMNmbCtx<br>Enterprise: https://t.co/Ht5jwxSrQB
Don't miss what's happening<br>People on X are the first to know.
Log inSign up
Trending now