Ask HN: Why are desktop AI apps so heavy?

yconst1 pts0 comments

I mean they are text apps basically, they should be flying on modern PCs that can do close to a trillion ops per second. Inference is done elsewhere, so what s the deal?

apps desktop heavy mean text basically

Related Articles