Ask HN: How are you operating OSS AI infrastructure?

kkgupta2 pts0 comments

There are many open-source projects across inference, orchestration, observability, vector search, data pipelines, evaluation, and model management. Most are relatively easy to test, but production operation is a different problem.For those running open-source AI infrastructure in production:* What open-source AI technologies are you using?* Where are you running them?* What challenges are you facing? - cost, GPU availability, security, manageability, or something elseThanks

open source infrastructure production running operating

Related Articles