Hacker News Reader

Thanks for your insights. Can you share more about your experience in self hosting the model inference to reduce cost or make it even zero if possible ?

View on HN

A small model can fit in an old gaming computer. One of the computers you keep for no reasons. My requirement was to run in 8GB of GDDR.

You still have to pay for the electricity though.

Reply on news.ycombinator.com