Hacker News Reader

How big are the executabels ? I would like to move our interence code from tensorflow to a executable

I just compiled the llama example on my M1 mac. The resulting binary is 9.5mb in size. I assume that includes support for apple's ML acceleration but not CUDA.

Reply on news.ycombinator.com