Comment by upbeat_general | Hacker News Reader

Top New Best Ask Show Jobs

Comment by upbeat_general | Hacker News Reader

Parent Full thread

upbeat_general·

Do you know of any good explanations of the techniques you used for those who only touch PyTorch Eager + occasionally torchscript?

You could check "AITemplate optimizations" section in the blog (https://ai.facebook.com/blog/gpu-inference-engine-nvidia-amd...), and https://github.com/facebookincubator/AITemplate#more-about-a.... The basic idea is to do aggressive kernel fusions.

Reply on news.ycombinator.com