We don’t offer GPU accelerated inference for now. However it’s on our roadmap, sign up for inferrd to get updates!