982 karma · joined February 22, 2013
I wrapped it in a simple browser demo using Transformers.js + WebGPU. It downloads the q4 ONNX weights (~1.7GB) and runs fully client-side. no server required. Falls back to WASM if WebGPU isn't available.
It did not exactly work out, but I think the pandemic is a call to create new online experiences that are different from your typical zoom call and are an excuse to have fun and socialize with your team/friends during lockdowns. It brings an opportunity to create original and creative experiences.
Also if the situation continues maybe gaming will enter the enterprise world - like playing Minecraft with co-workers make sense to do team-building and is cheap compared to other options. https://gather.town/ is a good example of something different too.