Portable LLM Across GPUs/CPUs/OSes: WASM for Cloud-Native and Edge AI [video]

Live demos start from 10:40, • Setting up LlamaEdge API server. • Packaging it as a Wasm container image. • Running the image using Docker. • Deploying in a Kubernetes cluster.