Build and deploy a Whisper chat app to Hugging Face with Livebook in 15 minutes

I am back for day 4 of Livebook's Launch Week. This time we use Livebook to build a Whisper chat app - where you can only talk via audio transcriptions - and deploy it to Hugging Face. All done with Elixir!

You can give the deployed application a try here: https://huggingface.co/spaces/josevalim/livebook - and then click on "Whisper chat" on the right. Audio messages are concurrently handled and batched within the same instance before being handled by the GPU. I guess we will soon find out if a Nvidia T4 is enough. :)

Have fun and I am glad to answer questions once more.