Hacker News Reader

svij137on Show HN: First autonomous ML and AI engineering Agent

Don't worry. Thousands of users are running NEO and taking advantage of it. It's well tested and mostly error free. Would love your feedback.

svij137on 90% savings using optimised Whisper API and distributed computing

As a developer, I achieved 90% cost-effective transcription and translation by Optimizing OpenAI Whisper and using an innovative approach to get GPUs.

TL;DR :

1.CTranslate2 is used to optimize the OpenAI Whisper model for efficient inference with Transformer models.

2. It can be easily installed on a Q Blocks GPU instance with a simple command.

3. The optimized Whisper model can be run on a Q Blocks decentralized 3090 GPU instance.

   A comparison showed that using the optimized model on Q Blocks resulted in a 12x cost reduction compared to the default model on AWS.

svij137on Interesting Colab Notebooks

Enjoy

svij137on The new business of AI and how it’s different from traditional software

Great experience. Would like to understand more from your experience as we build our own venture in the super computing space for data scientists and AI workloads.