Hacker News Reader

What sort of latency can you get on edge devices? Are there cases that processing can be done with 3ms or 10ms latency?

Definitely! You can see some of our benchmarks here, and we'll be expanding this list soon https://www.tensil.ai/docs/reference/benchmarks/