Tried this for few minutes, and it makes my phone run hot. Whats the CPU/GPu intensive work this app is doing on the device? I thought all the queries are sent to the server and no on device processing.
It's using whisper to do speech to text, which is a non-trivial amount of on device processing. At least that's why I think it's heating up my phone, because that was the first thing I wanted to try.
I haven’t tried speech to text earlier. To me with or without speech to text, my device heats up
Yeah I think these new models are going to burn through your battery like dried leaves, even if you have the very latest phones. I ran a reduced Vicuna on my 14 Pro and it heated up very quickly.
Same, I tried Whisper and received a call right after and it was unusually hot.