Also, real time encoding with VP8 (yes, that is the standard for WebRTC) barely works. It has barely enough CPU power to produce a working demo, but too little to actually do anything with it.
Can you expand on this? Is the hardware too slow, too power hungry, or just badly supported? At least coming from ARM there must be some hardware documentation on how they work. I mean, it can't be worse than Broadcom's all-proprietary GPUs.
Mali-G610MP4 is known to handle Genshin impact easily. (https://youtu.be/sA55S2Z7gLo?t=56) I doubt VideoCore VII can do that. As of today, there is still no detailed spec sheet for this GPU.
Llama 7B at 2.8 tok/s via Mlc-chat.
I'm setting up an LLM discord bot with it.