Azantys

Is LPDDR5X not too slow for inference, atleast compared against HBM?

I trust a proper solution (even though I can be certain how accurate it is), which compares to a known dataset much more than just giving it an AI. For identifying current living species it is probably fine but this is something to nice for an AI to be trustable. Also this path is much more fun and you learn sonething along the way!

The Matrix is imminent

+1 for an android app

Yeah I own an AMD Instinct MI50 and i need to patch all of my applications to work, like PyTorch, bitsandbytes, blender etc, while Nvidia cards from the same generation are still mostly supported. But the better value and hardware are worth it

It is for orchastrating inference/creating firecracker instances for agents etc. It does'nt have anything to do with actual AI usage.

Thats because Radeon VIIs were just AMD Instinct MI50 server gpus which didn't make the cut or were left over.