4 TOPS is last-gen smartphone territory - you aren't going to have a good time running big generative models, but it's a useful amount of performance for typical edge workloads like machine vision and robotics.
Efficientdet gives almost acceptable performance for security cams on an i5 if you only decode keyframes, I wonder how many NVR channels it could handle?
google coral tpu is 4Tops btw
These are INT8 TOPS are they not? That being the case, the Orin NX series are 50 TOPS I believe, the Orix AGX being 100 TOPS.