It's meant for embedding, tinkering, and learning.
To that end, 4GB of RAM on an AI Accelerator board is fine - the expected workloads will not consume a lot of RAM. This also makes the lack of NVMe sufficient as well.
For more "horsepower" there is also the BeagleBone AI-64[1], which claims up to 8 TOPS.