Check out Ayn Odin 2 Mini, it's an Android handheld with a PS Vita design, you can use it to emulate lots of games too (including Vita using Vita3k emulator).
For that kind of cash, you might as well get the real Vita from a second-hand market. Better yet, for that kind of cash, get Steam Deck, unless you have some restrictions like OP (i.e. "SD is too big")