The 3DS is an excellent choice due to it’s hackability and pretty decent processor(s). However, OP also asked for a replaceable battery. I’m assuming that means something like AA like the OG Gameboy had. Does anything come that way anymore?
I'm pretty sure you can replace the battery on (most? all?) 3DS models. At least on my New 3DS it's user serviceable.