If you've got 4 kids all under 4yo, you're kind of screwed no matter what vehicle you drive. For biking, you'd probably be looking at a Bakfiets with electric assist plus a trailer.
Presuming we've sufficiently eliminated car traffic and the roads are safe for kids, it's also likely that at least one of those kids can bike themselves to the store with you.