I did that and an alarm went off after a while - apparently the battery was depleting to levels where it can cause damage to the battery. I only had it in neutral for like a minute too.

I just go to the car washes where the car stays still now.