Until you discover in X months that moving from the beta to release versions that get security updates requires wiping your phone.
If you flashed the beta manually or want to downgrade, then yes, you need to wipe and flash.
This is my third beta (8 and 8.1) and I never wiped.