The time would be less, but you still need to power those cores. Single thread performance can be a good indicator of what it'll do the battery on your phone.
CPU power is proportional to frequency^2. Running on 4-6 little/efficiency cores (which are widespread on mobile) is likely faster than one big core, and uses less energy.