I remember reading that the difference between the fastest and slowest metabolisms worked out to somewhere around 1-200 calories per day. Not a huge difference.
The Mayo Clinic’s own comment on this seems to agree. https://www.mayoclinic.org/healthy-lifestyle/weight-loss/in-...