The web interface has an 'update all' button thats just as convenient. I find if theres ones i want to not update i just temp break their yaml file with an unexpected keyword and it fails to compile and then update.
To be clear, it is not hosted by the ESPHome devices themselves, it's a separate component.