I've thought about putting a manual brake light switch in my manual transmission car because of this, but I'm also that guy that engine brakes more than actual brakes. 6 years of owning this car and I've never worn out a brake pad.
https://en.wikipedia.org/wiki/Engine_braking#Limitations
Just do a decent job matching revs on the downshifts so you don't trade brake dust for clutch dust :)