I get where you are coming from. I also have some sort of colorblindness apparently (just found out!). I agree with you that there is no single correct way to "see" colors, and as such that does not require fixing. i.e. If the glasses are only going to change color A to be more or less vivid then what really is the "philosophical" value?

However, if the glasses allow you to start differentiating colors that you previously perceived as a single uniform color, then I think there is a much stronger reason to wear them.