How do you know when something is too loud without measuring it? If your answer is "ringing ears", you've already incurred at least some hearing damage.
Do you have the tools to measure how loud your headphones are? I don't. And so I keep them as low as I can.
Is there a limiter in amplifying headphones to keep them from going above a certain threshold (like 80Db)?