He is hated by both Hindu and Muslim extremists. I take that as a complement. His tolerance should be judged in context. One should not judge him on the basis of his early reign, when he was under influence of Bairam Khan. Remember he was barely teen when he ascended the throne. He abolished religious taxes on Hindus, employed them in high positions and patronised other religions like Sikhism. A lot of critics pick his early reign. By that token even Ashoka should not be venerated.