Which is a strange concern because the solution is obvious: if the project is popular, it should be easy to find someone else to pass on the leadership position to and move on to other things.
The only guilt should come from just straight up abandoning the project. Unfortunately the open-source world is chock full of those.