They cannot go ad infinitum. The longest is 28 hours and Paul ended his around 13 hours. This is because if Paul himself leaves, the filibuster he started ends. He can let others speak but he must stay the entire time.

He didn't use the bathroom for 13 hours, and as some pointed out: a long filibuster is less a contest between a speaker and a Congress and more about a man versus his bladder.