I was also under that impression as well, but from that same page you posted:
https://www.gnu.org/licenses/gpl-faq.en.html#WhatDoesWritten...
Which sounds like if you didn't provide the source with the program up front then you're required to give it to anyone that asks since they may have received the program indirectly.