The line is "can you use the purchase solely in the app distributed through Apple's infrastructure". I think their fee is outrageous, but that does seem like a defensible line.
That is, if someone wants to, they can use Patreon's iOS app, not interact with Patreon in any other way, and get all of the benefits available to patrons.