Infinite scrolling is typically annoying, often making you do busy work to find content you want, and frankly a worse solution than just having multiple pages. So if it's also harder, why do it?
Especially when it's a list like favorites where you would what to browse to any point equally as often (im looking at you SoundCloud).
I'm hoping that infinite scroll looses the hipster appeal sooner or later and we can implement the best solution rather than jumping on the bandwagon all the time (SoundCloud's favorites were paginated a few years ago).
All infinite scrolls should come with a filter that lets you hide all of the stuff you are not looking for.