What is the largest library of watched media that this has been tested at? I can see this choking on media fanatics watch histories.
What is the largest library of watched media that this has been tested at? I can see this choking on media fanatics watch histories.
As for the largest library, I only really know of my own which is around 250 series and 250 movies. Not small but not huge. Passing all of that info is fine enough, but I'm also curious how truly massive libraries or watch histories are handled.
I imagine you would hit the LLM token input limit first if you had thousands of series and movies. Definitely need some further testing in those cases.
At some point though like you say, it's going to become ineffective and you'd probably want to use the "Sampling" mode that is available to only send a random subset of your library to model as a general representation. Though how well this works on massive library remains to be seen.