Indeed. I also tracked everything I ate for a long time, many years ago. As soon as you eat something made by someone else you're basically guessing.
Like if you just tracked the things you can track, and noted the number of occurrences you didn't, then your end of the month weight will tell you whether you're overshooting or not, and you can estimate what proportion the "unknowns" might represent (and whether you should put a conscious effort into reducing them.
I know I’m not going to be able to eat my main, a couple slices of pizza, one or two entrees and a dessert with only 800 calories left in my budget.
Sure, I might be somewhat off in my estimate, but in practice, I might forgo the entrees and dessert (or share a bite from someone else), set some of my main aside to take home, and have a slice of pizza.