How sure of that are you? Mark Haub, Nutrition Professor, famously ate a diet made entirely of "convenience store food" like Twinkies and chips for 10wks at a caloric deficit.
Despite a diet based on pure junk food, all of his health metrics improved and he lost 27lbs[0].
As someone who has lost well over 100lbs and who struggles constantly to deal with their weight, I can say from my experience that how many calories you eat is practically the only thing that matters. I have tried all the fad diets over the years and not a one of them has managed to lose me any weight and perform any better without strict calorie counting.
[0] http://www.cnn.com/2010/HEALTH/11/08/twinkie.diet.professor/...