" there is a not a single study in the history of science which has been able to demonstrate eating at a caloric deficit and gaining weight."
That's absolutely right.
"takes what is a relatively simple issue and makes it needlessly complex."
Human metabolism and psychology is complex. Basically, it's the most complex system that we know of.
You can't just throw out psychology and metabolism, and say it doesn't matter, because as long as you eat less calories than you consume you're alright.
People have know "calories in vs. calories out" for decades. People are still getting fatter. Maybe if you shout it a bit louder, it will start working? Sorry about the sarcasm, but that's how I feel about the issue.
I feel it's a bit like telling a depressed person to just "stop it". Snap out of it! Why are you thinking these bad thoughts? It's bad for you! Stop it!
https://www.youtube.com/watch?v=Ow0lr63y4Mw
You do touch on this though "(how to ensure someone sticks with the program)", but then seem to gloss over it. You start out saying it's "not complex". If it's not complicated, why is it not solved yet?
What you eat, is certainly not everything, but sugar drives behaviour very strongly. More so than other nutrients is my impression. It affects motivation which again affects how well you stick with a program. It's not everything, but it's part of the puzzle. Other things that affect compliance could be, mental health, friends, advertisement, culture, economical situation.. How is this not complicated?