I also really like both of the films but I don't see how either is more or less faithful to the book.
My other issue is that Depp is insufferable, irritating and took the "child-like" description to an extreme. I dislike the Burton version more than I dislike the Hitchhikers film... which is to say, a lot. Both took a well trodden and loved story and changed it in a way that seems to add nothing to the narrative. The Hitchhikers film[1] fell back on the "but Douglas Adams never told the story the same twice in any medium" as an excuse. I don't believe Burton had that one to fall back on. Especially as Dahl felt Willy Wonka and the Chocolate Factory didn't capture his vision for the movie[2].
[1] http://www.therobotsvoice.com/2011/05/the_15_worst_things_ab... [2] https://uk.movies.yahoo.com/why-roald-dahl-hated-willy-wonka...