When I started doing intermittent fasting I also started eating lots of walnuts, and I can say my craving for sugar went way, way down. I haven't had sugar once since I started IF (> 30 days).
Does that mean you haven't included sugar in your foods yourself, or you've managed to avoid eating any prepared food since you started?
Practically all prepared foods contain sugar, though they might not call it that in the ingredients list. When next you go boy chicken or turkey, read the list of ingredients. I'm talking about the raw forms, not the already cooked ones. It's shocking.
For me, the big change was desserts. I was a fiend for those. I've tried a lot of things to ween myself from eating and binging on sugary treats. I wasn't expecting IF to be the thing that worked. That was totally unexpected.