I've been treating sugar as personal health enemy #1 for quite a few years now.
Note: I am deeply addicted to sugar. It has been absurdly and embarrassingly hard for me to abstain from high sugar foods.
I can eat a healthy, high-protein meal, and be full. Yet 30 minutes later, I will feel hungry again. But checking in with my stomach: still full.
I can eat a few grams of sugar and feel instantly full.
I'm at work and can't take time to cite properly, but I have read some relatively new science about how they have identified some physical structures in the brains of people who are unusually drawn to sugar consumption.
Like you, I have lost quite a bit of weight, and I do eat very little sugar these days.
But it's seriously a daily struggle, and it feels so damn irrational at times.