Refined sugar is extremely concentrated compared to the natural sources. You need like 50 kilos of sugar cane to produce one kilo of refined sugar, and through multiple steps of heavy industrial processes.
You could make a case for honey, but, like all other natural sources, it contains other ingredients that somehow limits ingestion or metabolization.