Two meanings of the word spectrum are used in this discussion, definition quoted from wiktionary:
1. "A range; a continuous, infinite, one-dimensional set, possibly bounded by extremes." "Specifically, a range of colours representing light (electromagnetic radiation) of contiguous frequencies"
2. A plot of energy against frequency, e.g. "[t]he pattern of absorption or emission of radiation produced by a substance", or the output of a Fourier transform.
You were talking about the former, BoiledCabbage the latter.
---
I agree with you that the former makes a terrible analogy of autism; and to be honest I really don't see how the latter can be an analogy of autism.
The actual difference in frequency is the composition of that energy.
If of course you compare a dimmer beam of light with a brighter one the dimmer one will have less energy.
So no less energy is due to lower intensity light, not due to different frequency. You can pretty trivially have 5 flashlights each with a different color of light and all with the same energy.
Look up the definition of "spectrum", and contrast with "gamut".
The only way that two different otherwise identical light sources can output different amounts of energy is if they have different intensity.
Or put differently, in your example if you have different wavelengths and hold intensity constant then energy is also constant. It's your example that has implicitly introduced the concept of intensity without explicitly saying so. And the evidence of that is my example. My example is exactly your example, but holding the intensity consistent between the two different light sources. If you do that, then your example fails.
Different wavelengths of light at the same intensity output the same energy. Meaning wavelength does not change the energy output by light.
Even though photons exist, light is fundamentally not a particle. Your statement would hold if light were a particle and only a particle and did not also have wavelike properties. And generally when discussing light as human perception it's the macro scale and wavelike behavior that is being discussed.