MIL-SPEC just means it conforms to a spec. Whether that means "rugged" or just "standardized" really depends on why and when the spec was written.
I've managed production of a number of "MIL-SPEC" parts over the years. Usually it just meant documentation and traceability.