After I learned signal processing at university I always thought that the Heaviside step function was named like that because the step is "heavy" or something in the signal.