I believe that the difference is meaningful. Neglect is a very specific type of abuse.

Physical, emotional and sexual abuse are all very different from neglect. All forms of abuse are different in terms of the psychological effects on the abused, societal reactions to both parties, motivation on the part of the abuser and much more.