Absolutely. Independently of the unauthorized sharing of your bandwidth, ISP gateways are notoriously insecure and underspec'ed. They also have nasty backdoors[0].

[0] https://en.wikipedia.org/wiki/TR-069