Not necessarily. Turn off NAT on your router. ISP router then needs a static route sending traffic for your LAN via your router's WAN IP.