You can avoid this by preventing any traffic to or from the device except from Frigate.