Hardly, if done correctly, you're probably improving the CTR by reducing the number of ad impressions that would never result in a click.