If you fell for this, changing your password is not the right solution - you want to log into your google account and remove permissions from the application.
https://myaccount.google.com/permissions?pli=1 should show a list of apps connected to your account.
Also, if you fell for this, you sent a bunch of emails to people like the one you received, so maybe tell them not to click.