Phone numbers are not required for credit card processing. Address, yes. Phone, no.
Address is also not a requirement.
But it can be if you require. Billing address verification can be important for higher value transactions. Some sites won't ship to an address other than the billing address.
Ah yeah I think you are correct, AVS is sometimes required. Sorry for the confusion.