https://support.apple.com/en-us/HT204034
You've been able to download free apps without a credit card since forever
You've been able to download free apps without a credit card since forever
If you're using the iTunes Store or App Store for the first time
If you're using the store for the first time with an existing Apple ID, you must provide a payment method. After you create the account, you can change your payment information to None. If you're creating a new Apple ID, you might be able to create an account without entering your credit card details.
The only way is with gift card which is not sold worldwide.
Quite reasonable as a trade off and as you mentioned it is possible to circumvent the need for a traditional credit card.
Plus, if you're against that then you'd have to be 100% off the grid anyhow - any bank or utility company (inc your phone company) knows more about you than Apple.