> The root challenge of all modern frequentist statistics is "does the selection criteria for the sample actually allow me to generalize the results".

Why did you single out frequentists here? This is a challenge for all inference, prediction, classification, and any other "forecasting".