It effectively does, since revocation of Obama-era net neutrality rules is still being litigated in courts and all providers are still following them while they wait for a decision. Now that the Democrats control the Senate, the House's net neutrality bill which passed in 2019 and was blocked in the senate by Republicans will likely become law.
> would/should such laws not also apply to major internet infrastructure providers such as AWS
Net neutrality applies in the other direction. Comcast can absolutely ban you, the consumer, from using its service if you run afoul of their terms of service, as can AWS.