"Is the CLOUD Act only applicable to U.S. cloud service providers?"

"No. The CLOUD Act applies to all electronic communication service or remote computing service providers that operate or have a legal presence in the U.S. For example, the CLOUD Act is also applicable to a cloud service provider that is headquartered in the EU and has operations in the United State"

https://aws.amazon.com/compliance/cloud-act/