Yes. There are a few companies in this space already. If you scan through https://www.ycombinator.com/companies?industry=Infrastructur... you'll see some.

There are hosting providers that are both simpler and cheaper than AWS, like Digital Ocean or Hetzner. People who chose AWS probably want the additional features. So make sure that, for some kind of users, you're better than both.