It really depends on how complex your solution is and how AWS savvy your team are.

I'd argue that if your team is writing business logic code, it's not going to be a huge time investment to get them up to speed with the various AWS API's so they can operate the infra.