Yes, you can set up SSH keys to connect to your jumpbox from Bitbucket Pipelines: https://confluence.atlassian.com/bitbucket/use-ssh-keys-in-b...
At the moment, direct access to your Amazon resources requires an access key configured via secure variables in Pipelines. We'd consider adding support for IAM roles/key rotation if a lot of people would find it useful.