Just checked the .pem I was given (by a person, not by Amazon) - looks like it was an RSA format key all along. I'm a little confused - it's possible I'm an idiot.
I'll check to make sure I'm an idiot by seeing what I can generate from Amazon itself.