I've done this repeatedly. I like to put mildly insulting things in all the form fields before I lock out the account entirely.
Bad idea. This could get called identity theft. Also you would really be on the hook for the bill!
The account was created under fraudulent pretenses. Amazon didn't perform any due diligence to confirm the email and already considers you the owner. Just take it over and shut it down.
I had to resort to this for an Ebay account that someone opened with my email address. I finally got sick of them not fixing it so I used the email-based password reset feature to login, change the password, then closed the account.
Someone would have to figure out who to call an identity thief, who purchased the goods, who to send the bill collectors after, who to serve for a lawsuit, etc.
All the company has is an email address and a bunch of other incorrect information.
And an IP address. And the previous contact with their support asking for the error to be resolved.