"First off you did nothing wrong at all!" <-- That's a dangerous statement. He [guessing gender] did something wrong by agreeing to be in the employ of the first company and then agreeing to be in the employ of the second company without first notifying the first company.
There is nothing wrong with fishing for offers, but its wrong to accept two offers without rescinding one. Accepting two offers is like marrying two people in a country/state that bans polygyny or polyandry.