The argument for has two levels:
1) The trade is a victimless crime. Given the way markets worse, the naïve party would have bought or sold the asset anyway from someone else. Think about how you buy stocks: you just call your broker and ask to buy at the market price. If you do that and end up buying from an insider, you are no worse off.
2) Insiders actually move the price in favor of the naïve party they trade with. If a stock is being sold on the market $29 and the insider knows its true value is $20, they must sell below the other offers (e.g., $28.99) to make the trade. This is in favor of the buying party relative to the outcome without the insider: the buyer will lose $.01 less per share. At large trading volumes, insiders will actually move the market strongly in the direction of the fair price, making all trades of that asset more fair.
Unfair though it may be, society at large does not benefit banning insider trading, and allowing it would make stock market prices more accurate which is actually probably a fairly strong benefit to society.