Yes, someone can steal your cash - but they can also steal your item.
Setting aside theft - cash is simply the most secure way to ensure you keep your money post-transaction. There is no fraud mechanism to abuse, and no way to reclaim cash once in-hand.
For anything of value, the "old school" rules of meeting in a very public place and only accepting cash are still really sound.