I changed the behavior now: tap and hold magnifies it and short tap select the card. At least with my fingers now I was able to avoid the mentioned side effects