Seems like it depends on the content, and whether or not I was previously aware of it. Sometimes it's a news story I already heard about, so I'd feel comfortable upvoting w/o reading.
It also seems dependent on the site. On HN I'm more likely to read articles that are posted, but not as much on Reddit.