Good points. The contrary is way more difficult i think... (me being a biz founder, finding tech partners or employees can be really tricky).

For the non-tech guys, in an early stage startup, i would definitely look at :

- product skills => can the guy understand what customers/users need ? and if he doesn't, will he ask them?

- tech skills => you guys need to speak the same language. even if he's a beginner, has he tried coding in RoR, php, python, ...? will you speak the same language?

- network => does he know investors and bloggers? or at least know people who know them?

- traction and community => can the guy move heaven and earth to get people on board?

- recklessness => is he okay with the risk, the absence of salary, the non-benefits, ...?