You said
My initial goal is to figure out what kind of group I'm dealing with. Three friends about to graduate from college? Two colleagues who work together at a big company and want to jump ship? Are they all programmers? A mix of programmers and business people? There are maybe 20 or 30 different configurations of founders, most of which I've probably seen by this point.
Is there a subset of these group types that work(s) better than others in your experience? If so, founders might be able to choose cofounders that increase their chance of succeeding.
Also, having worked as a member of a couple of types of groups (startup with room mate / recruiting talented programmers with a similar outlook and goals), I have found that there seem to be problems common to each type.
Since you have a much larger dataset, you might be able to outline the common pitfalls each type of group runs into. Could you do that, at least for the common types of groups?
The reason I want to know the type of group is that it helps me to interpret the answers to the other questions. E.g. if the founders are undergrads, I shouldn't have as high standards for what they've achieved; if they're colleagues who worked together, I'm curious about whether the idea grew out of some need they had at work; etc.
If you want to know who to pick as cofounders, pick people who are smart and energetic and that you can work well with. Also try to pick people you've known for a while. You need more holding you together than the startup, because there will probably be some point when you dip below the x axis and the startup seems worthless.
I have also found that wanting similar (or at least compatible) things from the startup is also essential.
I tried to start my first real startup (one where we started writing code) with a friend from gradschool. We had known each other for a while, but it didn't work because we had different goals and approaches at the time. He wanted to build a world changing product and focus on that from the get go. I would have loved to do that but wanted to start with building something small that was useful and build up on that. Thankfully we realized this fast and parted amicably.
I was incredibly lucky the second time. I found and recruited someone who is attending the same school I did, but who I didn't know, mainly because he is a great programmer and a frank person. In our first meeting he was direct about everything ranging from his motivation to his weaknesses as a coworker and he expected the same of me. We have now become good friends but in the interim this transparency served as an effective substitute.
In the past year there have been multiple occasions where one of us has felt like the startup is below the X axis. When that happens, having an enthusiastic, frank and committed colleague who believes in the startup and can boost your optimism is a big boon.
Here's how the question is used in practice. We vote on applications without necessarily checking it. Then at the end when we have a ranked list, we go back and check to see whether any of the top ranked ones have any signs of breakage. (That's when we check the answer to this question.) If they do we dig deeper, maybe asking the founders questions. What we decide depends on that digging.
So it's not as if we have some kind of rule that if a startup answers this question yes, 30% gets subtracted from their score, or anything like that. This question acts more as a warning light.
Well, yes. I more or less understood all of that based on comments you've made in the past and what happened last time I submitted a "I can't move to the bay area" application -- my point was that it might be a useful thing to explain in your essay.
Sounds like a good risk/reward profile for my effort to me.
We're doing a little 1-2 minute video explaining our stuff at the moment and staying rather lo-fi and plan at least 10 hours of work on it.
Trying too hard to pitch in the video is actually a mistake, because it makes the video stilted.
In the end I shot my video with a cell phone camera. Took two takes and about 5 minutes. Finding the right location for it took a little longer, but fortunately the place just popped up one day while walking around town.