Thanks for your input! I agree with all your points. Right now, we're just doing things that don't scale and hoping it works out. A year after the first two batches graduate, hopefully we have enough data points to workout tangible benefits.
Also you might want to look to understand what went wrong at Triplebyte which wanted to provide a one interview-only experience for experienced candidates but it never worked. Companies still did their interviews. The company also had to pivot their business model from this and explained in detail why they did it [1]
Triplebyte was targeting a very valuable and hard-to-hire group of experienced engineers. You are targeting the easiest to hire group. Consider what will make you succeed as a business where Triplebyte could not, even though they solved for a much bigger pain point for hiring managers.