Where can I rent a cheap small startup place in the US?

If you can’t google this on your own you have zero chance of a successful Startup, IMHO.

Why not rely on crowd intelligence?

I can't google every state. Many of the "incubators" are just real estate businesses, they don't offer cheap or subsidized rent. Ycombinator is not an option.

Would you consider operating out of an apartment?

Yes, but it must be a little bit office like.

I know NYC but this seems to be too pricey.

Try the SouthEast