I eventually just stopped talking and just put on some music and let people watch me code if they wanted, plus some responses in the comments. But then I just felt this was half=assing the whole thing and why bother.
Another problem I had was maintaining a schedule. I have a young family so if I put out a schedule for certain times, I may not actually get around to getting on at those times and any viewers who had gotten used to watching me then were lost.
I know some people like Roxkstar74 has been doing since during COVID lockdown or slightly before on Twitch and has made a decent name for himself and built up a small devoted following.
I think the keys are know why you're doing it and don't let it get in the way of you building your project.