There is a bar on personal projects. Period. Period.
Either you're misunderstanding logic, law or society. If Karparthy fails he runs a real risk of having his life very closely examined. The rules are different for different people.
I do machine learning medical work for the coronavirus. I work at near optimal as humanly possible. Occasional hackernews is one of my few indulgences.