The problem with writing, and something I am noticing lately, is that AI robs your ability to create prose in your style. Even if you use AI just a little bit to touch up your writing - you start being influenced - And over time it adds up - you start writing like AI just a little bit every now and then. It seems to be robbing me of my ability to create original prose.
Strategic thought is the other thing - like if I am deciding what we, as a company should focus on long term, it is easy for LLM's to give you a wrong direction. I think this is more because Strategic directions require a ton of context - and it is almost impossible for you to feed the ai EVERYTHING. There might be some things which are easy to miss out, which might make all the difference, and the LLM would assume that the 'requirements' are complete and would go to town with it. I suspect, this is largely because the current SOTA LLM's are being optimised for code and there isnt enough data in the training set for them to learn long term thought.
Coding is I think fine for me. But even there, I dont let the agent use memory at all. I create the context - and it runs from that only. The biggest unlock here is that I can now program in any language. And it frees up sometime to think in systems and come up with more robust architectures.