Yes, extremely concerning. Recently new advancements in AI have shown it is possible to read your mind. Reconstruct images of your mind from what you have seen.
We are headed into a deep tech dystopia. Even more disturbing are the number of people with eyes filled of Utopian dreams of what the AI future is going to bring. Some are eager to become the new Borg or Cybermen.
Society is in a state of anxiety largely driven by technology's effect on socialization. The irony is that many will immerse themselves deeper into tech to try to escape the anxiety. A society death spiral.
I've written a lot more on the topic as well - https://dakara.substack.com/p/ai-and-the-end-to-all-things