The real human-rights issue, in my view, is optionality. If interacting with government or the financial system requires a specific proprietary device tied to a specific ecosystem, that's a problem
The scary part isn't "LLMs doing sums." It's that the same deterministic model, same weights, same prompt, same OS, produces different floating-point tensors on different devices
The selfie re-verification escape hatch helps, but it also quietly normalizes "prove you're an adult to get full functionality," which is a pretty big shift from how most software has worked historically
AI can help with synthesis once those insights exist, but it doesn't naturally occupy that liminal space between groups, or sense the cultural and organizational gaps
A good tech writer knows why something matters in context: who is using this under time pressure, what they're afraid of breaking, what happens if they get it wrong
In my experience, great tech writers quietly function as a kind of usability radar. They're often the first people to notice that a workflow is confusing
The hard part is the slow, human work of noticing confusion, earning trust, asking the right follow-up questions, and realizing that what users say they need and what they actually struggle with are often different things
The failure mode isn't just hallucinations, it's the absence of judgment: what not to document, what to warn about, what's still unstable, what users will actually misunderstand
Text feels boring only until you notice how much work it quietly does better than everything else... And pragmatically: text respects time and bandwidth