Perhaps this Twitter thread (sorry) may help alleviate some of the fears? The author is a full professor working on computational biology at University College London and had prior to that had a stint working on infectious disease epidemiology at Imperial College London.
https://twitter.com/BallouxFrancois/status/14765074434966364...
"Those results provide no evidence for SARS-CoV-2 being a neurotropic virus, it doesn't inform us on long-covid. SARS-CoV-2 is not expected to be commonly found in the brain of patients except in a subset of extremely severe, often lethal, infections. 3/"