Technically the virus should be able to reach all the cells, irrespective of whether they’re latent or not I would think but I’m just a lay person.
"The major reservoirs for HIV in the CNS are in the microglia, perivascular macrophages, and to a lesser extent, astrocytes" https://pubmed.ncbi.nlm.nih.gov/27873219/