Yeah, that's correct. We also believe that's a good direction for improving search results quality and combining different methods of search: https://qdrant.tech/articles/hybrid-search/
If the cross-encoder is well-calibrated then you really can merge search results from different sources the way IBM Watson did back in the day and not have to calibrate the individual sources.