The only way I could imagine this working is to lower the gyrotron itself down the borehole, but there's presumably tradeoffs of physical dimensions and output power that make it challenging. Again maybe not impossible, but there's no indication they've made fundamental advances in miniaturizing the source, or producing lossless waveguide.
Related, another interesting company I came across is Petra [2], who is doing something similar -- plasma/heat based non-contact drilling. But because they fracture the rock instead of vaporizing it, there's essentially gravel/sand leftover which is hard to evacuate from a deep vertical shaft, hence their focus on power/fiber trenches not geothermal.
[1] https://www.nrao.edu/meetings/isstt/papers/2012/2012151153.p...