David Foster Wallace had a similar reaction to McCain when he covered him in the 2000 election [1].
[1] https://www.rollingstone.com/politics/politics-features/davi...
[1] https://www.rollingstone.com/politics/politics-features/davi...
[0]: http://www.au.af.mil/au/awc/awcgate/readings/code_of_conduct...
Of course there are way more variable involved, but I think his refusal was mostly on the basis of maintaining solidarity with the other POWs. In that situation, I could imagine that one of the few things that would keep me going was knowing that the thing i was fighting for back home wasn't just a delusion.
If the other POWs saw Mccain released for on political reasons, then who is to say that the POWs loyalty to their nation wouldn't have been compromised?