The second stage will need a re-entry heat shield, but otherwise can land like the first. Tricky part is getting enough margin in the second stage for the landing fuel and legs and heat shield. Usually the top stage is the one you optimize most heavily. So plausible, but tricky.

Good news is that the second stage is much cheaper than the first, at least on the F9. Eight fewer engines, for one.