Neat way to reduce cost and pin-count? But I think the typical FPGA clock tree has poor jitter performance. Not using the internal PLL(s) might help with spurs but the clock buffers are unavoidable.
The documentation mentions it's likely further degraded by noise from switching regulators. Oh the joys of hunting RF noise sources.