"In a 2023 blog post, external, Palantir described the challenge of combining data from multiple government systems containing tens of thousands of visa applications and hundreds of thousands of accommodation offers."

This is the kind of thing GDS and other Civil Service departments build all the time, its a completely standard kind of challenge that a small team of Devs (+ supporting staff) from a departments DDAT department does day in and day out.

The output will be open source by default and use existing standards.