You solve the inverse problem once. That’s takes a while.
Then you build it. More time.
Then you run it for thousands of different inputs. There’s the benefit.
For example:
You build a kernel describing the acoustics of a sound (ie a body of water) once.
Then you can solve instantly what and where sounds (acoustics) are coming from