To evaluate if a feature is valuable, you could attach the value of the feature to past inferences and retrain a new model to check for improvement in performance.

But this “attach”-ing needs the feature value to be as of the time of the past inference.