Operative Assessment of Predicted Generalization Errors on Non-Stationary Distributions in Data-Intensive Applications