Yardstick metrics in `fit_resample` always OOS?

Good day,

I'd like to ask whether fit_resample returns out-of-sample results for all the possible metrics. In particular, I'm using yardstick::rsq to evaluate a GLM and get rather good results. Unfortunately, I didn't find a way to also extract training metrics to check myself.

Thank you very much in advance,

Unless you use the apparent() function as your resampling object, the results are all out of sample.

You could do it with an extract argument to the control function. You would make a function that predicts the training set and computes the metrics.

1 Like

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.

If you have a query related to it or one of the replies, start a new topic and refer back with a link.