Anastassia Loukina
Anastassia Loukina
FAQ
This PR addresses #547 - Create an FAQ page with common questions based on internal channels - Add internal anchors as necessary - Update packages to use sphinx-panels Opening the...
There are a few questions that came up recently as new users were using the tool - it would be good to document them under FAQ.
We want to refactor `compute_and_save_predictions` into three separate steps: (a) Read in model parameters from file into memory. (b) Apply preprocessing, generate predictions and post-process predictions using model parameters stored...
In some situations we might need to predict scores from coefficients stored in a data frame. This will be useful when we need to generate predictions for linear models where...
When tests are run in STRICT mode, we check for any errors or warnings in the report. We currently have two functions: ``test_utils.check_report`` https://github.com/EducationalTestingService/rsmtool/blob/main/rsmtool/test_utils.py#L767 checks for both errors and warnings...
We currently allow for different sign columns in the feature_subset_file to accommodate a legacy situation where we could have inputs with divergent feature signs. This generates a lot of complexity....
We use scaled predictions in tutorial. Prediction scaling is becoming increasingly obsolete: it was used to maximize kappas that were computed on rounded values but in fact it increases MSE....
The `Comparer` class in `comparer.py` currently contains a class `_modify_eval_columns_to_ensure_version_compatibilty` to allow running RSMCompare on outputs from RSMTool < 7.0. I think it's time to deprecate this.
Even though our initial intent was not to have much code in the notebooks beyond reading in .csv and displaying tables, the code for plots etc. is becoming increasingly complex...
Currently SDM/DSM is computed in `utils.metrics` but the parameters for computation are passed through two more functions in `analyzer` leading to confusing and repetitive documentation and making it difficult to...