rsmtool
rsmtool copied to clipboard
EducationalTestingService
A Python package to facilitate research on building and evaluating automated scoring models.
`...../nose/tools/nontrivial.py:62: ResourceWarning: unclosed file pass ResourceWarning: Enable tracemalloc to get the object allocation traceback`
There are some documentation-specific packages that shouldn't really be conda requirements for installing the RSMTool conda package as a user. We should figure out a way to remove these dependencies...
Currently in `correlation_helper` we let `pearsonr` return np.nan if the input has zero variance which leads to RunTime warnings. We should check for these and return np.nan ourselves with a...
In the future, when we can pass in other SKLL model fixed parameters to RSMTool (#136), we should make sure that any SKLL-model based tests have appropriate hyperparameters so that...
In a situation where predicted scores are on a completely different scale from the observed scores, kappa computation fails because the range of possible scores is too large. We saw...
[by @aoifecahill ] It would be nice if it was possible to automatically generate predictions for data that has non-numeric human scores. Obviously these predictions can't be used in most...
Requested by @aoifecahill .
Currently the correlations for All data are computed multiple times: first for all data in run_training_analyses and then during the analysis for each subgroup under compute_correlations_by_group. For various reasons it...
We should check whether the reports are consistent in showing whether the features have been standardized. Sometimes this is done using "If applicable".
Aoife: In a few cases features of interest didn't make it into the final NNLS model. Unfortunately that also meant that they were excluded from all analyses including feature descriptions....
Metadata
Owner
Metadata
A Python package to facilitate research on building and evaluating automated scoring models.