triage
triage copied to clipboard
dssg
General Purpose Risk Modeling and Prediction Toolkit for Policy and Social Good Problems
Once [this s3fs fix](https://github.com/dask/s3fs/commit/05fc3d9c64a5f9ff701f9d9541f707aff5750349) is released, we can update Triage's s3fs requirement, remove the `S3Store` open/write shim, and test Triage against it – as indicated by #687. That PR's unit...
… from psycopg2 to psycopg2-binary version. sqlalchemy-postgres-copy currently requires psycopg2. However, triage requires psycopg2-binary, (and pip doesn't know that these provide the same package). As such, a build of triage...
This **PR** is about putting out there the new proposed API. It is still work in progress. Missing parts: - Jaccard plot methods - Feature importance plot methods - Crosstab...
https://github.com/dssg/triage/blob/f66d1262c977a84602811c2ec8148218fa6bd9d9/src/triage/component/postmodeling/plots.py#L221 It should be something like ``` python def plot_reliability_curve(model, *kwargs): ```
We often want to change the grid config for the same "experiment" but triage assigns it a new experiment hash. This is counter-intuitive. The grid gets encoded in the model...
It's very hard to communicate using hashes. This issue proposes to assign a user friendly identifier (can be a int just like model_id and model_group_id) to the experiment, subset and...
What we want -------------------- If you have several `as_of_dates` in your test matrices, you should get one evaluation per `as_of_date`. Rationale ---------------- You are training a model every year, but...
using the following config file: ```yaml output: schema: 'test_results' table: 'eis_crosstabs_test' thresholds: rank_abs: [50] rank_pct: [5] #(optional): a list of entity_ids to subset on the crosstabs analysis entity_id_list: [] models_list_query:...
Crosstabs should generate automatically the features query from the feature importances table (if you don't specify it from the configuration file) Rationale: ------------- crosstabs on all the features takes a...