trulens
trulens copied to clipboard
truera
Evaluation and Tracking for LLM Experiments
Quantities of interests receive output values on DoI samples but these are not necessarily the instance being explained, except in some cases like point. Because of this, one cannot define...
Hello! Would appreciate any help to solve this problem! I'm trying to use the IntegratedGradients() to explain my model. ``` yolo = Load_Yolo_model() # yolo is object model_wrapped = get_model_wrapper(yolo)...
The notebooks directory contains notebooks named [intro_demo_pytorch.ipynb](https://github.com/truera/trulens/blob/master/notebooks/intro_demo_pytorch.ipynb) and [intro_demo_tf2_keras.ipynb](https://github.com/truera/trulens/blob/master/notebooks/intro_demo_tf2_keras.ipynb) , these notebooks show how trulens can be used for visualizing and explaining an image classification model. I request similar notebooks...
It seems that the output of torchvision models is an OrderedDict and not a torch.Tensor, which by default has a single key, `'out'`. Currently a custom QoI is required to...
Many visualizers, including the `Tiler` class should be able to be used without necessarily using other TruLens features. However, typically, the backend will be set when the user calls `get_model_wrapper`,...
Hi team, I'm delighted to explore this library for finding notorious issues in our trained models. I'm trying to apply TruLens to various tasks (CV - segmentation, localisation; NLP -...
Hi team, I'm trying to explain the output of localization models (fasterrcnn_resnet50_fpn, and others in Torchvision). There are no issues when I wrap the pytorch model in _get_model_wrapper()_ but passing...
- Reformatted a lot of comment text. - Added some new comments for todos or unknown points. - Added __str__ to various trulens types. - Cleared notebook outputs. - Added...
