Transformer-MM-Explainability

Transformer-MM-Explainability copied to clipboard

Using the methods for a custom architecture

3

Hello! Thank you for the excellent work and examples, also really appreciate the time you've taken to respond to queries. In this spirit, I attempted to implement the mechanism to...

nelaturuharsha

Details about the changes in the code of base models

1

I am trying to study the code in this repository. However, it is difficult to figure out the changes that have been made in sub folders of the Base Models...

NikhilM98

``` self.frcnn_cfg = Config.from_pretrained("unc-nlp/frcnn-vg-finetuned") ``` An ssl error occurred while the model was loading。 Would like to ask how to solve, looking forward to your answer，thanks!

fzb408

How to apply this work on google/vit model from hugging face ?

1

Thanks for the great work, When I tried to follow the vit notebook I got a lot of attribute errors and I think the model architecture and layers names may...

MohieEldinMuhammad

Readability of CLIP notebook

4

- deleted modification of clip.clip.MODELS as it is no longer needed (all models are now there by default, see last commit) - there was a repetition of 17 lines of...

josh-freeman

Hi HIla, Could you point where is the save_visual_results function definition? I use ViLT for multimodal transformer but cannot use num_tokens = image_attn_blocks[0].attn_probs.shape[-1] to set the number of tokens. For...

guanhdrmq

In this [notebook](https://github.com/hila-chefer/Transformer-MM-Explainability/blob/main/Transformer_MM_explainability_ViT.ipynb) for creating the explanations for ViT there was a memory leak in the function ```generate_relevance```. This PR fixes that.

lenbrocki

I encountered an issue while running the Colab notebook with the clip RN50 model. Specifically, I received an AttributeError stating that the 'ModifiedResNet' object does not have an attribute named...

jiheddachraoui

Hi, I am running experiments using [OpenCLIP model from mlfoundations.](https://github.com/mlfoundations/open_clip) . It turns out that openCLIP's architecture is different from CLIP's architecture you defined. I encountered the same error [as...

tahirmiri

# Patching CVE-2007-4559 Hi, we are security researchers from the Advanced Research Center at [Trellix](https://www.trellix.com). We have began a campaign to patch a widespread bug named CVE-2007-4559. CVE-2007-4559 is a...

TrellixVulnTeam