AI-EnabledSoftwareEngineering-AISE

Thank you @JustinLin610 for your response, I am a newbie in transformers, and may my questions seem very stupid. I tried to encode the image as I looked in your...

Dear @JustinLin610 I followed your insightful comments, to encode texts I used this code: ``` def text_sample(text): src_text = encode_text(f"{text}", append_bos=True, append_eos=True).unsqueeze(0) src_length = torch.LongTensor([s.ne(pad_idx).long().sum() for s in src_text]) sample...

> ResidualAttentionBlock As I go through the CLIP model code, they have two classes with this definition: ``` class Transformer(nn.Module): def __init__(self, width: int, layers: int, heads: int, attn_mask: torch.Tensor...

Dear @JustinLin610 I know you are very busy but if you give me some hints it would be very helpful!

@JustinLin610 Thank you for your response I will look at `named_children`. Let say we have a pair of text and images, I would like to visualize where is the OFA...

Thank you @JustinLin610. I followed your advice and inserted those properties into your code to draw the model's attention, however it appears that I made a mistake with the associated...