Youness el brag

does torchscale functionalities can impove modeling generality and capability in case of Session-Based Recommendation system

1

i am currently working Session-Based Recommendation system problem, indeed this topic in NLP so quite under progress of improvement, and most of technics used to tackle that problem are Matrix...

**Feature relates to MoE End-to-End inference** i would to know if MoE used in DeepSpeed can implement in the Segmentation task **Describe the solution** i was working on the MoE...

[Q] : can The Global filter Network use for Segmentation images

3

I read the paper, it was providing straight ideas about how does GFNT tackled the limitation of using Self-Attention with a Vision-Transformer in computations cost and complexity also, i would...

[Q] : why Softmax function take computed only on abs values and ignore imaginary part

1

i tried to re-implemented on both of them following this code :+1: ```python import torch from torch.nn import functional as F def complex_softmax(input, dim=None): """Applies the complex softmax function to...

Mixture of Expert in Vison Task (Segmentation )

2

Thank you for providing an end-to-end Framework to train the MoE system, I would to ask if I can able to use this in Vision Task m in the Case...

i am currently working on the Segmentation of Coronaries arteries, but i have only the Truth Medical images of Diseases which the annotated label still not I have them yet,...

Quantize Per-Trained model Using QLoRa or LoRa , PFET Technique

1

I would like to ask how can I use QLoRa or Parameter-Efficient Fine-Tuning thin a model does not register at Hugging face instead is Based on [OFA](https://github.com/OFA-Sys/OFA) i am trying...