Oleh Kuznetsov

icon indicating a website link https://github.com/sadaisystems

icon company MSD icon location Prague icon location Student at CTU in Prague, knowledge engineering. Currently working in MSD Czech Republic as LLM engineer (Emergent Talent Rotational Program)

Results 12 comments of Oleh Kuznetsov

Add batched inference

+1

Could not load the custom kernel for multi-scale deformable attention.

Had the same issue there. Seems like the issue is with newer `torch==2.6` and `torchvision==0.21.0` that comes with it. I downgraded them to `torch==2.5.1 torchvision==0.20.1`. No issues so far. Exact...