sam-hq
sam-hq copied to clipboard
Will a fast version be released like segment-anything-fast?
Hello, i'm the contributor of project ISAT. Your project sam-hq give me more help, it's a great work.
The pytorch-labs has recently released a new project segment-anything-fast, this version is faster than SAM. Will you release a faster version of sam-hq?
please check the Light HQ-SAM here: https://github.com/SysCV/sam-hq?tab=readme-ov-file#light-hq-sam-vs-mobilesam-on-coco
That's not my means.I know sam-hq-tiny. This is a light model.
I am currently learning some new features of PyTorch 2.0. This project segment-anything-fast is released by pytorch-labs to show these features of pytorch2.0. This project use some techniques that reduce forward time cost and memory without changing the model structure and without retraining.
under lines are copy from pytorch-labs:
As announced during the PyTorch Developer Conference 2023, the PyTorch team rewrote Meta’s Segment Anything (“SAM”) Model resulting in 8x faster code than the original implementation, with no loss of accuracy, all using native PyTorch optimizations. We leverage a breadth of new PyTorch features:
- [Torch.compile(https://pytorch.org/tutorials/intermediate/torch_compile_tutorial.html): A compiler for PyTorch models
- GPU quantization: Accelerate models with reduced precision operations
- Scaled Dot Product Attention (SDPA): Memory efficient attention implementations
- Semi-Structured (2:4) Sparsity: A GPU optimized sparse memory format
- Nested Tensor: Batch together non-uniformly sized data into a single Tensor, such as images of different sizes.
- Custom operators with Triton: Write GPU operations using Triton Python DSL and easily integrate it into PyTorch’s various components with custom operator registration.
Maybe this project is more focused on engineering projects rather than academic research, so I'm not sure if you're interested in this.
any update on this?