BasicCoder

In group convolution, each group shares the weight, similar in deconvolution/conv2d_transpose, Although tensorflow dose not support group deconvolution/conv2d_transpose, we can recover the full weight of tensorflow deconvolution/conv2d_transpose by copying the...

I have an immature solution in caffe to tensorflow: in `mmdnn/conversion/caffe/shape.py` add code: ``` def shape_slice(node): print(node.parameters) axis = node.parameters.axis slices = len(node.parameters.slice_point) if len(node.parameters.slice_point) > 2 else 2 input_shape...

> hi, we have support vllm in this pr([vllm-project/vllm#4650](https://github.com/vllm-project/vllm/pull/4650)) Thank you for your great work. According to your document description: the actual deployment on an 8*H800 machine has an input...

possible solutions [#149 ](https://github.com/triton-inference-server/tensorrtllm_backend/issues/149)

possible solutions [#149](https://github.com/triton-inference-server/tensorrtllm_backend/issues/149)

I think this is a duplicate solution of #716 which is more elegant and efficient.

> > Another thing you can try is adding this to your /xverse/tensorrt_llm/config.pbtxt file. After disabling trt overlap, I don't see the > > Currently, we have conducted tests and...