akhoroshev comments

Results 5 comments of


akhoroshev

Can not load module in Setup.hs

Same issue ``` OS: Debian 9.8 stretch HIE source build for 8.6.3 (lts-13.8) ```

Can not load module in Setup.hs

My log ``` 2019-03-01 11:20:49.526002938 [ThreadId 4] - run entered for hie-wrapper(hie-wrapper) Version 0.6.0.0, Git revision ba44c5841d687896c5f8101742ae2051fe1c6fbb (2434 commits) x86_64 ghc-8.6.3 2019-03-01 11:20:49.536708287 [ThreadId 4] - Current directory:/home/akhoroshev/Documents/fl_ifmo_2019_spr 2019-03-01 11:20:49.552053516...

[optimizer.cpp::computeCosts::1981] Error Code 10: Internal Error (Could not find any implementation for node {ForeignNode[Reshape_419 + Transpose_420...Gather_2423]}

I met the same error with trt **8.2.3.0** ``` [01/28/2022-07:54:29] [TRT] [E] 10: [optimizer.cpp::computeCosts::2011] Error Code 10: Internal Error (Could not find any implementation for node {ForeignNode[113 + (Unnamed Layer*...

[FeatureRequest] Collecting additional model outputs in `GenerationSession`

This feature will also be very useful for GptManager 1. https://github.com/NVIDIA/TensorRT-LLM/issues/595 2. https://github.com/NVIDIA/TensorRT-LLM/issues/868

Stop the generation if the eod is reached

@byshiue thanks for fixing in parallel gpt 😌 gptneox and gptj have the same bug? When I tested gptneox I met an same bug... Do you have plans for fix...