Ahmed Raza

TensorRT-LLM (Language Model) does support custom layer plugins, but the Python API for custom layers can sometimes lead to issues like the segmentation fault you're experiencing. This is often due...

Try updating the `client.mjs` file like this: ``` import { connect } from 'node:http2'; import { AsyncLocalStorage } from 'async_hooks'; import { setTimeout as sleep } from 'timers/promises'; const asyncLocalStorage...

To maintain the correct session context throughout the request-response lifecycle, you need to ensure that both the client creation and the requests are encapsulated within the same `asyncLocalStorage.run()` call. Here’s...

I understand that you're using `grpc-js`, which internally utilizes HTTP/2, making it difficult to control how the asynchronous context is managed within those library internals. Given this, let’s explore alternative...