bohou-aryn
bohou-aryn
Looks like the driver/worker process model ser/de incompatible, move model instantiation inside worker process to get rid of the ser/de. ``` RuntimeError: Attempting to deserialize object on a CUDA device...
Test the generate Sphinx htmls locally.
We don't have nice way for handling opensearch writer throttling. We might consider expose the knobs for opensearch write, e.g. the bulk write size. Also, we might consider certain ways...
This is part of the series of tasks for converting llm operator to use Henry's new LLMMap or LLMElementMap.