pratik3558

> Thank you for fast reply: > > ```yaml > components: > schemas: > Document: > type: object > properties: > id: > type: string > example: abc123 > createdDate:...

Thank you for the prompt response! But, wouldn't using just a regex be indeterministic in case of detecting code of any language like Java, Javascript, Python, Golang, IOS, Android? It...

Hi @liyucheng09 Some of the code is internal to our company code base which would be ingested and the user could ask questions related to the code: for example, can...

Would it be able to give back code if the code is broken? Its not just feedback ,but exact code too. Since some of the code is internal, LLM cannot...

Its not just feedback ,but exact code too. Since some of the code is internal, LLM cannot give back since its not present in the context

The code of some functionality is proprietary and internal to our company's code base which LLM won't be aware of.

Makes sense ! Thanks @liyucheng09 ! Let me try it out and share with you! Also, i might refactor the code a bit, so please expect a PR may be...

@liyucheng09 what's the latency you are seeing on your systems? could you share the hardware info that you used i.e image type, cpu, memory etc? Trying to bring down the...

@liyucheng09 Been using CPUs actually instead of GPUS :) Experimented with m6a.12xlarge with 7500m and 12G m6a.2xlarge with 2500m and 12G memory both gave around 3-4 seconds for us which...

@liyucheng09 ``` "Selective Context, Ratio: 0.5, CUDA Memory = 61,885 MB, Time = 76.3 ms/token, Time to construct selective context = 46.1 ms" ``` It took only 46.1 ms on...