Selective_Context
Selective_Context copied to clipboard
liyucheng09
Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.
when i put pip install selective-context, found error like this: ERROR: Could not find a version that satisfies the requirement selective-context (from versions: none) ERROR: No matching distribution found for...
Hello, I am encoutering this error ``` RuntimeError: The size of tensor a (1024) must match the size of tensor b (1452) at non-singleton dimension 3 ``` I am using...
Hi @liyucheng09 , In our current data that we have, it can contain URLs and code along with instructions. The code can be in any language: Java, JS, Python, Golang...
I would like to ask if the experiments in Tables I and II below are averages over three data sets and four tasks
我们在想直接使用的时候会运行报错： " return issubclass(cls, self.origin) TypeError: issubclass() arg 1 must be a class" 想问一下作者您的spacy thinc pydantic三个版本分别是多少呢？
Run the code: sc = SelectiveContext(model_type='gpt2', lang='en') there is a version spacy, pydantic and thinc incompatible problem, you can provide the version that runs successfully
Dear Yucheng Li: For the condition that a token overlaps multiple lexical_unit, we assign its self_info divided by the overlap number to each overlapped lexical_units. Is my understanding right? https://github.com/liyucheng09/Selective_Context/blob/3074343653bbf3559a87a588667e843744bc6f2a/context_manager.py#L240C21-L242C24...
Hello, the dataset in the URL you provided, https://github.com/liyucheng09/Selective_Context/releases/download/v0.1.0rc1/datasets_dumps.zip, seems incomplete. There is no data in the news folder, it is empty. How can I prepare this part of the...
Metadata
Owner
Metadata
Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.