CodeTF
CodeTF copied to clipboard
CodeTF: One-stop Transformer Library for State-of-the-art Code LLM
It seems that the example fine-tune task is training for specific downstream task, like text-to-code. Is there any example for adding a new programming language? Thanks!

``` $ python test_inference/test_starcoder_nl2code.py requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/bigcode/starcoder/resolve/main/config.json huggingface_hub.utils._errors.RepositoryNotFoundError: 401 Client Error. (Request ID: Root=1-647a1d8b-7884a0702c5cae05744608f7) Repository Not Found for url: https://huggingface.co/bigcode/starcoder/resolve/main/config.json. Please make sure you specified...
Bumps [numpy](https://github.com/numpy/numpy) from 1.21.6 to 1.22.0. Release notes Sourced from numpy's releases. v1.22.0 NumPy 1.22.0 Release Notes NumPy 1.22.0 is a big release featuring the work of 153 contributors spread...
I run the demo in README: ```python # -*- encoding: utf-8 -*- from codetf.trainer.causal_lm_trainer import CausalLMTrainer from codetf.data_utility.codexglue_dataset import CodeXGLUEDataset from codetf.models import load_model_pipeline from codetf.performance.evaluation_metric import EvaluationMetric model_class =...
- :memo: update README - :fire: remove `.DS_Store` and `__pycache__`
Hi Nice project! Do you have the checkpoint and evaluation conclusions of the `defect` and `refine` tasks for `codet5p-16b`? Here I tested the codet5 defect and refine task examples in...
The link of technical report is updated to the URL of the paper abstract in arxiv
**Changes:** Added support for RWKV model family. **Related links:** Paper: https://arxiv.org/abs/2305.13048 Github: https://github.com/BlinkDL/RWKV-LM **Screenshots:** Model list: Sample generation: