Code-LMs

Code-LMs copied to clipboard

Converting models from GPT-NeoX to HuggingFace format

9

Hello, I am interested and volunteering to convert the models from GPT-NeoX to HuggingFace format.

sleekmike

Context Prompt - RuntimeError: CUDA error: CUBLAS_STATUS_EXECUTION_FAILED when calling ```cublasGemmEx( handle, opa, opb, m, n, k, &falpha, a, CUDA_R_16F, lda, b, CUDA_R_16F, ldb, &fbeta, c, CUDA_R_16F, ldc, CUDA_R_32F, CUBLAS_GEMM_DFALT_TENSOR_OP)```

1

I am trying to setup Polycoder inferencing on my machine with 2xP100 GPUs, and use the docker command as available in README: ```bash nvidia-docker run --rm -it -e NVIDIA_VISIBLE_DEVICES=0,1 --shm-size=1g...

LakshyAAAgrawal

Context prompt - example not working

2

I have configured this setup in a 4GPU machine. I have done the setup using docker image. I have received the Context prompt. When I feed it an example, it...

pallabganai

CUDA out of memory error on training

3

I was trying to train Polycoder using the [preconfigured dataset](https://github.com/frankxu2004/gpt-neox#datasets), from the checkpoint `checkpoints-2-7B`, I used the following command as per the [instructions](https://github.com/frankxu2004/gpt-neox#containerized-setup) in the repo (only changing the configs...

AftabHussain

I'm trying to generate code from a prompt, as described in the README: ``` ./deepy.py generate.py configs/text_generation.yml configs/local_setup.yml configs/small.yml ``` However, the command fails because the GTP2 vocab file is...

michaelpradel

This PR includes a script named `convert_neox_pt_to_huggingface_neox.py`, which is used to convert a PolyCoder checkpoint trained by GPT-NeoX into HuggingFace format. A `transformers.GPTNeoXConfig` file that matches the checkpoint is also...

NinedayWang

How to command PolyCoder to generate code?

1

`alex@billing desktop % python3 poly.py The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this...

Prestapro

How to use it on hugginface?

1

I am trying to use it on hugging face and the out is same as input with \n in the end. How to use this on huggingface. any guide will...

rajanpanchal

Code generation

3

Hi I want to ask what this error means: **Context prompt >>> def add():\n """1 add 2"""\n** Traceback (most recent call last): File "generate.py", line 74, in main() File "generate.py",...

LuYujing-97

Code Generation

3

Hi, First of all, thank you very much for the model, but then I had some problems running the code generation step. When it shows "Context prompt >>>", I enter...

LuYujing-97