Zhihan Zhou
Zhihan Zhou
Sorry for the delay in sharing the pre-training codes. We used and slightly modified the MosaicBERT implementation for DNABERT-2 https://github.com/mosaicml/examples/tree/main/examples/benchmarks/bert . You should be able to replicate the model training...
Hey, Thank you very much for your interest in our work and for this great suggestion! However, I can't do it right away since I have been quite busy recently....
Please try `pip uninstall triton` and run it again.
Hey, Can you please try to install triton from source? ``` git clone https://github.com/openai/triton.git; cd triton/python; pip install cmake; # build-time dependency pip install -e . ```
Do you have CUDA installed on your environment? This does not seem to be a problem with this repo.
The `triton` package is a bit tricky. If you fail to install from source, can you try `pip install triton==2.0.0.dev20221103`?
Can you try `pip install triton==2.0.0.dev20221103`? It works for me on A100 GPUs.
I have never seen this error before, but it seems to result from the GCC version. Maybe you need to checkout the `triton` Github for more information. What's the error...
@SPD3 Thank you for creating the PR! I have merged it.
Hey, Can you please try to install triton from source with: ``` git clone https://github.com/openai/triton.git; cd triton/python; pip install cmake; # build-time dependency pip install -e . ```