CodeBERT

[walking-octopus]

I appears Microsoft have a neat little BERT model for code search and basic comment generation, code translation, and simple refactoring. With faster inference in C++, perhaps someone can make a neat VSCode extension or CLI for it...

https://github.com/microsoft/CodeBERT

[skeskinen]

How would you imagine these models are used in practice? For code search or something else?

[walking-octopus]

Code search would be the easiest use-case for it, but it seems is can also support very basic code generation/editing. I suppose this model can be useful in the ggml-org/p1 project.

[znsoftm]

Are working on the codebert? my email: [email protected]