can-ai-code issues

Results 34 can-ai-code issues

Sort by recently updated

Test bench for code extractor

We have over 100 interviews now, more then enough data to put together a regression test for `extract.py` to make sure we can reliably handle anything these models throw at...

the-crypt-keeper

enhancement

Test bench for function signature extractor

After the code extractor test bench, fixing stuff like #43 and #29 requires the function prototype parser also have a test bench.

the-crypt-keeper

enhancement

airoboros-1.4 GPTQ writes JS functions that confuse the code extractor

The 33B in javascript in particular seems to have a really weird return style ``` var substrCount = (function () { 'use strict'; //substrCount :: String -> String -> Int...

the-crypt-keeper

bug

Investigate prompting techniques

https://twitter.com/s_tworkowski/status/1679132557906964480?t=L7BXiAl8V5TqW3el9PbFlg&s=19 This prompt is claimed to boost coding performance by 50% Paper: https://arxiv.org/abs/2307.05337

the-crypt-keeper

Models that write multiple functions in return to misnamed prompts are treated unfairly

Considering the following response from WizardLM 13b: ---- Sure! Here's an example JavaScript function `fofx` that takes in two numbers as arguments (`x` and `banana`) and returns their greatest common...

the-crypt-keeper