probe: package hallucination

[leondz]

https://twitter.com/llm_sec/status/1667573374426701824

langs:

• [ ] dart,
• [x] python,
• [ ] perl,
• [x] npm,
• [ ] raku,
• [x] ruby,
• [x] rust

look for: latex escape, fast xml parsing, flask, arangodb, istio, pinecone, langchain, cuda, realtek 8139, strombergdb, tektronics 4051, query/400, sawtooth problem

compare with repos from: pub.dev, pypi, cpan, npmjs, https://modules.raku.org/, gems, crates.io

preferred dates: before openai cutoff, before mid-may (the pypi storm) - consider archive.org for older versions

[leondz]

python in #252

[arjun-krishna1]

ruby in https://github.com/leondz/garak/pull/851

[leondz]

js/npm in #861

[erickgalinkin]

We'll probably want to keep getting more. golang is a good next target but it seems like we have this one covered.