agentops icon indicating copy to clipboard operation
agentops copied to clipboard

feat: add gptlint

Open transitive-bullshit opened this issue 9 months ago โ€ข 1 comments

๐Ÿ“ฅ Pull Request

๐Ÿ“˜ Description

This PR is an example of how to add gptlint to AgentOps.

๐Ÿ”„ Related Issue (if applicable) https://github.com/gptlint/gptlint/issues/17

๐ŸŽฏ Goal This PR ads a single gptlint rule aimed at enforcing correct spelling and grammar.

๐Ÿ” Additional Context Previous confo w/ Alex.

๐Ÿงช Testing CleanShot 2024-05-07 at 18 35 29@2x

transitive-bullshit avatar May 07 '24 22:05 transitive-bullshit

Maybe I'm just running it wrong, but it's not catching English errors I've intentionally introduced:

(Cached run, but results still the same):

(env) (base) โžœ  agentops git:(feature/gptlint) โœ— npx gptlint -C README.md
Linter tasks { numFiles: 1, numRules: 1, numTasks: 1 }
Linter stats; total cost $0.00 {
  model: 'gpt-4-turbo',
  weakModel: 'gpt-3.5-turbo',
  numModelCalls: 1,
  numModelCallsCached: 0,
  numPromptTokens: 2974,
  numCompletionTokens: 71,
  numTotalTokens: 3045,
  lintDuration: '2s'
}

no lint errors ๐ŸŽ‰
โœ” Preprocessing 1 files and 1 rules

areibman avatar May 07 '24 22:05 areibman