shortest
shortest copied to clipboard
QA via natural language AI tests
### What We may need better telemetry on how many input/output/total tokens went into `shortest`. Fortunately, Anthropic API [returns](https://docs.anthropic.com/en/docs/build-with-claude/tool-use#example-simple-tool-definition:~:text=When%20you%20send%20a%20tool%20use%20prompt%2C%20just%20like%20any%20other%20API%20request%2C%20the%20response%20will%20output%20both%20input%20and%20output%20token%20counts%20as%20part%20of%20the%20reported%20usage%20metrics.) token usage for each request. ### Why - Help people better...
### What Speed up test execution by finding ways to addressing issues outlined below. ### Why While working on #179, I have found that screenshooting perhaps takes the most time...
Fixs #144 **Changes** 1. consider the package manager the user is using when installing chromium with playwright. 2. the current package manager & the execute command is determinded using [antfu-collective/package-manager-detector](https://github.com/antfu-collective/package-manager-detector)...
Fixs #191 **Changes** Previously when the package is bundled, `index.d.ts` had incorrect paths for some imports. this makes the `ShortestConfig` from `@antiwork/shortest` not resolve properly. here's the file structure of...
For https://github.com/anti-work/shortest/issues/123, I thought of adding chained tests just like a testA inside testB to let testA depends on testB, but with this approach testA cannot depend on another testC...
Some stuff is still quite irrelevant as I was trying out the repo... 1. Made a SnapshotBrowserTool that records the steps taken by the AI. 2. Made a SnapshotAIClient that...
**Issue #124** This PR introduces basic caching mechanism to reduce costs and increase effectiveness of running test suites. **Performance Boost:** Achieves an average speedup of 400%-600%, automations like "Find Lionel...
Set a super basic example in my repo: ```ts import { shortest } from "@antiwork/shortest"; shortest("Verify that the user can access the / page"); ``` But would get this each...