OpenAdapt
OpenAdapt copied to clipboard
Open Source Generative Process Automation (i.e. Generative RPA). AI-First Process Automation with Large ([Language (LLMs) / Action (LAMs) / Multimodal (LMMs)] / Visual Language (VLMs)) Models
### Describe the bug During recording, if the active window changes and the user emits an `ActionEvent` before a new `WindowEvent` is received, the resulting segmentation (during replay) will fail....
**What kind of change does this PR introduce?** This PR addresses #724 **Summary** This PR adds a script to deploy an app to AWS lambda, that is then used by...
### Feature request e.g. Presidio, others? We need a (VERY LIGHTWEIGHT) evaluation framework for different commercial and non-commercial redaction APIs/libraries. We want to generate plots of various accuracy measures for...
### Feature request When calling scrub.scrub_text, instead of just replacing with `***`, we would like to retain semantic meaning. e.g. given: ``` Alice said hi to Bob ``` We want:...
### Feature request In a situation like this one, we don't want to force the user to delete each event individually: It would be better to automatically delete all child...
Certain use cases (e.g. SalesForce, LinkedIn) would greatly benefit from reading and writing website markup and the DOM (i.e. by simplifying tokenization of screenshots). 1) Implement a Chrome Plugin that...
### Feature request We would like to implement https://openreview.net/pdf?id=TrjbxzRcnf- via https://github.com/lucidrains/memorizing-transformers-pytorch and/or https://github.com/google-research/meliad as a completion provider. See also https://twitter.com/ChrSzegedy/status/1589492667247132672?s=20&t=1VqJB9gI-yAmv2wM6VoYiQ ### Motivation Long term memory implemented by vector databases that...
### Describe the bug VanillaReplayStategy returns KeyError I have pulled the latest upstream and tested it. here's the log: ``` (openadapt-py3.10) C:\Users\nsaip\Desktop\algora\OpenAdapt>python -m openadapt.replay VanillaReplayStrategy --instructions "calculate 9-8" [2024-07-12 13:23:34.345]...
### Feature request Thank you for your excellent work on OpenAdapt! Currently, OpenAdapt captures the accessibility tree (a11ytree) of only the foremost window. This approach works well for single-window applications....
### Describe the bug When running the dashboard for the first time, I expect there to be no recordings. However the fixture recording is there. This would be fine except...