Richard Abrich

### Describe the bug When attempting to replay a recording from the system tray: ``` Process Process-1:5: Traceback (most recent call last): File "/Users/abrichr/Library/Caches/pypoetry/virtualenvs/openadapt-VBXg4jpm-py3.10/lib/python3.10/site-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context self.dialect.do_execute( File...

### Feature request - remove default values from config.py - remove config.json to config.defaults.json - remove config.local.json to config.json - document difference between the three files inside of config.py ###...

### Feature request https://github.com/OpenAdaptAI/OpenAdapt/pull/618/files#r1576993555 ### Motivation _No response_

### Feature request See https://github.com/OpenAdaptAI/OpenAdapt/pull/618/files#r1576846013 ### Motivation _No response_

### Describe the bug ``` (openadapt-py3.10) abrichr@MacBook-Pro-4 OpenAdapt % poetry run install-dashboard Warning: 'install-dashboard' is an entry point defined in pyproject.toml, but it's not installed as a script. You may...

Evaluate on OSWorld

1

### Feature request We would like to test OpenAdapt's ability to perform the tasks in https://os-world.github.io/. This may involve creating recordings of the tasks described in the benchmark, since (as...

### Feature request How can we take advantage of https://github.com/stanfordnlp/dspy ? ### Motivation > DSPy provides composable and declarative modules for instructing LMs in a familiar Pythonic syntax. It upgrades...

### Feature request We would like to offer an API to allow developers to trigger replay programmatically. ### Motivation Flexibility

### Describe the bug Notification icons currently default to python logo. We would like to display the openadapt logo. ### To Reproduce 1. `python -m openadapt.record foo` 2. Observe notification...

Implement MiniCPM-V-2

3

### Feature request https://github.com/OpenBMB/MiniCPM is the smallest multimodal model available. The latest version, https://huggingface.co/openbmb/MiniCPM-V-2, appears to be able to understand GUI images: > Describe the given image with as much...