Richard Abrich

Avoid unnecessary segmentation + description in `VisualReplayStrategy`

1

### Feature request https://github.com/OpenAdaptAI/OpenAdapt/pull/610 introduced the `VisualReplayStrategy` which works by segmenting the active window for every mouse event. This is wasteful because some or all of the active window may...

### Feature request We would like to automatically format typescript code. ### Motivation Legibility, consistency.

TODO: address https://github.com/OpenAdaptAI/OpenAdapt/issues/620

[Bug]: manual installation on Windows fails on `poetry shell`

4

### Describe the bug When running manual install steps on Windows 11 emulated in UTM on a MacOS host, at `poetry shell`: ``` File C: \Users\user\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-yEkGQRTF-py3.10\Scripts\activate.ps1 cannot be Loaded because...

### Describe the bug Fix: `pip install msvc-runtime` ### To Reproduce Follow manual installation instructions on Windows

Support winget

1

### Feature request On Windows 11, we can do: ``` winget install --id Git.Git -e --source winget winget install -i Python.Python.3.10 winget install --id=UB-Mannheim.TesseractOCR -e ``` ### Motivation Simplify installation

### Feature request We would like to use https://github.com/autodistill/autodistill to train a more efficient object detector for each recording. ### Motivation Reduce segmentation latency

### Feature request We would like to implement a local multimodal completion adapter via https://github.com/dusty-nv/NanoLLM ### Motivation Reduce latency, support offline mode

### Feature request We would like to implement a local multimodal completion adapter via https://huggingface.co/qnguyen3/nanoLLaVA Related: - https://github.com/OpenAdaptAI/OpenAdapt/issues/622 - https://github.com/dusty-nv/NanoLLM/issues/2 ### Motivation Reduce latency, support offline mode

### Feature request https://www.reka.ai/news/reka-core-our-frontier-class-multimodal-language-model ### Motivation _No response_