OpenAdapt

OpenAdapt copied to clipboard

Implement Set-of-Mark (SOM) with ollama

1

### Feature request Set-of-Mark: https://github.com/OpenAdaptAI/OpenAdapt/issues/519 ollama: https://github.com/OpenAdaptAI/OpenAdapt/issues/546 ### Motivation Open + offline state-of-the-art visual understanding

abrichr

### Feature request We would like to implement https://vstar-seal.github.io/ as a fallback for when the target object is not found by SAM. "Visual Search" refers to identifying the location of...

abrichr

### Feature request In order to implement the [OpenAdapt Architecture](https://github.com/OpenAdaptAI/OpenAdapt/wiki/OpenAdapt-Architecture-(draft)), we need to define states and transitions. Related: https://github.com/robocorp/llmstatemachine/ ### Motivation _No response_

abrichr

### Feature request How can we incorporate the concepts in https://github.com/pipilurj/G-LLaVA / https://arxiv.org/abs/2312.11370 ? ### Motivation > Utilizing our constructed Geo170K dataset, we develop G-LLaVA, which demonstrates exceptional performance in...

abrichr

Configure Sweep

1

🎉 Thank you for installing Sweep! We're thrilled to announce the latest update for Sweep, your AI junior developer on GitHub. This PR creates a `sweep.yaml` config file, allowing you...

sweep-ai[bot]

Refactor config management

2

### PR Feedback (click) - [ ] 👍 Sweep Did Well - [ ] 👎 Sweep Needs Improvement ## Description This PR refactors the configuration management in the `config.py` file...

sweep-ai[bot]

### Feature request How can we incorporate the ideas in https://openai.com/research/vpt? See also: https://github.com/openai/Video-Pre-Training https://scholar.google.ca/citations?view_op=view_citation&hl=en&user=5TZ7f5wAAAAJ&sortby=pubdate&citation_for_view=5TZ7f5wAAAAJ:BKYZGPsuSFYC ### Motivation > We trained a neural network to play Minecraft by Video PreTraining (VPT)...

abrichr

Explore simpleaichat

1

### Feature request How can we take advantage of https://github.com/minimaxir/simpleaichat ? Related: https://github.com/OpenAdaptAI/OpenAdapt/issues/534 ### Motivation > This tool has many features optimized for working with ChatGPT as fast and as...

abrichr

### Feature request How can we incorporate ideas in https://github.com/havenhq/mamba-chat / https://arxiv.org/abs/2311.18257? ### Motivation Transformers are memory intensive.

abrichr

feat: CompletionProvider API

20

**What kind of change does this PR introduce?** Added a rough sketch of what the infrastructure surrounding the models we use might look like. Addresses #252 , #69 and #368...

FFFiend