Richard Abrich

Industry: freight/logistics

1

How can we enable the freight industry to automate repetitive tasks? This involves: 1. Identifying specific use cases relevant to the power generation/transmission/distribution industry (i.e. job positions, associated tasks, and...

Set-of-Mark Prompting (via Segment-Anything-Model) + GPT4-V

2

Work-in-progress. Related: https://github.com/OpenAdaptAI/SoM `sam_mixin.py`:  ### Scratch: Via https://huggingface.co/spaces/Roboflow/SoM :  `gpt4v_coords.py`: `gpt4v_grid.py`: Addresses https://github.com/OpenAdaptAI/OpenAdapt/issues/513

Implement Set-of-Mark (SOM) with ollama

1

### Feature request Set-of-Mark: https://github.com/OpenAdaptAI/OpenAdapt/issues/519 ollama: https://github.com/OpenAdaptAI/OpenAdapt/issues/546 ### Motivation Open + offline state-of-the-art visual understanding

### Feature request We would like to implement https://vstar-seal.github.io/ as a fallback for when the target object is not found by SAM. "Visual Search" refers to identifying the location of...

### Feature request In order to implement the [OpenAdapt Architecture](https://github.com/OpenAdaptAI/OpenAdapt/wiki/OpenAdapt-Architecture-(draft)), we need to define states and transitions. Related: https://github.com/robocorp/llmstatemachine/ ### Motivation _No response_

### Feature request How can we incorporate the concepts in https://github.com/pipilurj/G-LLaVA / https://arxiv.org/abs/2312.11370 ? ### Motivation > Utilizing our constructed Geo170K dataset, we develop G-LLaVA, which demonstrates exceptional performance in...

### Feature request How can we incorporate the ideas in https://openai.com/research/vpt? See also: https://github.com/openai/Video-Pre-Training https://scholar.google.ca/citations?view_op=view_citation&hl=en&user=5TZ7f5wAAAAJ&sortby=pubdate&citation_for_view=5TZ7f5wAAAAJ:BKYZGPsuSFYC ### Motivation > We trained a neural network to play Minecraft by Video PreTraining (VPT)...

Explore simpleaichat

1

### Feature request How can we take advantage of https://github.com/minimaxir/simpleaichat ? Related: https://github.com/OpenAdaptAI/OpenAdapt/issues/534 ### Motivation > This tool has many features optimized for working with ChatGPT as fast and as...

### Feature request How can we incorporate ideas in https://github.com/havenhq/mamba-chat / https://arxiv.org/abs/2311.18257? ### Motivation Transformers are memory intensive.

Implement smart contract for model feedback signal

3

### Feature request This task involves implementing a smart contract to represent the "feedback" of a "human" to an "output" of a "model" via an "agent", where "feedback" is the...