Richard Abrich

@FFFiend please see: https://www.youtube.com/watch?v=DxInMGIvkp0 See also: https://mldsai.slack.com/archives/C050869D3K4/p1689640271500029 https://twitter.com/Yampeleg/status/1668337702440165376

Please review https://github.com/OpenAdaptAI/OpenAdapt/pull/420 and let's discuss 1-1

@FFFiend notes from our conversation: ``` [ { “action”: {“name”: … }, “window”: {“...”: …, }}, { “action”: {“name”: … }, “window”: {“...”: …, }}, … ] For GPT: require...

We need to filter this out: ``` 'AXRoleDescription': 'text entry area', 'AXValue': 'Last login: Wed Jul 19 19:20:24 on ttys000\nowaiszahid@Owaiss-MacBook-Pro modelapi % git clone https://github.com/Owais-Enhancement-Org/OpenAdapt.git\nCloning into \'OpenAdapt\'...\nremote: Enumerating objects: 3311,...

We also want to add the `recording.task_description` to the prompts/finetune pairs. To clarify, fine tune pairs should be generated by replay strategies. These are what generate the prompts, and these...

Related: https://github.com/OpenAdaptAI/OpenAdapt/issues/430

Thanks @FFFiend ! Can you please review https://github.com/CambioML/pykoi to see if we might be able to re-use some of their primitives?

@FFFiend it looks like this PR includes several unrelated changes (e.g. alembic/versions/5139d7df38f6_add_recording_task_description.py). Can you please remove all unrelated code? 🙏

This is now stale and needs to be updated to support images. Related: https://github.com/OpenAdaptAI/OpenAdapt/pull/527 @FFFiend do you have any bandwidth? 🙏

@FFFiend would love your thoughts on https://github.com/OpenAdaptAI/OpenAdapt/issues/534 🙏 😄