Voyager Implement a way test local models

Hello,

Wonderful work on Voyager.

Please consider added local model support (instead of openai package - using something like Python requests package to a localhost local model using openai completion elements).

I believe Voyager is a superb way to measure future Large Language models against one another using the Minecraft diamond challenge.

Please consider a collaboration with Eleuther AI on locally hosted LLM evaluation via Voyager

https://github.com/EleutherAI/lm-evaluation-harness

Mar 22 '24 19:03 bennmann

This issue is stale because it has been open for 30 days with no activity.

Apr 22 '24 01:04 github-actions[bot]

Please reconsider this issue in light of Llama 3 8B and 70B.

Apr 22 '24 14:04 bennmann

This issue is stale because it has been open for 30 days with no activity.

May 23 '24 01:05 github-actions[bot]

Any updates on this?

May 25 '24 15:05 KhaoDoesDev

This issue is stale because it has been open for 30 days with no activity.

Jun 26 '24 01:06 github-actions[bot]

This issue was closed because it has been inactive for 14 days since being marked as stale.

Jul 10 '24 01:07 github-actions[bot]