imda-junyoung issues

Repositories
Issues
Comments

Results 3 issues of


                                            imda-junyoung

Managing concurrently running tasks

With the current interactive CLI environment, we have to open a new terminal in order to run a new task (cookbook/recipe) concurrently. Would it be possible to run them in...

Exit sequence for running tasks

During model development, it can prove useful to have a safe exit sequence for a currently running task to make quick changes to the model and redeploy, instead of force...

Using Moonshot for local models instead of hosted models via API endpoints

For locally developed models / most models downloaded from HuggingfaceHub, it can be troublesome to set up an API endpoint for the model. There are libraries such as [vLLM](https://blog.vllm.ai/2023/06/20/vllm.html) that...