Chansung Park

anyone tried batch inference?

4

when I set pad token 0 and padding=True, the generated text for the padded prompt shows always

simple playground share

3

not sure when I am going to shutdown, but I will leave this for few hours at least (running on RTX5000). maybe I will put things up in GKE later...

sharing experimental results like a chatbot

11

7B demo link: https://notebooksd.jarvislabs.ai/tz0hyvPyQMO0qXbeTpLYv2Wu5-j9AfFm_dM9sQN5fqFGI0lT90sAIHgT-Gi0jLcX/

sharing 13B and 30B Alpaca-LoRA ckpt

20

I have put the links of both one in this repository : https://github.com/deep-diver/Alpaca-LoRA-Serve I used A100 40GB to train both one. I didnt' change the script provided in this repository,...

sharing Alpaca-LoRA chatbot (Gradio app)

32

I hope you guys find it useful. Here is the repo : https://github.com/deep-diver/Alpaca-LoRA-Serve and I am currently running 30B version on my VM. Try it while it is live. Share...

Sharing updated 30B Alpaca-LoRA chatbot playground

7

I have shared the one at #87 , and it it still running. Today, I want to share a little modified version of it running on a separate A6000 instance....

Sharing re-branded project "LLM As Chatbot" from "Alpaca-LoRA-Serve"

1

for those of you know the project `Alpaca-LoRA-Serve`, I have updated the project to include other models besides `Alpaca-LoRA`. The screenshot shows a GUI menu that you can choose a...

Model weights contributions?

5

There is a model called SOLAR. This model follows the same architecture as LLaMA2, but it has more layers which make it outstanding performer better than Mistral and even Mixtral...

Canceling event with JavaScript handler doesn't work

1

### Describe the bug when events are chained, and there is an event with JavaScript handler in between, the chain of events can not be canceled. I verified this issue...

LLMEvaluator that evaluates model's output with LLM

2

This is a custom TFX component project idea. hope to get some feedbacks from (@rcrowe-google , @hanneshapke , @sayakpaul , @casassg) Temporary Name of the component: LLMEvaluator Behaviour : LLMEvaluator...