Nick Dat Le

I didn't see the -gs flag, after setting it to 16.2,24 like you mentioned, it worked. Thank you! -- Perplexity: -- - Dataset: datasets/wikitext2_val_sample.jsonl -- - Chunks: 100 -- -...

> > How do i split the model between the two GPUs? Does it matter than I'm running python 3.11? > > Sorry, I forgot about that! I edited it...

If it's ok with the mods, I'm going to leave this thread open in case someone posts a tutorial or have some great links to exllama.

@SinanAkkoyun do you know what folks in the LLM community are using to communicate? Discord? Slack?

> @NickDatLe Most that I know use Discord, however very decentralized over many servers Ahh ok, I will join some discord servers. It seems "TheBloke" has a server and that...

> send invite/link please!

> https://discord.gg/theblokeai > > Really awesome Add me! nickdle

I invited you as a friend :)

> @NickDatLe Oh you mean that, sure! I can't find you in my friend requests, what is your tag? :) nickdle, I sent a friend request.