lm_perplexity icon indicating copy to clipboard operation
lm_perplexity copied to clipboard

/Users/raihankhan/PycharmProjects/lm_perplexity/lm_perplexity/run_lm_perplexity.py': [Errno 2] No such file or directory

Open raihankhan-rk opened this issue 2 years ago • 4 comments
trafficstars

I can't seem to find the 'run_lm_perplexity.py' file. Can someone help, please?

Also, could someone provide a good guide on how to run this model locally on PC?

raihankhan-rk avatar Jan 13 '23 06:01 raihankhan-rk

I think it should be compute_perplexity.py

StellaAthena avatar Jan 13 '23 06:01 StellaAthena

Also, could someone provide a good guide on how to run this model locally on PC?

This isn’t a language model. It’s a utility for doing analysis of language models. There’s a very good chance that this isn’t what you’re looking for.

StellaAthena avatar Jan 13 '23 06:01 StellaAthena

I want to compute bpb for language models, what is this argument -- utf8_conversion_scalar ?

joan126 avatar May 04 '23 09:05 joan126

I want to compute bpb for language models, what is this argument -- utf8_conversion_scalar ?

co-asking. did you find a solution for this?

owos avatar Sep 18 '24 14:09 owos