David Gilbertson comments

Results 57 comments of


                                            David Gilbertson

trafficstars

Less noisy console output

Thanks @sgugger, I just tried that. There's still plenty of noise from code in HF (datasets) like this: ```py logger.warning(f"Loading cached processed dataset at {cache_file_name}") ``` Also, `Trainer` will call...

Less noisy console output

I've got a full schedule with study at the moment, sorry. So in summary this looks like 2.5 issues: * messages like "loaded from cache" should be log level INFO,...

Less noisy console output

Ah, interesting, I thought the first one was quite clear cut. From the [Python logging how-to](https://docs.python.org/3/howto/logging.html): * INFO: Confirmation that things are working as expected. * WARNING: An indication that...

Less noisy console output

Oh good! :) Yes I just checked and this is actually coming from the datasets package.

Less noisy console output

@sgugger something else I've just noticed is that sometimes transformers will set the log level to info. I can't pin down exactly when, but I see that there's lots of...

Less noisy console output

Hmm, are these scripts ever called from the application code? There's definitely _something_ that sets the log level to INFO, and I think it's related to loading a model for...

Less noisy console output

Here's an example, I have this code that references a model not in my cache. ```py print(f"Verbosity: {transformers.logging.get_verbosity()}") conf = transformers.AutoModel.from_pretrained("distilgpt2") print(f"Verbosity: {transformers.logging.get_verbosity()}") ``` Interestingly, it ran and had the...