joblib icon indicating copy to clipboard operation
joblib copied to clipboard

warning persisting input arguments

Open amueller opened this issue 7 years ago • 3 comments

I got

UserWarning: Persisting input arguments took 0.66s to run.
If this happens often in your code, it can cause performance problems 
(results will be correct in all cases). 
The reason for this is probably some large input arguments for a wrapped
 function (e.g. large strings).
THIS IS A JOBLIB ISSUE. If you can, kindly provide the joblib's team with an
 example so that they can fix the problem.

The example is a pandas dataframe containing the telco customer churn data: https://www.kaggle.com/blastchar/telco-customer-churn

amueller avatar Oct 07 '18 15:10 amueller

I also got:

lookandsay.py:116: UserWarning: Persisting input arguments took 4.87s to run.
If this happens often in your code, it can cause performance problems
(results will be correct in all cases).
The reason for this is probably some large input arguments for a wrapped
 function (e.g. large strings).
THIS IS A JOBLIB ISSUE. If you can, kindly provide the joblib's team with an
 example so that they can fix the problem.
  print(f"{time.time() - t} sec\n"

My example is a SLOW adventofcode solution: https://github.com/HenryFBP/adventofcode/tree/master/2015/10

meltingscales avatar Oct 11 '18 01:10 meltingscales

I am looking for a way to suppress this warning. It seems that in the project I am working on the warning occurs when I run many threads simultaneously and concurrency delays a thread persisting the input arguments. Note that the input argument are relatively small.

filipbartek avatar Dec 29 '20 10:12 filipbartek

Any way how to silent this warning?

smith558 avatar Mar 28 '23 10:03 smith558