recordlinkage icon indicating copy to clipboard operation
recordlinkage copied to clipboard

Progess indicator or verbose output in Recordlinkage Python

Open gsunit opened this issue 5 years ago • 1 comments

I am using Recordlinkage to find matches among two dataframes. However, since the no. of entries in both the dataframes is quite big, the comparison takes a lot of time.

It would be better if I knew the expected time for completion and whether it is actually processing (instead of my machine hanging in between the process).

Is there a way to print the verbose output of the processing in Recordlinkage?

Also, the tqdm Python package for Jupyter Notebook is really good for tracking progress (easily implementable for for-loops). Can tqdm be used somehow for tracking the progress?

P.S. here is the same question I posted on Stackoverflow: https://stackoverflow.com/questions/63319479/progess-indicator-or-verbose-output-in-recordlinkage-python

gsunit avatar Aug 08 '20 19:08 gsunit

Try changing the logging level to INFO in rl_logging.py#L46.

umarbutler avatar Jan 01 '21 14:01 umarbutler