[Bug]: fastdup overwrites similarity.csv when calling run_mode=4 or search

[Tompil3r]

What happened?

When calling run(run_mode=4) or search - which both generate new similarities, fastdup overwrites the similarity.csv in the work_dir. Meaning in order to keep the similarities a copy of the file needs to be made each time.

What did you expect to see?

No response

What version of fastdup were you runnning on?

1.30

What version of Python were you running on?

Python 3.10

Operating System

Ubuntu 20

Reproduction steps

No response

Relevant log output

No response

Attach a screenshot [Optional]

No response

Contact Details [Optional]

No response

[dnth]

I find that this is the line that overwrites the similarity.csv file.

https://github.com/visual-layer/fastdup/blob/bf302fa499137f92973057b2bd75f62d5e00ec59/fastdup/init.py#L2110

@dbickson could you please check on the C side?