BUG | Found 2 rare glitches with whois.csv + Found ways for users to fix those 2 glitches.

[DandelionSprout]

What is the problem you are experiencing?

Note that quite a bit of this is based on circumstantial evidence, as I was more focused on seeing if the errors could be fixed instead of documenting the exact error messages in deep detail; I did however feel it'd be worth it to share advices about them to this repo. They apply to both the native Windows versions of Python 3.13.7 (Tested with the Microsoft Store version of Python) and (from what I could tell) to the Cygwin python312 package version 3.12.9.

1. During a session, after scanning around 100 domains or so, PyFunceble can begin to throw increasingly more errors about _csv.Error: field larger than field limit (131072), before crashing after 200 domains or so.

The fix I found for it was that whois.csv had increased to around 7.3 MB at the time, which seems to have been more than Python 3 could handle. Deleting the whole whois.csv file prevented that error, but does not fix the 2nd error listed below if that one is also encountered.

2. During a session, whois.csv can throw a different error that I remember involves being about (epoch), but I've completely forgot the exact name and syntaxing of the error message, I have not been able to reproduce it after I first fixed it, and cases of it elsewhere seems to be non-existent in online searches.

Both of the 2 errors also complained about Error 13: Permission denied (...), so I went to the file → right-click → "Properties" → "Security" → "Edit" → "Add..." → Type "All" (Very likely different in non-English Windows versions) → "OK" → Give "All" all available permissions → "Apply". This fixed the 2nd error; it can likely fix the 1st error too but I can't prove it for that one.

How can we reproduce the problem?

Good question, to be honest.

To at least replicate the 1st error:

1. Have a bafflingly large whois.csv file in %appdata%/PyFunceble (if using a native Windows version of Python)
2. Run pyfunceble -f https://raw.githubusercontent.com/DandelionSprout/adfilt/refs/heads/master/Sensitive%20lists/TabloidRemover.txt
3. After scanning something between 100〜300 domains, it can begin throwing the error around once every 20 domains, before crashing on approximately the 4th error occurence.

How to replicate the 2nd error is anyone's guess.

Do you have a screenshot?

I really wish I had any screenshots to provide, but I don't seem to have any.

What did you expect to happen?

PyFunceble completes scan sessions without users needing to handle the whois.csv file.

Is there a workaround?

All of the working ones are listed further above.

How did you configure PyFunceble?

The .PyFunceble.overwrite.yaml file is empty on my end, as fas as I can tell.

Which Operating System did you use?

Windows 11

Which Python Version did you use?

3.13

Which PyFunceble Version did you use?

4.3.0

Additional context

Among the things I tried to fix them with, but which didn't work:

• Changed some entries in whois.csv whose listed ISPs were shown with as many as 6 quotation marks, so that no ISPs in the file were listed with more than 2 quotation marks.
• Change the default opener app for .csv files in Windows from Excel (Office 365's version) to Sublime Text 4.

[funilrys]

@Yuki2718 can you confirm that the following solves your issue #430 ?

Both of the 2 errors also complained about Error 13: Permission denied (...), so I went to the file → right-click → "Properties" → "Security" → "Edit" → "Add..." → Type "All" (Very likely different in non-English Windows versions) → "OK" → Give "All" all available permissions → "Apply". This fixed the 2nd error; it can likely fix the 1st error too but I can't prove it for that one.

@DandelionSprout If confirmed, I think I will add that to the documentation. I'll try to reproduce the whois.csv issue.

Thank you both for the support and time invested in this.

[Yuki2718]

Give "All" all available permissions

Do you mean "ALL APPLICATION PACKAGES"? Assuming yes, so far it looks the problem is solved.

[DandelionSprout]

Not really. I was thinking about these ones (in order):

————————————————————————————————

(Windows' internal names for account types do not seem to change when the OS language is changed; so "Alle" corresponds to "All".)

[Yuki2718]

Hmm, what actually appeared when I typed "All" on my end is "ALL APPLICATION PACKAGES". Even the icon is different...

[DandelionSprout]

Windows' internal systems for account types stretch back to maybe even Windows XP, so I fully believe that there's many localisation inconsistencies that Microsoft must've done around 2003-04.

[Yuki2718]

I've got an error even with the tweaks. And now another error too "The process cannot access the file because it is being used by another process." It's not always, running the scan again usually completes.