ail-framework icon indicating copy to clipboard operation
ail-framework copied to clipboard

Published 20 hours ago • verified publisher icon ail-project

Bug: Submit larger file: Did not analyse => 404

Open certrik opened this issue 4 years ago • 5 comments

Hi,

I submitted a 100 MB ascii text file via https://ail.domain.tld:7000/PasteSubmit/ via file upload. It stated everything workes fine but apparently it didn't. Didn't get any tracker alerts even if I manually looked into it and it should have alerted on some. If searching for tag infoleak:submission="manual" it shows up but if I try to access the reference I get an 404 error.

certrik avatar Nov 06 '20 16:11 certrik

maybe related to https://github.com/CIRCL/AIL-framework/issues/277

certrik avatar Nov 06 '20 22:11 certrik

Is there any upper limit for filesize? I searched for an info, but didn't find any answers.

certrik avatar Nov 09 '20 09:11 certrik

Not sure if it help, but it may be worth playing with this https://flask.palletsprojects.com/en/1.1.x/patterns/fileuploads/#improving-uploads

mokaddem avatar Nov 10 '20 09:11 mokaddem

@mokaddem Sorry for asking ... but is this a comment for me to try to find a workaround or is it something which could resolve the issue upstream?

certrik avatar Nov 10 '20 22:11 certrik

I also think that your intuition about maximum submission size is correct, so I just pointed the relevant part of the documentation. If your initial guess is correct, it should solve the issue and we would gladly add an entry in the documentation. However, please note that AIL is not designed (yet?) to process files of this size. If you can split your big file into multiple fragments (<5Mb would be best), it would be much faster for the system to ingest and process.

mokaddem avatar Nov 11 '20 09:11 mokaddem