tonic icon indicating copy to clipboard operation
tonic copied to clipboard

Add some Prophesee datasets

Open biphasic opened this issue 3 years ago • 7 comments

apart from NCARS, which we already have, it would be nice to have access to some Gen4 camera datasets: https://docs.prophesee.ai/stable/datasets.html#datasets

biphasic avatar Oct 15 '21 11:10 biphasic

Hi! I saw that you mentioned that NCARS is already available in Tonic but I am not able to find it. Is it hidden in some other datasets? Or it has been removed (maybe due to the fact that at this link they ask every time for user information before downloading?)

fabrizio-ottati avatar Apr 19 '22 22:04 fabrizio-ottati

it used to be in there but I removed it (see this commit https://github.com/neuromorphs/tonic/commit/a7d78a747477b24eaf6fa4a1fbd56c58eca5b0ff) because in order to read the files, I was dependent on the loris package https://github.com/neuromorphic-paris/loris but that one is a compiled package and it created some issues. I thought that it would be nice to put some newer Prophesee datasets in place but when I looked at it the other day, it seems that they provide their data in their custom format .dat (which loris is able to read) a lot of the times still... Which dataset would you like to work on? The original NCARS with two classes?

biphasic avatar Apr 20 '22 08:04 biphasic

Yes, I need to work with the dataset from the original HATS paper. Do you suggest to manually download NCARS from their website and use loris to handle it? Of course, it would be nice to write a DAT processing function and integrate it in Tonic. Do you think it is feasible and that it makes sense?

fabrizio-ottati avatar Apr 20 '22 09:04 fabrizio-ottati

We can reintroduce it (see the old commit), however I just want to have loris as optional dependency. So I suggest to do the following: copy the dataset file from the previous commit and check that it works, and if you can manage to make loris an optional dependency (using a try/except block) we can put it back into Tonic.

biphasic avatar Apr 20 '22 09:04 biphasic

I noticed something: on this line, loris is used directly without the try/except block. In fact, read_aedat4() is used also in CIFAR10DVS to read the file. Hence, we can simply restore the N-CARS dataset, add a try/except statement for loris in read_aedat4() and everything should be fine, right? Am I missing something?

fabrizio-ottati avatar Apr 20 '22 14:04 fabrizio-ottati

Good point! Please try this. Thank you 🙏

Le 20 avril 2022 15:09:56 GMT+01:00, Fabrizio Ottati @.***> a écrit :

I noticed something: on this line, loris is used directly without the try/except block. In fact, read_aedat4() is used also in CIFAR10DVS to read the file. Hence, we can simply restore the N-CARS dataset, add a try/except statement for loris in read_aedat4() and everything should be fine, right? Am I missing something?

-- Reply to this email directly or view it on GitHub: https://github.com/neuromorphs/tonic/issues/143#issuecomment-1103979579 You are receiving this because you authored the thread.

Message ID: @.***> -- Envoyé de mon appareil Android avec Courriel K-9 Mail. Veuillez excuser ma brièveté.

biphasic avatar Apr 20 '22 14:04 biphasic

After getting in touch with Prophesee, they informed me that they plan on releasing more hdf5 datasets / files with their next release in September. Let's hope for the best!

biphasic avatar Jun 23 '22 13:06 biphasic

closing as we now have https://github.com/neuromorphs/tonic/issues/231 and https://github.com/neuromorphs/tonic/issues/230

biphasic avatar Dec 27 '22 09:12 biphasic