functa icon indicating copy to clipboard operation
functa copied to clipboard

Question about building the tfds

Open Jason-Chi-xx opened this issue 1 year ago • 3 comments

I have a question in building the new tfds. For example, the command "cd celeb_a_hq_custom ” “tfds build --register_checksums" are to setup celeb_a_hq_custom dataset as tfds. However, when I run the test_celeb_a_hq.py, it just threw out the error : "tensorflow_datasets.core.load.DatasetNotFoundError: Dataset celeb_a_hq_custom not found." Why did celeb_a_hq_custom fail to be added as the new tfds?

Jason-Chi-xx avatar Jun 01 '23 14:06 Jason-Chi-xx

Apologies for the late reply. Hmm you shouldn't be seeing this error. I've just tried following the instructions from scratch in a new venv and the test runs fine for me. Have you tried deleting the celeb_a_hq_custom dataset (i.e. deleting the directory /{PARENT_PATH}/tensorflow_datasets/celeb_a_hq_custom - the PARENT_PATH can be found out by running tfds build --register_checksums in the celeb_a_hq_custom directory), and regenerating the dataset using tfds build --register_checksums, before running the test? When you try regenerating the dataset, let me know if you were able to successfully create the dataset i.e. whether you see the message:

Dataset celeb_a_hq_custom downloaded and prepared to /{PARENT_PATH}/tensorflow_datasets/celeb_a_hq_custom/1.0.0. Subsequent calls will reuse this data.
INFO[build.py]: Dataset generation complete...

If you do, then you should be able to run test_celeb_a_hq.py.

hyunjik11 avatar Jun 26 '23 23:06 hyunjik11

Hi! Hopping on to this issue, since I tried to reproduce your results based on your codebase, but experience issues with the tfds build --register_checksums command. It seems the link to the zip file on Google Drive is broken, do you know if the file was removed or did it move somewhere else? Thank you in advance!

Dieuwertje97 avatar Dec 08 '23 11:12 Dieuwertje97

Hi! Hopping on to this issue, since I tried to reproduce your results based on your codebase, but experience issues with the tfds build --register_checksums command. It seems the link to the zip file on Google Drive is broken, do you know if the file was removed or did it move somewhere else? Thank you in advance!

I've got the same issue, and I found that this Kaggle link provides the same files. Its naming convention of the directory looks the same as Functa's code. (data128x128). And I am able to make TFDS dataset through a bit of modification of the celeb_a_hq_custom.py code. I'm NOT an official author, so it may differ from the original one, but I hope this Kaggle data does not affect reproducibility.

Hyunmin-jasper-Cho avatar Jan 04 '24 02:01 Hyunmin-jasper-Cho