[Datasets] Create Dataset download component.

Open cweill opened this issue 5 years ago • 1 comments

We need a way for TFDS to lazily download and prepare datasets, so that it only runs at pipeline execution time instead of during DAG construction time.

Jun 26 '20 02:06 cweill

Do you think we still need this? We can change the TFDS data_dir (e.g. https://github.com/googleinterns/nitroml/blob/nitroml_cloud/examples/titanic_benchmark.py#L50)

Jun 27 '20 02:06 nikhil-dce