rhadar
rhadar
Most of the course is currently not compatible with Keras 2.0 api. I guess @jph00 and @racheltho need to decide whether they want to upgrade the first course to keras...
Well, i've tried it on 2 different machines and I am getting what I believe to be the same error. The weaker one has 16gig of ram and 960M (laptop)...
@danielvarga Thank you for sharing your experience. So you are saying that the most elegant solution is to ultimately port the code to tensorflow?
Thank you @xushiwei I acknowledge that this is a very big feature and as such it should be done right rather than right away :smiley: I believe if you took...
I've changed empty_files to false and attempted to copy the files. This does improve performance for a small amount of files. However for my practical pipeline, I'm talking gigabytes per...
The peculiar thing is that this also happens for 1.13.4. It takes me about 8 minutes to run the above symlink pipeline on 1.13.4 with only 50 generated files. I...
Thank you @BOsterbuhr, will give it a retest and report back.
I did test this with 2.1.7 on azure. And I even simplified this somewhat to test more general shuffle pipelines. In my simplified pipeline I take x inputs and map...
Here is the updated mock to reproduce this: data generation code: ``` for i in range(1,50000): with open('./data/' + str(i) + '.json','w') as fp: fp.write(str(i)) ``` pipeline code's main.py: ```...
just a question. why are you removing this functionality? it was a big upgrade to Pachyderm