automl-gs icon indicating copy to clipboard operation
automl-gs copied to clipboard

FileNotFoundError

Open mahesh1amour opened this issue 5 years ago • 4 comments

          from automl_gs import automl_grid_search
          automl_grid_search('Housing.csv','price')

Solving a regression problem, minimizing mse using tensorflow. Modeling with field specifications: area: numeric bedrooms: numeric bathrooms: categorical stories: categorical mainroad: categorical guestroom: categorical basement: categorical hotwaterheating: categorical airconditioning: categorical parking: categorical prefarea: categorical furnishingstatus: categorical

0% 0/100 [00:00<?, ?trial/s] 0% 0/20 [00:00<?, ?epoch/s]

FileNotFoundError Traceback (most recent call last) in 1 from automl_gs import automl_grid_search ----> 2 automl_grid_search('Housing.csv','price')

~/.local/lib/python3.6/site-packages/automl_gs/automl_gs.py in automl_grid_search(csv_path, target_field, target_metric, framework, model_name, context, num_trials, split, num_epochs, col_types, gpu, tpu_address) 85 # and append to the metrics CSV. 86 results = pd.read_csv(os.path.join(train_folder, ---> 87 "metadata", "results.csv")) 88 results = results.assign(**params) 89 results.insert(0, 'trial_id', uuid.uuid4())

~/.local/lib/python3.6/site-packages/pandas/io/parsers.py in parser_f(filepath_or_buffer, sep, delimiter, header, names, index_col, usecols, squeeze, prefix, mangle_dupe_cols, dtype, engine, converters, true_values, false_values, skipinitialspace, skiprows, skipfooter, nrows, na_values, keep_default_na, na_filter, verbose, skip_blank_lines, parse_dates, infer_datetime_format, keep_date_col, date_parser, dayfirst, iterator, chunksize, compression, thousands, decimal, lineterminator, quotechar, quoting, doublequote, escapechar, comment, encoding, dialect, tupleize_cols, error_bad_lines, warn_bad_lines, delim_whitespace, low_memory, memory_map, float_precision) 700 skip_blank_lines=skip_blank_lines) 701 --> 702 return _read(filepath_or_buffer, kwds) 703 704 parser_f.name = name

~/.local/lib/python3.6/site-packages/pandas/io/parsers.py in _read(filepath_or_buffer, kwds) 427 428 # Create the parser. --> 429 parser = TextFileReader(filepath_or_buffer, **kwds) 430 431 if chunksize or iterator:

~/.local/lib/python3.6/site-packages/pandas/io/parsers.py in init(self, f, engine, **kwds) 893 self.options['has_index_names'] = kwds['has_index_names'] 894 --> 895 self._make_engine(self.engine) 896 897 def close(self):

~/.local/lib/python3.6/site-packages/pandas/io/parsers.py in _make_engine(self, engine) 1120 def _make_engine(self, engine='c'): 1121 if engine == 'c': -> 1122 self._engine = CParserWrapper(self.f, **self.options) 1123 else: 1124 if engine == 'python':

~/.local/lib/python3.6/site-packages/pandas/io/parsers.py in init(self, src, **kwds) 1851 kwds['usecols'] = self.usecols 1852 -> 1853 self._reader = parsers.TextReader(src, **kwds) 1854 self.unnamed_cols = self._reader.unnamed_cols 1855

pandas/_libs/parsers.pyx in pandas._libs.parsers.TextReader.cinit()

pandas/_libs/parsers.pyx in pandas._libs.parsers.TextReader._setup_parser_source()

FileNotFoundError: [Errno 2] File b'automl_train/metadata/results.csv' does not exist: b'automl_train/metadata/results.csv'

mahesh1amour avatar Mar 27 '19 16:03 mahesh1amour

Same error here occurring on multiple machines. I should note that after running into this error on a first trial with Google Collab, I re-ran the code and it worked.

archaeocharlie avatar Mar 28 '19 15:03 archaeocharlie

Same error here, re-run didn't work for me

jaymanjunath avatar Mar 28 '19 17:03 jaymanjunath

Tip: this may be happening because the training subprocess is crashing; if so, Jupyter/ipython/colab won't show exceptions from that because it's being run in a separate process.

If you run automl_gs on the command line, you should see the exception from the model.py subprocess (in addition to this exception), which might give you more insight into what's breaking.

evan-burke avatar Mar 31 '19 20:03 evan-burke

Like @evan-burke said, this can happen when a subprocess crashes. Running from the command line is one option, but I was also able to see the error by looking at my Jupyter log.

(In my case the problem was automl-gs using the wrong Python version (see #26). Once I corrected that, I ran into a MemoryError.)

harvitronix avatar Jun 05 '19 17:06 harvitronix