automl-gs
automl-gs copied to clipboard
FileNotFoundError
from automl_gs import automl_grid_search
automl_grid_search('Housing.csv','price')
Solving a regression problem, minimizing mse using tensorflow. Modeling with field specifications: area: numeric bedrooms: numeric bathrooms: categorical stories: categorical mainroad: categorical guestroom: categorical basement: categorical hotwaterheating: categorical airconditioning: categorical parking: categorical prefarea: categorical furnishingstatus: categorical
0% 0/100 [00:00<?, ?trial/s] 0% 0/20 [00:00<?, ?epoch/s]
FileNotFoundError Traceback (most recent call last)
~/.local/lib/python3.6/site-packages/automl_gs/automl_gs.py in automl_grid_search(csv_path, target_field, target_metric, framework, model_name, context, num_trials, split, num_epochs, col_types, gpu, tpu_address) 85 # and append to the metrics CSV. 86 results = pd.read_csv(os.path.join(train_folder, ---> 87 "metadata", "results.csv")) 88 results = results.assign(**params) 89 results.insert(0, 'trial_id', uuid.uuid4())
~/.local/lib/python3.6/site-packages/pandas/io/parsers.py in parser_f(filepath_or_buffer, sep, delimiter, header, names, index_col, usecols, squeeze, prefix, mangle_dupe_cols, dtype, engine, converters, true_values, false_values, skipinitialspace, skiprows, skipfooter, nrows, na_values, keep_default_na, na_filter, verbose, skip_blank_lines, parse_dates, infer_datetime_format, keep_date_col, date_parser, dayfirst, iterator, chunksize, compression, thousands, decimal, lineterminator, quotechar, quoting, doublequote, escapechar, comment, encoding, dialect, tupleize_cols, error_bad_lines, warn_bad_lines, delim_whitespace, low_memory, memory_map, float_precision) 700 skip_blank_lines=skip_blank_lines) 701 --> 702 return _read(filepath_or_buffer, kwds) 703 704 parser_f.name = name
~/.local/lib/python3.6/site-packages/pandas/io/parsers.py in _read(filepath_or_buffer, kwds) 427 428 # Create the parser. --> 429 parser = TextFileReader(filepath_or_buffer, **kwds) 430 431 if chunksize or iterator:
~/.local/lib/python3.6/site-packages/pandas/io/parsers.py in init(self, f, engine, **kwds) 893 self.options['has_index_names'] = kwds['has_index_names'] 894 --> 895 self._make_engine(self.engine) 896 897 def close(self):
~/.local/lib/python3.6/site-packages/pandas/io/parsers.py in _make_engine(self, engine) 1120 def _make_engine(self, engine='c'): 1121 if engine == 'c': -> 1122 self._engine = CParserWrapper(self.f, **self.options) 1123 else: 1124 if engine == 'python':
~/.local/lib/python3.6/site-packages/pandas/io/parsers.py in init(self, src, **kwds) 1851 kwds['usecols'] = self.usecols 1852 -> 1853 self._reader = parsers.TextReader(src, **kwds) 1854 self.unnamed_cols = self._reader.unnamed_cols 1855
pandas/_libs/parsers.pyx in pandas._libs.parsers.TextReader.cinit()
pandas/_libs/parsers.pyx in pandas._libs.parsers.TextReader._setup_parser_source()
FileNotFoundError: [Errno 2] File b'automl_train/metadata/results.csv' does not exist: b'automl_train/metadata/results.csv'
Same error here occurring on multiple machines. I should note that after running into this error on a first trial with Google Collab, I re-ran the code and it worked.
Same error here, re-run didn't work for me
Tip: this may be happening because the training subprocess is crashing; if so, Jupyter/ipython/colab won't show exceptions from that because it's being run in a separate process.
If you run automl_gs on the command line, you should see the exception from the model.py subprocess (in addition to this exception), which might give you more insight into what's breaking.
Like @evan-burke said, this can happen when a subprocess crashes. Running from the command line is one option, but I was also able to see the error by looking at my Jupyter log.
(In my case the problem was automl-gs using the wrong Python version (see #26). Once I corrected that, I ran into a MemoryError.)