TypeError: '>' not supported between instances of 'str' and 'int'

[PeterouZh]

I encountered this error when I tried to execute the training script. The line of code that caused the exception is seen here url. I am looking forward to your help.

Below is the detailed error message：

/home/shhs/anaconda3/envs/torch_1_0_py3_6/bin/python /home.bak/shhs/soft/pycharm-2019.1.1/helpers/pydev/pydevd.py --multiproc --qt-support=auto --client 127.0.0.1 --port 46783 --file /media/shhs/Peterou2/user/code/HomoInterpGAN/run.py attribute_manipulation -bs 8 -gpu 0 pydev debugger: process 6843 is connecting

Connected to pydev debugger (build 191.6605.12) loading default VGG

• Total Images: 162770 Traceback (most recent call last): File "/home.bak/shhs/soft/pycharm-2019.1.1/helpers/pydev/pydevd.py", line 1741, in main() File "/home.bak/shhs/soft/pycharm-2019.1.1/helpers/pydev/pydevd.py", line 1735, in main globals = debugger.run(setup['file'], None, None, is_module) File "/home.bak/shhs/soft/pycharm-2019.1.1/helpers/pydev/pydevd.py", line 1135, in run pydev_imports.execfile(file, globals, locals) # execute the script File "/home.bak/shhs/soft/pycharm-2019.1.1/helpers/pydev/_pydev_imps/_pydev_execfile.py", line 18, in execfile exec(compile(contents+"\n", file, 'exec'), glob, loc) File "/media/shhs/Peterou2/user/code/HomoInterpGAN/run.py", line 205, in engine.run() File "/media/shhs/Peterou2/user/code/HomoInterpGAN/run.py", line 200, in run exec ('self.{}()'.format(self.args.command)) File "", line 1, in File "/media/shhs/Peterou2/user/code/HomoInterpGAN/run.py", line 161, in attribute_manipulation _, test_dataset = self.load_dataset() File "/media/shhs/Peterou2/user/code/HomoInterpGAN/run.py", line 106, in load_dataset csv_path='info/celeba-with-orientation.csv') File "/media/shhs/Peterou2/user/code/HomoInterpGAN/data/attributeDataset.py", line 220, in init f3 = self.frame.iloc[:, 1:] > 0 File "/home/shhs/anaconda3/envs/torch_1_0_py3_6/lib/python3.6/site-packages/pandas/core/ops.py", line 2108, in f res = self._combine_const(other, func) File "/home/shhs/anaconda3/envs/torch_1_0_py3_6/lib/python3.6/site-packages/pandas/core/frame.py", line 5120, in _combine_const return ops.dispatch_to_series(self, other, func) File "/home/shhs/anaconda3/envs/torch_1_0_py3_6/lib/python3.6/site-packages/pandas/core/ops.py", line 1157, in dispatch_to_series new_data = expressions.evaluate(column_op, str_rep, left, right) File "/home/shhs/anaconda3/envs/torch_1_0_py3_6/lib/python3.6/site-packages/pandas/core/computation/expressions.py", line 208, in evaluate return _evaluate(op, op_str, a, b, **eval_kwargs) File "/home/shhs/anaconda3/envs/torch_1_0_py3_6/lib/python3.6/site-packages/pandas/core/computation/expressions.py", line 68, in _evaluate_standard return op(a, b) File "/home/shhs/anaconda3/envs/torch_1_0_py3_6/lib/python3.6/site-packages/pandas/core/ops.py", line 1128, in column_op for i in range(len(a.columns))} File "/home/shhs/anaconda3/envs/torch_1_0_py3_6/lib/python3.6/site-packages/pandas/core/ops.py", line 1128, in for i in range(len(a.columns))} File "/home/shhs/anaconda3/envs/torch_1_0_py3_6/lib/python3.6/site-packages/pandas/core/ops.py", line 1766, in wrapper res = na_op(values, other) File "/home/shhs/anaconda3/envs/torch_1_0_py3_6/lib/python3.6/site-packages/pandas/core/ops.py", line 1625, in na_op result = _comp_method_OBJECT_ARRAY(op, x, y) File "/home/shhs/anaconda3/envs/torch_1_0_py3_6/lib/python3.6/site-packages/pandas/core/ops.py", line 1603, in _comp_method_OBJECT_ARRAY result = libops.scalar_compare(x, y, op) File "pandas/_libs/ops.pyx", line 97, in pandas._libs.ops.scalar_compare TypeError: '>' not supported between instances of 'str' and 'int'

[yingcong]

Hi @PeterouZh, I think the reason might be that f3 parse "-1" as string instead of int. Can you try to replace that line with f3 = self.frame.replace(-1, 0) or f3 = self.frame.replace("-1", 0)? Please let me know whether it works or not.

[oscardhc]

Hi @yingcong , I'm facing the same problem, and I tried your method to solve it. But after change that line, it keeps run time error at the start of training(showing "stack overflow") Then follows lots of lines of "***********/data/attributeDataset.py", line 244 in __getitem__" Here's some first lines of the error message.

loading default VGG
loading default VGG
loading default VGG
* Total Images: 162770
* Total Images: 19962
save_dir: checkpoints/CelebA_my
n_discrim: 5
command: train
gpu: 0
batch_size: 128
data_dir: ../celebra-dataset
attr: Mouth_Slightly_Open@Smiling,Male@No_Beard@Mustache@Goatee@Sideburns,Black_Hair@Blond_Hair@Brown_Hair@Gray_Hair,Bald@Receding_Hairline@Bangs,Young
dec_type: v1
continue_train: False
epoch: 10000

  0%|                                                                                                                                                                        | 0/1271 [00:00<?, ?it/s]Fatal Python error: Cannot recover from stack overflow.

Current thread 0x00007f8675a0b740 (most recent call first):
  File "/....../HomoInterpGAN/util/util.py", line 144 in readRGB
  File "/....../HomoInterpGAN/data/attributeDataset.py", line 244 in __getitem__
  File "/....../HomoInterpGAN/data/attributeDataset.py", line 266 in __getitem__
  File "/....../HomoInterpGAN/data/attributeDataset.py", line 266 in __getitem__
  File "/....../HomoInterpGAN/data/attributeDataset.py", line 266 in __getitem__
  File "/....../HomoInterpGAN/data/attributeDataset.py", line 266 in __getitem__
......

I'm using pytorch 1.0.1 with cuda 9.1, other modules are installed as requirement.txt I'm looking forward to your help, thanks!

[yingcong]

Hi @oscardhc It seems that images are not successfully loaded with getitem. Have you checked if the celeba images (jpg format) are in the ../celebra-dataset file? If yes, could you remove the "try -- except" block in the getitem method? This could give more information about why images cannot be loaded.

[oscardhc]

@yingcong Thank you for the advice! It turns out that I've put all images in a subdirectory in the dataset path(as the default result of unzipping). After moving the images, your solutions above work and it starts to train.

[PeterouZh]

I fix this issue by replacing "f3 = self.frame.iloc[:, 1:] > 0" url with "f3 = self.frame.iloc[:, 3:-1] > 0".

[yingcong]

Hi @PeterouZh I've replaced f3 = self.frame.iloc[:, 1:] > 0 with f3 = self.frame.replace(-1, 0) in the later commit, which seems more general for different pandas versions.