BinaryNet.tf icon indicating copy to clipboard operation
BinaryNet.tf copied to clipboard

OutOfRangeError (see above for traceback): FIFOQueue '_1_data/batch/fifo_queue' is closed and has insufficient elements (requested 128, current size 0)

Open Viscoo opened this issue 6 years ago • 2 comments

"D:\Program Files\Anaconda3\python.exe" E:/Master/Project/图像压缩/github/BinaryNet.tf-master/main.py I c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\stream_executor\dso_loader.cc:135] successfully opened CUDA library cublas64_80.dll locally I c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\stream_executor\dso_loader.cc:135] successfully opened CUDA library cudnn64_5.dll locally I c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\stream_executor\dso_loader.cc:135] successfully opened CUDA library cufft64_80.dll locally I c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\stream_executor\dso_loader.cc:135] successfully opened CUDA library nvcuda.dll locally I c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\stream_executor\dso_loader.cc:135] successfully opened CUDA library curand64_80.dll locally E c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:943] OpKernel ('op: "BestSplits" device_type: "CPU"') for unknown op: BestSplits E c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:943] OpKernel ('op: "CountExtremelyRandomStats" device_type: "CPU"') for unknown op: CountExtremelyRandomStats E c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:943] OpKernel ('op: "FinishedNodes" device_type: "CPU"') for unknown op: FinishedNodes E c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:943] OpKernel ('op: "GrowTree" device_type: "CPU"') for unknown op: GrowTree E c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:943] OpKernel ('op: "ReinterpretStringToFloat" device_type: "CPU"') for unknown op: ReinterpretStringToFloat E c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:943] OpKernel ('op: "SampleInputs" device_type: "CPU"') for unknown op: SampleInputs E c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:943] OpKernel ('op: "ScatterAddNdim" device_type: "CPU"') for unknown op: ScatterAddNdim E c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:943] OpKernel ('op: "TopNInsert" device_type: "CPU"') for unknown op: TopNInsert E c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:943] OpKernel ('op: "TopNRemove" device_type: "CPU"') for unknown op: TopNRemove E c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:943] OpKernel ('op: "TreePredictions" device_type: "CPU"') for unknown op: TreePredictions E c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:943] OpKernel ('op: "UpdateFertileSlots" device_type: "CPU"') for unknown op: UpdateFertileSlots WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) WARNING:tensorflow:tf.variable_op_scope(values, name, default_name) is deprecated, use tf.variable_scope(name, default_name, values) I c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\common_runtime\gpu\gpu_device.cc:885] Found device 0 with properties: name: GeForce GTX 1050 Ti major: 6 minor: 1 memoryClockRate (GHz) 1.392 pciBusID 0000:01:00.0 Total memory: 4.00GiB Free memory: 3.47GiB I c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\common_runtime\gpu\gpu_device.cc:906] DMA: 0 I c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\common_runtime\gpu\gpu_device.cc:916] 0: Y I c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\common_runtime\gpu\gpu_device.cc:975] Creating TensorFlow device (/gpu:0) -> (device: 0, name: GeForce GTX 1050 Ti, pci bus id: 0000:01:00.0) WARNING:tensorflow:From E:/Master/Project/图像压缩/github/BinaryNet.tf-master/main.py:160: initialize_all_variables (from tensorflow.python.ops.variables) is deprecated and will be removed after 2017-03-02. Instructions for updating: Use tf.global_variables_initializer instead. num of trainable paramaters: 10355860 Started epoch 1 W c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:993] Out of range: FIFOQueue '_1_data/batch/fifo_queue' is closed and has insufficient elements (requested 128, current size 0) [[Node: data/batch = QueueDequeueManyV2[component_types=[DT_FLOAT, DT_INT32], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](data/batch/fifo_queue, data/batch/n)]] W c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:993] Out of range: FIFOQueue '_1_data/batch/fifo_queue' is closed and has insufficient elements (requested 128, current size 0) [[Node: data/batch = QueueDequeueManyV2[component_types=[DT_FLOAT, DT_INT32], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](data/batch/fifo_queue, data/batch/n)]] W c:\tf_jenkins\home\workspace\release-win\device\gpu\os\windows\tensorflow\core\framework\op_kernel.cc:993] Out of range: FIFOQueue '_1_data/batch/fifo_queue' is closed and has insufficient elements (requested 128, current size 0) [[Node: data/batch = QueueDequeueManyV2[component_types=[DT_FLOAT, DT_INT32], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](data/batch/fifo_queue, data/batch/n)]] Traceback (most recent call last): File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1022, in _do_call return fn(*args) File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1004, in _run_fn status, run_metadata) File "D:\Program Files\Anaconda3\lib\contextlib.py", line 66, in exit next(self.gen) File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\framework\errors_impl.py", line 466, in raise_exception_on_not_ok_status pywrap_tensorflow.TF_GetCode(status)) tensorflow.python.framework.errors_impl.OutOfRangeError: FIFOQueue '_1_data/batch/fifo_queue' is closed and has insufficient elements (requested 128, current size 0) [[Node: data/batch = QueueDequeueManyV2[component_types=[DT_FLOAT, DT_INT32], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](data/batch/fifo_queue, data/batch/n)]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "E:/Master/Project/图像压缩/github/BinaryNet.tf-master/main.py", line 235, in tf.app.run() File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\platform\app.py", line 44, in run _sys.exit(main(_sys.argv[:1] + flags_passthrough)) File "E:/Master/Project/图像压缩/github/BinaryNet.tf-master/main.py", line 231, in main num_epochs=FLAGS.num_epochs) File "E:/Master/Project/图像压缩/github/BinaryNet.tf-master/main.py", line 183, in train _, loss_val = sess.run([train_op, loss]) File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 767, in run run_metadata_ptr) File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 965, in _run feed_dict_string, options, run_metadata) File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1015, in _do_run target_list, options, run_metadata) File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1035, in _do_call raise type(e)(node_def, op, message) tensorflow.python.framework.errors_impl.OutOfRangeError: FIFOQueue '_1_data/batch/fifo_queue' is closed and has insufficient elements (requested 128, current size 0) [[Node: data/batch = QueueDequeueManyV2[component_types=[DT_FLOAT, DT_INT32], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](data/batch/fifo_queue, data/batch/n)]]

Caused by op 'data/batch', defined at: File "E:/Master/Project/图像压缩/github/BinaryNet.tf-master/main.py", line 235, in tf.app.run() File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\platform\app.py", line 44, in run _sys.exit(main(_sys.argv[:1] + flags_passthrough)) File "E:/Master/Project/图像压缩/github/BinaryNet.tf-master/main.py", line 231, in main num_epochs=FLAGS.num_epochs) File "E:/Master/Project/图像压缩/github/BinaryNet.tf-master/main.py", line 98, in train x, yt = data.generate_batches(batch_size) File "E:\Master\Project\图像压缩\github\BinaryNet.tf-master\data.py", line 146, in generate_batches capacity=min_queue_examples + 3 * batch_size) File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\training\input.py", line 872, in batch name=name) File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\training\input.py", line 667, in _batch dequeued = queue.dequeue_many(batch_size, name=name) File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\ops\data_flow_ops.py", line 458, in dequeue_many self._queue_ref, n=n, component_types=self._dtypes, name=name) File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\ops\gen_data_flow_ops.py", line 1310, in _queue_dequeue_many_v2 timeout_ms=timeout_ms, name=name) File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\framework\op_def_library.py", line 763, in apply_op op_def=op_def) File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\framework\ops.py", line 2327, in create_op original_op=self._default_original_op, op_def=op_def) File "D:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\framework\ops.py", line 1226, in init self._traceback = _extract_stack()

OutOfRangeError (see above for traceback): FIFOQueue '_1_data/batch/fifo_queue' is closed and has insufficient elements (requested 128, current size 0) [[Node: data/batch = QueueDequeueManyV2[component_types=[DT_FLOAT, DT_INT32], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](data/batch/fifo_queue, data/batch/n)]]

I use Windows7 Tensorflow 1.0.1 I guess there is no "placeholder", but when I find your data, there is tensor type which can't feed in sess. but I can't solve the problem below. hoped reply!

Viscoo avatar Mar 13 '18 08:03 Viscoo

Did you changed the initializer?

ArchieGu avatar Mar 15 '18 02:03 ArchieGu

Yes, I have changed the initializer from tf.initialize_all_variables() to tf.global_variables_initializer(), but the same problem still exist. I also try update tensorflow to 1.2.1, there still raise error:


OutOfRangeError (see above for traceback): FIFOQueue '_1_data/batch/fifo_queue' is closed and has insufficient elements (requested 128, current size 0)
	 [[Node: data/batch = QueueDequeueManyV2[component_types=[DT_FLOAT, DT_INT32], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](data/batch/fifo_queue, data/batch/n)]]

Viscoo avatar Mar 30 '18 04:03 Viscoo