snakebite icon indicating copy to clipboard operation
snakebite copied to clipboard

Unexpected end-group tag

Open FlorianWilhelm opened this issue 7 years ago • 0 comments

I am running in the same end-group tag issue that was actually already filed in #99 and #190 which were closed but never solved. You'll find the debug output below. I am using hive-1.1.0+cdh5.6.0+377 and here is the output of pip list:

pip (8.1.2) protobuf (3.0.0) python-krbV (1.0.90) sasl (0.2.1) setuptools (26.1.1) six (1.10.0) snakebite (2.11.0) wheel (0.29.0)

Here is my actual script. I tried also different hadoop_version with no success.

client = Client("xxx.internal_hostname.so", 10000, use_trash=False, use_sasl=True, hdfs_namenode_principal='hive', use_datanode_hostname=True)

for x in client.ls(['/']): print x

Output after creating the client and calling ls:

DEBUG:snakebite.client:Created client for xxx.internal_hostname.so:10000 with trash=False and sasl=True DEBUG:snakebite.client:Trying to find path / DEBUG:snakebite.channel:############## CONNECTING ############## DEBUG:snakebite.channel:Sending: 68 72 70 63 (len: 4) DEBUG:snakebite.channel:Sending: 0a (len: 1) DEBUG:snakebite.channel:Sending: 00 (len: 1) DEBUG:snakebite.channel:Sending: df (len: 1) DEBUG:snakebite.channel:Sending: 00 00 00 0e (len: 4) DEBUG:snakebite.channel:Sending: 0a (len: 1) DEBUG:snakebite.channel:Sending: 08 02 10 00 18 41 22 00 28 01 (len: 10) DEBUG:snakebite.channel:Sending: 02 (len: 1) DEBUG:snakebite.channel:Sending: 10 01 (len: 2) DEBUG:snakebite.rpc_sasl:Send out:

state: NEGOTIATE

DEBUG:snakebite.channel:############## RECVING ############## DEBUG:snakebite.channel:############## PARSING ############## DEBUG:snakebite.channel:Payload class: <class 'snakebite.protobuf.RpcHeader_pb2.RpcSaslProto'> DEBUG:snakebite.channel:Bytes read: 4, total: 4 DEBUG:snakebite.channel:Total response length: 67108864 DEBUG:snakebite.channel:Bytes read: 4, total: 8 DEBUG:snakebite.channel:Delimited message length (pos 1): 18 DEBUG:snakebite.channel:Rewinding pos 7 with 3 places DEBUG:snakebite.channel:Reset buffer to pos 4 DEBUG:snakebite.channel:Bytes read: 15, total: 23 DEBUG:snakebite.channel:Delimited message bytes (18): 49 6e 76 61 6c 69 64 20 73 74 61 74 75 73 20 31 30 34 (len: 18) DEBUG:snakebite.channel:Header read 19 DEBUG:snakebite.channel:Closing socket Traceback (most recent call last): File "hdfs_access.py", line 9, in for x in client.ls(['/']): File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/snakebite/client.py", line 168, in ls recurse=recurse): File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/snakebite/client.py", line 1214, in _find_items fileinfo = self._get_file_info(path) File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/snakebite/client.py", line 1342, in _get_file_info return self.service.getFileInfo(request) File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/snakebite/service.py", line 40, in rpc = lambda request, service=self, method=method.name: service.call(service_stub_class.dict[method], request) File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/snakebite/service.py", line 46, in call return method(self.service, controller, request) File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/google/protobuf/service_reflection.py", line 267, in self._StubMethod(inst, method, rpc_controller, request, callback)) File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/google/protobuf/service_reflection.py", line 284, in _StubMethod method_descriptor.output_type._concrete_class, callback) File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/snakebite/channel.py", line 442, in CallMethod self.get_connection(self.host, self.port) File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/snakebite/channel.py", line 248, in get_connection sasl_connected = sasl.connect() File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/snakebite/rpc_sasl.py", line 98, in connect res = self._recv_sasl_message() File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/snakebite/rpc_sasl.py", line 79, in _recv_sasl_message sasl_response = self._trans.parse_response(bytestream, RpcSaslProto) File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/snakebite/channel.py", line 403, in parse_response header.ParseFromString(header_bytes) File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/google/protobuf/message.py", line 186, in ParseFromString self.MergeFromString(serialized) File "/media/home/fwilhelm/miniconda3/envs/snakebite/lib/python2.7/site-packages/google/protobuf/internal/python_message.py", line 842, in MergeFromString raise message_mod.DecodeError('Unexpected end-group tag.') google.protobuf.message.DecodeError: Unexpected end-group tag.

FlorianWilhelm avatar Sep 14 '16 07:09 FlorianWilhelm