pyulog icon indicating copy to clipboard operation
pyulog copied to clipboard

Need help with updated ULG file format error

Open RobPritt opened this issue 10 months ago • 12 comments

Hi, I have been using your ULG2CSV to convert a drone's ULG file to CSV. However they apparently did something to their ULG files in latest drone update and ULG2CSV now chokes on them and throws an error along the lines of UnicodeDecodeError: 'utf-8' codec can't decode byte 0xff in position 9: invalid start byte The location varies for each ulg file.. I had previously been able to convert dozens of their ULG files without a problem. Would you be willing to take a look at the ULG files if I send them to you?

RobPritt avatar Feb 09 '25 23:02 RobPritt

Can you try with ulog2csv -i <file.ulg>. This makes it ignore string parsing exceptions.

bkueng avatar Feb 11 '25 08:02 bkueng

Thankyou. That worked. I added “-i” to my current line..

ulog2csv -i <file.ulg> –o

Would you like me to send you some ULG files with the error to debug? I would be worried that ignoring certain things will cause loss of some data.

Rob From: Beat Küng Sent: Tuesday, February 11, 2025 12:16 AM To: PX4/pyulog Cc: RobPritt ; Author Subject: Re: [PX4/pyulog] Need help with updated ULG file format error (Issue #107)

Can you try with ulog2csv -i <file.ulg>. This makes it ignore string parsing exceptions.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

RobPritt avatar Feb 11 '25 17:02 RobPritt

Yes I can have a look. I agree with you, that's why the flag is not set by default. There's one case where I've seen this happen without there being a memory corruption. It's when the NuttX boot console outputs some special characters (which end up in the log).

bkueng avatar Feb 12 '25 07:02 bkueng

Did you get my ULG files OK?

Rob

From: Beat Küng Sent: Tuesday, February 11, 2025 11:19 PM To: PX4/pyulog Cc: RobPritt ; Author Subject: Re: [PX4/pyulog] Need help with updated ULG file format error (Issue #107)

Yes I can have a look. I agree with you, that's why the flag is not set by default. There's one case where I've seen this happen without there being a memory corruption. It's when the NuttX boot console outputs some special characters (which end up in the log).

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

RobPritt avatar Feb 13 '25 19:02 RobPritt

No, I did not see anything

bkueng avatar Feb 14 '25 07:02 bkueng

I sent you three emails. each with one or two ULG file attached due to size limitations. Maybe they got stuck in your email spam filter. I will re-send them next in a Zip file or my Google Drive.

Rob

From: Beat Küng Sent: Thursday, February 13, 2025 11:01 PM To: PX4/pyulog Cc: RobPritt ; Author Subject: Re: [PX4/pyulog] Need help with updated ULG file format error (Issue #107)

No, I did not see anything

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***> bkueng left a comment (PX4/pyulog#107) No, I did not see anything

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

RobPritt avatar Feb 14 '25 16:02 RobPritt

I sent you the ULG files last week. I was expecting to hear back from you.

RobPritt avatar Feb 19 '25 23:02 RobPritt

Sorry I did not receive anything, I also checked the spam folder. Can you PM me on PX4 discord?

bkueng avatar Feb 20 '25 06:02 bkueng

I have no idea what PX4 discord is.

I emailed you several times. Shouldn’t have to be so difficult!

From: Beat Küng Sent: Wednesday, February 19, 2025 10:39 PM To: PX4/pyulog Cc: RobPritt ; Author Subject: Re: [PX4/pyulog] Need help with updated ULG file format error (Issue #107)

Sorry I did not receive anything, I also checked the spam folder. Can you PM me on PX4 discord?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***> bkueng left a comment (PX4/pyulog#107) Sorry I did not receive anything, I also checked the spam folder. Can you PM me on PX4 discord?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

RobPritt avatar Feb 20 '25 19:02 RobPritt

I'm open to other suggestions.

bkueng avatar Feb 25 '25 09:02 bkueng

Can you provide me with a different email address to send them to?

From: Beat Küng Sent: Tuesday, February 25, 2025 1:30 AM To: PX4/pyulog Cc: RobPritt ; Author Subject: Re: [PX4/pyulog] Need help with updated ULG file format error (Issue #107)

I'm open to other suggestions.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***> bkueng left a comment (PX4/pyulog#107) I'm open to other suggestions.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

RobPritt avatar Feb 25 '25 16:02 RobPritt

Yes, beat [@] px4.io

bkueng avatar Feb 26 '25 07:02 bkueng