problem with ubuntu 13.10

[merira]

Hey there, I've been using your downloader for almost a year now and never had a problem. However, since I updated to ubuntu 13.10, it will no longer transmit tcx files to garmin connect. The trouble is that there is no error message. any idea where I could start looking for a problem?

[braiden]

It is pulling data from the watch, but not uploading? Check that tcx files exist in ~/.antd/[device serial number]/tcx.

Make sure its enabled uploading in configuration;

~/.antd/antd.cfg should have; [antd.connect] enabled=True username=... password=...

Then, make sure your device has a little data read for download, and run;

ant-downloader --verbose > log.txt 2>&1

You can send me the log, [braiden] at [braiden.org]. I'll take a look.

On Tue, Feb 11, 2014 at 7:53 AM, merira [email protected] wrote:

Hey there, I've been using your downloader for almost a year now and never had a problem. However, since I updated to ubuntu 13.10, it will no longer transmit tcx files to garmin connect. The trouble is that there is no error message. any idea where I could start looking for a problem?

Reply to this email directly or view it on GitHubhttps://github.com/braiden/python-ant-downloader/issues/51 .

[oliverkurth]

I have the same problem. I don't think it's related to Ubuntu - I use 3 different computers (all running Ubuntu 12.04) to upload my data, and I have that problem with at least 2 of them for a few days now. The tcx file is correctly downloaded from the watch. I don't see any error message. I can upload the tcx file to garmin manually. I guess that something has changed at the garmin site.

I will use the --verbose option next time (hopefully tomorrow) and send the log.

[merira]

Your site seems to be down.

Everything's fine, in fact. TCX are there, it says it' uploading.

Now I got this message once:

[MainThread] 2014-02-11 23:14:46,972 WARNING Failed to uplaod to Garmin Connect. Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/antd/connect.py", line 79, in data_available self.upload(format, file) File "/usr/local/lib/python2.7/dist-packages/antd/connect.py", line 126, in upload self.opener.open(request) File "/usr/lib/python2.7/urllib2.py", line 404, in open response = self._open(req, data) File "/usr/lib/python2.7/urllib2.py", line 422, in _open '_open', req) File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain result = func(*args) File "/usr/local/lib/python2.7/dist-packages/poster/streaminghttp.py", line 142, in http_open return self.do_open(StreamingHTTPConnection, req) File "/usr/lib/python2.7/urllib2.py", line 1184, in do_open raise URLError(err) URLError: <urlopen error [Errno 32] Broken pipe>

[dlotton]

FYI, My project (Garmin Connect Python Uploader) has recently received some complaints about upload problems as well. I haven't had a chance to look into it yet, but I'm wondering if Garmin has changed their API.

https://sourceforge.net/p/gcpuploader/discussion/general/thread/a7375183/?limit=25#8da2/438f

[oliverkurth]

Okay, I just downloaded from the watch, using the --verbose option. This is at the end (I don't think the previous output is interesting, but let me know if you need it):

[MainThread] 2014-02-12 17:43:07,456 INFO tcx: writing 20140212-174242.raw -> /home/okurth/.antd/0xe5b775e8/tcx/20140213-003000.tcx. [MainThread] 2014-02-12 17:43:07,535 DEBUG Fetching cookies from Garmin Connect. [MainThread] 2014-02-12 17:43:08,049 DEBUG Posting login credentials to Garmin Connect. username=okurth [MainThread] 2014-02-12 17:43:10,863 DEBUG Checking if login was successful. [MainThread] 2014-02-12 17:43:11,058 INFO Uploading /home/okurth/.antd/0xe5b775e8/tcx/20140213-003000.tcx to Garmin Connect. [MainThread] 2014-02-12 17:43:12,159 DEBUG SEND: a4094f004403000000000000a5 [MainThread] 2014-02-12 17:43:12,160 DEBUG Executing Command. RESET_SYSTEM() [MainThread] 2014-02-12 17:43:12,160 DEBUG SEND: a4014a00ef [Thread-1] 2014-02-12 17:43:12,162 DEBUG RECV: a4016f20ea [Thread-1] 2014-02-12 17:43:12,162 DEBUG Processing reply. STARTUP_MESSAGE(startup_message=32)

[braiden]

Thanks, I see the same issue too. As suggested, Garmin may have changed something. I'll investigate.

On Wed, Feb 12, 2014 at 8:46 PM, oliverkurth [email protected]:

Okay, I just downloaded from the watch, using the --verbose option. This is at the end (I don't think the previous output is interesting, but let me know if you need it):

[MainThread] 2014-02-12 17:43:07,456 INFO tcx: writing 20140212-174242.raw -> /home/okurth/.antd/0xe5b775e8/tcx/20140213-003000.tcx. [MainThread] 2014-02-12 17:43:07,535 DEBUG Fetching cookies from Garmin Connect. [MainThread] 2014-02-12 17:43:08,049 DEBUG Posting login credentials to Garmin Connect. username=okurth [MainThread] 2014-02-12 17:43:10,863 DEBUG Checking if login was successful. [MainThread] 2014-02-12 17:43:11,058 INFO Uploading /home/okurth/.antd/0xe5b775e8/tcx/20140213-003000.tcx to Garmin Connect. [MainThread] 2014-02-12 17:43:12,159 DEBUG SEND: a4094f004403000000000000a5 [MainThread] 2014-02-12 17:43:12,160 DEBUG Executing Command. RESET_SYSTEM() [MainThread] 2014-02-12 17:43:12,160 DEBUG SEND: a4014a00ef [Thread-1] 2014-02-12 17:43:12,162 DEBUG RECV: a4016f20ea [Thread-1] 2014-02-12 17:43:12,162 DEBUG Processing reply. STARTUP_MESSAGE(startup_message=32)

Reply to this email directly or view it on GitHubhttps://github.com/braiden/python-ant-downloader/issues/51#issuecomment-34940236 .

[braiden]

I think I've found the cause of the issue and fixed. Grab latest version of code and let me know if you have issues (I also added better logging of response received from garmin.).

@dlotton In case your uploader is affected by the same bug here was issue:

--602cc69be5714babbb2b665dbdc1f9e4
Content-Disposition: form-data; name="data"; filename="20140211-165601.tcx"
Content-Type: text/plain; charset=utf-8

The "filename" attribute must not include a path component or garmin connect replies with an error something like "unsupported file type". I was using python "poster" library which adds a filename path by default.

[dlotton]

Thanks for the heads-up. I was just looking into this, myself. I'll look at the filename.

[dlotton]

Hmmm, well, my filename looks fine...

Content-Disposition: form-data; name="data"; filename="2014-02-15_20-45-03_4_117.fit" Content-Type: application/octet-stream

I've tied a TCX file as well.

I'm kind of stumped with this. I've done a capture of the web form upload and one from my program trying to upload the same file. I'm not seeing the issue in the form data or anything. Some of my parameters are different (such as User-Agent), and some parameters are in different order, but I don't think that should matter.

Do you have a complete capture of your POST transaction you could share?

[edit] btw, I'm also getting a complaint about an unsupported file type.

[braiden]

https://gist.github.com/braiden/ef841d3728d104a0fb0c is a sample of my successful upload except that I redacted Cookie headers.

[dlotton]

Braiden,

Thanks for the POST transaction. It was helpful. Between your capture above and a capture of the web form I figured it out.

In the multi-part form post I was putting the 'responseContentType' part before the 'filename' part of my post. This worked fine for over two years and now suddenly changed. It seems like they are now parsing the parts of he multi-part post by their position in the stream instead of looking at the name of the data field. I'm a total hack programmer, but this seems like a supremely bad idea, even to me.

Thanks again.

Dave L.

[merira]

hmm, thanks for the efforts, but I have still not been able to upload. here's the end of my output:

[MainThread] 2014-02-17 20:18:56,857 WARNING Username mismatch, probably OK, if upload fails check user/pass. Merira != pseudo [MainThread] 2014-02-17 20:18:56,902 INFO Uploading /home/emiliano/.antd/0xe4d0161d/tcx/20130920-062425.tcx to Garmin Connect. [MainThread] 2014-02-17 20:18:57,384 ERROR Failed to upload to garmin connect. Message follows: [MainThread] 2014-02-17 20:18:57,384 ERROR {u'detailedImportResult': {u'successes': [], u'fileName': u'20130920-062425.tcx', u'processingTime': 118, u'report': None, u'uploadId': u'', u'fileSize': 6354, u'owner': 4548472, u'failures': [{u'messages': [{u'content': u'Duplicate Activity.', u'code': 202}], u'externalId': u'2013-09-20T06:24:25Z', u'internalId': 378343638}], u'creationDate': u'2014-02-17 19:18:57.267 GMT', u'ipAddress': u'192.168.18.45'}} [MainThread] 2014-02-17 20:18:57,384 WARNING Failed to uplaod to Garmin Connect. Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/antd/connect.py", line 79, in data_available self.upload(format, file) File "/usr/local/lib/python2.7/dist-packages/antd/connect.py", line 133, in upload raise GarminUploadFailure() GarminUploadFailure

2014-02-16 22:19 GMT+01:00 dlotton [email protected]:

Braiden,

Thanks for the POST transaction. It was helpful. Between your capture above and a capture of the web form I figured it out.

In the multi-part form post I was putting the 'responseContentType' part before the 'filename' part of my post. This worked fine for over two years and now suddenly changed. It seems like they are now parsing the parts of he multi-part post by their position in the stream instead of looking at the name of the data field. I'm a total hack programmer, but this seems like a supremely bad idea, even to me.

Thanks again.

Dave L.

Reply to this email directly or view it on GitHubhttps://github.com/braiden/python-ant-downloader/issues/51#issuecomment-35212937 .

[dlotton]

u'failures': [{u'messages': [{u'content': u'Duplicate Activity.', u'code': 202}]

Merira, The above excerpt from your output suggests that the activity already exists on Garmin Connect (note: Duplicate Activity). In other words, it looks like it has already been uploaded.

[braiden]

Its failing to upload a file 20130920-062425.tcx because Garmin claims a file with that name was already uploaded. Since this is an old file (2013) maybe it was previously uploaded, or you manually uploaded?

You may need to manually remove this file from queue of pending uploads. Just deleted file below to clear all pending uploads. You can also edit the txt file and remove only failing files.

~/.antd/garmin-connect-upload-queue.txt

Actually, I need to clean this up. Did you 'force all downloads' from the watch to try to sync up with garmin connect? The issue with this use case is I given up uploading after the first failure. I'll update code to keep trying more files even if the first on fails.

On Mon, Feb 17, 2014 at 2:27 PM, dlotton [email protected] wrote:

u'failures': [{u'messages': [{u'content': u'Duplicate Activity.', u'code': 202}]

Merira, The above excerpt from your output suggests that the activity already exists on Garmin Connect (note: Duplicate Activity).

Reply to this email directly or view it on GitHubhttps://github.com/braiden/python-ant-downloader/issues/51#issuecomment-35315073 .

[merira]

Yep, I did use the force-send option. Thanks. Will do that. Le 17 févr. 2014 20:36, "Braiden Kindt" [email protected] a écrit :

Its failing to upload a file 20130920-062425.tcx because Garmin claims a file with that name was already uploaded. Since this is an old file (2013) maybe it was previously uploaded, or you manually uploaded?

You may need to manually remove this file from queue of pending uploads. Just deleted file below to clear all pending uploads. You can also edit the txt file and remove only failing files.

~/.antd/garmin-connect-upload-queue.txt

Actually, I need to clean this up. Did you 'force all downloads' from the watch to try to sync up with garmin connect? The issue with this use case is I given up uploading after the first failure. I'll update code to keep trying more files even if the first on fails.

On Mon, Feb 17, 2014 at 2:27 PM, dlotton [email protected] wrote:

u'failures': [{u'messages': [{u'content': u'Duplicate Activity.', u'code': 202}]

Merira, The above excerpt from your output suggests that the activity already exists on Garmin Connect (note: Duplicate Activity).

Reply to this email directly or view it on GitHub< https://github.com/braiden/python-ant-downloader/issues/51#issuecomment-35315073

.

Reply to this email directly or view it on GitHubhttps://github.com/braiden/python-ant-downloader/issues/51#issuecomment-35315737 .

[mehrar]

Just to confirm the tip of repo works for me. I was able to upload TCXs previously collected using an old version of ant-downloader to Garmin Connect using the tip of the tree build.