meteor-launchpad icon indicating copy to clipboard operation
meteor-launchpad copied to clipboard

Retrying Download despite finding the Meteor version

Open badmark opened this issue 7 years ago • 18 comments

Cannot get past the meteor download of the Docker image build. Unlike other issue, the version is being found, just not downloading; any ideas?

`node-v4.8.4-linux-x64/lib/node_modules/npm/node_modules/umask/.npmignore % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 7786 0 7786 0 0 44481 0 --:--:-- --:--:-- --:--:-- 44747 <--- Seems to suggest the download occured

... Installing Meteor 1.5.2.2

Downloading Meteor distribution Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... The command '/bin/sh -c cd $APP_SOURCE_DIR && $BUILD_SCRIPTS_DIR/install-deps.sh && $BUILD_SCRIPTS_DIR/install-node.sh && $BUILD_SCRIPTS_DIR/install-phantom.sh && $BUILD_SCRIPTS_DIR/install-graphicsmagick.sh && $BUILD_SCRIPTS_DIR/install-mongo.sh && $BUILD_SCRIPTS_DIR/install-meteor.sh && $BUILD_SCRIPTS_DIR/build-meteor.sh && $BUILD_SCRIPTS_DIR/post-build-cleanup.sh' returned a non-zero code: 1 `

badmark avatar Oct 04 '17 20:10 badmark

That's usually a network issue with either your local network or the Meteor CDN. Retrying the build usually fixes it. You can also try manually installing it within a test image to confirm it works

# hop into a fresh base image
docker run -it --rm --entrypoint bash jshimko/meteor-launchpad:latest

# install curl
apt-get update && apt-get install -y curl

# try to run the Meteor installer
curl https://install.meteor.com/ | sh

jshimko avatar Oct 06 '17 13:10 jshimko

root@367cd2bac007:/opt/meteor/dist/bundle# curl https://install.meteor.com/ | sh
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  7786    0  7786    0     0  31822      0 --:--:-- --:--:-- --:--:-- 31909
Downloading Meteor distribution
######################################################################## 100.0%

Meteor 1.5.2.2 has been installed in your home directory (~/.meteor).
Writing a launcher script to /usr/local/bin/meteor for your convenience.

To get started fast:

  $ meteor create ~/my_cool_app
  $ cd ~/my_cool_app
  $ meteor

Or see the docs at:

  docs.meteor.com

root@367cd2bac007:/opt/meteor/dist/bundle#

Works just fine, but when I build it with my app, I get the same error. No network issue as all of the apt commands run just fine. Have tried building on Ubuntu and Arch with exact same results on two distinct workstations.

When trying to create the image, this line:

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  7786    0  7786    0     0  30661      0 --:--:-- --:--:-- --:--:-- 30774

Just flashes by and then the Retrying message starts, as opposed to when I just ran the blank image it took about 3-4 seconds to download. I have this application working in a Node.JS docker container, but would prefer to use a Meteor based Docker image.

Could it have anything to do with environment $DEV_BUILD, which I am not setting? Any help in getting this worked out is greatly appreciated!

badmark avatar Oct 06 '17 13:10 badmark

No, DEV_BUILD is for caching Meteor in the image with the :devbuild tag (which makes a huge image).

So, I'm not sure what to recommend. I have several apps using Meteor 1.5.2.2 that are building fine. If you have a repo that can reliably reproduce the problem, I can give it a closer look. Otherwise, I'm not sure I have any better answers. Sorry.

jshimko avatar Oct 06 '17 13:10 jshimko

I do have a private GitLab repo which I would give you access if you'd be willing to give it a chance, it would be a great help as I feel this is one of the best Meteor Dockerfile's I've seen to date.

What I find odd is that everything works up until that point, i.e:

[-] Installing Node 4.8.4...

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 11.4M  100 11.4M    0     0  4986k      0  0:00:02  0:00:02 --:--:-- 4987k

Downloads just fine. I do use internal DNS servers, but I can't see that as an issue since everything else downloads just fine.

badmark avatar Oct 06 '17 14:10 badmark

If it's a gitlab.com repo, you should be able to invite my gitlab username (same as this one).

jshimko avatar Oct 06 '17 14:10 jshimko

Also, pull down the build I just created (v2.2.1 or the new :latest). I just added more verbose output to all curl commands, so maybe you'll get a better clue to what's going on.

jshimko avatar Oct 06 '17 14:10 jshimko

It's a self-hosted GitLab instance, send me your email and I'll setup an account. I truly appreciate it.

Don't see any extra error messages after pulling :latest - changed DNS servers to Google and still same issue, so I'm ruling out DNS.

badmark avatar Oct 06 '17 14:10 badmark

Now I see more output (pulling by version tag rather than latest), but nothing stands out to me as an error:

* Rebuilt URL to: https://install.meteor.com/
* Hostname was NOT found in DNS cache
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0*   Trying 52.72.166.246...
* Connected to install.meteor.com (52.72.166.246) port 443 (#0)
* successfully set certificate verify locations:
*   CAfile: none
  CApath: /etc/ssl/certs
* SSLv3, TLS handshake, Client hello (1):
} [data not shown]
* SSLv3, TLS handshake, Server hello (2):
{ [data not shown]
* SSLv3, TLS handshake, CERT (11):
{ [data not shown]
* SSLv3, TLS handshake, Server key exchange (12):
{ [data not shown]
* SSLv3, TLS handshake, Server finished (14):
{ [data not shown]
* SSLv3, TLS handshake, Client key exchange (16):
} [data not shown]
* SSLv3, TLS change cipher, Client hello (1):
} [data not shown]
* SSLv3, TLS handshake, Finished (20):
} [data not shown]
* SSLv3, TLS change cipher, Client hello (1):
{ [data not shown]
* SSLv3, TLS handshake, Finished (20):
{ [data not shown]
* SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256
* Server certificate:
* 	 subject: CN=install.meteor.com
* 	 start date: 2017-09-09 18:35:00 GMT
* 	 expire date: 2017-12-08 18:35:00 GMT
* 	 subjectAltName: install.meteor.com matched
* 	 issuer: C=US; O=Let's Encrypt; CN=Let's Encrypt Authority X3
* 	 SSL certificate verify ok.
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0> GET / HTTP/1.1
> User-Agent: curl/7.38.0
> Host: install.meteor.com
> Accept: */*
> 
< HTTP/1.1 200 OK
< Content-Type: text/plain
< Date: Fri, 06 Oct 2017 15:02:36 GMT
< Set-Cookie: galaxy-sticky=KYpdAvjMzhnPiD5WF-vgxhx; Path=/; HttpOnly
< Vary: Accept-Encoding
< Transfer-Encoding: chunked
< 
{ [data not shown]
100  7786    0  7786    0     0  32015      0 --:--:-- --:--:-- --:--:-- 31909
* Connection #0 to host install.meteor.com left intact

... Installing Meteor 1.5.2.2

Downloading Meteor distribution
Retrying download in 5 seconds...

badmark avatar Oct 06 '17 15:10 badmark

Hi , i am also experimenting the same error while building my app made with meteor 1.6 it keeps retrying the download but when i test the curl url inside a fresh container it works fine.

zjjt avatar Dec 26 '17 10:12 zjjt

@zjjt you'll need to share your logs. There are a variety of reasons that could fail (none of which have anything to do with this image), but I can't recommend much without debug logs.

jshimko avatar Dec 26 '17 15:12 jshimko

@jshimko I am really sorry for the delay i was away from work for a long time. heres is the log,I trimmed it down to the most important part.My connection is working fine and all docker images running older version of meteor works fine too but for all the ones with meteor 1.6 i cant get them to build.

`Rebuilt URL to: https://install.meteor.com/

  • Hostname was NOT found in DNS cache % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Trying 54.174.3.231... 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0* Connected to install.meteor.com (54.174.3.231) port 443 (#0)
  • successfully set certificate verify locations:
  • CAfile: none CApath: /etc/ssl/certs
  • SSLv3, TLS handshake, Client hello (1): } [data not shown]
  • SSLv3, TLS handshake, Server hello (2): { [data not shown]
  • SSLv3, TLS handshake, CERT (11): { [data not shown]
  • SSLv3, TLS handshake, Server key exchange (12): { [data not shown]
  • SSLv3, TLS handshake, Server finished (14): { [data not shown]
  • SSLv3, TLS handshake, Client key exchange (16): } [data not shown]
  • SSLv3, TLS change cipher, Client hello (1): } [data not shown]
  • SSLv3, TLS handshake, Finished (20): } [data not shown]
  • SSLv3, TLS change cipher, Client hello (1): { [data not shown]
  • SSLv3, TLS handshake, Finished (20): { [data not shown]
  • SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256
  • Server certificate:
  •    subject: CN=install.meteor.com
    
  •    start date: 2018-03-08 15:35:56 GMT
    
  •    expire date: 2018-06-06 15:35:56 GMT
    
  •    subjectAltName: install.meteor.com matched
    
  •    issuer: C=US; O=Let's Encrypt; CN=Let's Encrypt Authority X3
    
  •    SSL certificate verify ok.
    
    0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0> GET / HTTP/1.1

User-Agent: curl/7.38.0 Host: install.meteor.com Accept: /

0 0 0 0 0 0 0 0 --:--:-- 0:00:03 --:--:-- 0< HTTP/1.1 200 OK < Content-Type: text/plain < Date: Tue, 20 Mar 2018 09:10:01 GMT < Set-Cookie: galaxy-sticky=KYpdAvjMzhnPiD5WF-8k1gk; Path=/; HttpOnly < Vary: Accept-Encoding < Transfer-Encoding: chunked < { [data not shown] 100 7784 0 7784 0 0 1885 0 --:--:-- 0:00:04 --:--:-- 1886

  • Connection #0 to host install.meteor.com left intact

... Installing Meteor 1.6.0.1

Downloading Meteor distribution Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... The command '/bin/sh -c cd $APP_SOURCE_DIR && $BUILD_SCRIPTS_DIR/install-deps.sh && $BUILD_SCRIPTS_DIR/install-node.sh && $BUILD_SCRIPTS_DIR/install-phantom.sh && $BUILD_SCRIPTS_DIR/install-graphicsmagick.sh && $BUILD_SCRIPTS_DIR/install-mongo.sh && $BUILD_SCRIPTS_DIR/install-meteor.sh && $BUILD_SCRIPTS_DIR/build-meteor.sh && $BUILD_SCRIPTS_DIR/post-build-cleanup.sh' returned a non-zero code: 1`

zjjt avatar Mar 20 '18 09:03 zjjt

Having the same problem here - also from gitlab. Can I give any information to help ?

petrometro avatar May 27 '18 23:05 petrometro

I have this same problem, also with gitlab. Have tried running the steps on my local machine, as suggested, and it works fine. The only point that seems to differ in my logs is the line just above "Installing meteor"

head: cannot open '/opt/meteor/src/.meteor/release' for reading: No such file or directory

Here are the logs

  • Rebuilt URL to: https://install.meteor.com/

  • Hostname was NOT found in DNS cache % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed

    0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Trying 52.200.233.239...

  • Connected to install.meteor.com (52.200.233.239) port 443 (#0)

  • successfully set certificate verify locations:

  • CAfile: none CApath: /etc/ssl/certs

  • SSLv3, TLS handshake, Client hello (1): } [data not shown]

  • SSLv3, TLS handshake, Server hello (2): { [data not shown]

  • SSLv3, TLS handshake, CERT (11): { [data not shown]

  • SSLv3, TLS handshake, Server key exchange (12): { [data not shown]

  • SSLv3, TLS handshake, Server finished (14): { [data not shown]

  • SSLv3, TLS handshake, Client key exchange (16): } [data not shown]

  • SSLv3, TLS change cipher, Client hello (1): } [data not shown]

  • SSLv3, TLS handshake, Finished (20): } [data not shown]

  • SSLv3, TLS change cipher, Client hello (1): { [data not shown]

  • SSLv3, TLS handshake, Finished (20): { [data not shown]

  • SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256

  • Server certificate:

  • subject: CN=install.meteor.com

  • start date: 2018-05-07 14:36:20 GMT

  • expire date: 2018-08-05 14:36:20 GMT

  • subjectAltName: install.meteor.com matched

  • issuer: C=US; O=Let's Encrypt; CN=Let's Encrypt Authority X3

  • SSL certificate verify ok.

GET / HTTP/1.1 User-Agent: curl/7.38.0 Host: install.meteor.com Accept: /

< HTTP/1.1 200 OK < Content-Type: text/plain < Date: Sun, 27 May 2018 23:49:31 GMT < Set-Cookie: galaxy-sticky=KYpdAvjMzhnPiD5WF-gsgvm; Path=/; HttpOnly < Vary: Accept-Encoding < Transfer-Encoding: chunked < { [data not shown]

100 7786 0 7786 0 0 41739 0 --:--:-- --:--:-- --:--:-- 42315

  • Connection #0 to host install.meteor.com left intact head: cannot open '/opt/meteor/src/.meteor/release' for reading: No such file or directory

[-] Installing Meteor ...

Downloading Meteor distribution Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... Retrying download in 5 seconds... The command '/bin/sh -c cd $APP_SOURCE_DIR && $BUILD_SCRIPTS_DIR/install-deps.sh && $BUILD_SCRIPTS_DIR/install-node.sh && $BUILD_SCRIPTS_DIR/install-phantom.sh && $BUILD_SCRIPTS_DIR/install-graphicsmagick.sh && $BUILD_SCRIPTS_DIR/install-mongo.sh && $BUILD_SCRIPTS_DIR/install-meteor.sh && $BUILD_SCRIPTS_DIR/build-meteor.sh && $BUILD_SCRIPTS_DIR/post-build-cleanup.sh' returned a non-zero code: 1 ERROR: Job failed: exit code 1

petrometro avatar May 27 '18 23:05 petrometro

I have tried removing bcrypt, with no changes

petrometro avatar May 27 '18 23:05 petrometro

The line head: cannot open '/opt/meteor/src/.meteor/release' for reading: No such file or directory was because of a missing file - the file was added and still having the same problem.

petrometro avatar May 28 '18 00:05 petrometro

Is this a problem with Gitlab ?

petrometro avatar May 28 '18 00:05 petrometro

Ok I found the problem for me, in case it helps anyone. In .meteor/release I had [email protected] - this is the version I was trying to build.

I think this line in scripts/install-meteor.sh sed -i.bak "s/RELEASE=.*/RELEASE="$METEOR_VERSION"/g" /tmp/install_meteor.sh

is creating the problem, don't know why.

petrometro avatar May 28 '18 00:05 petrometro

Im also experiencing the same issue when trying beta versions or release candidates, for stable releases seems to be working, is there a work around to be able to build using betas or rc?

mexin avatar Aug 25 '18 20:08 mexin