private-bower
private-bower copied to clipboard
Published
20 hours ago •
Hacklone
Hacklone
Problems pulling large git repositories
I'm trying to set up private bower to use for our build servers as a cache. I have it running in a docker container and that seems to be working well for the most part. I see it pulling repositories and things seem to be working well. One project I'm trying to get running is using ember. The repo for ember is ridiculously large and I get the following error when it reaches the ember part.
bower ember#2.0.0 ENORESTARGET No tag found that was able to satisfy 2.0.0
If I look in the git cache in the docker container I see an ember directory. If I do a git log it just shows the initial commit. I'm not sure exactly what private bower does to resolve things but I'm wondering if the number of commits are proving to be a problem.
I can turn on more logging if theres any config I should use there. I see it registering the package but I don't see it getting the Pulled latest.
On the build server I'm running the following command to use the private bower during builds.
bower install --config.registry=http://x.x.x.x:5678 --config.timeout=300000
Any advice is appreciated. It would be great to get private-bower running over here.
Actually when looking at some of the logs after reboot I'm seeing a good amount of delay between when the initial request comes in and when private-bower seems to be ready for it. Even seeing a timeout for some things.
1/14/2016 7:34:26 PM[32m[bower] [39m [36m15/1/16 03:34:26[39m Refreshing public packages...
1/14/2016 7:34:26 PM[32m[bower] [39m [36m15/1/16 03:34:26[39m private-bower server started
1/14/2016 7:34:26 PM[32m[bower] [39m [36m15/1/16 03:34:26[39m Starting git cache server
1/14/2016 7:34:26 PM[32m[bower] [39m [36m15/1/16 03:34:26[39m Starting svn cache server
1/14/2016 7:34:30 PM[32m[bower] [39m [36m15/1/16 03:34:30[39m Loaded public packages
1/14/2016 7:34:30 PM[32m[bower] [39m [36m15/1/16 03:34:30[39m Public registry cached
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning ember ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning ember-cli-shims ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning ember-cli-test-loader ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning ember-load-initializers ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning ember-qunit ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning ember-qunit-notifications ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning ember-resolver ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning jquery ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning loader.js ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning qunit ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning foundation ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning pretender ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning lodash ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning Faker ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning es5-shim ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning sinonjs ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning malihu-custom-scrollbar-plugin ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning lightgallery ...
1/14/2016 7:35:35 PM[32m[bower] [39m [36m15/1/16 03:35:35[39m Cloning moment ...
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Cloned ember-cli-shims git repository to private
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Cloned ember-load-initializers git repository to private
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Cloned ember-qunit-notifications git repository to private
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Registered package: ember-cli-shims
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Registered package: ember-load-initializers
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Registered package: ember-qunit-notifications
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Cloned ember-cli-test-loader git repository to private
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Registered package: ember-cli-test-loader
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Cloned loader.js git repository to private
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Registered package: loader.js
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Cloned pretender git repository to private
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Registered package: pretender
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Cloned sinonjs git repository to private
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Registered package: sinonjs
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Cloned ember-qunit git repository to private
1/14/2016 7:35:36 PM[32m[bower] [39m [36m15/1/16 03:35:36[39m Registered package: ember-qunit
1/14/2016 7:35:37 PM[32m[bower] [39m [36m15/1/16 03:35:37[39m Cloned ember-resolver git repository to private
1/14/2016 7:35:37 PM[32m[bower] [39m [36m15/1/16 03:35:37[39m Registered package: ember-resolver
1/14/2016 7:35:38 PM[32m[bower] [39m [36m15/1/16 03:35:38[39m Cloning qunit-notifications ...
1/14/2016 7:35:38 PM[32m[bower] [39m [36m15/1/16 03:35:38[39m Cloned malihu-custom-scrollbar-plugin git repository to private
1/14/2016 7:35:38 PM[32m[bower] [39m [36m15/1/16 03:35:38[39m Registered package: malihu-custom-scrollbar-plugin
1/14/2016 7:35:38 PM[32m[bower] [39m [36m15/1/16 03:35:38[39m Cloning FakeXMLHttpRequest ...
1/14/2016 7:35:38 PM[32m[bower] [39m [36m15/1/16 03:35:38[39m Cloning route-recognizer ...
1/14/2016 7:35:39 PM[32m[bower] [39m [36m15/1/16 03:35:39[39m Cloned qunit git repository to private
1/14/2016 7:35:39 PM[32m[bower] [39m [36m15/1/16 03:35:39[39m Registered package: qunit
1/14/2016 7:35:39 PM[32m[bower] [39m [36m15/1/16 03:35:39[39m Cloned qunit-notifications git repository to private
1/14/2016 7:35:39 PM[32m[bower] [39m [36m15/1/16 03:35:39[39m Registered package: qunit-notifications
1/14/2016 7:35:39 PM[32m[bower] [39m [36m15/1/16 03:35:39[39m Cloned FakeXMLHttpRequest git repository to private
1/14/2016 7:35:39 PM[32m[bower] [39m [36m15/1/16 03:35:39[39m Registered package: FakeXMLHttpRequest
1/14/2016 7:35:39 PM[32m[bower] [39m [36m15/1/16 03:35:39[39m Cloning jquery-mousewheel ...
1/14/2016 7:35:39 PM[32m[bower] [39m [36m15/1/16 03:35:39[39m Registered package: jquery
1/14/2016 7:35:39 PM[32m[bower] [39m [36m15/1/16 03:35:39[39m Cloned route-recognizer git repository to private
1/14/2016 7:35:39 PM[32m[bower] [39m [36m15/1/16 03:35:39[39m Registered package: route-recognizer
1/14/2016 7:35:40 PM[32m[bower] [39m [36m15/1/16 03:35:40[39m Cloned es5-shim git repository to private
1/14/2016 7:35:40 PM[32m[bower] [39m [36m15/1/16 03:35:40[39m Registered package: es5-shim
1/14/2016 7:35:41 PM[32m[bower] [39m [36m15/1/16 03:35:41[39m Cloned jquery-mousewheel git repository to private
1/14/2016 7:35:41 PM[32m[bower] [39m [36m15/1/16 03:35:41[39m Registered package: jquery-mousewheel
1/14/2016 7:35:50 PM[32m[bower] [39m [36m15/1/16 03:35:50[39m Cloned Faker git repository to private
1/14/2016 7:35:50 PM[32m[bower] [39m [36m15/1/16 03:35:50[39m Registered package: Faker
1/14/2016 7:35:50 PM[32m[bower] [39m [36m15/1/16 03:35:50[39m Cloned foundation git repository to private
1/14/2016 7:35:50 PM[32m[bower] [39m [36m15/1/16 03:35:50[39m Registered package: foundation
1/14/2016 7:35:56 PM[32m[bower] [39m [36m15/1/16 03:35:56[39m Cloned moment git repository to private
1/14/2016 7:35:56 PM[32m[bower] [39m [36m15/1/16 03:35:56[39m Registered package: moment
1/14/2016 7:36:15 PM[32m[bower] [39m [36m15/1/16 03:36:15[39m Registered package: ember
1/14/2016 7:36:15 PM[32m[bower] [39m [36m15/1/16 03:36:15[39m Registered package: lodash
1/14/2016 7:36:15 PM[32m[bower] [39m [36m15/1/16 03:36:15[39m Registered package: lightgallery
1/14/2016 7:36:22 PM[32m[bower] [39m [36m15/1/16 03:36:22[39m Cloned jquery git repository to private
1/14/2016 7:36:22 PM[32m[bower] [39m [36m15/1/16 03:36:22[39m Registered package: jquery
1/14/2016 7:36:42 PM[32m[bower] [39m [36m15/1/16 03:36:42[39m Cloned lodash git repository to private
1/14/2016 7:36:42 PM[32m[bower] [39m [36m15/1/16 03:36:42[39m Registered package: lodash
1/14/2016 7:37:44 PM[32m[bower] [39m [36m15/1/16 03:37:44[39m Cloned lightgallery git repository to private
1/14/2016 7:37:44 PM[32m[bower] [39m [36m15/1/16 03:37:44[39m Registered package: lightgallery
1/14/2016 7:38:05 PM[32m[bower] [39m [36m15/1/16 03:38:05[39m Cloning modernizr ...
1/14/2016 7:38:05 PM[32m[bower] [39m [36m15/1/16 03:38:05[39m Cloning fastclick ...
1/14/2016 7:38:05 PM[32m[bower] [39m [36m15/1/16 03:38:05[39m Cloning jquery.cookie ...
1/14/2016 7:38:05 PM[32m[bower] [39m [36m15/1/16 03:38:05[39m Cloning jquery-placeholder ...
1/14/2016 7:38:06 PM[32m[bower] [39m [36m15/1/16 03:38:06[39m Cloned jquery-placeholder git repository to private
1/14/2016 7:38:06 PM[32m[bower] [39m [36m15/1/16 03:38:06[39m Registered package: jquery-placeholder
1/14/2016 7:38:06 PM[32m[bower] [39m [36m15/1/16 03:38:06[39m Cloned jquery.cookie git repository to private
1/14/2016 7:38:06 PM[32m[bower] [39m [36m15/1/16 03:38:06[39m Registered package: jquery.cookie
1/14/2016 7:38:07 PM[32m[bower] [39m [36m15/1/16 03:38:07[39m Cloned fastclick git repository to private
1/14/2016 7:38:07 PM[32m[bower] [39m [36m15/1/16 03:38:07[39m Registered package: fastclick
1/14/2016 7:39:29 PM[32m[bower] [39m [36m15/1/16 03:39:29[39m Cloned modernizr git repository to private
1/14/2016 7:39:29 PM[32m[bower] [39m [36m15/1/16 03:39:29[39m Registered package: modernizr
1/14/2016 7:41:39 PM[32m[bower] [39m [36m15/1/16 03:41:39[39m Error during "git clone git://43.138.14.254:6789/moment /usr/local/lib/node_modules/private-bower/lib/temp/packageDetails/aaifwrltv3x47vi --depth=1" in "undefined".
1/14/2016 7:41:39 PM Output:
1/14/2016 7:41:39 PM stdout:
1/14/2016 7:41:39 PM stderr: Cloning into '/usr/local/lib/node_modules/private-bower/lib/temp/packageDetails/aaifwrltv3x47vi'...
1/14/2016 7:41:39 PMfatal: unable to connect to 43.138.14.254:
1/14/2016 7:41:39 PM43.138.14.254[0: 43.138.14.254]: errno=Connection timed out
1/14/2016 7:41:39 PM
1/14/2016 7:41:39 PM
After leaving it alone for the evening and trying to bower install again it managed to complete successfully. Not sure if there would be any way for private-bower to maybe be a bit smarter about the initial clone of a large repo. It makes it seem broken initially.