noobaa-core
noobaa-core copied to clipboard
Published
20 hours ago •
noobaa
noobaa
building from source failed (using Podman, not sure it's related)
Replaced all 'docker ...' with 'podman ...' (since I don't have Docker working on my Fedora 31, but Podman seems fine).
Failed to build:
[15:39:58] Starting 'bundleDebug'...
npm WARN deprecated [email protected]: 🙌 Thanks for using Babel: we recommend using babel-preset-env now: please read https://babeljs.io/env to update!
npm WARN deprecated [email protected]: The package has been renamed to `open`
npm WARN deprecated [email protected]: Please use the native JSON object instead of JSON 3
npm WARN deprecated [email protected]: core-js@<3 is no longer maintained and not recommended for usage due to the number of issues. Please, upgrade your dependencies to the actual version of core-js@3.
[15:40:07] Finished 'bundleDebug' after 8.89 solveWithNewModule [email protected] ch
[15:40:08] Finished 'generateSVGIcons' after 12 snerateActionsToTake
[15:40:08] Finished 'buildAPI' after 12 s
[15:40:10] Finished 'copy' after 14 s: sill extract babel-plugin-transform-rege
[15:40:12] Finished 'compileStyles' after 17 stract [email protected]
> [email protected] postinstall /noobaa/frontend/src/lib/shifty/node_modules/core-js
> node -e "try{require('./postinstall')}catch(e){}"
Thank you for using core-js ( https://github.com/zloirock/core-js ) for polyfilling JavaScript standard library!
The project needs your help! Please consider supporting of core-js on Open Collective or Patreon:
> https://opencollective.com/core-js
> https://www.patreon.com/zloirock
Also, the author of core-js ( https://github.com/zloirock ) is looking for a good job -)
> [email protected] postinstall /noobaa/frontend/src/lib/shifty/node_modules/nodemon
> node bin/postinstall || exit 0
Love nodemon? You can now support the project via the open collective:
> https://opencollective.com/nodemon/donate
[15:40:19] Finished 'lintApp' after 22 s lifecycle [email protected]~pos
[15:40:19] Starting 'bundleApp'...
npm notice created a lockfile as package-lock.json. You should commit this file.
npm WARN optional SKIPPING OPTIONAL DEPENDENCY: [email protected] (node_modules/fsevents):
npm WARN notsup SKIPPING OPTIONAL DEPENDENCY: Unsupported platform for [email protected]: wanted {"os":"darwin","arch":"any"} (current: {"os":"linux","arch":"x64"})
added 754 packages from 712 contributors and audited 10856 packages in 21.158s
found 5 vulnerabilities (3 low, 1 high, 1 critical)
run `npm audit fix` to fix them, or `npm audit` for details
> [email protected] build /noobaa/frontend/src/lib/shifty
> webpack
Hash: 3d0076bc18113d56ddbc
Version: webpack 2.5.1
Time: 1876ms
Asset Size Chunks Chunk Names
shifty.js 14.8 kB 0 [emitted] main
shifty.js.map 128 kB 0 [emitted] main
[0] ./src/tweenable.js 18.6 kB {0} [built]
[1] ./~/object-assign/index.js 2.1 kB {0} [built]
[2] ./src/bezier.js 6.47 kB {0} [built]
[3] ./src/interpolate.js 2.81 kB {0} [built]
[4] (webpack)/buildin/global.js 823 bytes {0} [built]
[5] ./src/easing-functions.js 7.3 kB {0} [built]
[6] ./src/main.js 889 bytes {0} [built]
[7] ./src/token.js 10.4 kB {0} [built]
WARNING in shifty.js from UglifyJs
Side effects in initialization of unused variable setBezierFunction [./src/bezier.js:159,13]
Side effects in initialization of unused variable unsetBezierFunction [./src/bezier.js:177,13]
Side effects in initialization of unused variable interpolate [./src/interpolate.js:48,13]
Side effects in initialization of unused variable linear [./src/easing-functions.js:39,13]
Side effects in initialization of unused variable easeInQuad [./src/easing-functions.js:41,13]
Side effects in initialization of unused variable easeOutQuad [./src/easing-functions.js:43,13]
Side effects in initialization of unused variable easeInOutQuad [./src/easing-functions.js:45,13]
Side effects in initialization of unused variable easeInCubic [./src/easing-functions.js:50,13]
Side effects in initialization of unused variable easeOutCubic [./src/easing-functions.js:52,13]
Side effects in initialization of unused variable easeInOutCubic [./src/easing-functions.js:54,13]
Side effects in initialization of unused variable easeInQuart [./src/easing-functions.js:59,13]
Side effects in initialization of unused variable easeOutQuart [./src/easing-functions.js:61,13]
Side effects in initialization of unused variable easeInOutQuart [./src/easing-functions.js:63,13]
Side effects in initialization of unused variable easeInQuint [./src/easing-functions.js:68,13]
Side effects in initialization of unused variable easeOutQuint [./src/easing-functions.js:70,13]
Side effects in initialization of unused variable easeInOutQuint [./src/easing-functions.js:72,13]
Side effects in initialization of unused variable easeInSine [./src/easing-functions.js:77,13]
Side effects in initialization of unused variable easeOutSine [./src/easing-functions.js:79,13]
Side effects in initialization of unused variable easeInOutSine [./src/easing-functions.js:81,13]
Side effects in initialization of unused variable easeInExpo [./src/easing-functions.js:83,13]
Side effects in initialization of unused variable easeOutExpo [./src/easing-functions.js:85,13]
Side effects in initialization of unused variable easeInOutExpo [./src/easing-functions.js:87,13]
Side effects in initialization of unused variable easeInCirc [./src/easing-functions.js:103,13]
Side effects in initialization of unused variable easeOutCirc [./src/easing-functions.js:105,13]
Side effects in initialization of unused variable easeInOutCirc [./src/easing-functions.js:107,13]
Side effects in initialization of unused variable easeOutBounce [./src/easing-functions.js:112,13]
Side effects in initialization of unused variable easeInBack [./src/easing-functions.js:124,13]
Side effects in initialization of unused variable easeOutBack [./src/easing-functions.js:129,13]
Side effects in initialization of unused variable easeInOutBack [./src/easing-functions.js:134,13]
Side effects in initialization of unused variable elastic [./src/easing-functions.js:142,13]
Side effects in initialization of unused variable swingFromTo [./src/easing-functions.js:145,13]
Side effects in initialization of unused variable swingFrom [./src/easing-functions.js:152,13]
Side effects in initialization of unused variable swingTo [./src/easing-functions.js:157,13]
Side effects in initialization of unused variable bounce [./src/easing-functions.js:162,13]
Side effects in initialization of unused variable bouncePast [./src/easing-functions.js:174,13]
Side effects in initialization of unused variable easeFromTo [./src/easing-functions.js:186,13]
Side effects in initialization of unused variable easeFrom [./src/easing-functions.js:191,13]
Side effects in initialization of unused variable easeTo [./src/easing-functions.js:193,13]
Side effects in initialization of unused variable length [./src/token.js:343,12]
[15:40:22] Finished 'buildDeps' after 26 s
[15:40:22] Starting 'bundleLib'...
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
[15:40:27] Finished 'bundleApp' after 8.82 s
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
....
Error: EMFILE: too many open files, open '/noobaa/frontend/node_modules/readable-stream/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/node_modules/readable-stream/package.json'
[15:40:32] Finished 'bundleLib' after 10 s
[15:40:32] Starting 'verifyBuild'...
[15:40:32] Build encountered 526 build errors
[15:40:32] The following tasks did not complete: build, verifyBuild
[15:40:32] Did you forget to signal async completion?
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! [email protected] build: `gulp build`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the [email protected] build script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR! A complete log of this run can be found in:
npm ERR! /root/.npm/_logs/2020-01-06T15_40_32_978Z-debug.log
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! [email protected] build:fe: `cd frontend && npm install && npm run build`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the [email protected] build:fe script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
Any ideas?
Answer to self:
docker build --ulimit nofile=10240:10240 ...
Helped. Since I used podman, it almost worked - I had to use 'sudo' to get it set properly. But it did the trick. Now the question - should we add it to the Makefile?
Hi @mykaul can you try again from master? We have made a small change #6002 that might effect here.
Something is complete broken for me now:
[ykaul@ykaul noobaa-core]$ time make
real 0m0.227s
user 0m0.126s
sys 0m0.114s
It doesn't build at all. 'make base' did run, failing eventually with:
[14:42:55] Finished 'buildDeps' after 56 s
[14:42:55] Starting 'bundleLib'...
[14:42:56] Finished 'bundleLib' after 1.13 s
[14:42:56] Starting 'verifyBuild'...
[14:42:56] Build encountered 558 build errors
[14:42:56] The following tasks did not complete: build, verifyBuild
[14:42:56] Did you forget to signal async completion?
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! [email protected] build: `gulp build`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the [email protected] build script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR! A complete log of this run can be found in:
npm ERR! /root/.npm/_logs/2020-04-30T14_42_56_865Z-debug.log
Error: error building at STEP "RUN cd frontend && npm run build": error while running runtime: exit status 1
make: *** [Makefile:50: base] Error 125
Eventually, tried 'sudo make base' which failed with the same issue :(
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Hash: 3d0076bc18113d56ddbc
Version: webpack 2.5.1
Time: 1794ms
Asset Size Chunks Chunk Names
shifty.js 14.8 kB 0 [emitted] main
shifty.js.map 128 kB 0 [emitted] main
[0] ./src/tweenable.js 18.6 kB {0} [built]
[1] ./~/object-assign/index.js 2.1 kB {0} [built]
[2] ./src/bezier.js 6.47 kB {0} [built]
[3] ./src/interpolate.js 2.81 kB {0} [built]
[4] (webpack)/buildin/global.js 823 bytes {0} [built]
[5] ./src/easing-functions.js 7.3 kB {0} [built]
[6] ./src/main.js 889 bytes {0} [built]
[7] ./src/token.js 10.4 kB {0} [built]
WARNING in shifty.js from UglifyJs
Side effects in initialization of unused variable setBezierFunction [./src/bezier.js:159,13]
Side effects in initialization of unused variable unsetBezierFunction [./src/bezier.js:177,13]
Side effects in initialization of unused variable interpolate [./src/interpolate.js:48,13]
Side effects in initialization of unused variable linear [./src/easing-functions.js:39,13]
Side effects in initialization of unused variable easeInQuad [./src/easing-functions.js:41,13]
Side effects in initialization of unused variable easeOutQuad [./src/easing-functions.js:43,13]
Side effects in initialization of unused variable easeInOutQuad [./src/easing-functions.js:45,13]
Side effects in initialization of unused variable easeInCubic [./src/easing-functions.js:50,13]
Side effects in initialization of unused variable easeOutCubic [./src/easing-functions.js:52,13]
Side effects in initialization of unused variable easeInOutCubic [./src/easing-functions.js:54,13]
Side effects in initialization of unused variable easeInQuart [./src/easing-functions.js:59,13]
Side effects in initialization of unused variable easeOutQuart [./src/easing-functions.js:61,13]
Side effects in initialization of unused variable easeInOutQuart [./src/easing-functions.js:63,13]
Side effects in initialization of unused variable easeInQuint [./src/easing-functions.js:68,13]
Side effects in initialization of unused variable easeOutQuint [./src/easing-functions.js:70,13]
Side effects in initialization of unused variable easeInOutQuint [./src/easing-functions.js:72,13]
Side effects in initialization of unused variable easeInSine [./src/easing-functions.js:77,13]
Side effects in initialization of unused variable easeOutSine [./src/easing-functions.js:79,13]
Side effects in initialization of unused variable easeInOutSine [./src/easing-functions.js:81,13]
Side effects in initialization of unused variable easeInExpo [./src/easing-functions.js:83,13]
Side effects in initialization of unused variable easeOutExpo [./src/easing-functions.js:85,13]
Side effects in initialization of unused variable easeInOutExpo [./src/easing-functions.js:87,13]
Side effects in initialization of unused variable easeInCirc [./src/easing-functions.js:103,13]
Side effects in initialization of unused variable easeOutCirc [./src/easing-functions.js:105,13]
Side effects in initialization of unused variable easeInOutCirc [./src/easing-functions.js:107,13]
Side effects in initialization of unused variable easeOutBounce [./src/easing-functions.js:112,13]
Side effects in initialization of unused variable easeInBack [./src/easing-functions.js:124,13]
Side effects in initialization of unused variable easeOutBack [./src/easing-functions.js:129,13]
Side effects in initialization of unused variable easeInOutBack [./src/easing-functions.js:134,13]
Side effects in initialization of unused variable elastic [./src/easing-functions.js:142,13]
Side effects in initialization of unused variable swingFromTo [./src/easing-functions.js:145,13]
Side effects in initialization of unused variable swingFrom [./src/easing-functions.js:152,13]
Side effects in initialization of unused variable swingTo [./src/easing-functions.js:157,13]
Side effects in initialization of unused variable bounce [./src/easing-functions.js:162,13]
Side effects in initialization of unused variable bouncePast [./src/easing-functions.js:174,13]
Side effects in initialization of unused variable easeFromTo [./src/easing-functions.js:186,13]
Side effects in initialization of unused variable easeFrom [./src/easing-functions.js:191,13]
Side effects in initialization of unused variable easeTo [./src/easing-functions.js:193,13]
Side effects in initialization of unused variable length [./src/token.js:343,12]
[14:54:57] Finished 'buildDeps' after 40 s
[14:54:57] Starting 'bundleLib'...
[14:55:02] Finished 'bundleLib' after 5.06 s
[14:55:02] Starting 'verifyBuild'...
[14:55:02] Build encountered 555 build errors
[14:55:02] The following tasks did not complete: build, verifyBuild
[14:55:02] Did you forget to signal async completion?
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! [email protected] build: `gulp build`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the [email protected] build script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR! A complete log of this run can be found in:
npm ERR! /root/.npm/_logs/2020-04-30T14_55_02_886Z-debug.log
Error: error building at STEP "RUN cd frontend && npm run build": error while running runtime: exit status 1
make: *** [Makefile:50: base] Error 125
(note - I have no idea where this /root/.npm/_logs is - I don't have it on my computer).
@mykaul /root/.npm/_logs are in the layer that run (because it failed it does not exist...) the layer that fails will look something like this (with a different hash):
Step 18/18 : RUN cd frontend && npm run build
---> Running in 0beecebdf704
the easiest way of getting that logs are running:
docker run -it --name <name > <hash> bash
then running it manually and copying the logs out and deleting the container afterward.
@liranmauda - might be a podman issue (the limits) - see https://github.com/containers/libpod/pull/6004
@mykaul we might want to retest on podman v2 and up, according to this: https://github.com/containers/podman/issues/6093#issuecomment-624254340
ykaul@ykaul noobaa-core]$ sudo podman version
[sudo] password for ykaul:
Version: 2.0.4
API Version: 1
Go Version: go1.14.6
Built: Thu Jan 1 02:00:00 1970
OS/Arch: linux/amd64
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
Error: EMFILE: too many open files, open '/noobaa/frontend/package.json'
[06:35:42] Finished 'bundleLib' after 8.96 s
[06:35:42] Starting 'verifyBuild'...
[06:35:42] Build encountered 575 build errors
[06:35:42] The following tasks did not complete: build, verifyBuild
[06:35:42] Did you forget to signal async completion?
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! [email protected] build: `gulp build`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the [email protected] build script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR! A complete log of this run can be found in:
npm ERR! /root/.npm/_logs/2020-08-11T06_35_42_905Z-debug.log
Error: error building at STEP "RUN cd frontend && npm run build": error while running runtime: exit status 1
make: *** [Makefile:50: base] Error 125
And:
ykaul@ykaul noobaa-core]$ sudo podman run alpine grep open /proc/self/limits
Trying to pull registry.fedoraproject.org/alpine...
manifest unknown: manifest unknown
Trying to pull registry.access.redhat.com/alpine...
name unknown: Repo not found
Trying to pull registry.centos.org/alpine...
manifest unknown: manifest unknown
Trying to pull docker.io/library/alpine...
Getting image source signatures
Copying blob df20fa9351a1 done
Copying config a24bb40132 done
Writing manifest to image destination
Storing signatures
Max open files 1048576 1048576 files
Haven't tested it in a while, but I expected upstream to use Podman as well (for rootless build - can Docker do it? - unsure)