theia-blueprint initial implementation of an executable server

The goal of this PR is to setup a browser version of Blueprint packaged as a "drag and drop" solution that's easy to deploy.

The setup is a bit tricky and might not apply well to every kind of product made using the Theia framework, but it should work for most usages.

Add theia-blueprint-browser Theia extension that contributes the required customizations to run in the packaged environment (mostly to accommodate to the new file layout).

Use a node-specific Webpack configuration to bundle the backend along with the browser-specific customizations.

Use a forked pkg package to support forking child processes with execArgv options. The fork is setup as a git submodule.

Upstream patches to `pkg`

https://github.com/vercel/pkg/pull/1157
https://github.com/vercel/pkg/pull/1435

How to test

Run:

# setup git submodules
git submodule update --init

# build and package
yarn && yarn browser bundle && yarn browser package

This should result in the browser application being packaged into applications/browser/packaged.

Review checklist

[x] as an author, I have thoroughly tested my changes and carefully followed the review guidelines

Reminder for reviewers

as a reviewer, I agree to behave in accordance with the review guidelines

Oct 12 '21 22:10 paul-marechal

@vince-fugnitto @marcdumais-work I am seeing errors coming from a few builtins, do you guys know if this is expected?

Oct 12 '21 22:10 paul-marechal

I was wondering what would be good to do in this PR before merging it in master:

Do we want a CI that publishes this new application?
Is there any particular utilization case that is currently missing and that should be contributed via Theia extension?
Is there any weird bugs with the packaged version that need fixing?

I'd like help to try on different platforms as well. I only tested from Windows 10.

Oct 12 '21 22:10 paul-marechal

One thing I noticed: the help -> about dialog seems broken.

Oct 27 '21 20:10 marcdumais-work

Here are the vscode extensions that seem to fail for me at startup (more might when e.g. .a new LS is triggered):

vscode.merge-conflict
vscode.emmet
vscode.npm

More from backend startup log:

root INFO [hosted-plugin: 14507] PLUGIN_HOST(14507): PluginManagerExtImpl/loadPlugin(/opt/ericsson-dev/theia-blueprint/applications/browser/packaged/builtins/vscode.merge-conflict/extension/dist/mergeConflictMain) root ERROR [hosted-plugin: 14507] Activating extension 'Merge Conflict (built-in)' failed: TypeError: i.id.endsWith is not a function at Object.loadPlugin (/snapshot/theia-blueprint/applications/browser/bundled/plugin-host.js:1:429) at /snapshot/theia-blueprint/applications/browser/bundled/921.js:1:166617 at processTicksAndRejections (internal/process/task_queues.js:97:5) at async l.$activatePlugin (/snapshot/theia-blueprint/applications/browser/bundled/921.js:1:167690) at async Promise.all (index 0) at async l.activateBySingleEvent (/snapshot/theia-blueprint/applications/browser/bundled/921.js:1:167592) at async l.$activateByEvent (/snapshot/theia-blueprint/applications/browser/bundled/921.js:1:167258) root INFO [hosted-plugin: 14507] PLUGIN_HOST(14507): PluginManagerExtImpl/loadPlugin(/opt/ericsson-dev/theia-blueprint/applications/browser/packaged/builtins/vscode.emmet/extension/dist/node/emmetNodeMain) root ERROR [hosted-plugin: 14507] Activating extension 'Emmet (built-in)' failed: TypeError: i.id.endsWith is not a function at Object.loadPlugin (/snapshot/theia-blueprint/applications/browser/bundled/plugin-host.js:1:429) at /snapshot/theia-blueprint/applications/browser/bundled/921.js:1:166617 at processTicksAndRejections (internal/process/task_queues.js:97:5) at async l.$activatePlugin (/snapshot/theia-blueprint/applications/browser/bundled/921.js:1:167690) at async Promise.all (index 1) at async l.activateBySingleEvent (/snapshot/theia-blueprint/applications/browser/bundled/921.js:1:167592) at async l.$activateByEvent (/snapshot/theia-blueprint/applications/browser/bundled/921.js:1:167258) root INFO [hosted-plugin: 14507] PLUGIN_HOST(14507): PluginManagerExtImpl/loadPlugin(/opt/ericsson-dev/theia-blueprint/applications/browser/packaged/builtins/vscode.npm/extension/dist/npmMain) root ERROR [hosted-plugin: 14507] Activating extension 'NPM support for VS Code (built-in)' failed: TypeError: i.id.endsWith is not a function at Object.loadPlugin (/snapshot/theia-blueprint/applications/browser/bundled/plugin-host.js:1:429) at /snapshot/theia-blueprint/applications/browser/bundled/921.js:1:166617 at processTicksAndRejections (internal/process/task_queues.js:97:5) at async l.$activatePlugin (/snapshot/theia-blueprint/applications/browser/bundled/921.js:1:167690) at async Promise.all (index 0) at async l.activateBySingleEvent (/snapshot/theia-blueprint/applications/browser/bundled/921.js:1:167592) at async l.$activateByEvent (/snapshot/theia-blueprint/applications/browser/bundled/921.js:1:167258) root INFO [5b44c0a8-6407-43bf-ad2b-8228f1da8e98] Start of 85 plugins took: 731.6 ms [Finished 4.769 s after frontend start]

Nov 15 '21 19:11 marcdumais-work

When I try to search for a file in the repo (Ctrl-p), it's not able to spawn ripgrep:

root ERROR Failed to search: file:///opt/ericsson-dev/theia-blueprint Error: spawn /opt/ericsson-dev/theia-blueprint/applications/browser/packaged/bin/rg EACCES at Process.ChildProcess._handle.onexit (internal/child_process.js:268:19) at onErrorNT (internal/child_process.js:470:16) at processTicksAndRejections (internal/process/task_queues.js:84:21)

I notice the ripgrep executable does not have execute permission. If I manually add it (chmod +x <rg executable>, now search works.