build-your-own-radar icon indicating copy to clipboard operation
build-your-own-radar copied to clipboard

SSL Error

Open prasadaws10 opened this issue 3 years ago • 15 comments

Hi I am using docker image to call my URL on 443 with jwilder/nginx-proxy. But my web page doesn't load.

prasadaws10 avatar Jul 28 '22 00:07 prasadaws10

Hi @prasadaws10 , can you pls share some more info of the error you are getting ? Browser console and nginx logs would help.

devansh-sharma-tw avatar Jul 28 '22 14:07 devansh-sharma-tw

@Devansh, my web page doesn't load.

The server at thoughtworks-dev.az.com is taking too long to respond.

The site could be temporarily unavailable or too busy. Try again in a few moments.
If you are unable to load any pages, check your computer’s network connection.
If your computer or network is protected by a firewall or proxy, make sure that Firefox is permitted to access the Web.

Logs from Nginx docker:

Info: running nginx-proxy version 1.0.1-6-gc4ad18f Setting up DH Parameters.. forego | starting dockergen.1 on port 5000 forego | starting nginx.1 on port 5100 nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: using the "epoll" event method nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: nginx/1.21.6 nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: built by gcc 10.2.1 20210110 (Debian 10.2.1-6) nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: OS: Linux 3.10.0-1160.62.1.el7.x86_64 nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: getrlimit(RLIMIT_NOFILE): 1048576:1048576 nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: start worker processes nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: start worker process 21 nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: start worker process 22 dockergen.1 | 2022/07/28 00:10:22 Generated '/etc/nginx/conf.d/default.conf' from 2 containers dockergen.1 | 2022/07/28 00:10:22 Running 'nginx -s reload' dockergen.1 | 2022/07/28 00:10:22 Watching docker events nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: signal 1 (SIGHUP) received from 25, reconfiguring nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: reconfiguring nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: using the "epoll" event method nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: start worker processes nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: start worker process 28 nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: start worker process 29 dockergen.1 | 2022/07/28 00:10:22 Contents of /etc/nginx/conf.d/default.conf did not change. Skipping notification 'nginx -s reload' nginx.1 | 2022/07/28 00:10:22 [notice] 22#22: gracefully shutting down nginx.1 | 2022/07/28 00:10:22 [notice] 21#21: gracefully shutting down nginx.1 | 2022/07/28 00:10:22 [notice] 22#22: exiting nginx.1 | 2022/07/28 00:10:22 [notice] 21#21: exiting nginx.1 | 2022/07/28 00:10:22 [notice] 21#21: exit nginx.1 | 2022/07/28 00:10:22 [notice] 22#22: exit nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: signal 17 (SIGCHLD) received from 22 nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: worker process 21 exited with code 0 nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: worker process 22 exited with code 0 nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: signal 29 (SIGIO) received

@devansh-sharma-tw, Can you please share how this can be run on 443 or using SSL ?

prasadaws10 avatar Jul 28 '22 17:07 prasadaws10

Thanks for sharing the logs! It seems like the nginx instance spawned from the jwilder/nginx-proxy image that you mention to be using, seems to be having some issues and is shutting down. This does not seem to be an error from the nginx instance in the BYOR image (which is running nginx v1.23.0). You may have to check the nginx configuration in that image to figure out any possible issues there.

Can you please share how this can be run on 443 or using SSL ?

To run BYOR standalone over HTTPS using docker, you would have to setup the nginx instance running in the BYOR container to use SSL. You could try to add the needed configurations by modifying the Dockerfile from this repo and build a local image or create another new image with the BYOR image as its base. Some reference docs to start with setting up SSL in nginx can be found here.

devansh-sharma-tw avatar Jul 29 '22 13:07 devansh-sharma-tw

Hi Devansh, I was able to fix the error by using a different image. But now question on sharepoint. Lets say I have my CSV in my sharepoint. Can I use the sharepoint URL ?

Or the URL should only be from google sheets. Since I am hosting it privately in my cloud CSP, I would like to input the data CSV file from my private sharepoint URL. Is this possible ?

Also I am trying to load data but it doesn't load. It says like "Your Technology Radar will be available in just a few seconds"

When I check the docker logs:

Nginx server is UP! 172.18.0.3 - - [03/Aug/2022:20:54:54 +0000] "GET /?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing HTTP/1.1" 200 2617 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 172.18.0.3 - - [03/Aug/2022:20:54:55 +0000] "GET /main.c7833f7c7eab6946a9b8.js HTTP/1.1" 200 1073525 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 172.18.0.3 - - [03/Aug/2022:20:54:55 +0000] "GET /images/tw-logo.png HTTP/1.1" 200 13041 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 2022/08/03 20:54:57 [error] 39#39: *4 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [03/Aug/2022:20:54:57 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 172.18.0.3 - - [03/Aug/2022:20:55:00 +0000] "GET /?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing HTTP/1.1" 304 0 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 172.18.0.3 - - [03/Aug/2022:20:55:00 +0000] "GET /main.c7833f7c7eab6946a9b8.js HTTP/1.1" 304 0 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 172.18.0.3 - - [03/Aug/2022:20:55:00 +0000] "GET /images/tw-logo.png HTTP/1.1" 200 13041 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 2022/08/03 20:55:00 [error] 39#39: *8 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [03/Aug/2022:20:55:00 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 172.18.0.3 - - [03/Aug/2022:20:55:03 +0000] "GET /images/favicon.ico HTTP/1.1" 200 1150 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 172.18.0.3 - - [03/Aug/2022:20:55:10 +0000] "GET /main.c7833f7c7eab6946a9b8.js HTTP/1.1" 304 0 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 172.18.0.3 - - [03/Aug/2022:20:55:10 +0000] "GET /images/tw-logo.png HTTP/1.1" 200 13041 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 2022/08/03 22:24:47 [error] 39#39: *14 open() "/opt/build-your-own-radar/export" failed (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [03/Aug/2022:22:24:47 +0000] "GET /export?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38" 172.18.0.3 - - [03/Aug/2022:22:24:48 +0000] "GET /?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2Fe%2F2PACX-1vSXepTRKq0hDSTVZ1mvAq7NbMd4JORjavJMrnClpCD4CDebaMqBr7LKhy13Mvnt4wDw6aMkFJYWpWuJ%2Fpubhtml HTTP/1.1" 200 2617 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38" 2022/08/03 22:24:49 [error] 39#39: *16 open() "/opt/build-your-own-radar/export" failed (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [03/Aug/2022:22:24:49 +0000] "GET /export?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38" 172.18.0.3 - - [03/Aug/2022:22:25:07 +0000] "GET /?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing HTTP/1.1" 200 2617 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38" 2022/08/03 22:25:08 [error] 39#39: *18 open() "/opt/build-your-own-radar/export" failed (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [03/Aug/2022:22:25:08 +0000] "GET /export?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38" 2022/08/03 22:28:15 [error] 38#38: *19 open() "/opt/build-your-own-radar/export" failed (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [03/Aug/2022:22:28:15 +0000] "GET /export?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38" 2022/08/03 22:31:51 [error] 38#38: *20 open() "/opt/build-your-own-radar/export" failed (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [03/Aug/2022:22:31:51 +0000] "GET /export?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38"

prasadaws10 avatar Aug 02 '22 23:08 prasadaws10

Hi Devansh, I was able to fix the error by using a different image. But now question on sharepoint. Lets say I have my CSV in my sharepoint. Can I use the sharepoint URL ?

Or the URL should only be from google sheets. Since I am hosting it privately in my cloud CSP, I would like to input the data CSV file from my private sharepoint URL. Is this possible ?

Yes, it is possible to use a CSV file from a publicly accessible URL. You would need to make sure there are no CORS restrictions for your BYOR domain, from the server hosting the CSV file. Alternatively, if possible you can also host the CSV file locally inside the container and use it that way. Instructions for the same are here.

Also I am trying to load data but it doesn't load. It says like "Your Technology Radar will be available in just a few seconds"

Could you pls explain more on how you are trying to load data ? What URL you are using ? Additionally logs from Chrome browser console would help as well. I see a few instances of GET /export?format=pdf and open() "/opt/build-your-own-radar/export" failed in your logs, so would like to understand more what URL you are trying, as PDFs are not a supported format to read from.

devansh-sharma-tw avatar Aug 04 '22 04:08 devansh-sharma-tw

Hi Devansh,

I am using the sample from https://www.thoughtworks.com/radar/how-to-byor web page.

  1. Create Section - Paragraph -3 "Here's an example public Google sheet and a screenshot of the editable Google Sheet"

Logs from Chrome browser console section:

Access to XMLHttpRequest at 'https://docs.google.com/spreadsheets/d/1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I' from origin 'https://dtvbi-thoughtworks-dev.az.3pc.att.com' has been blocked by CORS policy: No 'Access-Control-Allow-Origin' header is present on the requested resource. main.c7833f7c7eab6946a9b8.js:2 GET https://docs.google.com/spreadsheets/d/1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I net::ERR_FAILED 200 n.validate @ main.c7833f7c7eab6946a9b8.js:2 n.build @ main.c7833f7c7eab6946a9b8.js:2 build @ main.c7833f7c7eab6946a9b8.js:2 (anonymous) @ main.c7833f7c7eab6946a9b8.js:2 (anonymous) @ main.c7833f7c7eab6946a9b8.js:2 m=base:238 GET https://accounts.google.com/o/oauth2/iframerpc?action=checkOrigin&origin=https%3A%2F%2Fdtvbi-thoughtworks-dev.az.3pc.att.com&client_id=1tIhRtDw2EdQSOjoC1l-TFCxFXO_FMOHlUGaD6FMFRB8 401 (Unauthorized) Ug @ m=base:238 Vg @ m=base:238 (anonymous) @ m=base:262 (anonymous) @ m=base:245 Ag.getItem @ m=base:224 W.h @ m=base:245 wh @ m=base:258 Kh @ m=base:261 n.Rb @ m=base:265 (anonymous) @ m=base:276 lh.v @ m=base:253 b @ m=base:264 cb=gapi.loaded_0?le=scs:224 Uncaught {error: 'idpiframe_initialization_failed', details: "Not a valid origin for the client: https://dtvbi-t…egister this origin for your project's client ID."}

prasadaws10 avatar Aug 04 '22 06:08 prasadaws10

Hi,

cb=gapi.loaded_0?le=scs:224 Uncaught {error: 'idpiframe_initialization_failed', details: "Not a valid origin for the client: https://dtvbi-t…egister this origin for your project's client ID."}

Can you check if your GCP Client ID has your current domain (that is running BYOR) set in the Authorized JavaScript Origins section ? More info about setting this is present here and here.

devansh-sharma-tw avatar Aug 04 '22 12:08 devansh-sharma-tw

Hi Devansh,

I am still not able to load my data file. It says loading and in the back end I see this error. Do you have any availability to connect on a call ? I work in PST timings. Please let me know your time.

Docker logs:

172.18.0.3 - - [16/Aug/2022:16:26:05 +0000] "GET /images/tech-radar-landing-page-wide.png HTTP/1.1" 200 16509 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/main.89310c67680e48318f0d.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 172.18.0.3 - - [16/Aug/2022:16:26:05 +0000] "GET /images/favicon.ico HTTP/1.1" 200 1150 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 2022/08/16 16:26:07 [error] 39#39: *43 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [16/Aug/2022:16:26:07 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET / HTTP/1.1" 200 2617 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET /main.89310c67680e48318f0d.css HTTP/1.1" 200 13478 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET /images/tw-logo.png HTTP/1.1" 200 13041 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET /main.c7833f7c7eab6946a9b8.js HTTP/1.1" 304 0 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:12:49 +0000] "GET /images/tech-radar-landing-page-wide.png HTTP/1.1" 200 16509 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/main.89310c67680e48318f0d.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:13:09 +0000] "GET /?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing HTTP/1.1" 200 2617 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 2022/09/09 21:13:11 [error] 39#39: *50 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [09/Sep/2022:21:13:11 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:16:00 +0000] "GET / HTTP/1.1" 304 0 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:16:10 +0000] "GET /export/?format=pdf HTTP/1.1" 403 153 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 2022/09/09 21:16:10 [error] 38#38: *53 directory index of "/opt/build-your-own-radar/export/" is forbidden, client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" [root@dtvbi-eastus2-nprd-gen-vm-1 ~]# ~ ~~~~~~~timed out waiting for input: auto-logout

prasadaws10 avatar Sep 12 '22 08:09 prasadaws10

hey @prasadaws10 , you are mentioning the wrong Devansh. @devansh-sharma-tw is the Devansh you need.

devansh avatar Sep 12 '22 08:09 devansh

Hi,

cb=gapi.loaded_0?le=scs:224 Uncaught {error: 'idpiframe_initialization_failed', details: "Not a valid origin for the client: https://dtvbi-t…egister this origin for your project's client ID."}

Can you check if your GCP Client ID has your current domain (that is running BYOR) set in the Authorized JavaScript Origins section ? More info about setting this is present here and here.

Hi Devansh,

I am still not able to load my data file. It says loading and in the back end I see this error. Do you have any availability to connect on a call ? I work in PST timings. Please let me know your time.

Docker logs:

172.18.0.3 - - [16/Aug/2022:16:26:05 +0000] "GET /images/tech-radar-landing-page-wide.png HTTP/1.1" 200 16509 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/main.89310c67680e48318f0d.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 172.18.0.3 - - [16/Aug/2022:16:26:05 +0000] "GET /images/favicon.ico HTTP/1.1" 200 1150 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 2022/08/16 16:26:07 [error] 39#39: *43 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [16/Aug/2022:16:26:07 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET / HTTP/1.1" 200 2617 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET /main.89310c67680e48318f0d.css HTTP/1.1" 200 13478 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET /images/tw-logo.png HTTP/1.1" 200 13041 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET /main.c7833f7c7eab6946a9b8.js HTTP/1.1" 304 0 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:12:49 +0000] "GET /images/tech-radar-landing-page-wide.png HTTP/1.1" 200 16509 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/main.89310c67680e48318f0d.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:13:09 +0000] "GET /?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing HTTP/1.1" 200 2617 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 2022/09/09 21:13:11 [error] 39#39: *50 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [09/Sep/2022:21:13:11 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:16:00 +0000] "GET / HTTP/1.1" 304 0 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 172.18.0.3 - - [09/Sep/2022:21:16:10 +0000] "GET /export/?format=pdf HTTP/1.1" 403 153 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38" 2022/09/09 21:16:10 [error] 38#38: *53 directory index of "/opt/build-your-own-radar/export/" is forbidden, client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" [root@dtvbi-eastus2-nprd-gen-vm-1 ~]# ~ ~~~~~~~timed out waiting for input: auto-logout

prasadaws10 avatar Sep 12 '22 09:09 prasadaws10

Hi Prasad

2022/08/16 16:26:07 [error] 39#39: *43 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [16/Aug/2022:16:26:07 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"

Can you please verify how/why the call to /export/?format=pdf endpoint is happening in your setup ? As this is not a part of the BYOR functionality. We do not expose any such end points in the application. This being a 403 is likely what's blocking the app from continuing after you give the sheet URL. I've tried the same sheet URL you mentioned earlier in my local docker instance. It's not making the call to /export for me.

We are working in IST time, so it would be tough to get on a call. Would be great if we can continue debugging over this issue here itself.

Thanks!

devansh-sharma-tw avatar Sep 13 '22 14:09 devansh-sharma-tw

Hi Prasad

2022/08/16 16:26:07 [error] 39#39: *43 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [16/Aug/2022:16:26:07 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"

Can you please verify how/why the call to /export/?format=pdf endpoint is happening in your setup ? As this is not a part of the BYOR functionality. We do not expose any such end points in the application. This being a 403 is likely what's blocking the app from continuing after you give the sheet URL. I've tried the same sheet URL you mentioned earlier in my local docker instance. It's not making the call to /export for me.

We are working in IST time, so it would be tough to get on a call. Would be great if we can continue debugging over this issue here itself.

Thanks!

Hi Devansh,

If you are available to connect I can send my bridge details in your available IST time. Please let me know. I am trying to set up this from almost a month. Appreciate your help.

I have removed the nginx and restarted the docker on port 80. I don't see any error but my file says it is loading. I tried different options like google sheet and csv from git. Below is the log:

10.2.4.38 - - [14/Sep/2022:04:20:18 +0000] "GET /images/tech-radar-landing-page-wide.png HTTP/1.1" 304 0 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/main.89310c67680e48318f0d.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" 10.2.4.38 - - [14/Sep/2022:04:20:21 +0000] "GET /?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew HTTP/1.1" 304 0 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" 10.2.4.38 - - [14/Sep/2022:04:20:27 +0000] "GET /?sheetId=https%3A%2F%2Fgithub.com%2Fprasadaws10%2FTworks%2Fblob%2F3ea41dbc51971caa9286bea25e101be31b81d54c%2FThoughtWorks%2520Technology%2520Radar.csv HTTP/1.1" 200 2617 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" 10.2.4.38 - - [14/Sep/2022:04:23:44 +0000] "GET /?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew HTTP/1.1" 304 0 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" 10.2.4.38 - - [14/Sep/2022:04:24:03 +0000] "GET /?sheetId=https%3A%2F%2Fgithub.com%2Fprasadaws10%2FTworks%2Fblob%2F34247f6336a4b41b20b8df4cc2ed9457e470f172%2FRadar.csv HTTP/1.1" 200 2617 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" ^[[

prasadaws10 avatar Sep 14 '22 04:09 prasadaws10

Hi Prasad

2022/08/16 16:26:07 [error] 39#39: *43 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com" 172.18.0.3 - - [16/Aug/2022:16:26:07 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"

Can you please verify how/why the call to /export/?format=pdf endpoint is happening in your setup ? As this is not a part of the BYOR functionality. We do not expose any such end points in the application. This being a 403 is likely what's blocking the app from continuing after you give the sheet URL. I've tried the same sheet URL you mentioned earlier in my local docker instance. It's not making the call to /export for me. We are working in IST time, so it would be tough to get on a call. Would be great if we can continue debugging over this issue here itself. Thanks!

Hi Devansh,

If you are available to connect I can send my bridge details in your available IST time. Please let me know. I am trying to set up this from almost a month. Appreciate your help.

I have removed the nginx and restarted the docker on port 80. I don't see any error but my file says it is loading. I tried different options like google sheet and csv from git. Below is the log:

10.2.4.38 - - [14/Sep/2022:04:20:18 +0000] "GET /images/tech-radar-landing-page-wide.png HTTP/1.1" 304 0 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/main.89310c67680e48318f0d.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" 10.2.4.38 - - [14/Sep/2022:04:20:21 +0000] "GET /?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew HTTP/1.1" 304 0 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" 10.2.4.38 - - [14/Sep/2022:04:20:27 +0000] "GET /?sheetId=https%3A%2F%2Fgithub.com%2Fprasadaws10%2FTworks%2Fblob%2F3ea41dbc51971caa9286bea25e101be31b81d54c%2FThoughtWorks%2520Technology%2520Radar.csv HTTP/1.1" 200 2617 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" 10.2.4.38 - - [14/Sep/2022:04:23:44 +0000] "GET /?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew HTTP/1.1" 304 0 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" 10.2.4.38 - - [14/Sep/2022:04:24:03 +0000] "GET /?sheetId=https%3A%2F%2Fgithub.com%2Fprasadaws10%2FTworks%2Fblob%2F34247f6336a4b41b20b8df4cc2ed9457e470f172%2FRadar.csv HTTP/1.1" 200 2617 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" ^[[

Hi Devansh,

Do you have any availability today ?

prasadaws10 avatar Sep 15 '22 06:09 prasadaws10

Hi Prasad,

"GET /?sheetId=https%3A%2F%2Fgithub.com%2Fprasadaws10%2FTworks%2Fblob%2F3ea41dbc51971caa9286bea25e101be31b81d54c%2FThoughtWorks%2520Technology%2520Radar.csv HTTP/1.1"

Can you please try the raw GitHub URL for the CSV file ? This would be the raw URL for the file you are trying: https://raw.githubusercontent.com/prasadaws10/Tworks/3ea41dbc51971caa9286bea25e101be31b81d54c/ThoughtWorks%20Technology%20Radar.csv This will work in the application. The direct GitHub URL (https://github.com/prasadaws10/Tworks/blob/3ea41dbc51971caa9286bea25e101be31b81d54c/ThoughtWorks%20Technology%20Radar.csv) would not work as that actually is an HTML file when fetched, not a CSV one.

"GET /?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew HTTP/1.1"

The SharePoint URL would not work as it is behind a user login. Only publicly accessible URLs (not behind any login mechanism) to CSV/JSON files are supported by the application.

Regarding the issue you were facing with /export/?format=pdf endpoint in the logs, as mentioned earlier it is not a functionality of the BYOR application, so unfortunately we would not be able to help fix it.

Thanks!

devansh-sharma-tw avatar Sep 21 '22 14:09 devansh-sharma-tw

Hi Prasad,

"GET /?sheetId=https%3A%2F%2Fgithub.com%2Fprasadaws10%2FTworks%2Fblob%2F3ea41dbc51971caa9286bea25e101be31b81d54c%2FThoughtWorks%2520Technology%2520Radar.csv HTTP/1.1"

Can you please try the raw GitHub URL for the CSV file ? This would be the raw URL for the file you are trying: https://raw.githubusercontent.com/prasadaws10/Tworks/3ea41dbc51971caa9286bea25e101be31b81d54c/ThoughtWorks%20Technology%20Radar.csv This will work in the application. The direct GitHub URL (https://github.com/prasadaws10/Tworks/blob/3ea41dbc51971caa9286bea25e101be31b81d54c/ThoughtWorks%20Technology%20Radar.csv) would not work as that actually is an HTML file when fetched, not a CSV one.

"GET /?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew HTTP/1.1"

The SharePoint URL would not work as it is behind a user login. Only publicly accessible URLs (not behind any login mechanism) to CSV/JSON files are supported by the application.

Regarding the issue you were facing with /export/?format=pdf endpoint in the logs, as mentioned earlier it is not a functionality of the BYOR application, so unfortunately we would not be able to help fix it.

Thanks!

@devansh-sharma-tw,

Is there any documentation or URL link on how to use this tool or functionality. Can you please share any such link.

Thank You.

prasadaws10 avatar Sep 21 '22 16:09 prasadaws10

Hi Prasad,

You can follow this project's README for instructions on how to use with hosted CSV files here. Additionally, you can look for steps on how to use the application with Google Sheets here.

Thanks!

devansh-sharma-tw avatar Sep 26 '22 09:09 devansh-sharma-tw