riju icon indicating copy to clipboard operation
riju copied to clipboard

Roadmap: Riju architecture improvements

Open raxod502 opened this issue 3 years ago • 19 comments

Riju has some serious scalability and maintainability problems, and I've been thinking for the last few months about how to address them. For transparency, I created the following roadmap outlining my plans:

https://nextcloud.intuitiveexplanations.com/s/mHoFwFGMNCpLjim [note: moved from Google Drive to Nextcloud]

Feedback is of course welcome!

raxod502 avatar Jan 23 '22 23:01 raxod502

Riju has some serious scalability and maintainability problems, and I've been thinking for the last few months about how to address them. For transparency, I created the following roadmap outlining my plans:

https://docs.google.com/document/d/e/2PACX-1vRKkmilDiHXW8wpwFCplLrXRo-ANCLLTPpJ7vl4pI4diZAxr56vyuAo6NQ0ZTVYhf-X5HcQlVx3Ud9u/pub

Feedback is of course welcome!

Don't have access to the Google Doc, could you share it as a PDF?

hello-smile6 avatar Jan 24 '22 06:01 hello-smile6

I'm curious what issue you ran into, I seem to be able to access the link in your comment using unauthenticated curl, without even any JavaScript?

raxod502 avatar Jan 29 '22 04:01 raxod502

I'm curious what issue you ran into, I seem to be able to access the link in your comment using unauthenticated curl, without even any JavaScript?

Permissions issues with non-gmail account.

hello-smile6 avatar Jan 30 '22 23:01 hello-smile6

You probably saw the original version of the link, which was broken. I edited the issue shortly after posting it. Try it again.

raxod502 avatar Jan 31 '22 00:01 raxod502

You probably saw the original version of the link, which was broken. I edited the issue shortly after posting it. Try it again.

Okay

hello-smile6 avatar Jan 31 '22 00:01 hello-smile6

You probably saw the original version of the link, which was broken. I edited the issue shortly after posting it. Try it again.

image Yes, I removed my email.

hello-smile6 avatar Jan 31 '22 00:01 hello-smile6

Huh, not sure what to say. When signed into another Google account that doesn't have access to that document, it works for me. Also works if I'm not signed into any Google account. It's not an IP address restriction either since I can even access it through Tor. And, as I mentioned, curl works fine with no authentication whatsoever. Perhaps it's some kind of issue that affects your account specifically. Seems like a pretty rare issue judging by the lack of discussion online about the error message.

raxod502 avatar Jan 31 '22 01:01 raxod502

Huh, not sure what to say. When signed into another Google account that doesn't have access to that document, it works for me. Also works if I'm not signed into any Google account. It's not an IP address restriction either since I can even access it through Tor. And, as I mentioned, curl works fine with no authentication whatsoever. Perhaps it's some kind of issue that affects your account specifically. Seems like a pretty rare issue judging by the lack of discussion online about the error message.

Okay, maybe use this link? It goes through a CORS proxy. https://cors-anywhere.9pfs.repl.co/docs.google.com/document/d/e/2PACX-1vRKkmilDiHXW8wpwFCplLrXRo-ANCLLTPpJ7vl4pI4diZAxr56vyuAo6NQ0ZTVYhf-X5HcQlVx3Ud9u/pub

hello-smile6 avatar Jan 31 '22 01:01 hello-smile6

@raxod502 I just used Tor as a test (for the first time) to open it, and I can confirm that it works.

hello-smile6 avatar Jan 31 '22 04:01 hello-smile6

Wow this is a super exciting proposal!

plondon avatar Feb 01 '22 13:02 plondon

Prometheus metrics are :fire: and much better than CloudWatch.

image

raxod502 avatar Feb 12 '22 06:02 raxod502

Did you have an outage at 21:55 in that screenshot?

hello-smile6 avatar Feb 12 '22 21:02 hello-smile6

No, this is all on a staging instance not serving any live traffic.

raxod502 avatar Feb 12 '22 21:02 raxod502

No, this is all on a staging instance not serving any live traffic.

Oh.

hello-smile6 avatar Feb 12 '22 21:02 hello-smile6

Hi @raxod502!

Checking in on the progress and timeline (if any) of this roadmap?

plondon avatar Jun 21 '22 12:06 plondon

Hey @plondon. Sorry for the delay - I've moved apartments and have been spending the last few weeks unpacking boxes and putting together furniture.

I haven't done much work on this specific roadmap, mostly because I've had other ideas about how to rebuild things from scratch using the knowledge I've gained over the last year from other infrastructure-related personal projects as well as my experience operating Kubernetes at Plaid.

I have a project in progress that is a Heroku-like platform with true user authentication and workload scheduling on Kubernetes, and a separate project that rewrites Riju to use Go microservices and a relational database. Neither of those are MVP enough that I've put them up on GitHub yet. Learning a bunch of things, but since these are all things I'm working on ad hoc in my free time, they compete with all the other stuff going on.

Let me know if I can answer any specific questions!

raxod502 avatar Jul 08 '22 23:07 raxod502

What the progress on this so far now?

nyabinary avatar Nov 22 '23 14:11 nyabinary

Unfortunately, still https://github.com/radian-software/riju/issues/168. Considerable architectural work is needed to get Riju back into a state where I am able to deploy changes, and I haven't had time yet with all the other things that have taken time in my personal computing and non-computing life.

raxod502 avatar Nov 23 '23 20:11 raxod502