ChRIS_ultron_backEnd icon indicating copy to clipboard operation
ChRIS_ultron_backEnd copied to clipboard

Plugin instance logs

Open jennydaman opened this issue 2 years ago • 6 comments

There are some current issues with how logs are represented and stored:

  • https://github.com/FNNDSC/ChRIS_ultron_backEnd/issues/364
  • https://github.com/FNNDSC/pman/issues/197

Some ideas regarding how it can be improved:

Store Logs in Object Storage

Currently they're saved in the database as a string

https://github.com/FNNDSC/ChRIS_ultron_backEnd/blob/9ec45e8d5dfd6a6603eefe51504061898608c173/chris_backend/plugininstances/models.py#L39

However, logs can be large and they are not necessarily (encoded) strings.

My recommendation is to use a cloud-native log storage service, such as:

  • https://quickwit.io/
  • https://grafana.com/oss/loki/
  • https://openobserve.ai/

jennydaman avatar Mar 19 '22 21:03 jennydaman

Hi! I am Pridhi and a potential Outreachy intern. I am rooting for the project `Improve how plugin instance logs are stored in the backend. I am trying to understand what possible object storage we can use. Right now, Amazon s3 and its open-source alternative Minio come to my mind. Please shed some light on this topic.

pridhi-arora avatar Oct 10 '22 07:10 pridhi-arora

Hello

Hope you are doing good on this day. My name is Nigale and i am an outreachy applicant. Can this task be assigned to me, i will like to work on.

Best

Nigale-Djomo avatar Oct 10 '22 12:10 Nigale-Djomo

@jennydaman Hello everyone my name is Tedom Donald I'm Outreachy applicant and I want to contribute on ChRIS . I'have follow this tow tutorials (How ChRIS Works and Get ChRIS Running) to really understand the project base on image processing.

I'm trying to setup the project on my local machine, but I'm getting some error. In project description on Outreachy it's mention that there is a group where we can ask question but I'm not seeing the link to go through that community exchange.

Please @jennydaman our mentor I really need a directory.

best regard

donaldte avatar Oct 11 '22 09:10 donaldte

@donaldte please join https://matrix.to/#/#chris-outreachy:fedora.im

jennydaman avatar Oct 12 '22 03:10 jennydaman

@Nigale-Djomo and @pridhi-arora this issue is related to one of the proposed projects for the Outreachy internship and may be too big to work on during the contribution phase. If either of you would like to work on it, please draft a proposal for how you will solve the problem and have me review it before implementing your proposed solution.

jennydaman avatar Oct 12 '22 03:10 jennydaman

Here is the first draft of the proposal you asked for the object storage of logs. Your feedback is highly appreciated.

pridhi-arora avatar Oct 14 '22 18:10 pridhi-arora