grimoirelab icon indicating copy to clipboard operation
grimoirelab copied to clipboard

Provide helm chart deploy method

Open Eroyi opened this issue 1 year ago • 8 comments

Using helm chart to deploy:

  • Mordred
  • Nginx
  • Sortinghat
  • Sortinghat Worker
  • Opensearch
  • Opensearch Dashboard

Eroyi avatar Oct 29 '24 04:10 Eroyi

Does it mean we can remove the other files that we have to deploy on kubernetes?

Absolutely, you may remove those deployment.yaml files since the helm chart is now available for Kubernetes deployment. But I must remind that helm charts, especially nested charts like this, are highly abstracted compared to the loose yaml file, which means it's more tricky to debug and hot-wire things. I'll maintain this as long as I can, but highly recommend you get a helm chart specialist rather than rely on the community.

Could you also update the README file to explain a little bit more about how to configure and deploy it using helm. Also, all files don't end on an empty line. Please update them.

Sure, will do.

Eroyi avatar Oct 31 '24 04:10 Eroyi

@Eroyi tell me when you think the PR is ready to review it.

sduenas avatar Nov 07 '24 09:11 sduenas

@Eroyi tell me when you think the PR is ready to review it.

All of a sudden I failed to clone any GitHub repos from my Ubuntu, so I had to do things through the browser on github.com and Windows PC. Apologise for the messy commits.

Anyway I scrubbed all the Windows format toxics, LGTM now, please review.

This chart is tested in our Kubernetes cluster (with mariadb and redis installed separately).

Eroyi avatar Nov 08 '24 02:11 Eroyi

@Eroyi tell me when you think the PR is ready to review it.

All of a sudden I failed to clone any GitHub repos from my Ubuntu, so I had to do things through the browser on github.com and Windows PC. Apologise for the messy commits.

Anyway I scrubbed all the Windows format toxics, LGTM now, please review.

This chart is tested in our Kubernetes cluster (with mariadb and redis installed separately).

I haven't merged this PR yet because I talked the other day to some people interested on checking it too. Let's wait some days and if we haven't heard anything, we'll merge it.

sduenas avatar Dec 03 '24 08:12 sduenas

@Eroyi tell me when you think the PR is ready to review it.

All of a sudden I failed to clone any GitHub repos from my Ubuntu, so I had to do things through the browser on github.com and Windows PC. Apologise for the messy commits. Anyway I scrubbed all the Windows format toxics, LGTM now, please review. This chart is tested in our Kubernetes cluster (with mariadb and redis installed separately).

I haven't merged this PR yet because I talked the other day to some people interested on checking it too. Let's wait some days and if we haven't heard anything, we'll merge it.

@sduenas thank you for your following upp. Yeah i noticed that issue you mentioned, I haven't seen any replied too. Speak of that I am highly recommend you or your team give a try on this helm chart before merging, in case of anything doesn't work as expected (or any ambiguous in readme / instruction), there I can fix it asap before it affetcs the users.

Eroyi avatar Dec 06 '24 03:12 Eroyi

I've been trying to run Grimoirelab on OpenShift using this helm chart, and currently I'm gettinga permission denied error in sortinghat pod. Does anyone have an idea how to fix this?

Error trace:

## SortingHat static files installation
Traceback (most recent call last):
File "/opt/venv/bin/sortinghat-admin", line 8, in <module>
sys.exit(sortinghat_admin())
File "/opt/venv/lib/python3.9/site-packages/click/core.py", line 1157, in __call__
return self.main(*args, **kwargs)
File "/opt/venv/lib/python3.9/site-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
File "/opt/venv/lib/python3.9/site-packages/click/core.py", line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/opt/venv/lib/python3.9/site-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/opt/venv/lib/python3.9/site-packages/click/core.py", line 783, in invoke
return __callback(*args, **kwargs)
File "/opt/venv/lib/python3.9/site-packages/sortinghat/server/sortinghat_admin.py", line 84, in setup
_setup(no_interactive=no_interactive, only_ui=only_ui)
File "/opt/venv/lib/python3.9/site-packages/sortinghat/server/sortinghat_admin.py", line 135, in _setup
_install_static_files()
File "/opt/venv/lib/python3.9/site-packages/sortinghat/server/sortinghat_admin.py", line 423, in _install_static_files
management.call_command('collectstatic', clear=True,
File "/opt/venv/lib/python3.9/site-packages/django/core/management/__init__.py", line 194, in call_command
return command.execute(*args, **defaults)
File "/opt/venv/lib/python3.9/site-packages/django/core/management/base.py", line 458, in execute
output = self.handle(*args, **options)
File "/opt/venv/lib/python3.9/site-packages/django/contrib/staticfiles/management/commands/collectstatic.py", line 209, in handle
collected = self.collect()
File "/opt/venv/lib/python3.9/site-packages/django/contrib/staticfiles/management/commands/collectstatic.py", line 135, in collect
handler(path, prefixed_path, storage)
File "/opt/venv/lib/python3.9/site-packages/django/contrib/staticfiles/management/commands/collectstatic.py", line 378, in copy_file
self.storage.save(prefixed_path, source_file)
File "/opt/venv/lib/python3.9/site-packages/django/core/files/storage/base.py", line 49, in save
name = self._save(name, content)
File "/opt/venv/lib/python3.9/site-packages/django/core/files/storage/filesystem.py", line 87, in _save
os.makedirs(directory, exist_ok=True)
File "/usr/local/lib/python3.9/os.py", line 215, in makedirs
makedirs(head, exist_ok=exist_ok)
File "/usr/local/lib/python3.9/os.py", line 225, in makedirs
mkdir(name, mode)
PermissionError: [Errno 13] Permission denied: '/opt/venv/lib/python3.9/site-packages/sortinghat/static/admin'

hanygirgis avatar Jan 15 '25 12:01 hanygirgis

I've been trying to run Grimoirelab on OpenShift using this helm chart, and currently I'm gettinga permission denied error in sortinghat pod. Does anyone have an idea how to fix this?

Error trace:

## SortingHat static files installation
Traceback (most recent call last):
File "/opt/venv/bin/sortinghat-admin", line 8, in <module>
sys.exit(sortinghat_admin())
File "/opt/venv/lib/python3.9/site-packages/click/core.py", line 1157, in __call__
return self.main(*args, **kwargs)
File "/opt/venv/lib/python3.9/site-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
File "/opt/venv/lib/python3.9/site-packages/click/core.py", line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/opt/venv/lib/python3.9/site-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/opt/venv/lib/python3.9/site-packages/click/core.py", line 783, in invoke
return __callback(*args, **kwargs)
File "/opt/venv/lib/python3.9/site-packages/sortinghat/server/sortinghat_admin.py", line 84, in setup
_setup(no_interactive=no_interactive, only_ui=only_ui)
File "/opt/venv/lib/python3.9/site-packages/sortinghat/server/sortinghat_admin.py", line 135, in _setup
_install_static_files()
File "/opt/venv/lib/python3.9/site-packages/sortinghat/server/sortinghat_admin.py", line 423, in _install_static_files
management.call_command('collectstatic', clear=True,
File "/opt/venv/lib/python3.9/site-packages/django/core/management/__init__.py", line 194, in call_command
return command.execute(*args, **defaults)
File "/opt/venv/lib/python3.9/site-packages/django/core/management/base.py", line 458, in execute
output = self.handle(*args, **options)
File "/opt/venv/lib/python3.9/site-packages/django/contrib/staticfiles/management/commands/collectstatic.py", line 209, in handle
collected = self.collect()
File "/opt/venv/lib/python3.9/site-packages/django/contrib/staticfiles/management/commands/collectstatic.py", line 135, in collect
handler(path, prefixed_path, storage)
File "/opt/venv/lib/python3.9/site-packages/django/contrib/staticfiles/management/commands/collectstatic.py", line 378, in copy_file
self.storage.save(prefixed_path, source_file)
File "/opt/venv/lib/python3.9/site-packages/django/core/files/storage/base.py", line 49, in save
name = self._save(name, content)
File "/opt/venv/lib/python3.9/site-packages/django/core/files/storage/filesystem.py", line 87, in _save
os.makedirs(directory, exist_ok=True)
File "/usr/local/lib/python3.9/os.py", line 215, in makedirs
makedirs(head, exist_ok=exist_ok)
File "/usr/local/lib/python3.9/os.py", line 225, in makedirs
mkdir(name, mode)
PermissionError: [Errno 13] Permission denied: '/opt/venv/lib/python3.9/site-packages/sortinghat/static/admin'

Looks like an issue related to pod's python runtime @sduenas

Eroyi avatar Jan 20 '25 08:01 Eroyi

Off topic: If you're coming to FOSDEM, it would be great to meet up there. On Thursday, we're hosting CHAOSScon and will have a GrimoireLab workshop in the afternoon. You can email me if you like to set up a meeting with others from GrimoireLab. (sorry for posting in the PR, I didn't know how else to invite you. your work on the helm chart is appreciated).

GeorgLink avatar Jan 27 '25 16:01 GeorgLink