terrakube icon indicating copy to clipboard operation
terrakube copied to clipboard

Terrakube Executor Agents for Jobs

Open alfespa17 opened this issue 2 years ago • 4 comments

Feature description 💡

Currently if you are using a remote job it is executed inside the "executor component" this component can scale horizontally and can process a lot of job concurrently, but it could be a good idea to add a way to execute jobs in different "agents" like for example if necesarry run the job in a "agent" just for one or more organizations, like having different "executors" based on some predefine rules inside the templates

Anything else?

No response

alfespa17 avatar Dec 13 '23 22:12 alfespa17

This could be also security enhancement where jobs (workflow) are executed within independent dynamically created container and not interfere with other jobs (workflow). This pattern is quite popular ex jenkins with kubernetes agent.

dawidmalina avatar Feb 10 '24 16:02 dawidmalina

This could be also security enhancement where jobs (workflow) are executed within independent dynamically created container and not interfere with other jobs (workflow). This pattern is quite popular ex jenkins with kubernetes agent.

I tried to do it this way using a separate container a long time ago but I was facing some kubernetes issue when creating the container I guess it was some service account access restriction and I never had the time to fix it, even the executor component still have the code to run in a kind batch mode executing just one job if i remember correctly

alfespa17 avatar Feb 10 '24 17:02 alfespa17

If you still have that change somewhere i could try to test and help with kubernetes part if you want.

dawidmalina avatar Feb 10 '24 17:02 dawidmalina

If you still have that change somewhere i could try to test and help with kubernetes part if you want.

I will search the error information, I should have somewhere in my notes and update here once I found it.

alfespa17 avatar Feb 10 '24 17:02 alfespa17