flyte-flink-plugin icon indicating copy to clipboard operation
flyte-flink-plugin copied to clipboard

Published 20 hours ago • verified publisher icon spotify

Add worker config

Open smikloska opened this issue 1 year ago • 2 comments

Adding the ability to configure worker with tshirt size and type. These can be used in the flink cluster creation to construct taskmanager configuration (not added in this PR)

smikloska avatar Oct 26 '23 18:10 smikloska

At first, it appears that this is being added to proto but leveraged somewhere else, is that correct?

Yes. It is used by a closed source plugin that depends on this plugin

I would really prefer that whatever is added to be leveraged by the plugin as well.

Should we make use of it for worker sizing to make the PR more complete? 🤔 @regadas

live-wire avatar Dec 21 '23 10:12 live-wire

Should we make use of it for worker sizing to make the PR more complete?

@live-wire let me think about this for a little bit. We can also sync at some point IRL (maybe first week of jan?)

regadas avatar Dec 21 '23 14:12 regadas