crane icon indicating copy to clipboard operation
crane copied to clipboard

NodeResourceController should merge real-time data from nodes to compute ext resources

Open shijieqin opened this issue 2 years ago • 0 comments

Describe the feature

The current NodeResourceController only calculates the kubernetes node's ext resource based on TSP's prediction data, and does not update when TSP has no data, however, in some cases TSP will not be able to calculate the data and TSP is not sensitive to bursts, so we need to merge real-time data of kubernetes nodes to assist NodeResourceController in calculating ext resource.

  1. If we want to merge real-time data to assist calculations, we first have to put it together The logic of nodeResourceController is implemented in the crane-agent.
  2. Crane-agent uses timeSeriesPredictionInformer to sense changes in TSP and notify NodeResourceManager, NodeResourceManager collect data from other collectors (including collectors of real-time data) and merges them with TSP's data, and finds the maximum value from the merged data to calculate the ext resource
  3. In order to avoid abnormal TSP controller and cause TSP not to be updated for a long time, NodeResourceManager's real-time data Collector will regularly notify NodeResourceManager.NodeResourceManager collects and merges other Collector data (including TSP Collector data). And get the maximum value from the merged data to calculate the ext resource.

shijieqin avatar Mar 02 '22 06:03 shijieqin