texera icon indicating copy to clipboard operation
texera copied to clipboard

Introduce engine version for workflow executions

Open liqinye opened this issue 3 years ago • 1 comments

This PR introduces Texera engine version to each workflow execution. The engine version is a hash code created automatically when the Texera is run. The engine version is not shown in the front end but can be checked in the sql for now.

liqinye avatar Aug 07 '22 05:08 liqinye

Operator version is introduced. Any modification of the operators in the Texera will be traced (from the code implementation perspective). The Operator version we generated is the git commit hash code that is related to the latest operator implementation changes. Now, the environment version that is associated with each execution would have engine version (front end) and operator version

Screen Shot 2022-08-12 at 12 18 34 AM

liqinye avatar Aug 12 '22 07:08 liqinye

  • Instead of having one operator version for all, we retrieve the latest git commit hash code for each operator individually.
  • The latest version of all operators are retrieved and updated once the Texera Web Application start to run and are stored into a file named operator_version.properties.
  • Each operator's own version is displayed like a footnote in the operator property editor (see the GIF below)
  • The corresponding version of the operator will be stored in sql so that it can be retrieved when we want to view a particular execution and see if the operator version has changed.

operator_version

liqinye avatar Aug 27 '22 06:08 liqinye

Operator version frontend display updated Screen Shot 2022-08-29 at 10 55 01 AM

liqinye avatar Aug 29 '22 18:08 liqinye

please add test cases

sadeemsaleh avatar Sep 02 '22 20:09 sadeemsaleh

Enable to highlight operator version if the operator version is different in workflow version track. Demo: opVersionHighlight

liqinye avatar Sep 08 '22 07:09 liqinye