tiflow icon indicating copy to clipboard operation
tiflow copied to clipboard

Tracking issues: refining meta pkg

Open maxshuang opened this issue 2 years ago • 2 comments

Is your feature request related to a problem?

Refine meta pkg of engine to achieve:

  • support new isolation for meta(all tiflow clusters share the same store)
    • We use unique cluster uuid to construct the schema to achieve cluster isolation
    • We use unique projectID to construct table name to achieve project isolation
    • We use <jobID, Key> as uk to achieve job-level isolation
  • move inner implement of kv client to internal pkg
  • sql implement for kv client suppport job level isolation

Describe the feature you'd like

TaskList:

  • [x] refine the StoreConfigParams to support Schema param https://github.com/pingcap/tiflow/issues/6173
  • [x] refine the meta pkg dir https://github.com/pingcap/tiflow/pull/6179
  • [x] refine the implement of orm and meta to support new isolation schema https://github.com/pingcap/tiflow/pull/6202
  • [x] sql implement for kv client to support job-level isolation https://github.com/pingcap/tiflow/pull/6220
  • [x] business metastore uses mysql in test https://github.com/pingcap/tiflow/pull/6435
  • [x] decouple the framework model creation and client creation https://github.com/pingcap/tiflow/pull/6439
  • [ ] split orm pkg to specified model

Describe alternatives you've considered

No response

Teachability, Documentation, Adoption, Migration Strategy

No response

maxshuang avatar Jul 03 '22 13:07 maxshuang

/area engine

maxshuang avatar Jul 03 '22 13:07 maxshuang

/assign @maxshuang

maxshuang avatar Jul 03 '22 13:07 maxshuang