tiflow icon indicating copy to clipboard operation
tiflow copied to clipboard

Improving logging and monitoring to help better debug

Open CharlesCheung96 opened this issue 3 years ago • 0 comments

Logging

Error handling

When the error happend, use cerror.WrapError to wrap the error by self defined RFCError if the error is from third party, or call errors.Trace to track the call stack. error.Annotate is not recommend to use.

  • [ ] add development guide about how to handle error in the TiCDC
  • [x] #6778

Log level

logs

  • [x] #6884
  • [x] #6905
  • [x] #6988

Monitoring

  • [ ] #6847
  • [ ] introduce ticdc-summary grafana panel
  • [ ] #6871
  • [ ] #6445
  • [ ] #6982
  • [x] #7049
  • [x] #7243

Add monitoring and logs to the main flow of CDC

  • [x] #3884

Improve log and monitor for submodules of CDC

  • [ ] Check for blocking and high latency problems on the main dataflow of CDC
  • [ ] Strengthen the monitoring of processor pipeline
  • [ ] #5072
  • [x] #5229

Split Sink metrics

  • [x] #5013

Add sarama producer monitoring

  • [x] #4561
  • [x] #4588
  • [x] #4964
  • [x] #4965
  • [x] #4966

Owner

  • [x] #4821

add ticdc-summary

Refact logging and monitoring related things

  • [ ] refact changefeedID, captureAddr, role in the context.
  • [x] #4607
  • [x] #4858

docs

  • [x] #5029
  • [x] #5030

CharlesCheung96 avatar Jan 26 '22 07:01 CharlesCheung96