dify icon indicating copy to clipboard operation
dify copied to clipboard

Support regex pattern in segement(Fixed bug)

Open hibernate2011 opened this issue 10 months ago • 0 comments

Description

Use regex pattern to better control the segement result in text cleaning

Type of Change

Please delete options that are not relevant.

  • [ ] Bug fix (non-breaking change which fixes an issue)
  • [x] New feature (non-breaking change which adds functionality)
  • [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • [ ] This change requires a documentation update, included: Dify Document
  • [ ] Improvement, including but not limited to code refactoring, performance optimization, and UI/UX improvement
  • [ ] Dependency upgrade

How Has This Been Tested?

  • [x] Tested in local environment

default

regex

Suggested Checklist:

  • [x] I have performed a self-review of my own code
  • [x] I have commented my code, particularly in hard-to-understand areas
  • [x] My changes generate no new warnings
  • [ ] I ran dev/reformat(backend) and cd web && npx lint-staged(frontend) to appease the lint gods
  • [ ] optional I have made corresponding changes to the documentation
  • [ ] optional I have added tests that prove my fix is effective or that my feature works
  • [ ] optional New and existing unit tests pass locally with my changes

Next Step:

Please help edit i18n transelate for 'separatorPlaceholder' in all dataset-creation.ts files, because I'm afraid my translation won't be accurate

hibernate2011 avatar Apr 11 '24 11:04 hibernate2011