transformers.js
transformers.js copied to clipboard
aggregation strategy and offset mapping
Following #750, clean up changes in branch
- TokenClassificationPipeline aggregation_strategy
- TokenClassificationPipeline start end char
- QuestionAnsweringPipeline start end char
- Tokenizer return_offsets_mapping
- Similar to Python transformers
- Marked as TODO in the code
- Close Is 'aggregation_strategy' parameter available for token classification pipeline? #633
- Close [Feature request] Return offset mapping using tokenizer #425