Tanvi Garg

icon indicating a website link https://tanvi09garg.github.io/

icon company University of North Carolina at Charlotte icon location Charlotte, NC icon location Graduate Teaching Assistant | MS CS student at UNC Charlotte | Ex-Data Analyst @Wipro | Python | Power BI | Tableau | SQL| 1×AWS | 1×Power BI

Results 2 comments of Tanvi Garg

Tokenizer attribute .tokens_from_list deprecated

Instead using old_tokenizer.tokens_from_list, you can substitute any custom tokenizer that does the correct input -> Doc conversion with the correct vocab for nlp.tokenizer: from spacy.tokens import Doc class _PretokenizedTokenizer: """Custom...

Tokenizer attribute .tokens_from_list deprecated

'List' is used to store input string/text