microsoft
Add page number to Memory Records.
Motivation and Context (Why the change? What's the scenario?)
I'd like to solve discussion #669 the ability to insert page number inside Memory Record in the Section property.
High level description (Approach, Design)
Introduced a new TextChunker2 that allows for specification of a series of line with a tag, then it will split based on token number, but instead of creating simple lines in output it will preserve the tag of the original line. I've chosen a tag object so we can add more info if needed, in this PR I've added the plain page number.
Needs to check if the overall implant of the PR is ok, then I'll finish implementation and testing of TextChunk2. Actually we can even validate that TextChunk2 is the only one chunker (it works exactly as TextChunk with the only addition of keeping tracks of a tag associated to a piece of text).
