Luis Quintanilla
Luis Quintanilla
> @luisquintanilla , I have added this to the project team so we can track this. Sounds great. Thanks!
> @luisquintanilla we're doing some work to integrate tiktoken, does ML.Tokenizer include additional tokenizers, not part of tiktoken? @dluc Currently ML.Tokenizers supports only BPE which I think is also the...
Thanks for these changes @lemillermicrosoft. They look great. Feel free to close this when the PR merges.
Makes sense to me especially the potential for integration with existing .NET libraries and tools. From a repo / ownership perspective I'm happy to follow the AutoGen community lead here.
Looks like Qdrant has built support for AutoGen. It'd be interesting to test out the integration in .NET. https://qdrant.tech/documentation/integrations/autogen/
@GoEddie @GeorgeS2019 since the project is open-source and part of the .NET Foundation is this something the community would be interested in contributing to in order to help move it...
Thanks @GoEddie & @GeorgeS2019. This is definitely something for us to look into how we can unblock you and by extension the project.
## Consume ONNX Workflow ```mermaid graph LR; Train model --> Export to ONNX; Export to ONNX --> Load into ML.NET; ```
Looks great!
> Can we maybe combine notebooks? #21 Maybe. I was going to rework mine anyway. There's a lot of non-actionable info on here I was just thinking of trimming it...