EasyDeL
EasyDeL copied to clipboard
fix: implement tool parser cloning for isolated request handling
This pull request introduces improvements to how tool parsers are managed and used during streaming inference in both the esurge and vsurge servers. The main goal is to ensure that each request operates with an isolated instance of the tool parser, preventing potential state leakage between requests and enhancing thread safety.