what are the performance capabilities of this tool
i'm trying to process a 180k line file using my own OAI api key, but i consistently crash after 6-7% of the file has been processed (which takes me approximately 1.5h). i'm curious if someone can share insights on the most complex / largest projects that this tool has successfully handled?
@txkbir Are you able to provide details/specifics about what is crashing / what the error is?
And also what platform you're running on, node version, etc.
i get an InternalServerError: 503 upstream connect error or disconnect/reset before headers. reset reason: connection termination at APIError.generate (file:///Users/takbir/.nvm/versions/node/v21.2.0/lib/node_modules/humanifyjs/node_modules/openai/error.mjs:62:20) at OpenAI.makeStatusError, which seems to mean it has nothing to do with the code but rather the api server. regardless, i'm still curious if my performance metrics sound reasonable based on what has been tested by this tool to handle.
im running node v21.2.0 with npm v10.2.3 on macOS sequoia 15.5
My guess would be that's related to humanify's dependency of openai being a major version behind what's current.