[GH-ISSUE #550] Breaks on long files (missing retry logic) #90

Open
opened 2026-03-03 13:52:53 +03:00 by kerem · 4 comments
Owner

Originally created by @txkbir on GitHub (Jul 28, 2025).
Original GitHub issue: https://github.com/jehna/humanify/issues/550

i'm trying to process a 180k line file using my own OAI api key, but i consistently crash after 6-7% of the file has been processed (which takes me approximately 1.5h). i'm curious if someone can share insights on the most complex / largest projects that this tool has successfully handled?

Originally created by @txkbir on GitHub (Jul 28, 2025). Original GitHub issue: https://github.com/jehna/humanify/issues/550 i'm trying to process a 180k line file using my own OAI api key, but i consistently crash after 6-7% of the file has been processed (which takes me approximately 1.5h). i'm curious if someone can share insights on the most complex / largest projects that this tool has successfully handled?
Author
Owner

@0xdevalias commented on GitHub (Jul 29, 2025):

@txkbir Are you able to provide details/specifics about what is crashing / what the error is?

And also what platform you're running on, node version, etc.

<!-- gh-comment-id:3130199348 --> @0xdevalias commented on GitHub (Jul 29, 2025): @txkbir Are you able to provide details/specifics about what is crashing / what the error is? And also what platform you're running on, node version, etc.
Author
Owner

@txkbir commented on GitHub (Jul 29, 2025):

i get an InternalServerError: 503 upstream connect error or disconnect/reset before headers. reset reason: connection termination at APIError.generate (file:///Users/takbir/.nvm/versions/node/v21.2.0/lib/node_modules/humanifyjs/node_modules/openai/error.mjs:62:20) at OpenAI.makeStatusError, which seems to mean it has nothing to do with the code but rather the api server. regardless, i'm still curious if my performance metrics sound reasonable based on what has been tested by this tool to handle.

im running node v21.2.0 with npm v10.2.3 on macOS sequoia 15.5

<!-- gh-comment-id:3133173549 --> @txkbir commented on GitHub (Jul 29, 2025): i get an `InternalServerError: 503 upstream connect error or disconnect/reset before headers. reset reason: connection termination at APIError.generate (file:///Users/takbir/.nvm/versions/node/v21.2.0/lib/node_modules/humanifyjs/node_modules/openai/error.mjs:62:20) at OpenAI.makeStatusError`, which seems to mean it has nothing to do with the code but rather the api server. regardless, i'm still curious if my performance metrics sound reasonable based on what has been tested by this tool to handle. im running node v21.2.0 with npm v10.2.3 on macOS sequoia 15.5
Author
Owner

@brianjenkins94 commented on GitHub (Jul 29, 2025):

My guess would be that's related to humanify's dependency of openai being a major version behind what's current.

<!-- gh-comment-id:3133267038 --> @brianjenkins94 commented on GitHub (Jul 29, 2025): My guess would be that's related to `humanify`'s dependency of `openai` being a major version behind what's current.
Author
Owner

@jehna commented on GitHub (Jan 25, 2026):

The underlying issue here is that there's no proper error handling logic on the 3rd party API clients. I'm thinking we'll probably need to add some kind of queue with retry logic to fix this.

<!-- gh-comment-id:3797303867 --> @jehna commented on GitHub (Jan 25, 2026): The underlying issue here is that there's no proper error handling logic on the 3rd party API clients. I'm thinking we'll probably need to add some kind of queue with retry logic to fix this.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/humanify#90
No description provided.