[GH-ISSUE #723] [FEATURE REQUEST] Bulk Enqueue Tasks #2377

Open
opened 2026-03-15 20:18:13 +03:00 by kerem · 1 comment
Owner

Originally created by @FaBeyyy on GitHub (Aug 13, 2023).
Original GitHub issue: https://github.com/hibiken/asynq/issues/723

Originally assigned to: @hibiken on GitHub.

Is your feature request related to a problem? Please describe.
Enqueueing millions of tasks can be slow and annoying.

Describe the solution you'd like
Enqueueing multiple tasks should be possible in a single function call

Originally created by @FaBeyyy on GitHub (Aug 13, 2023). Original GitHub issue: https://github.com/hibiken/asynq/issues/723 Originally assigned to: @hibiken on GitHub. **Is your feature request related to a problem? Please describe.** Enqueueing millions of tasks can be slow and annoying. **Describe the solution you'd like** Enqueueing multiple tasks should be possible in a single function call
Author
Owner

@kamikazechaser commented on GitHub (Aug 14, 2023):

Related to #535

Are you using client.Enqueue? Because this is expected to be slow when attempting to add millions of keys because of network round trips.

This could be solved with pipelines.

<!-- gh-comment-id:1676668762 --> @kamikazechaser commented on GitHub (Aug 14, 2023): Related to #535 Are you using `client.Enqueue`? Because this is expected to be slow when attempting to add millions of keys because of network round trips. This could be solved with [pipelines](https://redis.uptrace.dev/guide/go-redis-pipelines.html#pipelines).
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/asynq#2377
No description provided.