[GH-ISSUE #887] [FEATURE REQUEST] aggregation task optimization #1453

Open
opened 2026-03-07 22:09:39 +03:00 by kerem · 0 comments
Owner

Originally created by @shuqingzai on GitHub (May 27, 2024).
Original GitHub issue: https://github.com/hibiken/asynq/issues/887

Originally assigned to: @hibiken on GitHub.

Is your feature request related to a problem? Please describe.
Several problems were discovered using task aggregation:

  1. There is no error returned in the task aggregation interface. An error return should be added. When a large number of tasks are aggregated, errors will inevitably occur. If the error is returned, this aggregation task should be ignored.

See:

  1. When using the aggregation task function, you cannot set additional options, such as: task delay

See: github.com/hibiken/asynq@d04888e748/aggregator.go (L163)

  1. Aggregation capabilities at the queue task level cannot be set, and aggregation can only be set at the server level, which is not very suitable for some complex aggregation requirements.

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Originally created by @shuqingzai on GitHub (May 27, 2024). Original GitHub issue: https://github.com/hibiken/asynq/issues/887 Originally assigned to: @hibiken on GitHub. **Is your feature request related to a problem? Please describe.** Several problems were discovered using task aggregation: 1. There is no error returned in the task aggregation interface. An error return should be added. When a large number of tasks are aggregated, errors will inevitably occur. If the error is returned, this aggregation task should be ignored. See: - https://github.com/hibiken/asynq/blob/d04888e74845fc7434c6a50755e62ec6ffda5911/aggregator.go#L161 - https://github.com/hibiken/asynq/blob/d04888e74845fc7434c6a50755e62ec6ffda5911/server.go#L263 2. When using the aggregation task function, you cannot set additional options, such as: task delay See: https://github.com/hibiken/asynq/blob/d04888e74845fc7434c6a50755e62ec6ffda5911/aggregator.go#L163 3. Aggregation capabilities at the queue task level cannot be set, and aggregation can only be set at the server level, which is not very suitable for some complex aggregation requirements. **Describe the solution you'd like** A clear and concise description of what you want to happen. **Describe alternatives you've considered** A clear and concise description of any alternative solutions or features you've considered. **Additional context** Add any other context or screenshots about the feature request here.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/asynq#1453
No description provided.