[GH-ISSUE #625] [QUESTION] Aggregate limits #306

New issue

Open

opened 2026-03-02 05:20:20 +03:00 by kerem · 1 comment

kerem commented

2026-03-02 05:20:20 +03:00

Owner

Originally created by @ghstahl on GitHub (Mar 6, 2023).
Original GitHub issue: https://github.com/hibiken/asynq/issues/625

Just started working with Task-aggregation.

I know there are bunch of HARD CODED/NON-CONFIGURABLE max queue sizes in this code base.

given this entry;

   GroupMaxSize:     20,

can I set it to

GroupMaxSize:     100000,

What are the boundaries for aggregation?

Originally created by @ghstahl on GitHub (Mar 6, 2023). Original GitHub issue: https://github.com/hibiken/asynq/issues/625 Just started working with [Task-aggregation](https://github.com/hibiken/asynq/wiki/Task-aggregation). I know there are bunch of **HARD CODED/NON-CONFIGURABLE** max queue sizes in this code base. given this entry; ```go GroupMaxSize: 20, ``` can I set it to ```go GroupMaxSize: 100000, ``` What are the boundaries for aggregation?

kerem commented

2026-03-02 05:20:20 +03:00

Author

Owner

@fivezjd commented on GitHub (Mar 10, 2023):

In my opinion, the boundary of aggregation is the upper limit of redis zset type members, if this number is too large, aggregation will be a very time-consuming operation.look at this

@fivezjd commented on GitHub (Mar 10, 2023): In my opinion, the boundary of aggregation is the upper limit of redis zset type members, if this number is too large, aggregation will be a very time-consuming operation.[look at this](https://github.com/hibiken/asynq/blob/cc777ebdaa62b69bd6e985fa97117b854e7d1cd6/internal/rdb/rdb.go#L1031)