[GH-ISSUE #1039] [BUG] How to clean up leftover data after a run #490

New issue

Open

opened 2026-03-02 05:21:33 +03:00 by kerem · 3 comments

kerem commented

2026-03-02 05:21:33 +03:00

Owner

Originally created by @Harvi-C on GitHub (Mar 27, 2025).
Original GitHub issue: https://github.com/hibiken/asynq/issues/1039

Originally assigned to: @hibiken, @kamikazechaser on GitHub.

I found that if my server terminates abnormally, Redis will leave a lot of unprocessed task data. Will this data be automatically checked and cleaned up after the next server startup? Because I found that these data have no expiration time set,

I am now manually calling the Inspector to process, but some counting-related statistics will be left, and I don’t know whether more keys will be generated as the system runs. Is there any elegant way to clean it up?

Originally created by @Harvi-C on GitHub (Mar 27, 2025). Original GitHub issue: https://github.com/hibiken/asynq/issues/1039 Originally assigned to: @hibiken, @kamikazechaser on GitHub. I found that if my server terminates abnormally, Redis will leave a lot of unprocessed task data. Will this data be automatically checked and cleaned up after the next server startup? Because I found that these data have no expiration time set, I am now manually calling the Inspector to process, but some counting-related statistics will be left, and I don’t know whether more keys will be generated as the system runs. Is there any elegant way to clean it up? ![Image](https://github.com/user-attachments/assets/dfc0eff4-9916-4f25-b753-ae829cb40999)

kerem added the

work-around-available

wontfix

labels

2026-03-02 05:21:33 +03:00

kerem commented

2026-03-02 05:21:34 +03:00

Author

Owner

@Harvi-C commented on GitHub (Mar 27, 2025):

这是我现在的处理方式，但它不够彻底：

@Harvi-C commented on GitHub (Mar 27, 2025): 这是我现在的处理方式，但它不够彻底： <img width="634" alt="Image" src="https://github.com/user-attachments/assets/60d9eda6-7d51-457a-b3ce-18d049c3fb76" />

kerem commented

2026-03-02 05:21:34 +03:00

Author

Owner

@ronge1012 commented on GitHub (Apr 25, 2025):

请问这个关于删除processed这个选项搞定了吗

@ronge1012 commented on GitHub (Apr 25, 2025): 请问这个关于删除processed这个选项搞定了吗

kerem commented

2026-03-02 05:21:34 +03:00

Author

Owner

@kamikazechaser commented on GitHub (May 5, 2025):

Are you on version v0.25.0+? Have you tried using the retention option? It should clear completed tasks. As for the others (archived, retry and scheduled) the behavior is different. I wouldn't delete those 3 automatically, they need to be manually inspected so your approach of using the inspector is fine because for you, it is safe to delete those 3, for the majority it is not.

@kamikazechaser commented on GitHub (May 5, 2025): Are you on version v0.25.0+? Have you tried using the retention option? It should clear completed tasks. As for the others (archived, retry and scheduled) the behavior is different. I wouldn't delete those 3 automatically, they need to be manually inspected so your approach of using the inspector is fine because for you, it is safe to delete those 3, for the majority it is not.

kerem referenced this issue

2026-03-02 06:05:30 +03:00

[PR #490] [CLOSED] feat(*): add recoverPanicFunc #762

kerem referenced this issue

2026-03-07 22:13:10 +03:00

[PR #490] [CLOSED] feat(*): add recoverPanicFunc #1773

kerem referenced this issue

2026-03-15 21:03:08 +03:00

[PR #490] [CLOSED] feat(*): add recoverPanicFunc #2784