[GH-ISSUE #981] scheduled workflows aren't started or getting "Pending" status for no clear reason #671

Closed
opened 2026-03-03 01:05:07 +03:00 by kerem · 6 comments
Owner

Originally created by @fudiwei on GitHub (Oct 10, 2025).
Original GitHub issue: https://github.com/certimate-go/certimate/issues/981

@fudiwei I updated the Certimate to v0.4.0-alpha.5 and some of my scheduled workflow still hanging, the system logs in "Diagnostic" mentioned concurrency limit reason, but the workflow still not running from expected run time (at 18:00) until now.

This happens if I set same cron jobs in all of my workflows (which is 0 */2 * * *), I'm never had this issue yet when I set different cron job in every single workflow.

There is a screenshots for pending running workflow:

Image Image

The system log contents are as follows below:

[2025-09-11 20:00:01] workflow run #xw2imaqe5w83bth (work#24oktv6in42oe89) stopped
[2025-09-11 20:00:01] workflow run #75fk05sjgy2zn1k (work#4otg78c0wnm6646) stopped
[2025-09-11 20:00:01] workflow run #xw2imaqe5w83bth (work#24oktv6in42oe89) started
[2025-09-11 20:00:01] workflow run #75fk05sjgy2zn1k (work#4otg78c0wnm6646) started
[2025-09-11 20:00:01] workflow run #xw2imaqe5w83bth (work#24oktv6in42oe89) is being dispatched ...
[2025-09-11 20:00:01] workflow run #2kwrf3g4wnons3v (work#35rkl93p277c7uj) stopped
[2025-09-11 20:00:01] workflow run #75fk05sjgy2zn1k (work#4otg78c0wnm6646) is being dispatched ...
[2025-09-11 20:00:01] workflow run #jck54re4ebmkj9n (work#o62vwzfsa5623kl) stopped
[2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v (work#35rkl93p277c7uj) started
[2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v (work#35rkl93p277c7uj) is being dispatched ...
[2025-09-11 20:00:00] workflow run #z0r7di4r8cqyoce (work#986rb9m44dyetoj) stopped
[2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n (work#o62vwzfsa5623kl) started
[2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n (work#o62vwzfsa5623kl) is being dispatched ...
[2025-09-11 20:00:00] workflow run #f6fj53znlyk0soi (work#la5thk24embh22n) stopped
[2025-09-11 20:00:00] workflow run #xw2imaqe5w83bth is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 20:00:00] workflow run #75fk05sjgy2zn1k is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 20:00:00] workflow run #f6fj53znlyk0soi (work#la5thk24embh22n) started
[2025-09-11 20:00:00] workflow run #z0r7di4r8cqyoce (work#986rb9m44dyetoj) started
[2025-09-11 20:00:00] workflow run #75fk05sjgy2zn1k is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 20:00:00] workflow run #f6fj53znlyk0soi (work#la5thk24embh22n) is being dispatched ...
[2025-09-11 20:00:00] workflow run #z0r7di4r8cqyoce (work#986rb9m44dyetoj) is being dispatched ...
[2025-09-11 18:00:01] workflow run #lua0y9xmtk7vecb (work#35rkl93p277c7uj) stopped
[2025-09-11 18:00:01] workflow run #4qhgyqhumnmq0av (work#la5thk24embh22n) stopped
[2025-09-11 18:00:01] workflow run #ad4wgjviru91s1y (work#24oktv6in42oe89) stopped
[2025-09-11 18:00:01] workflow run #lua0y9xmtk7vecb (work#35rkl93p277c7uj) started
[2025-09-11 18:00:01] workflow run #lua0y9xmtk7vecb (work#35rkl93p277c7uj) is being dispatched ...
[2025-09-11 18:00:01] workflow run #jrm3gsad71cmjbf (work#986rb9m44dyetoj) stopped
[2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av (work#la5thk24embh22n) started
[2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av (work#la5thk24embh22n) is being dispatched ...
[2025-09-11 18:00:00] workflow run #1tqhkswa99xmbgy (work#4otg78c0wnm6646) stopped
[2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf (work#986rb9m44dyetoj) started
[2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf (work#986rb9m44dyetoj) is being dispatched ...
[2025-09-11 18:00:00] workflow run #ad4wgjviru91s1y (work#24oktv6in42oe89) is being dispatched ...
[2025-09-11 18:00:00] workflow run #lua0y9xmtk7vecb is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 18:00:00] workflow run #lua0y9xmtk7vecb is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 18:00:00] workflow run #ad4wgjviru91s1y (work#24oktv6in42oe89) started
[2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 18:00:00] workflow run #hxuawvqck3b2khj is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 18:00:00] workflow run #hxuawvqck3b2khj is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 18:00:00] workflow run #lua0y9xmtk7vecb is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 18:00:00] workflow run #hxuawvqck3b2khj is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 18:00:00] workflow run #1tqhkswa99xmbgy (work#4otg78c0wnm6646) started
[2025-09-11 18:00:00] workflow run #ad4wgjviru91s1y (work#24oktv6in42oe89) is being dispatched ...
[2025-09-11 18:00:00] workflow run #1tqhkswa99xmbgy (work#4otg78c0wnm6646) is being dispatched ...

The following screenshot is about my current cron jobs and workflow dispatcher:

Image

I tried set and export the CERTIMATE_WORKFLOW_MAX_WORKERS to 16 before start the Certimate, but when I started it seems that maximum concurrency limit still at 2 and the "Concurrency" on Workflow Dispatcher still shows 2 as you can see the screenshot above.

There is the latest log:

[2025-09-11 22:00:01] workflow run #h5ga4htbh9eour7 (work#986rb9m44dyetoj) stopped
[2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a (work#la5thk24embh22n) stopped
[2025-09-11 22:00:00] workflow run #h5ga4htbh9eour7 (work#986rb9m44dyetoj) started
[2025-09-11 22:00:00] workflow run #h5ga4htbh9eour7 (work#986rb9m44dyetoj) is being dispatched ...
[2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 (work#o62vwzfsa5623kl) stopped
[2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a (work#la5thk24embh22n) started
[2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a (work#la5thk24embh22n) is being dispatched ...
[2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 (work#4otg78c0wnm6646) stopped
[2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 (work#4otg78c0wnm6646) started
[2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 (work#o62vwzfsa5623kl) started
[2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 (work#4otg78c0wnm6646) is being dispatched ...
[2025-09-11 22:00:00] workflow run #pos5f1ictq3q9ez (work#35rkl93p277c7uj) stopped
[2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 (work#o62vwzfsa5623kl) is being dispatched ...
[2025-09-11 22:00:00] workflow run #hv3c1713bbejwq7 (work#24oktv6in42oe89) stopped
[2025-09-11 22:00:00] workflow run #hv3c1713bbejwq7 (work#24oktv6in42oe89) started
[2025-09-11 22:00:00] workflow run #pos5f1ictq3q9ez (work#35rkl93p277c7uj) started
[2025-09-11 22:00:00] workflow run #h5ga4htbh9eour7 is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 is pending, because the maximum concurrency (limit: 2) has been reached
[2025-09-11 22:00:00] workflow run #hv3c1713bbejwq7 (work#24oktv6in42oe89) is being dispatched ...
[2025-09-11 22:00:00] workflow run #pos5f1ictq3q9ez (work#35rkl93p277c7uj) is being dispatched ...

Originally posted by @FarrelF in #949

Originally created by @fudiwei on GitHub (Oct 10, 2025). Original GitHub issue: https://github.com/certimate-go/certimate/issues/981 > @fudiwei I updated the Certimate to `v0.4.0-alpha.5` and some of my scheduled workflow still hanging, the system logs in "Diagnostic" mentioned concurrency limit reason, but the workflow still not running from expected run time (at 18:00) until now. > > This happens if I set same cron jobs in all of my workflows (which is `0 */2 * * *`), I'm never had this issue yet when I set different cron job in every single workflow. > > There is a screenshots for pending running workflow: > > <img width="1910" height="926" alt="Image" src="https://github.com/user-attachments/assets/216c6b04-0421-4dba-b439-058e443f1b91" /> > > <img width="1895" height="925" alt="Image" src="https://github.com/user-attachments/assets/2213e7a7-301d-4fd9-b679-7894a3df7213" /> > > The system log contents are as follows below: > > ```plain > [2025-09-11 20:00:01] workflow run #xw2imaqe5w83bth (work#24oktv6in42oe89) stopped > [2025-09-11 20:00:01] workflow run #75fk05sjgy2zn1k (work#4otg78c0wnm6646) stopped > [2025-09-11 20:00:01] workflow run #xw2imaqe5w83bth (work#24oktv6in42oe89) started > [2025-09-11 20:00:01] workflow run #75fk05sjgy2zn1k (work#4otg78c0wnm6646) started > [2025-09-11 20:00:01] workflow run #xw2imaqe5w83bth (work#24oktv6in42oe89) is being dispatched ... > [2025-09-11 20:00:01] workflow run #2kwrf3g4wnons3v (work#35rkl93p277c7uj) stopped > [2025-09-11 20:00:01] workflow run #75fk05sjgy2zn1k (work#4otg78c0wnm6646) is being dispatched ... > [2025-09-11 20:00:01] workflow run #jck54re4ebmkj9n (work#o62vwzfsa5623kl) stopped > [2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v (work#35rkl93p277c7uj) started > [2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v (work#35rkl93p277c7uj) is being dispatched ... > [2025-09-11 20:00:00] workflow run #z0r7di4r8cqyoce (work#986rb9m44dyetoj) stopped > [2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n (work#o62vwzfsa5623kl) started > [2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n (work#o62vwzfsa5623kl) is being dispatched ... > [2025-09-11 20:00:00] workflow run #f6fj53znlyk0soi (work#la5thk24embh22n) stopped > [2025-09-11 20:00:00] workflow run #xw2imaqe5w83bth is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 20:00:00] workflow run #75fk05sjgy2zn1k is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 20:00:00] workflow run #f6fj53znlyk0soi (work#la5thk24embh22n) started > [2025-09-11 20:00:00] workflow run #z0r7di4r8cqyoce (work#986rb9m44dyetoj) started > [2025-09-11 20:00:00] workflow run #75fk05sjgy2zn1k is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 20:00:00] workflow run #2kwrf3g4wnons3v is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 20:00:00] workflow run #jck54re4ebmkj9n is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 20:00:00] workflow run #f6fj53znlyk0soi (work#la5thk24embh22n) is being dispatched ... > [2025-09-11 20:00:00] workflow run #z0r7di4r8cqyoce (work#986rb9m44dyetoj) is being dispatched ... > [2025-09-11 18:00:01] workflow run #lua0y9xmtk7vecb (work#35rkl93p277c7uj) stopped > [2025-09-11 18:00:01] workflow run #4qhgyqhumnmq0av (work#la5thk24embh22n) stopped > [2025-09-11 18:00:01] workflow run #ad4wgjviru91s1y (work#24oktv6in42oe89) stopped > [2025-09-11 18:00:01] workflow run #lua0y9xmtk7vecb (work#35rkl93p277c7uj) started > [2025-09-11 18:00:01] workflow run #lua0y9xmtk7vecb (work#35rkl93p277c7uj) is being dispatched ... > [2025-09-11 18:00:01] workflow run #jrm3gsad71cmjbf (work#986rb9m44dyetoj) stopped > [2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av (work#la5thk24embh22n) started > [2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av (work#la5thk24embh22n) is being dispatched ... > [2025-09-11 18:00:00] workflow run #1tqhkswa99xmbgy (work#4otg78c0wnm6646) stopped > [2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf (work#986rb9m44dyetoj) started > [2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf (work#986rb9m44dyetoj) is being dispatched ... > [2025-09-11 18:00:00] workflow run #ad4wgjviru91s1y (work#24oktv6in42oe89) is being dispatched ... > [2025-09-11 18:00:00] workflow run #lua0y9xmtk7vecb is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 18:00:00] workflow run #lua0y9xmtk7vecb is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 18:00:00] workflow run #ad4wgjviru91s1y (work#24oktv6in42oe89) started > [2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 18:00:00] workflow run #hxuawvqck3b2khj is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 18:00:00] workflow run #hxuawvqck3b2khj is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 18:00:00] workflow run #lua0y9xmtk7vecb is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 18:00:00] workflow run #4qhgyqhumnmq0av is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 18:00:00] workflow run #jrm3gsad71cmjbf is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 18:00:00] workflow run #hxuawvqck3b2khj is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 18:00:00] workflow run #1tqhkswa99xmbgy (work#4otg78c0wnm6646) started > [2025-09-11 18:00:00] workflow run #ad4wgjviru91s1y (work#24oktv6in42oe89) is being dispatched ... > [2025-09-11 18:00:00] workflow run #1tqhkswa99xmbgy (work#4otg78c0wnm6646) is being dispatched ... > ``` > > The following screenshot is about my current cron jobs and workflow dispatcher: > > <img width="1275" height="696" alt="Image" src="https://github.com/user-attachments/assets/8271df55-3b6d-45eb-82f9-d19993a08b50" /> > > I tried set and export the `CERTIMATE_WORKFLOW_MAX_WORKERS` to `16` before start the Certimate, but when I started it seems that maximum concurrency limit still at 2 and the "Concurrency" on Workflow Dispatcher still shows 2 as you can see the screenshot above. > > There is the latest log: > > ```plain > [2025-09-11 22:00:01] workflow run #h5ga4htbh9eour7 (work#986rb9m44dyetoj) stopped > [2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a (work#la5thk24embh22n) stopped > [2025-09-11 22:00:00] workflow run #h5ga4htbh9eour7 (work#986rb9m44dyetoj) started > [2025-09-11 22:00:00] workflow run #h5ga4htbh9eour7 (work#986rb9m44dyetoj) is being dispatched ... > [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 (work#o62vwzfsa5623kl) stopped > [2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a (work#la5thk24embh22n) started > [2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a (work#la5thk24embh22n) is being dispatched ... > [2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 (work#4otg78c0wnm6646) stopped > [2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 (work#4otg78c0wnm6646) started > [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 (work#o62vwzfsa5623kl) started > [2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 (work#4otg78c0wnm6646) is being dispatched ... > [2025-09-11 22:00:00] workflow run #pos5f1ictq3q9ez (work#35rkl93p277c7uj) stopped > [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 (work#o62vwzfsa5623kl) is being dispatched ... > [2025-09-11 22:00:00] workflow run #hv3c1713bbejwq7 (work#24oktv6in42oe89) stopped > [2025-09-11 22:00:00] workflow run #hv3c1713bbejwq7 (work#24oktv6in42oe89) started > [2025-09-11 22:00:00] workflow run #pos5f1ictq3q9ez (work#35rkl93p277c7uj) started > [2025-09-11 22:00:00] workflow run #h5ga4htbh9eour7 is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 22:00:00] workflow run #8iceh7sv2naj56a is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 22:00:00] workflow run #1qbi8kght54xka8 is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 22:00:00] workflow run #ew3tha1rn289wj1 is pending, because the maximum concurrency (limit: 2) has been reached > [2025-09-11 22:00:00] workflow run #hv3c1713bbejwq7 (work#24oktv6in42oe89) is being dispatched ... > [2025-09-11 22:00:00] workflow run #pos5f1ictq3q9ez (work#35rkl93p277c7uj) is being dispatched ... > ``` _Originally posted by @FarrelF in [#949](https://github.com/certimate-go/certimate/issues/949#issuecomment-3281313707)_
kerem 2026-03-03 01:05:07 +03:00
  • closed this issue
  • added the
    bug
    label
Author
Owner

@fudiwei commented on GitHub (Oct 22, 2025):

@FarrelF Hi. I've had time recently to look into this issue, but I need your help.

Please provide the following information:

  • Number of CPU cores
  • Memory size
  • Operating system and version
  • If it's running in Docker, please provide the docker info output, and any other useful parameters passed in by docker run.
  • One or several minimal reproducible workflows (you can export them as YAML in the WebUI, replacing sensitive data with '*'). I suspect this issue is unrelated to certificate application or deployment. You can try creating some workflows containing only start and end nodes to see if the problem can be reproduced.

Thank you very much, this will be very helpful.

<!-- gh-comment-id:3431263299 --> @fudiwei commented on GitHub (Oct 22, 2025): @FarrelF Hi. I've had time recently to look into this issue, but I need your help. Please provide the following information: - Number of CPU cores - Memory size - Operating system and version - If it's running in Docker, please provide the `docker info` output, and any other useful parameters passed in by `docker run`. - One or several minimal reproducible workflows (you can export them as YAML in the WebUI, replacing sensitive data with '*'). I suspect this issue is unrelated to certificate application or deployment. You can try creating some workflows containing only start and end nodes to see if the problem can be reproduced. Thank you very much, this will be very helpful.
Author
Owner

@FarrelF commented on GitHub (Oct 22, 2025):

Hi. There is my information:

  • CPU: Intel Core i3-12100F (4 core, 8 thread), formerly I'm used Intel Pentium G2030 (2 core, 2 thread)
  • Memory: 8x2 GB (16 GB) DDR4 Dual-Channel
  • OS: Windows 11 Pro 24H2 (26100.6899)
  • I don't run Certimate in Docker, I had run it using WSL (Windows Subsystem Linux) instead but now I'm running it with native binary in Windows and just now I still encounter the same issue

There is one of my workflow information that now currently pending and I exported with YAML format:

nodes:
  - id: "qyOEdmqY3mCeueC_dP6ap"
    type: "start"
    name: "Start"
    config:
      trigger: "scheduled"
      triggerCron: "0 */2 * * *"
  - id: "tZ2KVa_nZHXym5J05MNL3"
    type: "tryCatch"
    name: "Try to ..."
    blocks:
      - id: "damKFgHawcJSX8GDING9z"
        type: "tryBlock"
        name: ""
        blocks:
          - id: "VmwlwkKjiWo9__vysGWx4"
            type: "bizApply"
            name: "Issue a GTS Certificate"
            config:
              caProvider: "googletrustservices"
              caProviderAccessId: "drf89mzhnx7i905"
              challengeType: "dns-01"
              contactEmail: "mail@example.my.id"
              dnsPropagationWait: "60"
              dnsTTL: "60"
              domains: "tls.example.my.id;*.example.my.id;example.my.id"
              keyAlgorithm: "RSA4096"
              provider: "bunny"
              providerAccessId: "937a849d05sten1"
              providerConfig: {}
              skipBeforeExpiryDays: 4
              validityLifetime: "7d"
          - id: "s-CP6VOEvhc3-nh5m3guZ"
            type: "bizApply"
            name: "Issue a GTS ECC Certificate"
            config:
              caProvider: "googletrustservices"
              caProviderAccessId: "drf89mzhnx7i905"
              challengeType: "dns-01"
              contactEmail: "mail@example.my.id"
              dnsPropagationWait: "60"
              dnsTTL: "60"
              domains: "tls.example.my.id;*.example.my.id;example.my.id"
              keyAlgorithm: "EC384"
              provider: "bunny"
              providerAccessId: "937a849d05sten1"
              providerConfig: {}
              skipBeforeExpiryDays: 4
              validityLifetime: "7d"
      - id: "WFoWg3YRBuEGVUWNfNpEK"
        type: "catchBlock"
        name: "On failed ..."
        blocks:
          - id: "2IIdQgUPMsl30NdTXxQBx"
            type: "bizNotify"
            name: "Notification"
            config:
              message: "Your certificate issuance workflow for tls.example.my.id domain by
                Google Trust Services has been failed. Please check the
                details."
              provider: "telegrambot"
              providerAccessId: "r290x117o17v176"
              subject: "[Certimate] Certificate Issuance Failure Alert!"
          - id: "DabYFnkra43rpMyobDf1P"
            type: "end"
            name: "End"
  - id: "IVlvibBFuXEpdlfSGOuJ0"
    type: "tryCatch"
    name: "Try to ..."
    blocks:
      - id: "tIgDuCKOAyPCx6tWUClhm"
        type: "tryBlock"
        name: ""
        blocks:
          - id: "wyp-OEQ7ZxHYrXXTwB1gX"
            type: "bizApply"
            name: "Issue a ZeroSSL Certificate"
            config:
              caProvider: "zerossl"
              caProviderAccessId: "4woi61uu67q764i"
              challengeType: "dns-01"
              contactEmail: "mail@example.my.id"
              dnsPropagationWait: "60"
              dnsTTL: "60"
              domains: "tls.example.my.id;*.example.my.id;example.my.id"
              keyAlgorithm: "RSA4096"
              provider: "bunny"
              providerAccessId: "937a849d05sten1"
              skipBeforeExpiryDays: 30
              validityLifetime: ""
          - id: "M3UehKjx9MJVvNecO1y40"
            type: "bizApply"
            name: "Issue a ZeroSSL ECC Certificate"
            config:
              caProvider: "zerossl"
              caProviderAccessId: "4woi61uu67q764i"
              challengeType: "dns-01"
              contactEmail: "mail@example.my.id"
              dnsPropagationWait: "60"
              dnsTTL: "60"
              domains: "tls.example.my.id;*.example.my.id;example.my.id"
              keyAlgorithm: "EC384"
              provider: "bunny"
              providerAccessId: "937a849d05sten1"
              skipBeforeExpiryDays: 30
              validityLifetime: ""
      - id: "z5C7yJsy9C3H2COQmzmyW"
        type: "catchBlock"
        name: "On failed ..."
        blocks:
          - id: "ho8D4t0scw4W656djB5X9"
            type: "bizNotify"
            name: "Notification"
            config:
              message: "Your certificate issuance workflow for tls.example.my.id domain by
                ZeroSSL has been failed. Please check the details."
              provider: "telegrambot"
              providerAccessId: "r290x117o17v176"
              providerConfig: {}
              subject: "[Certimate] Certificate Issuance Failure Alert!"
  - id: "wwWeb3suAhIitHSq1-x7w"
    type: "tryCatch"
    name: "Try to ..."
    blocks:
      - id: "q35_J6B5uWm1DWCYhr1JW"
        type: "tryBlock"
        name: ""
        blocks:
          - id: "NZgxfT8NcEHu7b7otwN-M"
            type: "bizDeploy"
            name: "Deploy to Netlify"
            config:
              certificateOutputNodeId: "VmwlwkKjiWo9__vysGWx4"
              provider: "netlify-site"
              providerAccessId: "oy7ph9m285f19g7"
              providerConfig:
                siteId: "example.my.id"
              skipOnLastSucceeded: true
      - id: "dx_ids3o7f3tHcTpMfdSs"
        type: "catchBlock"
        name: "On failed ..."
        blocks:
          - id: "unhrae8wTqBuHcu-aYJgV"
            type: "bizNotify"
            name: "Notification"
            config:
              message: "Your certificate deployment workflow to Netlify for example.my.id has
                been failed. Please check the details."
              provider: "telegrambot"
              providerAccessId: "r290x117o17v176"
              subject: "[Certimate] Certificate Deployment Failure Alert!"
  - id: "AdWCsMencBubnkKUCGVKH"
    type: "tryCatch"
    name: "Try to ..."
    blocks:
      - id: "0RZj2TV__tTnjnvZg1Mnx"
        type: "tryBlock"
        name: ""
        blocks:
          - id: "7u43DvFbjmrt9cvWtp4LX"
            type: "bizDeploy"
            name: "Deploy to DirectAdmin"
            config:
              certificateOutputNodeId: "VmwlwkKjiWo9__vysGWx4"
              provider: "webhook"
              providerAccessId: "9181f0jhgu4okjn"
              providerConfig:
                webhookData: "{

                  \  \"domain\": \"example.my.id\",

                  \  \"action\": \"save\",

                  \  \"type\": \"paste\",

                  \  \"certificate\": \"${CERTIFICATE}\\n${PRIVATE_KEY}\"

                  }"
              skipOnLastSucceeded: true
      - id: "hPG3oqzdrAEKZGrHUTICE"
        type: "catchBlock"
        name: "On failed ..."
        blocks:
          - id: "AYkEuVrmidsxVfFaJxnWz"
            type: "bizNotify"
            name: "Notification"
            config:
              message: "Your certificate deployment workflow to DirectAdmin for example.my.id
                has been failed. Please check the details."
              provider: "telegrambot"
              providerAccessId: "r290x117o17v176"
              subject: "[Certimate] Certificate Deployment Failure Alert!"
  - id: "anENnvqwFApqDJVc_X1Qy"
    type: "tryCatch"
    name: "Try to ..."
    blocks:
      - id: "hVbuQcTvih0pYzfoxstpX"
        type: "tryBlock"
        name: ""
        blocks:
          - id: "2dBFWE1PAKfHT-8gN_Wqk"
            type: "bizDeploy"
            name: "Deploy to Bunny example.my.id"
            config:
              certificateOutputNodeId: "VmwlwkKjiWo9__vysGWx4"
              provider: "bunny-cdn"
              providerAccessId: "937a849d05sten1"
              providerConfig:
                hostname: "example.my.id"
                pullZoneId: "<BUNNY PULL ZONE ID HERE>"
              skipOnLastSucceeded: true
          - id: "hpRXGbJRnRdNbOONJQMkS"
            type: "bizDeploy"
            name: "Deploy to Bunny *.example.my.id"
            config:
              certificateOutputNodeId: "VmwlwkKjiWo9__vysGWx4"
              provider: "bunny-cdn"
              providerAccessId: "937a849d05sten1"
              providerConfig:
                hostname: "*.example.my.id"
                pullZoneId: "<BUNNY PULL ZONE ID HERE>"
              skipOnLastSucceeded: true
      - id: "mswe7CwpMO5npwcLY6HfS"
        type: "catchBlock"
        name: "On failed ..."
        blocks:
          - id: "jHnqnqzQesQlMCMgzefp5"
            type: "bizNotify"
            name: "Notification"
            config:
              message: "Your certificate deployment workflow to Bunny CDN for example.my.id has
                been failed. Please check the details."
              provider: "telegrambot"
              providerAccessId: "r290x117o17v176"
              providerConfig: {}
              subject: "[Certimate] Certificate Deployment Failure Alert!"
          - id: "qbursyggm4mvjkw"
            type: "end"
            name: "End"
  - id: "01h811rb24oegq3"
    type: "end"
    name: "End"
<!-- gh-comment-id:3431912818 --> @FarrelF commented on GitHub (Oct 22, 2025): Hi. There is my information: - CPU: Intel Core i3-12100F (4 core, 8 thread), formerly I'm used Intel Pentium G2030 (2 core, 2 thread) - Memory: 8x2 GB (16 GB) DDR4 Dual-Channel - OS: Windows 11 Pro 24H2 (26100.6899) - I don't run Certimate in Docker, I had run it using WSL (Windows Subsystem Linux) instead but now I'm running it with native binary in Windows and just now I still encounter the same issue There is one of my workflow information that now currently pending and I exported with YAML format: ```yaml nodes: - id: "qyOEdmqY3mCeueC_dP6ap" type: "start" name: "Start" config: trigger: "scheduled" triggerCron: "0 */2 * * *" - id: "tZ2KVa_nZHXym5J05MNL3" type: "tryCatch" name: "Try to ..." blocks: - id: "damKFgHawcJSX8GDING9z" type: "tryBlock" name: "" blocks: - id: "VmwlwkKjiWo9__vysGWx4" type: "bizApply" name: "Issue a GTS Certificate" config: caProvider: "googletrustservices" caProviderAccessId: "drf89mzhnx7i905" challengeType: "dns-01" contactEmail: "mail@example.my.id" dnsPropagationWait: "60" dnsTTL: "60" domains: "tls.example.my.id;*.example.my.id;example.my.id" keyAlgorithm: "RSA4096" provider: "bunny" providerAccessId: "937a849d05sten1" providerConfig: {} skipBeforeExpiryDays: 4 validityLifetime: "7d" - id: "s-CP6VOEvhc3-nh5m3guZ" type: "bizApply" name: "Issue a GTS ECC Certificate" config: caProvider: "googletrustservices" caProviderAccessId: "drf89mzhnx7i905" challengeType: "dns-01" contactEmail: "mail@example.my.id" dnsPropagationWait: "60" dnsTTL: "60" domains: "tls.example.my.id;*.example.my.id;example.my.id" keyAlgorithm: "EC384" provider: "bunny" providerAccessId: "937a849d05sten1" providerConfig: {} skipBeforeExpiryDays: 4 validityLifetime: "7d" - id: "WFoWg3YRBuEGVUWNfNpEK" type: "catchBlock" name: "On failed ..." blocks: - id: "2IIdQgUPMsl30NdTXxQBx" type: "bizNotify" name: "Notification" config: message: "Your certificate issuance workflow for tls.example.my.id domain by Google Trust Services has been failed. Please check the details." provider: "telegrambot" providerAccessId: "r290x117o17v176" subject: "[Certimate] Certificate Issuance Failure Alert!" - id: "DabYFnkra43rpMyobDf1P" type: "end" name: "End" - id: "IVlvibBFuXEpdlfSGOuJ0" type: "tryCatch" name: "Try to ..." blocks: - id: "tIgDuCKOAyPCx6tWUClhm" type: "tryBlock" name: "" blocks: - id: "wyp-OEQ7ZxHYrXXTwB1gX" type: "bizApply" name: "Issue a ZeroSSL Certificate" config: caProvider: "zerossl" caProviderAccessId: "4woi61uu67q764i" challengeType: "dns-01" contactEmail: "mail@example.my.id" dnsPropagationWait: "60" dnsTTL: "60" domains: "tls.example.my.id;*.example.my.id;example.my.id" keyAlgorithm: "RSA4096" provider: "bunny" providerAccessId: "937a849d05sten1" skipBeforeExpiryDays: 30 validityLifetime: "" - id: "M3UehKjx9MJVvNecO1y40" type: "bizApply" name: "Issue a ZeroSSL ECC Certificate" config: caProvider: "zerossl" caProviderAccessId: "4woi61uu67q764i" challengeType: "dns-01" contactEmail: "mail@example.my.id" dnsPropagationWait: "60" dnsTTL: "60" domains: "tls.example.my.id;*.example.my.id;example.my.id" keyAlgorithm: "EC384" provider: "bunny" providerAccessId: "937a849d05sten1" skipBeforeExpiryDays: 30 validityLifetime: "" - id: "z5C7yJsy9C3H2COQmzmyW" type: "catchBlock" name: "On failed ..." blocks: - id: "ho8D4t0scw4W656djB5X9" type: "bizNotify" name: "Notification" config: message: "Your certificate issuance workflow for tls.example.my.id domain by ZeroSSL has been failed. Please check the details." provider: "telegrambot" providerAccessId: "r290x117o17v176" providerConfig: {} subject: "[Certimate] Certificate Issuance Failure Alert!" - id: "wwWeb3suAhIitHSq1-x7w" type: "tryCatch" name: "Try to ..." blocks: - id: "q35_J6B5uWm1DWCYhr1JW" type: "tryBlock" name: "" blocks: - id: "NZgxfT8NcEHu7b7otwN-M" type: "bizDeploy" name: "Deploy to Netlify" config: certificateOutputNodeId: "VmwlwkKjiWo9__vysGWx4" provider: "netlify-site" providerAccessId: "oy7ph9m285f19g7" providerConfig: siteId: "example.my.id" skipOnLastSucceeded: true - id: "dx_ids3o7f3tHcTpMfdSs" type: "catchBlock" name: "On failed ..." blocks: - id: "unhrae8wTqBuHcu-aYJgV" type: "bizNotify" name: "Notification" config: message: "Your certificate deployment workflow to Netlify for example.my.id has been failed. Please check the details." provider: "telegrambot" providerAccessId: "r290x117o17v176" subject: "[Certimate] Certificate Deployment Failure Alert!" - id: "AdWCsMencBubnkKUCGVKH" type: "tryCatch" name: "Try to ..." blocks: - id: "0RZj2TV__tTnjnvZg1Mnx" type: "tryBlock" name: "" blocks: - id: "7u43DvFbjmrt9cvWtp4LX" type: "bizDeploy" name: "Deploy to DirectAdmin" config: certificateOutputNodeId: "VmwlwkKjiWo9__vysGWx4" provider: "webhook" providerAccessId: "9181f0jhgu4okjn" providerConfig: webhookData: "{ \ \"domain\": \"example.my.id\", \ \"action\": \"save\", \ \"type\": \"paste\", \ \"certificate\": \"${CERTIFICATE}\\n${PRIVATE_KEY}\" }" skipOnLastSucceeded: true - id: "hPG3oqzdrAEKZGrHUTICE" type: "catchBlock" name: "On failed ..." blocks: - id: "AYkEuVrmidsxVfFaJxnWz" type: "bizNotify" name: "Notification" config: message: "Your certificate deployment workflow to DirectAdmin for example.my.id has been failed. Please check the details." provider: "telegrambot" providerAccessId: "r290x117o17v176" subject: "[Certimate] Certificate Deployment Failure Alert!" - id: "anENnvqwFApqDJVc_X1Qy" type: "tryCatch" name: "Try to ..." blocks: - id: "hVbuQcTvih0pYzfoxstpX" type: "tryBlock" name: "" blocks: - id: "2dBFWE1PAKfHT-8gN_Wqk" type: "bizDeploy" name: "Deploy to Bunny example.my.id" config: certificateOutputNodeId: "VmwlwkKjiWo9__vysGWx4" provider: "bunny-cdn" providerAccessId: "937a849d05sten1" providerConfig: hostname: "example.my.id" pullZoneId: "<BUNNY PULL ZONE ID HERE>" skipOnLastSucceeded: true - id: "hpRXGbJRnRdNbOONJQMkS" type: "bizDeploy" name: "Deploy to Bunny *.example.my.id" config: certificateOutputNodeId: "VmwlwkKjiWo9__vysGWx4" provider: "bunny-cdn" providerAccessId: "937a849d05sten1" providerConfig: hostname: "*.example.my.id" pullZoneId: "<BUNNY PULL ZONE ID HERE>" skipOnLastSucceeded: true - id: "mswe7CwpMO5npwcLY6HfS" type: "catchBlock" name: "On failed ..." blocks: - id: "jHnqnqzQesQlMCMgzefp5" type: "bizNotify" name: "Notification" config: message: "Your certificate deployment workflow to Bunny CDN for example.my.id has been failed. Please check the details." provider: "telegrambot" providerAccessId: "r290x117o17v176" providerConfig: {} subject: "[Certimate] Certificate Deployment Failure Alert!" - id: "qbursyggm4mvjkw" type: "end" name: "End" - id: "01h811rb24oegq3" type: "end" name: "End" ```
Author
Owner

@fudiwei commented on GitHub (Oct 22, 2025):

There is one of my workflow information that now currently pending and I exported with YAML format:

If you deactivate all other workflows and only activate this one, do you still encounter the issue?

<!-- gh-comment-id:3431956038 --> @fudiwei commented on GitHub (Oct 22, 2025): > There is one of my workflow information that now currently pending and I exported with YAML format: If you deactivate all other workflows and only activate this one, do you still encounter the issue?
Author
Owner

@FarrelF commented on GitHub (Oct 22, 2025):

There is one of my workflow information that now currently pending and I exported with YAML format:

If you deactivate all other workflows and only activate this one, do you still encounter the issue?

No, and the pending workflows sometimes are random (if all activated and starts at the same time), not only this one.

<!-- gh-comment-id:3432927500 --> @FarrelF commented on GitHub (Oct 22, 2025): > > There is one of my workflow information that now currently pending and I exported with YAML format: > > If you deactivate all other workflows and only activate this one, do you still encounter the issue? No, and the pending workflows sometimes are random (if all activated and starts at the same time), not only this one.
Author
Owner

@FarrelF commented on GitHub (Oct 22, 2025):

I just created 9 test workflows that contains start and end nodes to reproduce my issue, all of my workflows starts at the same time.

The following are my steps:

  1. Start a Certimate (In this my case, because I don't using Docker so I just directly execute the binary)
  2. Create 1 standard workflow
  3. When creating workflow, delete all nodes except start and end nodes
  4. In the "Start" node, for "Trigger" choose "Scheduled" option and set the Cron Expression (I'm using */5 * * * * in this case)
  5. Publish the workflow
  6. Duplicate the workflow that just created multiple times (I did this 8 times)
  7. Ensure that you publish all of the duplicated test workflows with edit the workflows, then click "Publish"
  8. Wait until the workflows start executing

In this case, when all of my start executing the scheduled workflows, I found that 4 of 9 my workflows are on pending status for no clear reason.

Even if I activate only 4 test workflows, sometimes 1 or 2 of them are pending for no clear reason.

<!-- gh-comment-id:3433185259 --> @FarrelF commented on GitHub (Oct 22, 2025): I just created 9 test workflows that contains start and end nodes to reproduce my issue, all of my workflows starts at the same time. The following are my steps: 1. Start a Certimate (In this my case, because I don't using Docker so I just directly execute the binary) 2. Create 1 standard workflow 3. When creating workflow, delete all nodes except start and end nodes 4. In the "Start" node, for "Trigger" choose "Scheduled" option and set the Cron Expression (I'm using `*/5 * * * *` in this case) 5. Publish the workflow 6. Duplicate the workflow that just created multiple times (I did this 8 times) 7. Ensure that you publish all of the duplicated test workflows with edit the workflows, then click "Publish" 8. Wait until the workflows start executing In this case, when all of my start executing the scheduled workflows, I found that 4 of 9 my workflows are on pending status for no clear reason. Even if I activate only 4 test workflows, sometimes 1 or 2 of them are pending for no clear reason.
Author
Owner

@fudiwei commented on GitHub (Oct 23, 2025):

Thank you for providing the information. I will try to investigate this issue.

<!-- gh-comment-id:3436539028 --> @fudiwei commented on GitHub (Oct 23, 2025): Thank you for providing the information. I will try to investigate this issue.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/certimate#671
No description provided.