[GH-ISSUE #71] Celery Configuration Update for Workers #25

New issue

Closed

opened 2026-03-03 11:58:28 +03:00 by kerem · 1 comment

kerem commented

2026-03-03 11:58:28 +03:00

Owner

Originally created by @falendary on GitHub (Jul 23, 2025).
Original GitHub issue: https://github.com/finmars-platform/finmars-core/issues/71

Originally assigned to: @paktusov on GitHub.

Finmars-core workers:

rename from "worker" to "core-worker" (e.g. core-worker01, core-worker02)
add CELERY_TASK_SOFT_TIME_LIMIT 86400 # VERY IMPORTANT
add CELERY_SEND_EVENTS True
add CELERY_WORKER_SEND_TASK_EVENTS True
set prefetch-multiplier to 1 # VERY IMPORTANT

====

Add rabbitmq-admin panel

Update nginx https://eu-central.finmars.com/realm0v4ry/workflow/rabbitmq-admin
Set env admin username / password

====

ELERY_WORKER_CONCURRENCY = ENV_INT("CELERY_WORKER_CONCURRENCY", 2)

Change to

ELERY_WORKER_CONCURRENCY = ENV_INT("CELERY_WORKER_CONCURRENCY", 1)

=====

f"--soft-time-limit=3000 -n {celery_worker} -Q {celery_queue} --max-tasks-per-child=1"

Remove soft-time-limit from command line argument and make it settings.py argument and set default value to 86400

Originally created by @falendary on GitHub (Jul 23, 2025). Original GitHub issue: https://github.com/finmars-platform/finmars-core/issues/71 Originally assigned to: @paktusov on GitHub. Finmars-core workers: 1. rename from "worker" to "core-worker" (e.g. core-worker01, core-worker02) 2. add CELERY_TASK_SOFT_TIME_LIMIT 86400 # VERY IMPORTANT 3. add CELERY_SEND_EVENTS True 4. add CELERY_WORKER_SEND_TASK_EVENTS True 5. set prefetch-multiplier to 1 # VERY IMPORTANT ==== Add rabbitmq-admin panel 1. Update nginx https://eu-central.finmars.com/realm0v4ry/workflow/rabbitmq-admin 2. Set env admin username / password ==== ELERY_WORKER_CONCURRENCY = ENV_INT("CELERY_WORKER_CONCURRENCY", 2) Change to ELERY_WORKER_CONCURRENCY = ENV_INT("CELERY_WORKER_CONCURRENCY", 1) ===== f"--soft-time-limit=3000 -n {celery_worker} -Q {celery_queue} --max-tasks-per-child=1" Remove soft-time-limit from command line argument and make it settings.py argument and set default value to 86400