[GH-ISSUE #760] [Tech debt] Distributed batch proccesing #290

Closed
opened 2026-03-04 02:13:51 +03:00 by kerem · 2 comments
Owner

Originally created by @ese on GitHub (Mar 31, 2016).
Original GitHub issue: https://github.com/Seldaek/monolog/issues/760

We have now huge tasks like occupation feeds running in batch at once, This means they need a big amount of RAM to store objects while are proccesing which can have impact in the server performance.
This also avoid the possibility of distribute the load across different servers.

The thing should be divide the task in individual jobs that they can be queued and have differents process (workers) that can consume its

Originally created by @ese on GitHub (Mar 31, 2016). Original GitHub issue: https://github.com/Seldaek/monolog/issues/760 We have now huge tasks like occupation feeds running in batch at once, This means they need a big amount of RAM to store objects while are proccesing which can have impact in the server performance. This also avoid the possibility of distribute the load across different servers. The thing should be divide the task in individual jobs that they can be queued and have differents process (workers) that can consume its
kerem closed this issue 2026-03-04 02:13:51 +03:00
Author
Owner

@xabbuh commented on GitHub (Mar 31, 2016):

Can you explain a bit how your problem is related to Monolog (which is a logging library)?

<!-- gh-comment-id:203974842 --> @xabbuh commented on GitHub (Mar 31, 2016): Can you explain a bit how your problem is related to Monolog (which is a logging library)?
Author
Owner

@ese commented on GitHub (Mar 31, 2016):

oops sorry, I opened the issue in the wrong repository :(

<!-- gh-comment-id:203993661 --> @ese commented on GitHub (Mar 31, 2016): oops sorry, I opened the issue in the wrong repository :(
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/monolog#290
No description provided.