[GH-ISSUE #158] slow crawl #158

New issue

Closed

opened 2026-02-27 15:55:22 +03:00 by kerem · 2 comments

kerem commented

2026-02-27 15:55:22 +03:00

Owner

Originally created by @denis1482 on GitHub (May 14, 2018).
Original GitHub issue: https://github.com/RD17/ambar/issues/158

When crawling a large storage (100k+ docx/xlsx files) on cifs-mounted share, 2.0.0rc performs very poor, adding less than 50 files per day. Ubuntu 18.04 64-bit, lots of RAM and CPUs.

Originally created by @denis1482 on GitHub (May 14, 2018). Original GitHub issue: https://github.com/RD17/ambar/issues/158 When crawling a large storage (100k+ docx/xlsx files) on cifs-mounted share, 2.0.0rc performs very poor, adding less than 50 files per day. Ubuntu 18.04 64-bit, lots of RAM and CPUs.

kerem

2026-02-27 15:55:22 +03:00

closed this issue
added the
help wanted
label

kerem commented

2026-02-27 15:55:23 +03:00

Author

Owner

@sochix commented on GitHub (May 16, 2018):

Please update Ambar, we improved the prefomance. Also you should tune docker-compose to give ES as much RAM as you can and add 2-3 pipelines.

@sochix commented on GitHub (May 16, 2018): Please update Ambar, we improved the prefomance. Also you should tune docker-compose to give ES as much RAM as you can and add 2-3 pipelines.

kerem commented

2026-02-27 15:55:23 +03:00

Author

Owner

@denis1482 commented on GitHub (May 16, 2018):

Fixed in 2.1.8

@denis1482 commented on GitHub (May 16, 2018): Fixed in 2.1.8