[GH-ISSUE #212] Ability to crawl recursively #207

Closed
opened 2026-02-27 15:55:38 +03:00 by kerem · 2 comments
Owner

Originally created by @7c on GitHub (Jan 11, 2019).
Original GitHub issue: https://github.com/RD17/ambar/issues/212

I am just testing your great product. I am simply crawling /tmp like this:

 test:
    depends_on: 
      serviceapi: 
        condition: service_healthy 
    image: ambar/ambar-local-crawler
    restart: always
    networks:
      - internal_network
    expose:
      - "8082"
    environment:      
      - name=test
    volumes:
      - /tmp:/usr/data

is there a way to tell that it is allowed to crawl all subdirectories inside /tmp ? I have put many pdf files inside /tmp/tmp but they are not crawled but the ones at /tmp are immedieately

Originally created by @7c on GitHub (Jan 11, 2019). Original GitHub issue: https://github.com/RD17/ambar/issues/212 I am just testing your great product. I am simply crawling /tmp like this: ``` test: depends_on: serviceapi: condition: service_healthy image: ambar/ambar-local-crawler restart: always networks: - internal_network expose: - "8082" environment: - name=test volumes: - /tmp:/usr/data ``` is there a way to tell that it is allowed to crawl all subdirectories inside /tmp ? I have put many pdf files inside /tmp/tmp but they are not crawled but the ones at /tmp are immedieately
kerem 2026-02-27 15:55:38 +03:00
  • closed this issue
  • added the
    wontfix
    label
Author
Owner

@ohnx commented on GitHub (Jan 24, 2019):

Are you sure the crawler isn't trying to crawl the files at /tmp first, and that the permissions for /tmp/tmp are correct? I have a crawler with the exact same config and it indexes 5-deep files without a problem.

<!-- gh-comment-id:457215039 --> @ohnx commented on GitHub (Jan 24, 2019): Are you sure the crawler isn't trying to crawl the files at `/tmp` first, and that the permissions for `/tmp/tmp` are correct? I have a crawler with the exact same config and it indexes 5-deep files without a problem.
Author
Owner

@stale[bot] commented on GitHub (Feb 8, 2019):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

<!-- gh-comment-id:461820969 --> @stale[bot] commented on GitHub (Feb 8, 2019): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/ambar#207
No description provided.