starred/papermerge

Fork 0

mirror of https://github.com/ciur/papermerge.git synced 2026-04-25 12:05:58 +03:00

[GH-ISSUE #282] mail import doesn't work #229

New issue

Closed

opened 2026-02-25 21:31:29 +03:00 by kerem · 8 comments

kerem commented

2026-02-25 21:31:29 +03:00

Owner

Originally created by @tigertim08 on GitHub (Jan 9, 2021).
Original GitHub issue: https://github.com/ciur/papermerge/issues/282

Originally assigned to: @ciur on GitHub.

Hello,

I'm using papermerge with the docker setup on a proxmox lxc. Everthing works sofar unless I'm not able to setup the email import. I added the neccesary information to the papermerge.conf.py from the worker. It looks like that now:

`www@2523c80e1056:~$ cat papermerge.conf.py

DBUSER = "dbuser"
DBPASS = "dbpass"
DBHOST = "db"
DBNAME = "dbname"

MEDIA_DIR = "/opt/media"
STATIC_DIR = "/opt/static"
MEDIA_URL = "/media/"
STATIC_URL = "/static/"

OCR_DEFAULT_LANGUAGE = "deu"

OCR_LANGUAGES = {
"deu": "Deutsch",
"spa": "Español",
"eng": "English",
"fra": "Français",
"rus": "Русский",
"ron": "Română"
}

#These values are required if you want papermerge to import email attachments
#from specific email account.
#If you don't define a HOST, mail checking will just be disabled.
IMPORT_MAIL_HOST = "imap.goneo.de"
IMPORT_MAIL_USER = "XXXX
IMPORT_MAIL_PASS = "XXXX"
#IMPORT_MAIL_BY_USER = False
IMPORT_MAIL_BY_SECRET = "Ablage"
IMPORT_MAIL_DELETE = True
#IMPORT_MAIL_INBOX = "Eingang"`

I double checked the host, user and pass -> there are correct. But unfortunately no files are imported.

I'm I missing something?

Thanks in advance
Info:

OS: Ubuntu 20.04 LTS
Database SQLite, PostgreSQL 12.1
Papermerge Version 1.5.5

Originally created by @tigertim08 on GitHub (Jan 9, 2021). Original GitHub issue: https://github.com/ciur/papermerge/issues/282 Originally assigned to: @ciur on GitHub. Hello, I'm using papermerge with the docker setup on a proxmox lxc. Everthing works sofar unless I'm not able to setup the email import. I added the neccesary information to the papermerge.conf.py from the worker. It looks like that now: `www@2523c80e1056:~$ cat papermerge.conf.py DBUSER = "dbuser" DBPASS = "dbpass" DBHOST = "db" DBNAME = "dbname" MEDIA_DIR = "/opt/media" STATIC_DIR = "/opt/static" MEDIA_URL = "/media/" STATIC_URL = "/static/" OCR_DEFAULT_LANGUAGE = "deu" OCR_LANGUAGES = { "deu": "Deutsch", "spa": "Español", "eng": "English", "fra": "Français", "rus": "Русский", "ron": "Română" } #These values are required if you want papermerge to import email attachments #from specific email account. #If you don't define a HOST, mail checking will just be disabled. IMPORT_MAIL_HOST = "imap.goneo.de" IMPORT_MAIL_USER = "XXXX IMPORT_MAIL_PASS = "XXXX" #IMPORT_MAIL_BY_USER = False IMPORT_MAIL_BY_SECRET = "Ablage" IMPORT_MAIL_DELETE = True #IMPORT_MAIL_INBOX = "Eingang"` I double checked the host, user and pass -> there are correct. But unfortunately no files are imported. I'm I missing something? Thanks in advance **Info:** - OS: Ubuntu 20.04 LTS - Database SQLite, PostgreSQL 12.1 - Papermerge Version 1.5.5

kerem

2026-02-25 21:31:29 +03:00

closed this issue
added the
bug
label

kerem commented

2026-02-25 21:31:30 +03:00

Author

Owner

@ciur commented on GitHub (Jan 10, 2021):

settings IMPORT_MAIL_BY_SECRET and IMPORT_MAIL_DELETE are part of Papermerge 2.0 (which is still in development) i.e. they are not valid option/don't exist prior to 2.0 version.
Sorry for confusion, I will update documentation with that note. Otherwise your configurations look ok.

@ciur commented on GitHub (Jan 10, 2021): settings ``IMPORT_MAIL_BY_SECRET`` and ``IMPORT_MAIL_DELETE`` are part of Papermerge 2.0 (which is still in development) i.e. they are not valid option/don't exist prior to 2.0 version. Sorry for confusion, I will update documentation with that note. Otherwise your configurations look ok.

kerem commented

2026-02-25 21:31:30 +03:00

Author

Owner

@tigertim08 commented on GitHub (Jan 10, 2021):

Thanks, I disabled the two options but the result is still the same. Is there a way to see where the worker fails? The log of the worker shows:

papermerge_worker | [2021-01-10 13:15:31,045: INFO/ForkPoolWorker-2] Task papermerge.core.management.commands.worker.txt2db[099be9fb-8618-4a39-b636-c8f43062b2bc] succeeded in 0.5137349280121271s: None papermerge_worker | [2021-01-10 13:15:48,641: INFO/Beat] Scheduler: Sending due task import_from_email (papermerge.core.management.commands.worker.import_from_email) papermerge_worker | [2021-01-10 13:15:48,645: INFO/MainProcess] Received task: papermerge.core.management.commands.worker.import_from_email[dc070768-126b-494e-8704-f37d17bfe96e] papermerge_worker | [2021-01-10 13:15:48,646: DEBUG/ForkPoolWorker-2] Celery beat: import_from_email papermerge_worker | [2021-01-10 13:15:48,802: DEBUG/ForkPoolWorker-2] IMAP Import: UNSEEN messages 0 count papermerge_worker | [2021-01-10 13:15:48,804: INFO/ForkPoolWorker-2] Task papermerge.core.management.commands.worker.import_from_email[dc070768-126b-494e-8704-f37d17bfe96e] succeeded in 0.15758350398391485s: None papermerge_worker | [2021-01-10 13:16:18,661: INFO/Beat] Scheduler: Sending due task import_from_email (papermerge.core.management.commands.worker.import_from_email) papermerge_worker | [2021-01-10 13:16:18,665: INFO/MainProcess] Received task: papermerge.core.management.commands.worker.import_from_email[0ba631c3-a0f7-4149-a97c-2c48b3f9befa] papermerge_worker | [2021-01-10 13:16:18,666: DEBUG/ForkPoolWorker-2] Celery beat: import_from_email papermerge_worker | [2021-01-10 13:16:18,814: DEBUG/ForkPoolWorker-2] IMAP Import: UNSEEN messages 0 count papermerge_worker | [2021-01-10 13:16:18,816: INFO/ForkPoolWorker-2] Task papermerge.core.management.commands.worker.import_from_email[0ba631c3-a0f7-4149-a97c-2c48b3f9befa] succeeded in 0.14987174997804686s: None

So it tells me that their are no unseen messageges but thats just not the case... Their are some in the inbox and also I sent a new one after the disabling of the two options. One thing I noticed is that the mails in my inbox are marked as read. I have now manually set this to unread and I get another error message in the worker.log

papermerge_worker | [2021-01-10 13:27:18,557: INFO/Beat] Scheduler: Sending due task rebuild_the_tree (papermerge.core.management.commands.worker.rebuild_the_tree) papermerge_worker | [2021-01-10 13:27:18,561: INFO/MainProcess] Received task: papermerge.core.management.commands.worker.rebuild_the_tree[f21d8fe4-2b68-4d08-890a-210b2a2b73d4] papermerge_worker | [2021-01-10 13:27:18,893: INFO/Beat] Scheduler: Sending due task import_from_email (papermerge.core.management.commands.worker.import_from_email) papermerge_worker | [2021-01-10 13:27:18,897: INFO/MainProcess] Received task: papermerge.core.management.commands.worker.import_from_email[a6af040d-dc5a-41f7-ad08-1928dd630976] papermerge_worker | [2021-01-10 13:27:19,062: INFO/ForkPoolWorker-2] Task papermerge.core.management.commands.worker.rebuild_the_tree[f21d8fe4-2b68-4d08-890a-210b2a2b73d4] succeeded in 0.49926389500615187s: None papermerge_worker | [2021-01-10 13:27:19,064: DEBUG/ForkPoolWorker-2] Celery beat: import_from_email papermerge_worker | [2021-01-10 13:27:23,223: DEBUG/ForkPoolWorker-2] IMAP Import: UNSEEN messages 2 count papermerge_worker | [2021-01-10 13:27:23,285: DEBUG/ForkPoolWorker-2] IMAP import: payload 0 maintype=multipart subtype=mixed. papermerge_worker | [2021-01-10 13:27:23,286: DEBUG/ForkPoolWorker-2] IMAP import: ignoring payload. papermerge_worker | [2021-01-10 13:27:23,286: DEBUG/ForkPoolWorker-2] IMAP import: payload 1 maintype=multipart subtype=alternative. papermerge_worker | [2021-01-10 13:27:23,286: DEBUG/ForkPoolWorker-2] IMAP import: ignoring payload. papermerge_worker | [2021-01-10 13:27:23,287: DEBUG/ForkPoolWorker-2] IMAP import: payload 2 maintype=text subtype=plain. papermerge_worker | [2021-01-10 13:27:23,287: DEBUG/ForkPoolWorker-2] IMAP import: ignoring payload. papermerge_worker | [2021-01-10 13:27:23,287: DEBUG/ForkPoolWorker-2] IMAP import: payload 3 maintype=text subtype=html. papermerge_worker | [2021-01-10 13:27:23,287: DEBUG/ForkPoolWorker-2] IMAP import: ignoring payload. papermerge_worker | [2021-01-10 13:27:23,287: DEBUG/ForkPoolWorker-2] IMAP import: payload 4 maintype=application subtype=octet-stream. papermerge_worker | [2021-01-10 13:27:23,287: DEBUG/ForkPoolWorker-2] IMAP import: importing... papermerge_worker | [2021-01-10 13:27:23,300: ERROR/ForkPoolWorker-2] Task papermerge.core.management.commands.worker.import_from_email[a6af040d-dc5a-41f7-ad08-1928dd630976] raised unexpected: Exception('Papermerge has no users defined') papermerge_worker | Traceback (most recent call last): papermerge_worker | File "/opt/app/.venv/lib/python3.8/site-packages/celery/app/trace.py", line 385, in trace_task papermerge_worker | R = retval = fun(*args, **kwargs) papermerge_worker | File "/opt/app/.venv/lib/python3.8/site-packages/celery/app/trace.py", line 650, in __protected_call__ papermerge_worker | return self.run(*args, **kwargs) papermerge_worker | File "/opt/app/papermerge/core/management/commands/worker.py", line 44, in import_from_email papermerge_worker | import_attachment() papermerge_worker | File "/opt/app/papermerge/core/importers/imap.py", line 135, in import_attachment papermerge_worker | read_email_message(email_message) papermerge_worker | File "/opt/app/papermerge/core/importers/imap.py", line 97, in read_email_message papermerge_worker | imp = DocumentImporter(temp.name) papermerge_worker | File "/opt/app/papermerge/core/document_importer.py", line 36, in __init__ papermerge_worker | raise Exception("Papermerge has no users defined") papermerge_worker | Exception: Papermerge has no users defined

@tigertim08 commented on GitHub (Jan 10, 2021): Thanks, I disabled the two options but the result is still the same. Is there a way to see where the worker fails? The log of the worker shows: `papermerge_worker | [2021-01-10 13:15:31,045: INFO/ForkPoolWorker-2] Task papermerge.core.management.commands.worker.txt2db[099be9fb-8618-4a39-b636-c8f43062b2bc] succeeded in 0.5137349280121271s: None papermerge_worker | [2021-01-10 13:15:48,641: INFO/Beat] Scheduler: Sending due task import_from_email (papermerge.core.management.commands.worker.import_from_email) papermerge_worker | [2021-01-10 13:15:48,645: INFO/MainProcess] Received task: papermerge.core.management.commands.worker.import_from_email[dc070768-126b-494e-8704-f37d17bfe96e] papermerge_worker | [2021-01-10 13:15:48,646: DEBUG/ForkPoolWorker-2] Celery beat: import_from_email papermerge_worker | [2021-01-10 13:15:48,802: DEBUG/ForkPoolWorker-2] IMAP Import: UNSEEN messages 0 count papermerge_worker | [2021-01-10 13:15:48,804: INFO/ForkPoolWorker-2] Task papermerge.core.management.commands.worker.import_from_email[dc070768-126b-494e-8704-f37d17bfe96e] succeeded in 0.15758350398391485s: None papermerge_worker | [2021-01-10 13:16:18,661: INFO/Beat] Scheduler: Sending due task import_from_email (papermerge.core.management.commands.worker.import_from_email) papermerge_worker | [2021-01-10 13:16:18,665: INFO/MainProcess] Received task: papermerge.core.management.commands.worker.import_from_email[0ba631c3-a0f7-4149-a97c-2c48b3f9befa] papermerge_worker | [2021-01-10 13:16:18,666: DEBUG/ForkPoolWorker-2] Celery beat: import_from_email papermerge_worker | [2021-01-10 13:16:18,814: DEBUG/ForkPoolWorker-2] IMAP Import: UNSEEN messages 0 count papermerge_worker | [2021-01-10 13:16:18,816: INFO/ForkPoolWorker-2] Task papermerge.core.management.commands.worker.import_from_email[0ba631c3-a0f7-4149-a97c-2c48b3f9befa] succeeded in 0.14987174997804686s: None` So it tells me that their are no unseen messageges but thats just not the case... Their are some in the inbox and also I sent a new one after the disabling of the two options. One thing I noticed is that the mails in my inbox are marked as read. I have now manually set this to unread and I get another error message in the worker.log `papermerge_worker | [2021-01-10 13:27:18,557: INFO/Beat] Scheduler: Sending due task rebuild_the_tree (papermerge.core.management.commands.worker.rebuild_the_tree) papermerge_worker | [2021-01-10 13:27:18,561: INFO/MainProcess] Received task: papermerge.core.management.commands.worker.rebuild_the_tree[f21d8fe4-2b68-4d08-890a-210b2a2b73d4] papermerge_worker | [2021-01-10 13:27:18,893: INFO/Beat] Scheduler: Sending due task import_from_email (papermerge.core.management.commands.worker.import_from_email) papermerge_worker | [2021-01-10 13:27:18,897: INFO/MainProcess] Received task: papermerge.core.management.commands.worker.import_from_email[a6af040d-dc5a-41f7-ad08-1928dd630976] papermerge_worker | [2021-01-10 13:27:19,062: INFO/ForkPoolWorker-2] Task papermerge.core.management.commands.worker.rebuild_the_tree[f21d8fe4-2b68-4d08-890a-210b2a2b73d4] succeeded in 0.49926389500615187s: None papermerge_worker | [2021-01-10 13:27:19,064: DEBUG/ForkPoolWorker-2] Celery beat: import_from_email papermerge_worker | [2021-01-10 13:27:23,223: DEBUG/ForkPoolWorker-2] IMAP Import: UNSEEN messages 2 count papermerge_worker | [2021-01-10 13:27:23,285: DEBUG/ForkPoolWorker-2] IMAP import: payload 0 maintype=multipart subtype=mixed. papermerge_worker | [2021-01-10 13:27:23,286: DEBUG/ForkPoolWorker-2] IMAP import: ignoring payload. papermerge_worker | [2021-01-10 13:27:23,286: DEBUG/ForkPoolWorker-2] IMAP import: payload 1 maintype=multipart subtype=alternative. papermerge_worker | [2021-01-10 13:27:23,286: DEBUG/ForkPoolWorker-2] IMAP import: ignoring payload. papermerge_worker | [2021-01-10 13:27:23,287: DEBUG/ForkPoolWorker-2] IMAP import: payload 2 maintype=text subtype=plain. papermerge_worker | [2021-01-10 13:27:23,287: DEBUG/ForkPoolWorker-2] IMAP import: ignoring payload. papermerge_worker | [2021-01-10 13:27:23,287: DEBUG/ForkPoolWorker-2] IMAP import: payload 3 maintype=text subtype=html. papermerge_worker | [2021-01-10 13:27:23,287: DEBUG/ForkPoolWorker-2] IMAP import: ignoring payload. papermerge_worker | [2021-01-10 13:27:23,287: DEBUG/ForkPoolWorker-2] IMAP import: payload 4 maintype=application subtype=octet-stream. papermerge_worker | [2021-01-10 13:27:23,287: DEBUG/ForkPoolWorker-2] IMAP import: importing... papermerge_worker | [2021-01-10 13:27:23,300: ERROR/ForkPoolWorker-2] Task papermerge.core.management.commands.worker.import_from_email[a6af040d-dc5a-41f7-ad08-1928dd630976] raised unexpected: Exception('Papermerge has no users defined') papermerge_worker | Traceback (most recent call last): papermerge_worker | File "/opt/app/.venv/lib/python3.8/site-packages/celery/app/trace.py", line 385, in trace_task papermerge_worker | R = retval = fun(*args, **kwargs) papermerge_worker | File "/opt/app/.venv/lib/python3.8/site-packages/celery/app/trace.py", line 650, in __protected_call__ papermerge_worker | return self.run(*args, **kwargs) papermerge_worker | File "/opt/app/papermerge/core/management/commands/worker.py", line 44, in import_from_email papermerge_worker | import_attachment() papermerge_worker | File "/opt/app/papermerge/core/importers/imap.py", line 135, in import_attachment papermerge_worker | read_email_message(email_message) papermerge_worker | File "/opt/app/papermerge/core/importers/imap.py", line 97, in read_email_message papermerge_worker | imp = DocumentImporter(temp.name) papermerge_worker | File "/opt/app/papermerge/core/document_importer.py", line 36, in __init__ papermerge_worker | raise Exception("Papermerge has no users defined") papermerge_worker | Exception: Papermerge has no users defined`

kerem commented

2026-02-25 21:31:30 +03:00

Author

Owner

@francescocarzaniga commented on GitHub (Jan 11, 2021):

@tigertim08 You need to create at least one user, i.e. the superuser as mentioned in the setup guide.

@francescocarzaniga commented on GitHub (Jan 11, 2021): @tigertim08 You need to create at least one user, i.e. the superuser as mentioned in the [setup guide](https://papermerge.readthedocs.io/en/latest/setup/manual_way.html#step-4-superuser).

kerem commented

2026-02-25 21:31:30 +03:00

Author

Owner

@tigertim08 commented on GitHub (Jan 11, 2021):

@tigertim08 You need to create at least one user, i.e. the superuser as mentioned in the setup guide.

Since I'm using the docker version, I have a superuser "admin"

@tigertim08 commented on GitHub (Jan 11, 2021): > @tigertim08 You need to create at least one user, i.e. the superuser as mentioned in the [setup guide](https://papermerge.readthedocs.io/en/latest/setup/manual_way.html#step-4-superuser). Since I'm using the docker version, I have a superuser "admin"

kerem commented

2026-02-25 21:31:30 +03:00

Author

Owner

@francescocarzaniga commented on GitHub (Jan 11, 2021):

@tigertim08 Then the importer is not seeing the user. Try opening a management shell (python3 manage.py shell) inside the docker container.
Then run the following:

from papermerge.core.models import User
User.objects.filter()
User.objects.filter(is_superuser=True)

and paste the output.

@francescocarzaniga commented on GitHub (Jan 11, 2021): @tigertim08 Then the importer is not seeing the user. Try opening a management shell (`python3 manage.py shell`) inside the docker container. Then run the following: ``` from papermerge.core.models import User User.objects.filter() User.objects.filter(is_superuser=True) ``` and paste the output.

kerem commented

2026-02-25 21:31:30 +03:00

Author

Owner

@tigertim08 commented on GitHub (Jan 13, 2021):

thank you, the Output looks like:

from papermerge.core.models import User
User.objects.filter()
<QuerySet [<User: admin>]>
User.objects.filter(is_superuser=True)
<QuerySet []>
`

@tigertim08 commented on GitHub (Jan 13, 2021): thank you, the Output looks like: ` >>> from papermerge.core.models import User >>> User.objects.filter() <QuerySet [<User: admin>]> >>> User.objects.filter(is_superuser=True) <QuerySet []> >>> `

kerem commented

2026-02-25 21:31:30 +03:00

Author

Owner

@ciur commented on GitHub (Jan 13, 2021):

@tigertim08, from the output above I see that you don't have superuser (administrative user).

Like above, in ./manage.py shell run following:

from papermerge.core.models import User

user =  User.objects.get(username='admin')
user.is_superuser = True
user.save()

@ciur commented on GitHub (Jan 13, 2021): @tigertim08, from the output above I see that you don't have superuser (administrative user). Like above, in ./manage.py shell run following: ``` from papermerge.core.models import User user = User.objects.get(username='admin') user.is_superuser = True user.save() ```

kerem commented

2026-02-25 21:31:30 +03:00

Author

Owner

@tigertim08 commented on GitHub (Jan 14, 2021):

Thank you @ciur and @francescocarzaniga! It works know :)

@tigertim08 commented on GitHub (Jan 14, 2021): Thank you @ciur and @francescocarzaniga! It works know :)

kerem referenced this issue

2026-02-25 21:32:17 +03:00

[PR #232] [CLOSED] WIP: pipeline overhaul #573