[GH-ISSUE #756] Proper unicode support (was: Look into handling Unicode in folder names (was: "Offline" in the top right trying to access one account, others are fine)) #462

Closed
opened 2026-02-25 21:35:05 +03:00 by kerem · 12 comments
Owner

Originally created by @rikberkelder on GitHub (Sep 5, 2023).
Original GitHub issue: https://github.com/cypht-org/cypht/issues/756

Originally assigned to: @kambereBr on GitHub.

💬 Question

I've gotten Cypht set up with three accounts. one gmail, one custom domain email on zoho, and one custom domain email on yandex. The first two work just fine. The yandex account, added through the "add an email account" wizard. It authenticates just fine, both smtp and imap work when i hit the test button. But when I click the account in the sidebar, a red square with the text "offline" appears in the top right. Any ideas what could be going wrong?

Originally created by @rikberkelder on GitHub (Sep 5, 2023). Original GitHub issue: https://github.com/cypht-org/cypht/issues/756 Originally assigned to: @kambereBr on GitHub. ## 💬 Question I've gotten Cypht set up with three accounts. one gmail, one custom domain email on zoho, and one custom domain email on yandex. The first two work just fine. The yandex account, added through the "add an email account" wizard. It authenticates just fine, both smtp and imap work when i hit the test button. But when I click the account in the sidebar, a red square with the text "offline" appears in the top right. Any ideas what could be going wrong?
kerem closed this issue 2026-02-25 21:35:05 +03:00
Author
Owner

@marclaporte commented on GitHub (Sep 5, 2023):

I don't know but can you create a test email account (with no confidential info) for a dev to try?

<!-- gh-comment-id:1707352833 --> @marclaporte commented on GitHub (Sep 5, 2023): I don't know but can you create a test email account (with no confidential info) for a dev to try?
Author
Owner

@rikberkelder commented on GitHub (Sep 6, 2023):

So the plot thickens a bit. I ended up migrating my yandex account over to zoho as well, which i'd been meaning to do. I then added the second zoho account the way i added the first one, which works fine. It authenticates and gets added to the list. To my surprise, trying to open it still pops up the "Offline" indicator in the top right. The first two accounts still work just fine in the meantime

What even is this indicator supposed to mean? Is there any place i can find logs as to what's happening?

<!-- gh-comment-id:1708659659 --> @rikberkelder commented on GitHub (Sep 6, 2023): So the plot thickens a bit. I ended up migrating my yandex account over to zoho as well, which i'd been meaning to do. I then added the second zoho account the way i added the first one, which works fine. It authenticates and gets added to the list. To my surprise, trying to open it still pops up the "Offline" indicator in the top right. The first two accounts still work just fine in the meantime What even is this indicator supposed to mean? Is there any place i can find logs as to what's happening?
Author
Owner

@marclaporte commented on GitHub (Sep 6, 2023):

The debug mode is documented in https://github.com/cypht-org/cypht/blob/master/INSTALL

<!-- gh-comment-id:1708839046 --> @marclaporte commented on GitHub (Sep 6, 2023): The debug mode is documented in https://github.com/cypht-org/cypht/blob/master/INSTALL
Author
Owner

@marclaporte commented on GitHub (Sep 11, 2023):

What even is this indicator supposed to mean?

Spin off task: https://github.com/cypht-org/cypht/issues/761

<!-- gh-comment-id:1712987889 --> @marclaporte commented on GitHub (Sep 11, 2023): > What even is this indicator supposed to mean? Spin off task: https://github.com/cypht-org/cypht/issues/761
Author
Owner

@rikberkelder commented on GitHub (Sep 11, 2023):

I didn't find the time to get the debug mode set up, but i did find the issue. The yandex account auto-generated some folder with cryllic characters. This also got migrated along to zoho. Cypht did not like this folder, and showed the "offline" message while failing to list the folders using the sidebar. I was still getting the emails from the account in the "everything" folder. I ended up deleting the folder, and now the account works fine. Might be worth looking into handling Unicode in folder names

<!-- gh-comment-id:1714265346 --> @rikberkelder commented on GitHub (Sep 11, 2023): I didn't find the time to get the debug mode set up, but i did find the issue. The yandex account auto-generated some folder with cryllic characters. This also got migrated along to zoho. Cypht did not like this folder, and showed the "offline" message while failing to list the folders using the sidebar. I was still getting the emails from the account in the "everything" folder. I ended up deleting the folder, and now the account works fine. Might be worth looking into handling Unicode in folder names
Author
Owner

@marclaporte commented on GitHub (Nov 4, 2023):

I've seen some nasty issues in my days when migrating mailboxes with folder names beyond ASCII. Sometimes, it was not even possible to rename the folder (!)

@kambereBr Please take a look to:

  • Make sure Cypht has folder name support comparable to popular mail clients like Roundcube and Thunderbird.
  • Review the "offline" message to see if it could have provided useful feedback in this case.

Thanks!

<!-- gh-comment-id:1793563172 --> @marclaporte commented on GitHub (Nov 4, 2023): I've seen some nasty issues in my days when migrating mailboxes with folder names beyond ASCII. Sometimes, it was not even possible to rename the folder (!) @kambereBr Please take a look to: - Make sure Cypht has folder name support comparable to popular mail clients like Roundcube and Thunderbird. - Review the "offline" message to see if it could have provided useful feedback in this case. Thanks!
Author
Owner

@kambereBr commented on GitHub (Nov 5, 2023):

@marclaporte I take a look at this.

Thanks!

<!-- gh-comment-id:1793710004 --> @kambereBr commented on GitHub (Nov 5, 2023): @marclaporte I take a look at this. Thanks!
Author
Owner

@marclaporte commented on GitHub (May 6, 2024):

@kambereBr We need you

<!-- gh-comment-id:2097032979 --> @marclaporte commented on GitHub (May 6, 2024): @kambereBr We need you
Author
Owner

@kambereBr commented on GitHub (May 8, 2024):

PR: https://github.com/cypht-org/cypht/pull/1012

<!-- gh-comment-id:2099566140 --> @kambereBr commented on GitHub (May 8, 2024): PR: https://github.com/cypht-org/cypht/pull/1012
Author
Owner

@marclaporte commented on GitHub (May 15, 2024):

At https://github.com/cypht-org/cypht/pull/1012#issuecomment-2100552165, Victor wrote:

It is OK to merge this as we already require mbstring extension in composer and sparingly use it mainly to convert encodings. However, if we want proper unicode support, we should do much more with the code. I see 170 different usages of substr only and there are a bunch of other string related functions that need to be converted to their multibyte counterparts - e.g. strtolower, strtoupper, strlen, strstr and probably others. @marclaporte maybe we merge this one now to fix the reported issue and release 2.0.1 and then open a PR for the rest of the places that need fixing for version 2.1.0?

This is quite a big change so it could also make sense to be done as part of Cypht 3.0. @kambereBr please prepare this (low priority), and when it's ready, we'll determine if it goes in 2.x or 3.0.0.

@rikberkelder please confirm if https://github.com/cypht-org/cypht/pull/1012 solves your immediate concern.

Thanks!

<!-- gh-comment-id:2113410446 --> @marclaporte commented on GitHub (May 15, 2024): At https://github.com/cypht-org/cypht/pull/1012#issuecomment-2100552165, Victor wrote: > It is OK to merge this as we already require mbstring extension in composer and sparingly use it mainly to convert encodings. However, if we want proper unicode support, we should do much more with the code. I see 170 different usages of substr only and there are a bunch of other string related functions that need to be converted to their multibyte counterparts - e.g. strtolower, strtoupper, strlen, strstr and probably others. @marclaporte maybe we merge this one now to fix the reported issue and release 2.0.1 and then open a PR for the rest of the places that need fixing for version 2.1.0? This is quite a big change so it could also make sense to be done as part of Cypht 3.0. @kambereBr please prepare this (low priority), and when it's ready, we'll determine if it goes in 2.x or 3.0.0. @rikberkelder please confirm if https://github.com/cypht-org/cypht/pull/1012 solves your immediate concern. Thanks!
Author
Owner

@kambereBr commented on GitHub (May 16, 2024):

At #1012 (comment), Victor wrote:

It is OK to merge this as we already require mbstring extension in composer and sparingly use it mainly to convert encodings. However, if we want proper unicode support, we should do much more with the code. I see 170 different usages of substr only and there are a bunch of other string related functions that need to be converted to their multibyte counterparts - e.g. strtolower, strtoupper, strlen, strstr and probably others. @marclaporte maybe we merge this one now to fix the reported issue and release 2.0.1 and then open a PR for the rest of the places that need fixing for version 2.1.0?

This is quite a big change so it could also make sense to be done as part of Cypht 3.0. @kambereBr please prepare this (low priority), and when it's ready, we'll determine if it goes in 2.x or 3.0.0.

@rikberkelder please confirm if #1012 solves your immediate concern.

Thanks!

@marclaporte noted, thank you !

<!-- gh-comment-id:2113898976 --> @kambereBr commented on GitHub (May 16, 2024): > At [#1012 (comment)](https://github.com/cypht-org/cypht/pull/1012#issuecomment-2100552165), Victor wrote: > > > It is OK to merge this as we already require mbstring extension in composer and sparingly use it mainly to convert encodings. However, if we want proper unicode support, we should do much more with the code. I see 170 different usages of substr only and there are a bunch of other string related functions that need to be converted to their multibyte counterparts - e.g. strtolower, strtoupper, strlen, strstr and probably others. @marclaporte maybe we merge this one now to fix the reported issue and release 2.0.1 and then open a PR for the rest of the places that need fixing for version 2.1.0? > > This is quite a big change so it could also make sense to be done as part of Cypht 3.0. @kambereBr please prepare this (low priority), and when it's ready, we'll determine if it goes in 2.x or 3.0.0. > > @rikberkelder please confirm if #1012 solves your immediate concern. > > Thanks! @marclaporte noted, thank you !
Author
Owner

@marclaporte commented on GitHub (Sep 28, 2024):

@rikberkelder This is solved via https://github.com/cypht-org/cypht/pull/1012

Please re-open if you have issues with Cypht 2.4.0

<!-- gh-comment-id:2380402139 --> @marclaporte commented on GitHub (Sep 28, 2024): @rikberkelder This is solved via https://github.com/cypht-org/cypht/pull/1012 Please re-open if you have issues with Cypht 2.4.0
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/cypht#462
No description provided.