Felamimal Cyrus-IMAP sent mail issue trunk@r43648

[Anthony_Messina]

I’m running into an issue that has gone unnoticed for at least a couple weeks
since I don’t send a lot of email via EGroupware… Felamimal will not send
mail as it encounters the following error:

“Error: No Folder destination supplied, and no folder to save message or other
measure to store the mail (save to infolog/tracker) provided, but required. No
(valid) Send Folder set in preferences”

For a few years now, I’ve had the Drafts, Sent, Templates, and Trash folders
set via “Forced Preferences” to ensure there were no interoperability issues
with Cyrus and that users would see the same mail whether they used EGroupware
or another mail client, accessing the same IMAP server.

I’ve taken a look through felamimail/inc/class.bocompose.inc.php, and the
commit that seems related is
http://dev.egroupware.org/viewvc/egroupware?view=revision&revision=41426 but
that commit was a while back. I think the issue may be related to the fix
that was introduced in
http://dev.egroupware.org/viewvc/egroupware?view=revision&revision=43321.

The Apache logs aren’t a ton of help to me, but they do spit out the following
error:

"felamimail_bo::folderExists4027 Called with empty Folder:felamimail_bo-

folderExists:4027 / bocompose->send:1088 / uicompose->action:193"

Any help would be appreciated. Thanks in advance. -A

–
Anthony - http://messinet.com - http://messinet.com/~amessina/gallery
8F89 5E72 8DF0 BCF0 10BE 9967 92DC 35DC B001 4A4E

[Leithoff_Klaus]

Hey Anthony,
Tricky; I use egw all the time and I do not run into the error described; but thats probably due to my prefs and config. With the described revisions we tried to introduce a more reliable and consistent way of determining what the Folders are, that we regard as required.
As a side effect we wanted to provide a way, that - if no folders are configured and the server provided the info, we were able to recover.
The action takes place in _getSpecialUseFolder
First we query the icServer related Folder info (folderinfo that me be set with the profile if you are allowed to define your own MailProfile in felamimail)
Second (if there is no result from the previous action) we have a look at the prefs.
Then we check if the found folder is existing.
If not, we check if there is a SpecialUseFolder configured with the mailserver.
If that failes too, we try to determine if the AutoFolderName is existing.

In Trunk that is line 3877 - 3911

I think; first please check your forced prefs.
Re-adjust if needed; Save them again.
Try to reproduce the problem.
Try to put/add error_log statements into each step , so after line 3893 (for profile specific)
after 3895 for pref settings
after 3901 for SpecialUseFolder-Info
and just before 3910 for the result.
best regards
Klaus

kl@stylite.de
Stylite AG
Developement
[ open style of IT ]
Morschheimer Strasse 15
67292 Kirchheimbolanden
fon 06352 . 70629-0
fax 06352 . 70629-30
www.stylite.de | www.egroupware.org

Managing Directors: Andre Keller | Ralf Becker | Gudrun Mueller
Chairman of the supervisory board: Prof. Dr. Birger Leon Kropshofer

VAT DE214280951 | Registered HRB 31158 Kaiserslautern Germany

[Anthony_Messina]

Hey Anthony,
Tricky; I use egw all the time and I do not run into the error described;
but thats probably due to my prefs and config. With the described revisions
we tried to introduce a more reliable and consistent way of determining
what the Folders are, that we regard as required. As a side effect we
wanted to provide a way, that - if no folders are configured and the server
provided the info, we were able to recover. The action takes place in
_getSpecialUseFolder
First we query the icServer related Folder info (folderinfo that me be set
with the profile if you are allowed to define your own MailProfile in
felamimail) Second (if there is no result from the previous action) we have
a look at the prefs. Then we check if the found folder is existing.
If not, we check if there is a SpecialUseFolder configured with the
mailserver. If that failes too, we try to determine if the AutoFolderName
is existing.

In Trunk that is line 3877 - 3911

I think; first please check your forced prefs.
Re-adjust if needed; Save them again.
Try to reproduce the problem.
Try to put/add error_log statements into each step , so after line 3893 (for
profile specific) after 3895 for pref settings
after 3901 for SpecialUseFolder-Info
and just before 3910 for the result.
best regards
Klaus

Thanks, Klaus. I’ll give it a whirl. -A

–
Anthony - http://messinet.com - http://messinet.com/~amessina/gallery
8F89 5E72 8DF0 BCF0 10BE 9967 92DC 35DC B001 4A4E

[Anthony_Messina]

Hey Anthony,
Tricky; I use egw all the time and I do not run into the error described;
but thats probably due to my prefs and config. With the described revisions
we tried to introduce a more reliable and consistent way of determining
what the Folders are, that we regard as required. As a side effect we
wanted to provide a way, that - if no folders are configured and the server
provided the info, we were able to recover. The action takes place in
_getSpecialUseFolder
First we query the icServer related Folder info (folderinfo that me be set
with the profile if you are allowed to define your own MailProfile in
felamimail) Second (if there is no result from the previous action) we have
a look at the prefs. Then we check if the found folder is existing.
If not, we check if there is a SpecialUseFolder configured with the
mailserver. If that failes too, we try to determine if the AutoFolderName
is existing.

In Trunk that is line 3877 - 3911

I think; first please check your forced prefs.
Re-adjust if needed; Save them again.
Try to reproduce the problem.
Try to put/add error_log statements into each step , so after line 3893 (for
profile specific) after 3895 for pref settings
after 3901 for SpecialUseFolder-Info
and just before 3910 for the result.
best regards
Klaus

I’m going to go through those steps, probably over the weekend as I have to
return to my regular paying job

However, I do have a bit more circumstantial information. It appears that I
am losing the IMAP connection somewhere during the sending of the message. Or
that the connection is not maintaining TLS.

My IMAP logs reveal the following when trying to copy the message to the
"Sent" folder, which is “INBOX.Sent” (verified in my prefs, the forced prefs,
and the default prefs). The hostname and IP address are redacted.

imap[6823]: badlogin: example.com [1.2.3.4] PLAIN [SASL(-15): mechanism too
weak for this user: mech PLAIN is too weak]

Also, the message save as Draft begins to fail as well. Then, if I click on
"INBOX" in Egroupware, it will never reload the message list and the Apache
logs reveal:

felamimail_bo::saveAsDraft->Folder INBOX.Drafts Does not exist on IMAP
server., referer:
https://example.com/egroupware/index.php?menuaction=felamimail.uicompose.action&composeid=14a400ee28997eeee7a73bf242dc6735

notifications_ajax::check_mailbox169 # notifications (user: ):
cannot connect to mailbox with Profile:-1. Please check your prefs!, referer:
https://example.com/egroupware/index.php?menuaction=felamimail.uifelamimail.viewMainScreen&ajax=true

notifications_ajax::check_mailbox170 # NO, Login only available under a layer,
referer:
https://example.com/egroupware/index.php?menuaction=felamimail.uifelamimail.viewMainScreen&ajax=true

I do not allow personal email profiles so the only mail profile is the one set
up in “eMailAdmin: Profilemanagement” which has an ID of “1” and is the one I
have been using for a few years.

Do you think it would help if I deleted that single global profile and
recreated it?

-A

–
Anthony - http://messinet.com - http://messinet.com/~amessina/gallery
8F89 5E72 8DF0 BCF0 10BE 9967 92DC 35DC B001 4A4E

[Leithoff_Klaus]

Deleting the profile and recreating: no that will not help.
the rest I have to look into. may have to try with a tls connection.
(usually i am either on ssl or none.)
I have seen some loosing connection / not connected issues on compose, but generally those where related to enviroments with “own profiles” enabled, and losing the active Profile information.
I think this can be ruled out in this case.

–
Stylite AG
[ open style of IT ]

Morschheimer Strasse 15 | D-67292 Kirchheimbolanden

fon +49 (0)6352 . 70629-0 | fax +49 (0)6352 . 70629-30
email: office@stylite.de

www.stylite.de | www.egroupware.org

Managing Directors: Andre Keller | Ralf Becker | Gudrun Mueller
Chairman of the supervisory board: Prof. Dr. Birger Leon Kropshofer

VAT DE214280951 | Registered HRB 31158 Kaiserslautern Germany

[Anthony_Messina]

Klaus, I am able to confirm that the copy of sent messages to the "Sent"
folder works with an SSL IMAP connection, but NOT with a TLS IMAP connection,
if that helps any. Perhaps the STARTTLS routine isn’t being re-issued when
copying a message to the “Sent” folder, causing the

“PLAIN [SASL(-15): mechanism too weak for this user: mech PLAIN is too weak]”

issue detailed below? Incidentally, I have upgraded to Revision: 43707 and
see the same issue.

-A

Deleting the profile and recreating: no that will not help.
the rest I have to look into. may have to try with a tls connection.
(usually i am either on ssl or none.)
I have seen some loosing connection / not connected issues on compose, but
generally those where related to enviroments with “own profiles” enabled,
and losing the active Profile information. I think this can be ruled out in
this case.

–
Stylite AG

Von: Anthony Messina [amessina@messinet.com ]
An: “development of eGroupWare, for active developers”
[egroupware-developers@lists.sourceforge.net ] Datum: Thu, 29 Aug 2013
05:38:20 -0500

Hey Anthony,
Tricky; I use egw all the time and I do not run into the error described;
but thats probably due to my prefs and config. With the described
revisions
we tried to introduce a more reliable and consistent way of determining
what the Folders are, that we regard as required. As a side effect we
wanted to provide a way, that - if no folders are configured and the
server
provided the info, we were able to recover. The action takes place in
_getSpecialUseFolder
First we query the icServer related Folder info (folderinfo that me be
set
with the profile if you are allowed to define your own MailProfile in
felamimail) Second (if there is no result from the previous action) we
have
a look at the prefs. Then we check if the found folder is existing.
If not, we check if there is a SpecialUseFolder configured with the
mailserver. If that failes too, we try to determine if the AutoFolderName
is existing.

In Trunk that is line 3877 - 3911

I think; first please check your forced prefs.
Re-adjust if needed; Save them again.
Try to reproduce the problem.
Try to put/add error_log statements into each step , so after line 3893
(for profile specific) after 3895 for pref settings
after 3901 for SpecialUseFolder-Info
and just before 3910 for the result.
best regards
Klaus

I’m going to go through those steps, probably over the weekend as I have
to return to my regular paying job

However, I do have a bit more circumstantial information. It appears that
I am losing the IMAP connection somewhere during the sending of the
message. Or that the connection is not maintaining TLS.

My IMAP logs reveal the following when trying to copy the message to the
"Sent" folder, which is “INBOX.Sent” (verified in my prefs, the forced
prefs, and the default prefs). The hostname and IP address are redacted.

imap[6823]: badlogin: example.com [1.2.3.4] PLAIN [SASL(-15): mechanism
too >

weak for this user: mech PLAIN is too weak]

Also, the message save as Draft begins to fail as well. Then, if I click
on “INBOX” in Egroupware, it will never reload the message list and the

logs reveal:

felamimail_bo::saveAsDraft->Folder INBOX.Drafts Does not exist on IMAP
server., referer:

https://example.com/egroupware/index.php?menuaction=felamimail.uicom
pose.action&composeid=14a400ee28997eeee7a73bf242dc6735

notifications_ajax::check_mailbox169 # notifications (user: ):

cannot connect to mailbox with Profile:-1. Please check your prefs!,
referer: >

https://example.com/egroupware/index.php?menuaction=felamimail.uifel
amimail.viewMainScreen&ajax=true

notifications_ajax::check_mailbox170 # NO, Login only available under a
layer,
referer:

https://example.com/egroupware/index.php?menuaction=felamimail.uifel
amimail.viewMainScreen&ajax=true

I do not allow personal email profiles so the only mail profile is the one
set up in “eMailAdmin: Profilemanagement” which has an ID of “1” and is
the one I have been using for a few years.

Do you think it would help if I deleted that single global profile and
recreated it?

–
Anthony - http://messinet.com - http://messinet.com/~amessina/gallery
8F89 5E72 8DF0 BCF0 10BE 9967 92DC 35DC B001 4A4E

[Leithoff_Klaus]

Tried with STARTTLS on our Server.
It is working. Could it be a proxying issue?
I will recheck. but if there is no connection , it is going all the way through the connection process. if the connection is established it is used.

kl@stylite.de
Stylite AG
Developement
[ open style of IT ]
Morschheimer Strasse 15
67292 Kirchheimbolanden
fon 06352 . 70629-0
fax 06352 . 70629-30
www.stylite.de | www.egroupware.org

Managing Directors: Andre Keller | Ralf Becker | Gudrun Mueller
Chairman of the supervisory board: Prof. Dr. Birger Leon Kropshofer

VAT DE214280951 | Registered HRB 31158 Kaiserslautern Germany

[Anthony_Messina]

Tried with STARTTLS on our Server.
It is working. Could it be a proxying issue?

Hmmm… That’s a bummer for me. I am not proxying anything here, so
I’m not sure that’s the issue. I’m having trouble debugging this problem with
STARTTLS because there aren’t any Apache/PHP error logs about the
connection/login failing, until I attempt to click on another mail folder
after the “copy to Sent” fails. Only then, I get the error in EGroupware
itself (and the Apache/PHP logs) that the connection was lost.

I will recheck. but if there is no connection , it is going all the way
through the connection process. if the connection is established it is
used.

One thing that I had used for a long time, since the IMAP server is on
127.0.0.1, was to disable the verification of certs and have 127.0.0.1 as the
IMAP server. I never had any issues with this. When trying to resolve this
issue, I tried changing the IMAP server in emailadmin to the actual hostname,
but came up with the same problem. In short, it doesn’t seem to matter for me
whether or not I use the real hostname, with cert verification enabled, or
127.0.0.1 with cert verification disabled.

If it matters any, I am using Sieve on 127.0.0.1, port 4190 without issue.

It’s never good for the sysadmin when the dev isn’t able to reproduce the
issue I’m only puzzled as I hadn’t changed my emailadmin config in well
over a year or two and never saw this come up before.

Thanks again for your help here. -A

–
Anthony - http://messinet.com - http://messinet.com/~amessina/gallery
8F89 5E72 8DF0 BCF0 10BE 9967 92DC 35DC B001 4A4E

[Leithoff_Klaus]

If I find anything I will let you know.
I use the mail-app all the time, and I switched my connections to starttls, so if it comes up, I will be able to tell, and then able to debug.
The actual connection is opened in egw_pear/Net/Socket.php
Function connect.
So if connection fails, and it was not passing by “here” we would have some hint where to start looking.

Stylite AG
[ open style of IT ]

Morschheimer Strasse 15 | D-67292 Kirchheimbolanden

fon +49 (0)6352 . 70629-0 | fax +49 (0)6352 . 70629-30
email: office@stylite.de

www.stylite.de | www.egroupware.org

Managing Directors: Andre Keller | Ralf Becker | Gudrun Mueller
Chairman of the supervisory board: Prof. Dr. Birger Leon Kropshofer

VAT DE214280951 | Registered HRB 31158 Kaiserslautern Germany

[Leithoff_Klaus]

seems I found the reason, and thus a solution for the issue. will be commited later that day.
(customer had the same problem, and provided an account, that when bound to my devmachine showed the same problem, so I could test easily from my machine )

kl@stylite.de
Stylite AG
Developement
[ open style of IT ]
Morschheimer Strasse 15
67292 Kirchheimbolanden
fon 06352 . 70629-0
fax 06352 . 70629-30
www.stylite.de | www.egroupware.org

Managing Directors: Andre Keller | Ralf Becker | Gudrun Mueller
Chairman of the supervisory board: Prof. Dr. Birger Leon Kropshofer

VAT DE214280951 | Registered HRB 31158 Kaiserslautern Germany

[Anthony_Messina]

seems I found the reason, and thus a solution for the issue. will be
commited later that day. (customer had the same problem, and provided an
account, that when bound to my devmachine showed the same problem, so I
could test easily from my machine ) –
kl@stylite.de
Stylite AG
Developement

From: Anthony Messina [amessina@messinet.com ]

Tried with STARTTLS on our Server.
It is working. Could it be a proxying issue?

Hmmm… That’s a bummer for me. I am not proxying anything here, so
I’m not sure that’s the issue. I’m having trouble debugging this problem
with STARTTLS because there aren’t any Apache/PHP error logs about the
connection/login failing, until I attempt to click on another mail folder
after the “copy to Sent” fails. Only then, I get the error in
EGroupware itself (and the Apache/PHP logs) that the connection was lost.

I will recheck. but if there is no connection , it is going all the way
through the connection process. if the connection is established it is
used.

One thing that I had used for a long time, since the IMAP server is on
127.0.0.1, was to disable the verification of certs and have 127.0.0.1 as
the IMAP server. I never had any issues with this. When trying to
resolve this issue, I tried changing the IMAP server in emailadmin to the
actual hostname, but came up with the same problem. In short, it doesn’t
seem to matter for me whether or not I use the real hostname, with cert
verification enabled, or 127.0.0.1 with cert verification disabled.

If it matters any, I am using Sieve on 127.0.0.1, port 4190 without issue.

It’s never good for the sysadmin when the dev isn’t able to reproduce the
issue I’m only puzzled as I hadn’t changed my emailadmin config in well
over a year or two and never saw this come up before.

Klaus, I can confirm that after my pull to trunk@r43883, I can once again use
STARTTLS for the IMAP server and messages are properly copied to the Sent
folder. Thanks again. -A

–
Anthony - http://messinet.com - http://messinet.com/~amessina/gallery
8F89 5E72 8DF0 BCF0 10BE 9967 92DC 35DC B001 4A4E