Mail Spool Problems / IMAP

Chuck Swiger cswiger at mac.com
Tue Apr 8 01:01:03 UTC 2008


On Apr 7, 2008, at 5:49 PM, Chris Maness wrote:
> How do I check it?  Should I use another IMAP server?

Look at the first few lines; you should see either a placeholder  
message like:

> From MAILER-DAEMON Mon Apr  7 13:08:13 2008
> Date: 07 Apr 2008 13:08:13 -0400
> From: Mail System Internal Data <MAILER-DAEMON at pong.codefab.com>
> Subject: DON'T DELETE THIS MESSAGE -- FOLDER INTERNAL DATA
> Message-ID: <1207588093 at pong.codefab.com>
> X-IMAP: 1143826475 0000000664 NonJunk $NotJunk JunkRecorded $Junk Junk
> Status: RO
>
> This text is part of the internal format of your mail folder, and is  
> not
> a real message.  It is created automatically by the mail system  
> software.
> If deleted, important folder data will be lost, and it will be re- 
> created
> with the data reset to initial values.
>

...or a normal message with an X-IMAPbase: header, depending on which  
version of UW IMAP you created the mailbox under.  If you see binary  
gunk (see forwarded message below), you're running into the same issue  
I've seen.

Regards,
-- 
-Chuck

PS: Since the mail below was written, I have seen this corruption  
happen with Outlook and Mozilla Tbird, not just with Apple Mail.

Begin forwarded message:
> From: Chuck Swiger <cswiger at mac.com>
> Date: January 24, 2008 11:05:50 AM PST
> To: imap-uw at u.washington.edu
> Subject: [Imap-uw] imap-2007 on Solaris 8, possible mbox data  
> corruption?
>
> Hi, all--
>
> I've been a happy user of UW imapd for many years, but recently a  
> number of my users have started really doing a lot of mail access in  
> parallel from a workstation and something like an iPhone.  I'd been  
> receiving more frequent reports of imapd locking problems with  
> imapd-2006h (ie, which would be resolved by them quitting and  
> restarting their MUA or smart phone), and have updated the imapd to  
> imap-2007 based on the comments in the release notes about the  
> locking issues which hopefully were resolved with 2006k.
>
> The users have initially reported that their locking problems were  
> much improved after the update, however, the build of imap-2007 is  
> now showing signs of a mbox corruption issue which has affected  
> several users.  Specifically, the first line or perhaps first few  
> lines of their mbox (either /var/mail/$USER, or ~$USER/mail/mbox)  
> which is normally the SMTP envelope From header, is being corrupted.
>
> Two examples (with apologies for the length):
>
> # head -2 mbox_200801114
> @???h?f??x?#~??$??
>                  I??U?#LiLQ?
>                             ?{?v?????۟c??"nF????m??mendez at gmail.com>
> Received: from pi.codefab.com (pi.codefab.com [199.103.21.227])
> # head -2 mbox_200801114 | od -h
> 0000000 1703 0100 4092 9291 0668 9f66 fae3 78df
> 0000020 237e c0d2 2415 e4f7 0b1e 499d da55 e223
> 0000040 1f8e 084c 694c 1c51 e00b 9f7b a076 0fbc
> 0000060 b1be a4e2 93db 9f63 b9b1 226e 46a3 1cc1
> 0000100 c9c9 6d8e 8f6d 656e 6465 7a40 676d 6169
> 0000120 6c2e 636f 6d3e 0a52 6563 6569 7665 643a
> 0000140 2066 726f 6d20 7069 2e63 6f64 6566 6162
> 0000160 2e63 6f6d 2028 7069 2e63 6f64 6566 6162
> 0000200 2e63 6f6d 205b 3139 392e 3130 332e 3231
> 0000220 2e32 3237 5d29 0a00
>
> # head -8 mbox_20080121
> ?*?D?jZ??????{?ڟ V??ùEy ?u?uG?M?Nl?R???:?hx
> Q?R?5????        ?r???U?N?E??δK??Ѽ?-K?͑@?!????$?c,?
>                                                  ??-?0?Z????4??9?@? 
> C??a6?v?
>                                                                            fJh 
> ?k?Kp?g??
>
>                                                                                          b 
> ??
> ?FR_????b?k?啾)???t_?ۆtF2?X??&??>h?z?3??ZNr?Yz=ˬ??9߬??6??4?{?mWCX? 
> Z2?K??ʩ)?vG??a??}Mi5?Я?9?)?=nUc?,<,?~
>                                                                                                      :?V 
> ?w<?n????????B?w?????<???>8AB   h7???푦X?
> ??d?d?tQ?bh?\6~rj???~ցa #?y?F??j????o??DA޺?e4d?z'???
>                                                    ]6    2??=??? 
> %?"??????8???v|??ᄡS?B?(     lJp?)^7'???g8?#??F0????ɞ??CP??֣??? 
> Rڗ3?8(?_??X"???Ŧր?E?[?F?K?f뜃?Qq?_ǖ ??咭o?
>                                    vBdh????L?1??w???G??
> ???ZLP???D?E6:?h?ܑNχ?M   ???ax?n?x?\?O/ZF3??=??0?[??1cfX??;???`???-? 
> z_>?E??\?C}??ׂP?\㋃J?~L^??=?ɶ???Y?4rF?\3<?I+DDUP??p??=?ĵD   ?K?? 
> FP??dm?|yH??D?E?K
> $YS???;F/4x?(e?~$3ʻ䚳=۷nR?.?6
> ?%??@????f??ݾ??r??7T??7??O??}?[3p?)7,??X?oޞ?T??;?*?6F??)q`????\?´? 
> &0??'&?zn??H??????9,o?!??EC6??U?( s\H$?h?B?P-7uO7?-Q?/?0?1%1j? 
> a???????!??!#$?????:??b???????6??B????LS>b?|4:11 -0400 (EDT)
> Received: from list.precipice.net ([199.103.21.231])
> # head -8 mbox_20080121 | od -h
> 0000000 1703 0103 e042 3493 4acb baae 3b03 ebab
> 0000020 9316 0deb 2ac0 4489 6a5a 8a81 e8a7 12af
> 0000040 0504 8e1b 23a2 8b7b d5da 9f20 56dc d5c3
> 0000060 b945 1279 1e20 d81f 758a 7547 1a93 1e4d
> 0000100 bb4e 6ce3 8606 521e d002 86aa 3ad7 6811
> 0000120 780a 51ab 52e9 358a d5ff f296 09c8 72fc
> 0000140 cad4 55c7 4e9b 45b4 b9ce b44b b990 d1bc
> 0000160 d62d 4bc4 cd91 100e 40ab 21ba a2cd f124
> 0000200 a863 2cf0 0c04 8615 a32d f913 30c1 5a97
> 0000220 f912 e804 02de 34d6 ef39 c140 b143 dfe6
> 0000240 610f 3605 db76 d80b 664a 68ca 036b 9c4b
> 0000260 1970 c667 c73f 0b06 0b09 62af c80a a846
> 0000300 190e 525f 95a6 9590 62d9 6b3f e595 be29
> 0000320 b98d e883 745f addb 8674 4632 ef58 86a9
> 0000340 2680 b33e 68cb 7aaa 3393 eb5a 4e72 138e
> 0000360 597a 3dcb acac 9d39 02df acba e636 9386
> 0000400 3499 7bfe 6d57 1143 58ff 5a32 9b4b b39a
> 0000420 caa9 2987 7647 f3ca 61ff c603 7d4d 6935
> 0000440 f2d0 afe1 1d39 dd29 d63d 6e55 631b 66eb
> 0000460 2c01 133c 2cc9 7e0b 3ac8 56a0 773c 966e
> 0000500 fcfa e280 f0f6 85ab dc42 cc77 edae a0de
> 0000520 dd3c 8c90 e33e 3841 4209 6837 8ee2 e3ed
> 0000540 91a6 5885 0acd db0e 64f2 7f64 d11c 7451
> 0000560 af62 68ce 5c36 7e72 6aae 119b 827e d681
> 0000600 0161 2023 1dd6 79ed 46bf b76a acf2 d6ea
> 0000620 9302 6fe9 d944 4117 deba b365 3464 af7a
> 0000640 1e27 8fa0 ba0b 5d36 0932 fffa 3dc5 dcfb
> 0000660 25f8 22ed 111a b799 9fca fc38 8d18 8acb
> 0000700 767c b019 bee1 84a1 53c1 42ba 2809 6c4a
> 0000720 1070 ad29 5e37 2712 92f9 9b67 38ae 23b8
> 0000740 fc46 30a2 12cb 00ff 87c9 9ee7 ed43 50a4
> 0000760 89d6 a3bb 1094 e5bd 52da 9733 8e38 28d3
> 0001000 5fb8 c906 5822 811e 89d7 c5a6 d680 e345
> 0001020 8006 5bd3 46c8 044b 01e6 66eb 9c83 f751
> 0001040 718f 5fc7 9620 87cf e592 ad6f e80b 2076
> 0001060 4264 68d5 c21c fbda 054c c731 f9ba 7710
> 0001100 b690 aa47 3fcd 0af0 9705 8edc 5a4c 50ca
> 0001120 daf3 2208 44e9 4536 3aad 6882 dc91 074e
> 0001140 cf87 f54d 0992 cfd0 6117 78b4 6e05 c978
> 0001160 995c 914f 2f5a 4633 acf0 3daf d030 04a1
> 0001200 1c5b a6bf 3163 6612 5814 9a07 1d9d 3b94
> 0001220 3f87 609a e9c8 2d8b 7a5f 3ec9 45c5 e75c
> 0001240 e643 7da6 0306 aed7 8250 b85c e38b 834a
> 0001260 de7e 104c 5ead 02aa 3ddd c9b6 c7dc de16
> 0001300 59ca 3472 46c2 5c33 3cfc 492b 0744 1244
> 0001320 5550 1501 d8dc 70a9 c63d c7c4 b544 0983
> 0001340 4bf6 ae46 50ad d846 4cbd 7c79 48bb 3f44
> 0001360 8145 864b 0d64 6d0a 2459 0153 fbab 803b
> 0001400 462f 3478 c328 65b0 7e24 33ca bbe4 9ab3
> 0001420 3ddb b712 6e52 1a19 932e d736 0a8f 25b1
> 0001440 8440 e3b3 f69c 9966 90c2 ddbe f7f1 80bc
> 0001460 72a7 f1a5 3754 a0ca 37b5 a54f b4e0 7d13
> 0001500 e788 5b33 1e70 c629 372c 0080 a758 a26f
> 0001520 de9e dd54 e8ea 1c3b eb2a a436 46aa d429
> 0001540 7160 bbfa fee7 5c10 dec2 b4aa 2630 85d2
> 0001560 2726 8d19 127a 6efc ea48 a088 8310 eaf0
> 0001600 a912 9239 0e2c 056f ba21 baac 4543 36c9
> 0001620 eea8 55c7 2820 735c 4824 de68 b942 a350
> 0001640 2d37 754f 37ee 952d 5103 cc2f ed30 8c31
> 0001660 2531 6af4 1461 fd1d afb4 a2d8 1fc5 c506
> 0001700 21cb e221 231e 24e0 e6ce eaef 3ade f162
> 0001720 f5be 8bf5 b09b ea36 eae4 42ba 8a93 f64c
> 0001740 533e 62b4 7c34 3a31 3120 2d30 3430 3020
> 0001760 2845 4454 290a 5265 6365 6976 6564 3a20
> 0002000 6672 6f6d 206c 6973 742e 7072 6563 6970
> 0002020 6963 652e 6e65 7420 285b 3139 392e 3130
> 0002040 332e 3231 2e32 3331 5d29 0a00
>
> The mailserver in question is a Sun E450 running Solaris 8 (kernel  
> rev=Generic_117350-46); imap-2007 was built with "make gso" using  
> gcc-3.4.6 from the sunfreeware.com SMCgcc package and against  
> OpenSSL 0.9.8f also from SMCossl; the only change was to set  
> mailsubdir = "mail".  All of the files are on local disks which are  
> in either a RAID-1 (/var) or RAID-10 (/home) configuration using  
> DiskSuite; metastat and systems logs are not reporting any disk  
> issues.
>
> This problem seems to only happen in conjunction with simultaneous  
> access and has been reported only with Mail.app from MacOS X  
> 10.4/10.5 & either a iPhone/Treo/Blackberry; I have yet to hear of  
> problems with users running Mozilla Thunderbird or Outlook Express.   
> Since all access is via 993/imaps, I can't readily tcpdump the  
> traffic, but I do have some syslogs which correspond to the issue:
>
> Jan 24 13:01:14 pong imapd[24697]: [ID 234311 mail.info] Login  
> user=xxxxx host=nfw1.codefab.com [199.103.21.225]
> Jan 24 13:01:14 pong imapd[24697]: [ID 960700 mail.info] Logout  
> user=xxxxx host=nfw1.codefab.com [199.103.21.225]
> Jan 24 13:03:32 pong imapd[24722]: [ID 234311 mail.info] Login  
> user=xxxxx host=mobile-032-137-230-023.mycingular.net [32.137.230.23]
> Jan 24 13:04:06 pong imapd[24722]: [ID 960700 mail.info] Hangup  
> user=xxxxx host=mobile-032-137-230-023.mycingular.net [32.137.230.23]
> Jan 24 13:06:15 pong imapd[25051]: [ID 234311 mail.info] Login  
> user=xxxxx host=nfw1.codefab.com [199.103.21.225]
> Jan 24 13:06:15 pong imapd[25051]: [ID 960700 mail.info] Logout  
> user=xxxxx host=nfw1.codefab.com [199.103.21.225]
> Jan 24 13:09:28 pong imapd[24023]: [ID 960700 mail.info] Killed  
> (terminated) user=xxxxx host=nfw1.codefab.com [199.103.21.225]
> Jan 24 13:17:24 pong imapd[25829]: [ID 234311 mail.info] Login  
> user=xxxxx host=nfw1.codefab.com [199.103.21.225]
> Jan 24 13:17:30 pong imapd[25834]: [ID 234311 mail.info] Login  
> user=xxxxx host=nfw1.codefab.com [199.103.21.225]
> Jan 24 13:17:31 pong imapd[25835]: [ID 234311 mail.info] Login  
> user=xxxxx host=nfw1.codefab.com [199.103.21.225]
> Jan 24 13:17:36 pong imapd[25834]: [ID 960700 mail.info] Logout  
> user=xxxxx host=nfw1.codefab.com [199.103.21.225]
> Jan 24 13:18:50 pong imapd[25857]: [ID 234311 mail.info] Login  
> user=xxxxx host=mobile-032-136-111-035.mycingular.net [32.136.111.35]
> Jan 24 13:18:51 pong imapd[25829]: [ID 960700 mail.info] Killed  
> (lost mailbox lock) user=xxxxx host=nfw1.codefab.com [199.103.21.225]
> Jan 24 13:18:51 pong imapd[25835]: [ID 960700 mail.info] Unexpected  
> client disconnect, while reading line user=xxxxx  
> host=nfw1.codefab.com [199.103.21.225]
> Jan 24 13:19:32 pong imapd[25857]: [ID 960700 mail.info] Hangup  
> user=xxxxx host=mobile-032-136-111-035.mycingular.net [32.136.111.35]
> Jan 24 13:22:30 pong imapd[26199]: [ID 234311 mail.info] Login  
> user=xxxxx host=nfw1.codefab.com [199.103.21.225]
>
> Regards,
> -- 
> -Chuck
>
> _______________________________________________
> Imap-uw mailing list
> Imap-uw at u.washington.edu
> https://mailman1.u.washington.edu/mailman/listinfo/imap-uw



More information about the freebsd-questions mailing list