Outlook 2016’s New POP3 Bug Deletes Your Emails!

Yikes, looks like the new version of Outlook 20016 has broken the POP3 implementation. If you are currently using the “leave on server and  delete after x days” function, the you should check your account because it seems like that the new Outlook is actually deleting your emails almost immediately after retrieving them over POP3. You might also be seeing dupes.

TL;DR If you are using the Outlook 2016 to download from a POP3 server, you should disable automatic updates and/or downgrade to a previous version or else your emails are likely to be deleted almost immediately.

UPDATE 03/21/2016:
You can now just update to the latest version of Outlook to fix this problem. Inside Outlook, click on…

File->Office Account->Office Updates->Update Now

Note that if you turned off Office updates before, you should probably turn them back on now.

 

UPDATE 02/26/2016:
New and helpful Microsoft Knowledge Base Article here…
https://support.microsoft.com/en-us/kb/3145116

TL;DR: Disable automatic updates in File->Office Account->Update Options and then downgrade by entering this at a command prompt…

[code]"C:\Program Files\Common Files\Microsoft shared\ClickToRun\officec2rclient.exe" /update user updatetoversion=16.0.6366.2068[/code]

 

Sad-outlook
About a week ago I started seeing dupes in my Outlook inbox. Later I noticed that other clients were not seeing new emails at all.

After hours and hours of painful research, I am almost certain that I’ve narrowed the problem down to a bug in the latest Outlook 2016 POP3 client UIDL database.

To prove it, you can do what I did….

  1. Download a fresh Windows virtual machine straight from Microsoft. While these VMs images are meant for testing browser compatibility, they are super handy for testing other things too since they are ready to run and super clean. I used VirtualBox to run the VM, but it doesn’t matter.
  2. Download and install a trial copy of Outlook 2016. Again, super fresh and super clean.
  3. Download and install hMailServer.  This is a clean and lightweight POP3 and SMTP server that you can install in about 2 minutes. Make sure you pick “use internal database”.
  4. From the hMailServer admin, add a domain “test.com” and then add a user “test@test.com” to the domain. You can safely leave everything at defaults.
  5. Launch Outlook without adding an account. We want to turn on logging before we do any POP3 so we capture everything.
  6. Enable logging under File->Options->Advanced->Enable Logging.
  7. Quit and Restart Outlook to actually enable logging.
  8. Now go into File-Add Account and manually add a POP3 account with the username “test@test.com” and POP3/SMTP servers “127.0.0.1”. You can leave everything else at default since the default is to leave messages on server for 14 days.
  9. Do “send/receive” and you should see the Outlook test email.
  10. Use the “New Email” button to send a couple of test emails to “test@test.com”.
  11. Do “send/receive” a couple of times and you should see the new test emails. Then you should also eventually start seeing dupes. Bingo!

Now open up the file C:\Users\IEUser\AppData\Local\Temp\outlook logging\OPMLog.log.  Here are the lines that highlight the issue…

[code]

# List all messages on the server

2016.02.24 13:40:46 POP3 (127.0.0.1): [tx] UIDL
2016.02.24 13:40:46 POP3 (127.0.0.1): <rx> +OK 1 messages (1081 octets)
2016.02.24 13:40:46 POP3 (127.0.0.1): <rx> 1 1
2016.02.24 13:40:46 POP3 (127.0.0.1): <rx> .

# There is a new message #1, so retrieve it

2016.02.24 13:40:00 POP3 (127.0.0.1): ==== Comparing server and local blobs ====
2016.02.24 13:40:00 POP3 (127.0.0.1): 1 : new
2016.02.24 13:40:00 POP3 (127.0.0.1): ==========================================
2016.02.24 13:40:00 POP3 (127.0.0.1): Do deletions: LoS: yes, DA: 14, DoN: no
2016.02.24 13:40:00 POP3 (127.0.0.1): ========= No blob changes =========
2016.02.24 13:40:00 POP3 (127.0.0.1): ===================================
2016.02.24 13:40:00 POP3 (127.0.0.1): [tx] RETR 1
2016.02.24 13:40:00 POP3 (127.0.0.1): <rx> +OK 1081 octets
2016.02.24 13:40:00 POP3 (127.0.0.1): done

# A little while later….
# List all messages on the server

2016.02.24 13:41:17 POP3 (127.0.0.1): [tx] UIDL
2016.02.24 13:41:17 POP3 (127.0.0.1): +OK 2 messages (3650 octets)
2016.02.24 13:41:17 POP3 (127.0.0.1): 1 1
2016.02.24 13:41:17 POP3 (127.0.0.1): 2 2
2016.02.24 13:41:17 POP3 (127.0.0.1): .

# Now there are two messages, #1 (the one from a couple of minutes ago) and #2 (a new one)

2016.02.24 13:41:17 POP3 (127.0.0.1): ==== Comparing server and local blobs ====
2016.02.24 13:41:17 POP3 (127.0.0.1): 2 : new
2016.02.24 13:41:17 POP3 (127.0.0.1): ==========================================

# Wait! What? Only one of those messages it new! Did you already forget about #1?

2016.02.24 13:41:17 POP3 (127.0.0.1): Do deletions: LoS: yes, DA: 14, DoN: no
2016.02.24 13:41:17 POP3 (127.0.0.1): [tx] DELE 1
2016.02.24 13:41:17 POP3 (127.0.0.1): +OK msg deleted

# WTH are you DELETING my 1st email message!?! I told you to leave on server (Los) for 14 days (DA)!

[/code]

The full log is available here showing the whole tragedy unfold.

After multiple calls with Microsoft, escalation is underway. I’ll update with details.

I do miss the old days when you could get straight to the application group with real problems, I think building walls around the engineers ends up hurting their situational awareness on stuff like this. All developers should be required to spend a certain amount of time every day fielding support calls. Makes for much better products.

UPDATE 3/1/2016:

If you are having problems downgrading…

  1. Try running the command as Administrator.

  2. If you are getting “Something went wrong” errors, try repairing your Office installation.

73 comments

  1. Mike

    I have 2 IMAP and 2 Exchange. It was actually doing it on all email domains. Deleting the email as soon as it appeared in Outlook 2016 Inbox. Downgraded to 2013. Microsoft tech remoted into my PC and ruined many features, including filling up my junk email box with Synchonization logs…thousands of them for each email account.

  2. Catharine P. Taylor

    I have put off upgrading to Outlook 2016 but am now ready to do so. I use POP3 accounts (for reasons particular to my work patterns).
    Has Microsoft solved this problem so that a fresh upgrade-download won’t engender issues with server/duplicates/erasures. etc. WITHOUT resorting to the complicated (read: time-consuming) workarounds listed?

  3. GuidoS

    Since a week or so, I also have an issue with Outlook 2016/pop3. I have it configured not to leave copies on the server. When retrieving mails, it happens now and then that only a part of the mails is retrieved. It happens now daily that one or a few mails are left on the server. When I use my phone to forward those mails, they arrive as it should. I have already done the office update and cleaned up the mailbox on the server side using webmail and emptying the sent folders and the trash. Anybody with ideas ?

  4. jan

    problem was gone but since latest update back again, lost all a-mails with hospital and specialist, now I’m really fucked, when does M$ grow up and releases only working software ??

  5. Alastair

    I am still using Outlook 2010 with a Pop3 account and a little less than couple of months ago, I suddenly found that when I have set up advanced to keep mails on server AND delete them when the Deleted Items folder is emptied, all ‘deleted’ emails in that folder just stay there are are not deleted on the server. I changed the setting to NOT keep emails on the server, and as soon as I click delete on an email in my inbox, looking at webmail for the same account on a second screen, I see that the email is immediately deleted on the ISP’s server. So, the second scenario is apparently working OK, but the first is just not working at all.

    Anyone had any experience of this NEWish malfunction with Outlook 2010 please?

  6. Julie

    I thought I fixed his last month and no I just realized it did it to me again and deleted a contact tat I needed.. UGH So last month when I messed around with it I was able to recover some of the older messages, will changing to an older version of word recover them?

  7. Peteski

    Hi Josh, I have outlook 2016 and this is happening to me. I have three gmail accounts going to the outlook. the first is fine but the other two delete every email after about ten minutes. I have updated to the most recent build but no change. Any idea?

    • bigjosh2

      This sounds like a different issue than the one this article is about. Have you checked the “Leave messages on server?” setting in the settings page for each account in Outlook? I’d also check the “Delete messages after ___ days?” setting.

  8. Stanley Davis

    I had the same problem. About 50 messages were immediatly deleted. I removed Outlook 2016. Reenstalled Outlook 2013. However these messages are gone forever. You would think Microsoft would test everything before selling their products. I wish I had my money back but fat chance of that. Should have converted to Apple 14 years ago.

  9. Chuk

    My Emails are gone from Sent Folder as of 12/31/2016 that i had in saved folder since 2013. Never had issue or wasn’t cautioned in advance that they would delete the sent emails, and nothing has come back from Microsoft’s thread about it other than if i had outlook.com or mail in the header. I had been using Windows Live as a favorite on the bookkeeper/favorite only to connect to the hotmail account. I understand they are disposing of that too, (this month actually Jan. 2017, if I’m correct on that) for the bigger and better Outlook and so it is….or sobeit and my opinion right now is if it can’t handle the roll over of their old system than but to delete the emails from the past and from their past hotmail account that they set up for us and then come to tell us that that’s no longer, etc…well, so much for their bigger better outfit I’ll find a real one elsewhere. Even though in the free cyberworld, there’s not a great pickings too choose from at the same time.

  10. Linda Simpson

    I have just found your really helpful info after discovering that all my sent items for the last 12 months, including some business critical ones have been deleted from Microsoft Office 365 Outlook. My question is, what has happened to the emails? Surely they can’t have been completely been wiped from my laptop without trace?

    • bigjosh2

      If those emails are important, then you should stop using your laptop immediately and get it to someone who can try to recover the lost data. The more you use it, the greater the chance that you might overwrite the data and loose it irretrievably.

  11. Gregory D Pochet

    It is May 2017 and I have this problem. Not sure when it started. I have the latest updates for Outlook 2016 I use gmail.

Leave a Reply