Exchange 2010 - Disconnected RPC sessions not closed

Hello All

Facing a bit weird issue in environment and have been trying to fix it since few days now without any luck. We are running on Exchange 2010 SP2 UR3 (planning for SP3 UR 1) soon. Recently we observed following issues in environment:

  1. Outlook clients, disconnecting and reconnecting intermittently (no WAN accelerator in env)
  2. Databases going into disconnected & healthy state intermittently
  3. Total number of connections to mailbox server running very high compared to what they should be.

Now as you must be suspecting by now, we have narrowed down the issue being packet loss in environment. After lot of diagnosis, we were able to determine that cause of packet drip is RX pause packets sent from servers to switch which indicates that destination box is unable to process as fast as they are being received, so it tells switch to slow down.

To fix above issue, switch guy tell us to enable flow control on switch which will buffer the packets. However we already have flow control on our esx 4.1 farm on which exchange is running along with dedicated NIC for mapi, replication and backup.

But the bigger issue is Outlook connections. In network capture we can see CAS requesting fast packet re transmit after intermittent packet drop.

Currently all users have more than 35 connections on an average. Exchange store limits have already been bumped up. The issue I believe is due to fact that exchange is not closing previously disconnected sessions and keep accumulating them over period of day. (tcp keep alive tome is default 2 hrs). Increased connections along with network packet drop is creating intermittent pop up on outlook side it seems.

So my question being:

  1. How can I ensure these connections get closed beside restarting services or moving mailboxes. Should I decrease tcp kewp alive time on server?
  2. If anyone knows impact of enabling flow control on network switches even though they are enabled on esx host side? If it is required and any know gotchas or issues due to same?

Hopefully I covered most of background, please let me know if additional details required.

Thanks in advance !

June 22nd, 2013 7:17am

Hi,

Based on all the symptoms, it seems there are performance issues on your Exchange Server. I suggest we use the perfmon tool to monitor the performance:

Perfwiz for Exchange 2010

http://blogs.technet.com/b/mikelag/archive/2010/01/11/perfwiz-for-exchange-2010.aspx

then compare with the performance counters via:

Performance and Scalability Counters and Thresholds

http://technet.microsoft.com/en-us/library/dd335215(v=exchg.141).aspx

Thanks,

Free Windows Admin Tool Kit Click here and download it now
June 26th, 2013 9:11am

Sorry no, it wasn't performance issues, it was network issue as I was suspecting originally. After working few weeks on same, I was able to resolve it and blogged same below:

http://exchangeserverinfo.net/2013/06/outlook-intermittent-disconnections-exchange-2010/

http://exchangeserverinfo.net/2013/06/database-copies-disconnects-randomly/

Thanks for the inputs, should be helpful in other scenarios leading to same issue !

July 7th, 2013 8:46am

This topic is archived. No further replies will be accepted.

Other recent topics Other recent topics