Exchange databases getting large
Hello
We are running Exchange 2003 SP2 on Windows 2003 SP2 servers.
On one of our Exchange mailbox servers, the stores are getting a bit too large for comfort. This is the store where we locate Executive mailboxes with the higher mailbox limit.
I guess we can run an offline defrag assuming Event ID 1221 says we are going to reclaim enough space
or
We can move the mailboxes to another (temp) store, delete the original store and recreate the original store
Are there any other options? What do people recommend?
September 2nd, 2010 10:36pm
I never recommend an offline defrag. It takes too much time and their are risks associated with it. I suggest creating 2 new databases and splitting up the users among the two databases. The reason for not just one database, is that you
will be in the same boat again in a few months. Keep the databases smaller and create more of them. Better performance and better DR/SLA implications.Tim Harrington - Catapult Systems - http://HowDoUC.blogspot.com
Free Windows Admin Tool Kit Click here and download it now
September 2nd, 2010 10:43pm
Thanks Tim. We'll go for the second option.
Out of interest, what are the risks associated with offline defrag?
September 2nd, 2010 11:19pm
Whenever you take a store offline and perform an operation against it using isinteg or eseutil, there is always the possibility of something going wrong. Power, disk, corruption, or it winds up taking 12 hours when you were expecting it to last only 2 hours.
etc etc...
Free Windows Admin Tool Kit Click here and download it now
September 2nd, 2010 11:36pm
Thanks both. Looks like we'll be avoiding offline defrags :)
Out of interest, is it possible to make a copy of a database, run a defrag on the copy, and then - if that was succesful - mount that as the live database? This way, if there was an issue with the offline defrag we could always revert to the original db?
September 4th, 2010 3:23pm
Yes. But of course, that means downtime because the production store will have to remain down during the offline defrag on the other copy.
You can also use eseutil /b to create a backup copy.
Free Windows Admin Tool Kit Click here and download it now
September 4th, 2010 3:38pm
Hmm...so let's say we do this.
StoreA is the db we want to defrag. So we run eseutil /b to make a copy (I assume StoreA needs to be dismounted to make a copy?).
Once we have the copy we mount StoreA. But we run the offline defrag on the copy of StoreA.
Once the defrag has run, we dismount StoreA and then mount the defragged copy? Is that not possible?
September 4th, 2010 4:09pm
During the defrag, store A is online and taking in messages, handling deletions, copies, moves, etc...
So when you dismount and replace it with the defragged copy, you have just lost a few (hours?) of mail and information.
Free Windows Admin Tool Kit Click here and download it now
September 4th, 2010 4:20pm
Good point :)
So, if we were forced to carry out an offline defrag (for whatever reason), then would the best way to be?
1. Backup database, dismount and then defrag the db. If there is a problem, restore.
2. Backup database, dismount store and copy. Run a defrag of the copy. If there was a problem, then mount the original?
September 4th, 2010 5:03pm
Depending on how much time you had and the size of the database, I would make a copy and then run the defrag, but since offline defrags are really unnecessary, you'll hopefully never be in that position :)
Free Windows Admin Tool Kit Click here and download it now
September 4th, 2010 5:23pm
There are NO risks whatsoever with running of offline defrag. Always run offline defrag followed by isinteg.
It is not recommended to delete the default mailbox store because it homes system attendant mailbox, smtp mailbox and system mailboxes.
Thanks------Exchange, OCS------
September 5th, 2010 1:44pm
On Sun, 5 Sep 2010 10:44:54 +0000, Dr. RPC wrote:
>There are NO risks whatsoever with running of offline defrag.
There are no zero-risk disk operations. To say otherwise is foolhardy.
>Always run offline defrag followed by isinteg.
Correct.
>It is not recommended to delete the default mailbox store because it homes system attendant mailbox, smtp mailbox and system mailboxes.
The store, or the database file? The mailboxes will be recreated if
the database file is deleted.
---
Rich Matheisen
MCSE+I, Exchange MVP
--- Rich Matheisen MCSE+I, Exchange MVP
Free Windows Admin Tool Kit Click here and download it now
September 6th, 2010 12:09am
Out of interest, why the need to run isinteg -fix (presumably) after the offline defrag?
And regarding the 'special' mailboxes (system attendant, smtp etc) - what happens if these are located on a store we wanted to delete the white space for and were planning a mailbox move to a new store on the same server? Should we move these as well?
Thanks everyone
September 6th, 2010 12:21am
On Sun, 5 Sep 2010 21:21:46 +0000, Joe Budden wrote:
>Out of interest, why the need to run isinteg -fix (presumably) after the offline defrag?
It's not a necessity, but it sure is recommended. The ESEUTIL program
rearranges the database pages within the file but has no idea of the
contents of those pages. The ISINTEG ensures that all the tables
within the database are intact and, depending on the options you
select, that things like folder sizes and item counts are updated and
correct.
>And regarding the 'special' mailboxes (system attendant, smtp etc) - what happens if these are located on a store we wanted to delete the white space for and were planning a mailbox move to a new store on the same server? Should we move these as well?
With the exception of the system attendant mailbox, the others are
specific to the database.
The system attendant mailbox should be recreated in another database
when you remove the one you're emptying. If that doesn't happen
automatically, restart the SA service.
---
Rich Matheisen
MCSE+I, Exchange MVP
--- Rich Matheisen MCSE+I, Exchange MVP
Free Windows Admin Tool Kit Click here and download it now
September 6th, 2010 3:06am
On Sun, 5 Sep 2010 21:21:46 +0000, Joe Budden wrote:
>Out of interest, why the need to run isinteg -fix (presumably) after the offline defrag?
It's not a necessity, but it sure is recommended. The ESEUTIL program
rearranges the database pages within the file but has no idea of the
contents of those pages. The ISINTEG ensures that all the tables
within the database are intact and, depending on the options you
select, that things like folder sizes and item counts are updated and
correct.
>And regarding the 'special' mailboxes (system attendant, smtp etc) - what happens if these are located on a store we wanted to delete the white space for and were planning a mailbox move to a new store on the same server? Should we move these as well?
With the exception of the system attendant mailbox, the others are
specific to the database.
The system attendant mailbox should be recreated in another database
when you remove the one you're emptying. If that doesn't happen
automatically, restart the SA service.
---
Rich Matheisen
MCSE+I, Exchange MVP
--- Rich Matheisen MCSE+I, Exchange MVP
I agree there are no zero risk operations.
My statement is my own view stemming from numerous numerous offline defrags i ran as a part of maintenance on databases of various shapes and sizes. Never encountered any issue. Going by your logic there is risk in each and every maintenance operation
but that does not mean we should not be performing them.
Infact running offline defrag once in a while is highly recommended. and it is MUST after you have run an eseutil /p on the database.
Sometimes people face issue after defrag is because they do not run isinteg just after defrag.
-----
The system attendant mailbox defined for the server is automatically stored in the first mailbox database created during
setup.
If you delete the default mailbox database and/or storage group , the homeMDB attribute with the system attendant
mailbox are no longer valid. and just wont be created by restarting the system attendant service.
You have to re home (MANUALLY)the system attendant mailbox to point to the newly created database.
Thanks.
------Exchange, OCS------
September 6th, 2010 11:02am
Running an offline defrag "once in a while" has never been highly recommended nor should be part of any regular maintenance.
Microsoft says this themselves:
http://msexchangeteam.com/archive/2004/07/08/177574.aspx
"....offline defrag is definitely not something to do on regular basis. And it is typically not needed either"
Any yes, after running eseutil/p , you need to run an offline defrag. But running eseutil/p is a last-resort option. Restoring from backups is preferred over a repair.
Free Windows Admin Tool Kit Click here and download it now
September 6th, 2010 4:15pm
The system attendant mailbox will be moved automatically if the first store is permanetly deleted:
http://technet.microsoft.com/en-us/library/aa996235(EXCHG.65).aspx
If the store is then deleted, the System Attendant mailbox will be moved automatically into another mailbox store on the server, that is, the
HomeMDB value on the directory object will be updated. The system attendant service must be restarted to reconfigure MSExchangeFBPublish to use the new mailbox location, and the mailbox object may not reappear under the Mailboxes node of Exchange
System Manager until it is used in the future.
If there is a System Attendant directory object but no mailbox object, the mailbox store object will be re-created automatically in the mailbox store referenced by the
HomeMDB attribute as soon as it is needed. Note that one cause of this is using a blank store for troubleshooting.
September 6th, 2010 4:18pm
On Mon, 6 Sep 2010 08:02:02 +0000, Dr. RPC wrote:
>On Sun, 5 Sep 2010 21:21:46 +0000, Joe Budden wrote: >Out of interest, why the need to run isinteg -fix (presumably) after the offline defrag? It's not a necessity, but it sure is recommended. The ESEUTIL program rearranges the database pages within the
file but has no idea of the contents of those pages. The ISINTEG ensures that all the tables within the database are intact and, depending on the options you select, that things like folder sizes and item counts are updated and correct. >And regarding the
'special' mailboxes (system attendant, smtp etc) - what happens if these are located on a store we wanted to delete the white space for and were planning a mailbox move to a new store on the same server? Should we move these as well? With the exception of
the system attendant mailbox, the others are specific to the database. The system attendant mailbox should be recreated in another database when you remove the one you're emptying. If that doesn't happen automatically,
>restart the SA service. --- Rich Matheisen MCSE+I, Exchange MVP
>--- Rich Matheisen MCSE+I, Exchange MVP
>
>I agree there are no zero risk operations.
>
>My statement is my own view stemming from numerous numerous offline defrags i ran as a part of maintenance on databases of various shapes and sizes. Never encountered any issue. Going by your logic there is risk in each and every maintenance operation
but that does not mean we should not be performing them.
There's no need to run eseutil as part of any normal, day-to-day,
maintenence activity.
http://msexchangeteam.com/archive/2004/07/08/177574.aspx
Do you take all your servers offline every day and run "chkdsk /f" on
them? If not, why not? Do you take your servers offline every day and
defrag the MFT?
>Infact running offline defrag once in a while is highly recommended. and it is MUST after you have run an eseutil /p on the database.
"Highly recommended" by whom? Certainly by the OEMs that tout their
"perfromance improving" software. But who else?
>and it is MUST after you have run an eseutil /p on the database.
Before you run ISINTEG after ESEUTIL /P you should run ESEUTIL /D.
There's no telling what the repair operation did to the database.
>Sometimes people face issue after defrag is because they do not run isinteg just after defrag.
No argument there.
>The system attendant mailbox defined for the server is automatically stored in the first mailbox database created during setup.
Yes, it is.
>If you delete the default mailbox database and/or storage group , the homeMDB attribute with the system attendant mailbox are no longer valid. and just wont be created by restarting the system attendant service.
Visit this link:
http://technet.microsoft.com/en-us/library/aa996235(EXCHG.65).aspx
See the 2nd bullet in the section "System Attendant Mailbox FAQ".
> You have to re home (MANUALLY)the system attendant mailbox to point to the newly created database.
I think you've been reading some misinformation. While you can't
*move* the SA mailbox without making modifications to the AD (at least
you used to have to do that -- I haven't tried using the UI to move it
in, well, a long time) it certainly isn't necessary to move the
mailbox if you're just removing the database.
---
Rich Matheisen
MCSE+I, Exchange MVP
--- Rich Matheisen MCSE+I, Exchange MVP
Free Windows Admin Tool Kit Click here and download it now
September 6th, 2010 5:34pm
====================================
There's no need to run eseutil as part of any normal, day-to-day,maintenence activity.
====================================
Let go back to the scope of this thread, which is Exchange databases getting large.
Reclaiming the white spaces by running offline defrag, because the database size has gotten big.
This scenarion is not a day to day activity or daily maintenance opeartion.
This is somehting one will do once and is not required to do like every week or month.
=====================================
Do you take all your servers offline every day and run "chkdsk /f" on
them? If not, why not? Do you take your servers offline every day and
defrag the MFT?
=====================================
No comments!
======================================
"Highly recommended" by whom? Certainly by the OEMs that tout their
"perfromance improving" software. But who else?
======================================
Obviously recommended by Microsoft
See the 2nd bullet in the section "System Attendant Mailbox FAQ".
=====================================
I agree. This is how it should be as per 2nd bullet in section.
But if one asks people who have worked on system attendant mailbox issues this is not always the case and especially if the default mailbox store has been deleted.
If you delete the default mailbox store you may have to rehome the Homemdb attribte to point to the DN of the new/other mailbox store.
======================================
I think you've been reading some misinformation. While you can't
*move* the SA mailbox without making modifications to the AD (at least
you used to have to do that -- I haven't tried using the UI to move it
in, well, a long time) it certainly isn't necessary to move the
mailbox if you're just removing the database.
=======================================
There is no misinformation. I have always maintained that need of rehoming arisies if the default mailbox store is deleted. System attendant mailbox points to the Distinguished Name of Mailbox store and is not
related to the database files (.edb etc) itself.
"When the default mailbox database and/or storage group are removed and recreated, the homeMDB associated with the system mailbox and system attendant mailbox are no longer valid. When a storage group and database
are recreated, the system mailbox should be created and the system attendant mailbox rehomed to this store.
The issue here is when these operations fail. When any of these operations fail, the following operations may also fail.
Thanks
http://blogs.technet.com/b/timmcmic/archive/2009/04/12/exchange-2007-renaming-the-default-storage-group-mailbox-database-or-deleting-and-recreating.aspx says
------Exchange, OCS------
September 6th, 2010 7:52pm
On Mon, 6 Sep 2010 16:52:51 +0000, Dr. RPC wrote:
[ snip ]
>Let go back to the scope of this thread, which is Exchange databases getting large.
Okay, let's.
>Reclaiming the white spaces by running offline defrag, because the database size has gotten big.
>
>This scenarion is not a day to day activity or daily maintenance opeartion.
Nor is it a necessary one.
>This is somehting one will do once and is not required to do like every week or month.
It also requires that the entire database be taken offline. Moving the
mailboxes to a new database (if you have space to defrag you have
space for the new database) and then removing the empty database is
not only safer, it only inconveniences a few people at at time, and
only for as long as it takes to move the mailbox.
>=====================================
>
>Do you take all your servers offline every day and run "chkdsk /f" on
>them? If not, why not? Do you take your servers offline every day and
>defrag the MFT?
>
>=====================================
>
>No comments!
I think you meant to say "Of course not."
>======================================
>
>"Highly recommended" by whom? Certainly by the OEMs that tout their
>
>"perfromance improving" software. But who else?
>
>======================================
>
>Obviously recommended by Microsoft
Where?
> See the 2nd bullet in the section "System Attendant Mailbox FAQ".
>
>=====================================
>
> I agree. This is how it should be as per 2nd bullet in section.
>
> But if one asks people who have worked on system attendant mailbox issues this is not always the case and especially if the default mailbox store has been deleted.
> If you delete the default mailbox store you may have to rehome the Homemdb attribte to point to the DN of the new/other mailbox store.
"May have to" and "have to" aren't the same, are they?
>?======================================
>
>I think you've been reading some misinformation. While you can't
>*move* the SA mailbox without making modifications to the AD (at least
>you used to have to do that -- I haven't tried using the UI to move it
>in, well, a long time) it certainly isn't necessary to move the
>mailbox if you're just removing the database.
>
>=======================================
>
> There is no misinformation. I have always maintained that need of rehoming arisies if the default mailbox store is deleted. System attendant mailbox points to the Distinguished Name of Mailbox store and is not related to the database files (.edb etc)
itself.
> "When the default mailbox database and/or storage group are removed and recreated, the homeMDB associated with the system mailbox and system attendant mailbox are no longer valid. When a storage group and database are recreated, the system mailbox should
be created and the system attendant mailbox rehomed to this store. The issue here is when these operations fail. When any of these operations fail, the following operations may also fail.
>
>Thanks
>
>http://blogs.technet.com/b/timmcmic/archive/2009/04/12/exchange-2007-renaming-the-default-storage-group-mailbox-database-or-deleting-and-recreating.aspx says
Following the instructions would create a new, empty database. It
doesn't seem to address the case where the empty database will be
removed.
---
Rich Matheisen
MCSE+I, Exchange MVP
--- Rich Matheisen MCSE+I, Exchange MVP
Free Windows Admin Tool Kit Click here and download it now
September 6th, 2010 8:56pm
==============================================
It also requires that the entire database be taken offline. Moving the
mailboxes to a new database (if you have space to defrag you have
space for the new database) and then removing the empty database is
not only safer, it only inconveniences a few people at at time, and
only for as long as it takes to move the mailbox.
==============================================
-My previous posts are nevr to estabilish the superamacy of offline defrag over move mailboxes. They are about clearing misconceptions surrounding offline defrag.
==============================================
>Obviously recommended by Microsoft
Where?
==============================================
-Recommended by MS.
http://support.microsoft.com/default.aspx/kb/328804
says
Defragmentation helps increase data access and retrieval speed. When you defragment your hard disks, you can increase disk performance and help the servers in your organization
run more smoothly and efficiently.
====================================================
"May have to" and "have to" aren't the same, are they?
====================================================
Yes, they aren't same and if you go through the complete sentence you will find that people who have woked on system attendant mailbox issues know what I mean. Because we have
seen similar issues after the default mailbox store has been deleted.
===============================================
>http://blogs.technet.com/b/timmcmic/archive/2009/04/12/exchange-2007-renaming-the-default-storage-group-mailbox-database-or-deleting-and-recreating.aspx says
Following the instructions would create a new, empty database. It
doesn't seem to address the case where the empty database will be
removed.
===============================================
I refernced this article to show the risks associated with deleted/renaming the mailbox store and also the need of manually rehoming the homemdb attribute.
Thanks
------Exchange, OCS------
September 6th, 2010 9:42pm
-Recommended by MS.
http://support.microsoft.com/default.aspx/kb/328804
says
Defragmentation helps increase data access and retrieval speed. When you defragment your hard disks, you can increase disk performance and help the servers in your organization
run more smoothly and efficiently.
That is referring to file-level disk defragmentation. Not Exchange offline defrags
Free Windows Admin Tool Kit Click here and download it now
September 6th, 2010 10:12pm
-Recommended by MS.
http://support.microsoft.com/default.aspx/kb/328804
says
Defragmentation helps increase data access and retrieval speed. When you defragment your hard disks, you can increase disk performance and help the servers in your organization
run more smoothly and efficiently.
That is referring to file-level disk defragmentation. Not Exchange offline defrags
Yeah, Same logic applies for Exchange databases as well.------Exchange, OCS------
September 6th, 2010 10:36pm
Clicked the wrong button and proposed as answer. Oh well. That article is not Microsoft recommending Exchange offline defragmentation. In fact, as we pointed out eariler, they say just the opposite.
Free Windows Admin Tool Kit Click here and download it now
September 6th, 2010 10:41pm
On Mon, 6 Sep 2010 18:42:03 +0000, Dr. RPC wrote:
>============================================== It also requires that the entire database be taken offline. Moving the mailboxes to a new database (if you have space to defrag you have space for the new database) and then removing the empty database is
not only safer, it only inconveniences a few people at at time, and only for as long as it takes to move the mailbox. ==============================================
>
>-My previous posts are nevr to estabilish the superamacy of offline defrag over move mailboxes. They are about clearing misconceptions surrounding offline defrag.
>
>
>
>
>
>============================================== >Obviously recommended by Microsoft Where?
>
>==============================================
>
>-Recommended by MS.
>
>http://support.microsoft.com/default.aspx/kb/328804 says
>
>Defragmentation helps increase data access and retrieval speed. When you defragment your hard disks, you can increase disk performance and help the servers in your organization run more smoothly and efficiently.
Ummm . . . that part of the paragraph is referring to *disk*
defragmentation.
Assuming you have each database on it's own disk/volume/lun the amount
of file (disk) fragmentation is minimal and hardly ever becomes an
issue.
>==================================================== "May have to" and "have to" aren't the same, are they?
>
>====================================================
>
>Yes, they aren't same and if you go through the complete sentence you will find that people who have woked on system attendant mailbox issues know what I mean. Because we have seen similar issues after the default mailbox store has been deleted.
Okay. Here's the complete sentence:
"If you delete the default mailbox store you may have to rehome the
Homemdb attribte to point to the DN of the new/other mailbox store."
Those are your words, not mine.
Nobody's saying there aren't sometimes problems. But to say there are
always problems is incorrect. So I'm agreeing with what you said, that
". . . you MAY have to . . ."
>=============================================== >http://blogs.technet.com/b/timmcmic/archive/2009/04/12/exchange-2007-renaming-the-default-storage-group-mailbox-database-or-deleting-and-recreating.aspx says Following the instructions would create a new,
empty database. It doesn't seem to address the case where the empty database will be removed.
>
>===============================================
>
>I refernced this article to show the risks associated with deleted/renaming the mailbox store and also the need of manually rehoming the homemdb attribute.
That blog's not going to be much help to the original poster who's
running Exchange 2003. If he has a problem it's ADSIEDIT time.
---
Rich Matheisen
MCSE+I, Exchange MVP
--- Rich Matheisen MCSE+I, Exchange MVP
September 6th, 2010 11:46pm
On Mon, 6 Sep 2010 19:36:23 +0000, Dr. RPC wrote:
[ snip ]
>That is referring to file-level disk defragmentation. Not Exchange offline defrags
>
> Yeah, Same logic applies for Exchange databases as well.
How many hundreds (thousands) of extents must there be before you'd
you'd defrag the database, remove all secondary indexes and
whitespace, and then immediately begin expanding the defragged file
and rebuilding all the indexes?
How many hours of downtime to defrag the database vs. what small
percentage of improved perfromance (if there really is any)?
---
Rich Matheisen
MCSE+I, Exchange MVP
--- Rich Matheisen MCSE+I, Exchange MVP
Free Windows Admin Tool Kit Click here and download it now
September 6th, 2010 11:52pm
Good question.
In exchange 2003 the rate of defrag is approx 5 Gb/ hour. In exchnage 2007 it is approx 10GB
To know more about the indexes and structure of your exchange database file you can run eseutil /ms on the database.
Multiply the output by 4 and the resultant number would be the amount (in KB) that you will reclaim after the defrag is over.
Defragmenting the database not only helps in reclaiming white spaces but it also makes makes used storage contiguous and there by increase in performance.
Thanks
------Exchange, OCS------
September 7th, 2010 12:43am
Do you work for GoExchange?
Free Windows Admin Tool Kit Click here and download it now
September 7th, 2010 1:48am
Do you work for GoExchange?
No Sir, I donot work for GoExchange.------Exchange, OCS------
September 7th, 2010 3:30am