What is optimization? 

When an index is in use, files are removed from the document stores and new ones are added, making it necessary to write to the index files constantly. When files are removed, the existing index entries that refer to those files are marked as unused, and these unused entries can easily add up over time, causing the index to grow.

In a system where files are only added to a large index over time, you will typically see very little fragmentation, whereas in indexes where files come and go, fragmentation is more frequent.

The index is held in memory, and when a user searches, Index Manager searches through the entire index to find matches. With many empty index entries, the server can gradually become slower at processing searches.

To this end, the system administrator can set a global optimization schedule in the Service options in Index Manager settings. At this point, the index server will be temporarily shut down, unused entries will be removed from the index ("defragmentation"), and the service will be started back up. This can be scheduled for a time when there's minimal system activity.

Setting an optimization schedule

1. In Index Manager Settings, open Indexes tab.
2. Select Automatic optimization.
   

Unused entries threshold: Specify the number of index entries that must be marked as unused before the optimization runs. Remember that an index may be fragmented even if there are few unused entries. (See point 1 above.) Therefore, if you want the index to optimize daily, you should set the threshold to zero and the time to the value described below.

Time to run optimize: Set the time to run the optimization here. Choose which days to optimize and when to optimize. Because indexes become unavailable during optimization, optimizing outside office hours is generally a good idea.

Rescan before optimize: Enabling this option is always a good idea, as it forces Index Manager to scan through all the attached document folders and locate any files that may not have been added to the index. This way, you can be sure that all files in the document stores are readily available for searches.

Manual optimization

1. You can also manually trigger an index optimization by going to the Status page and selecting the index you want to optimize.
2. Select Optimize.