Scaling Magnify Index Libraries

How to:

As the size of an index library increases, the search speed decreases and can eventually cause the indexing or search process to stop working. The dynamic partitioning feature enables the scalability of local index files by splitting index folders into partitions and thereby increasing the performance of the indexing and search processes significantly. For example, once a feed process starts for a data source called retail, new index folders named retail1, retail2,retail3 and so on are created dynamically.

To enable dynamic partitioning, you must complete the following steps:


Top of page

x
Reference: Specifying a Data Source Value for Dynamic Partitioning

The data source value can be set depending on which indexing method you are using:

Note: The Dynamic Partitioning feature requires a database. For more information about configuring the database connection settings, see How to Set Search Engine Parameters in the WebFOCUS Console. After configuring the database parameters, you must execute the \ibi\WebFOCUSxx\utilities\WFReposUtil\MagnifyCreateDDL scripts. The default parameter must be edited before executing the scripts. See procedure below to edit the default parameter.


Top of page

x
Procedure: How to Edit the Default Parameter for Dynamic Partitioning Index
  1. In the WebFOCUS Administration Console, click Configuration, select Application Settings, and then click Magnify.
  2. Navigate to the IBI_Magnify_Repos_DB_URL parameter.
  3. Delete DatabaseName=MagnifyDB and save the application settings.
  4. Execute the MagnifyCMDLine.dll and MagnifyCreateDDL.dll script files, for dynamic partition indexing.

Top of page

x
Procedure: How to Specify Dynamic Partitioning in the Collections File
  1. Edit the \ibi\WebFOCUSxx\config\magnify\collections.xml file.
  2. Append .* to each index library to be partitioned. For example,
     <collections>
     		<group name="all" id="all">
     		<component id="retail" member="retail.*" />
     <collections>
  3. Save the changes to the collections.xml file and restart the application server.

Top of page

x
Procedure: How to Enable Dynamic Partitioning in the Magnify Console
  1. From the Magnify Console, click General Settings.
  2. In the Dynamic Partition Clean Up drop-down box, select On.
  3. In the Clean Up Cycle Interval (minutes) input box, specify the frequency in which Magnify deletes duplicate data among the partitioned index libraries.

    Note: The default time for the Cleanup Cycle Interval is 15 minutes.

  4. In the Default_Partition_Size_In_Gigabytes input box, specify the size for each partitioned index library.
  5. Click Submit Query to save the settings.

WebFOCUS