Hyperstage provides a tool to validate the Hyperstage specific metadata structures. The Hyperstage Consistency Manager (ICM) is an external standalone application that can be run against a Hyperstage instance to verify, and in future releases, repair most Hyperstage data structures including the Knowledge Grid and Data Packs.

If you are seeing unexpected behavior with Hyperstage, such as server crashes, it can help to run the Hyperstage Consistency Manager for information for support, and future repair ability.

Note: Currently the Hyperstage database must be offline in order to run the Hyperstage Consistency Manager.

The current release of the Hyperstage Consistency Manager runs the following tests:

• Delete Mask Consistency Check. This test checks to ensure that the delete mask headers contain the proper sum for the delete mask body. If the Hyperstage Consistency Manager finds any inconsistency between the header and body, it returns the list of blocks of delete mask where inconsistencies were found.
• Number of Objects In Columns Equality. This test compares the stored number of objects in each column file related to the table. If it finds any inconsistency in the number of objects, it returns the first two columns with different object numbers.
• Comparison of Maximal Value In Lookup Dictionary versus DPN. This test executes only for lookup columns. It compares the maximal key value stored in the lookup column dictionary and in DPNs. If the values differ, the Hyperstage Consistency Manager writes them to the log.
• Comparison of Number of Objects In First-Column DPN versus Delete Mask. This test compares the metadata stored in the headers of the delete mask and DPN file related to number of objects. If any inconsistencies are found, the Hyperstage Consistency Manager returns both numbers. The Hyperstage Consistency Manager compares only the first column, because there exists an independent test of comparison of this value between columns. If the test does not find either the proper delete mask file or proper DPN file, then it reports corruption.
• Knowledge Grid Consistency (Phase 1). This test checks if the histograms report the proper value of fixed parameter. This test will be significantly expanded in upcoming releases.
• Test for overlapping datapacks in data files. This test checks if there are data packs in files that overlap each other. If the test discovers such a situation, it returns a list of pairs of datapack numbers that are overlapping.

icm --help

icm --datadir=/absolute/path/to/data/directory [parameters]