In Harmoni, you can apply statistical testing to analysis tables and charts by clicking the SIG option in the modify menu. Two display options are available: Green/Red Arrows or Green/Red Labels.

Statistical tests are used in hypothesis testing and can determine whether a predictor variable has a statistically significant relationship with an outcome variable. Tests can also estimate the difference between two or more groups.

Significance testing is available for record/respondent level data and is not available in aggregate data.

Creator
Explorer
Viewer

1. Statistical Significance Testing (SIG)

When using the SIG option, Harmoni calculates and displays the statistically significant differences between the results for one group and a reference group with an overlap correction factor.

For an analysis without a time axis, the default reference is the total column.
With a time axis included, the default reference is the previous period.
You can adjust the reference as you need.

🔗 To learn more about the reference (REF) in Harmoni, review the Reference for SIG Testing (REF) article.

The SIG option is available in the modify menu when no items are selected in the analysis. If you select a row, column or any other part of a table, you won't see the SIG button.

When you click the SIG button, SIG testing displays for a crosstab analysis or with a single axis or measure with a time axis as a filter. You won't see significance marked in a table with the single axis or measure on its own.

SIG can be set as a default and may automatically turn on. If not, manually click the SIG option.
When SIG testing is turned on, it does not display until your analysis is a crosstab or has a time axis as a filter.
When you intentionally switch SIG on, it remains on for your session, or until you reset the analysis. Clearing the analysis does not remove SIG.

🔗 Learn about the significant tests used in Harmoni, in the Statistical Significance Tests article.

SIG testing on as a default

The personalization key Keys that can be applied at the user, site (all users), or company (all users) level. Contact support@infotools.com for more information. for significance difference testing can be set to ON (True) as a default.

2. Significant Differences Display Options

Harmoni has two options for displaying significant differences. The default setting displays green and red arrows when you turn on SIG. Harmoni also provides the option to display colored labels instead of arrows. The option to change the display is available in the SIG drop-down menu.

Colored Arrows: Significant results are shown with a green or red arrows next to the value.
Colored Labels: Significant results are displayed by coloring data value labels red or green.

Create an analysis
Click the SIG button to turn on significance testing
Use the drop-down menu to change from colored arrows to colored labels

Display Options: Green and Red Arrows

Green and red arrows are the default display in Harmoni. When you click the SIG button the significant results are shown with green and red arrows next to the value.

Green - significantly higher compared to the reference
Red - significantly lower compared to the reference
The confidence level is displayed on the info bar

When you see a green arrow pointing up in a cell, it means that the number in the cell is significantly higher than the reference number it is being compared to, while a red arrow pointing down means the number is significantly lower than the reference.

Often, but not always, lower in the cell can mean worse, for example, brand usage, hence the red color approach.

SIG Arrows in an Analysis Table

SIG Arrows in a Chart

Display Options: Green and Red Colored Labels

With colored labels selected, data values that are significantly different are shown in green or red text. This can help to keep the analysis uncluttered.

Green Label - significantly higher compared to the reference
Red label - significantly lower compared to the reference
The confidence level is displayed on the info bar

The colored labels represent the same information as the colored arrows with a green value being significantly higher than the reference number it is being compared to, and a red value being significantly lower than the reference number.

To change to colored labels, select the drop-down arrow next to the SIG button in the modify menu and select Colored Labels.

SIG Labels in an Analysis Table

SIG Labels in a Chart

If you prefer to display Colored Labels by default, contact support@infotools.com.

Where to from here?

Learn more about statistical tests in Harmoni

Statistical Significance in Harmoni (SIG)

In this article