The article explains how to select a fixed reference item (row or column) for significance testing in Harmoni, including time-based axes for rolling period comparisons. It covers setting offsets for previous periods, using time axes in different dimensions or filters, including/excluding hidden items, and handling multiple time axes. The reference remains fixed despite table changes, aiding consistent statistical analysis over time.
In this article
1. Reference for Testing (REF)
When you create an analysis with SIG turned on, Harmoni calculates the significance based on a reference. Harmoni selects the reference based on the type of analysis.
- For an analysis without a time axis, the default reference is the Total column
- With a time axis included, the default reference is the previous period
- You can adjust the reference as you need
You can make changes to the reference item by selecting a specific item (i.e. column or row) as the reference for testing. Once selected, the reference is fixed to that item; if you flip or reorder your analysis, the reference remains fixed.
REF appears in the modify menu in the Selection section when you select a row or column or when you add a time axis to the analysis. Click REF to select the reference for testing or adjust the periodicity.
- The selected row or column becomes the reference for significant difference calculations.
- When a time-based axis is a part of your analysis you have the ability to set significance testing to be based on a rolling period. The axis must be marked as a date variable. See Previous period referencing below.
- The comparison reference is displayed on the info bar.
Analysis without a Time Axis
In an analysis without a time axis, the reference is the total column. You can change the reference by selecting a column or row and click REF from the modify menu.
- The default reference is the total column
- Select a column and click REF
- You can flip the table and the reference remains fixed
- Select the reference column and click REF to deselect the reference
🔗 Significance testing is also available within and across nested groups. Learn more about significance testing in nested analyses.
Previous Period Referencing (Time Axis)
When a time-based axis is a part of your analysis, Harmoni automatically uses it as the reference. Open the i-bar to see the reference displayed. The significance testing is set to be based on a rolling period. This could be the previous period or even the previous 4th period.
The offset determines how far away from the test cell the cell to be compared with is, for example, an offset of 1 is the cell next on the left of the cell being compared.
Using the drop-down menu for the REF icon allows you to access the reference period. Enter the offset number in the text box.
In this example, you can see that there are 25 Quarters (1-25) and the offset is 8.
- 1 = minimum available offset
- 25 = maximum available offset
- 8 = selected offset
Note, if the offset number sits too close to the start of the range, the minimum available offset may not display.
Time Axis in the Across Dimension
In the example below, the time axis, Quarter, is in the across dimension. The default offset is 1, the Previous Quarter. By accessing the REF drop-down menu, this is changed to 4 so that the reference is 4th Previous Quarter. At the bottom of the analysis, open the i-bar to display the reference information.
- Click REF to open the reference options
- The default setting is 1
- With Quarter in the across dimension, the reference is therefore Previous Quarter
- This information is displayed in the i-bar
- Change the offset to 4 and the reference changes to 4th Previous Quarter
Time Axis as a Filter
When a time axis is dragged to the filter, Harmoni defaults to using the time axis as the reference for significant differences. The offset defaults to 1 and can be changed by using the REF drop-down menu as demonstrated in the example above.
In this example, the offset is 1 and each cell displayed for the most recent Year (2025) is compared to the previous Year (2024). When you change the filter to 2023, each cell in the table is compared to 2022. Each selected filter year is always compared to the prior year in every cell.
- Drag the time period to the filter
- The i-bar updates the reference
- Use the filter to view each year
- The reference is the prior year for every cell
Include or Exclude Hidden Items
When a time-based axis is a part of your analysis (generally columns/across), hidden items are included in the reference set. You may choose to exclude by unticking the option "Include Hidden Items" from the REF drop box.
This is a useful option when, for example, there are missing time periods in your survey, but you still want to compare versus the most recent period.
- The COVID year element has no data
- HIDE the COVID element
- From the REF drop-down menu, untick Include Hidden Items
- 2022 is now compared to 2020, skipping the hidden element
Analysis with a Single Time Axis
When you first add a time axis to your analysis, the reference defaults to the Total for significance testing. As soon as you add a second item to create a crosstab, the reference changes to the previous time period.
- Drag a time axis in and the REF is the Total column
- Add an axis in the other drop zone and the REF changes to the previous period (time reference)
Analysis with Multiple Time Axes
When you add more than one axis in different dimensions in an analysis, you are able to choose which axis to use as a reference. By accessing the drop-down menu under the REF icon, you can select the required dimension.
In the following example, the time axis for Quarter is added to the across dimension, while Year is added to the filter. Using the REF drop-down menu, the default reference of Quarter (Across) is changed to Year (Filter).
- Drag a time axis to the across
- Drag a time axis to the filter
- In this example, we can use Suppress to remove empty cells
- Change the REF via the drop-down menu from Quarter to Year
Where to from here?
Learn more about statistical tests in Harmoni