A low sample size can pose challenges to the validity and reliability of the research findings and it is therefore important that you are aware when your sample size (number of respondents) is too low. When the results in the analysis are based on small sub-samples, Harmoni's low sample size feature identifies data that has a low or too low sample size.
In this article
1. Applying Low Sample Size
Harmoni's low sample size feature hides or fades values in the table or chart when the unweighted value of the denominator (base) used for calculations is equal or lower than a specified level. The unweighted value relates to respondents, not responses.
Clicking LOW on the modify menu allows you to easily identify when the base goes below certain thresholds. Use the drop-down arrow below the icon to view and adjust the Low Sample and Too Low Sample values.
| Low Sample Option | Default Threshold | Description |
|
Low sample
|
200 or under | Transparency is applied to the results to match the warning threshold. |
|
Too low sample
|
50 or under | An asterisk (*) is shown instead of the result. |
To change the values, click the drop down menu and type in the required thresholds. During your session, your setting preferences are retained. Low sample values are included in the information panel at the base of the screen.
Site settings can be controlled using personalization keys.Keys that can be applied at the user, site (all users), or company (all users) level. Contact support@infotools.com for more information.
In the example below, you can see the changes to a table when there is a low sample.
- Click the LOW sample icon in the modify menu
- Change the default Low and Too Low sample values if required
Charts also indicate when there is a low sample. Here, you can see the plotted items are removed when the sample is too low and the percentage number is faded with a low sample.
2. Low Sample Size Calculation Rules
For most calculation types, the unweighted base (uB), is used for low sample size calculation. Harmoni considers the share number of people in the cell and the total/base in the relevant column.
For AVG and ∑ , Harmoni considers the summation of all values and therefore uses the u123.
Low sample size considers respondents, not responses.
| Calculation Type | Determine LOW using |
Compare both self cell and reference cell |
| AVG | u123 | |
| 123 | uB | |
| IND | uB | Yes |
| IND Σ | uB | Yes |
| u123 | uB | |
| Σ u123 | uB | |
| uB | NA - Always show | |
| uB Σ | uB | |
| Σ | u123 | |
| % | uB | |
| % Σ | uB | |
| uΣ | u123 | |
| B | NA - Always show | |
| B Σ | uB | |
| AVG Diff | u123 | Yes |
| 123 Diff | uB | Yes |
| IND Diff | uB | Yes |
| IND Σ Diff | uB | Yes |
| u123 Diff | uB | Yes |
| Σ u123 Diff | uB | Yes |
| uB Diff | NA - Always show | |
| uB Σ Diff | uB | Yes |
| Σ Diff | u123 | Yes |
| % Diff | uB | Yes |
| % Σ Diff | uB | Yes |
| uΣ Diff | u123 | Yes |
| B Diff | uB | Yes |
| B Σ Diff | uB | Yes |
Where to from here?
Learn more about Harmoni