Interpreting Time Comparison Results
After running a Time Comparison analysis, the results will be returned in the fact page underneath the "Top drivers" tab. These facts will help identify what's meaningfully impacting metric performance.
Each line of the table represents a “Subgroup”, or a subset of rows in the data, that had a statistically significant impact on the metric.
- The name of the subgroup describes which column and value pair make up the subgroup. For example, “operating_system = iOS” refers to the subgroup where the value in the column “operating_system” was equal to “iOS”.
- "Subgroup sizes" describes how big that subset of the data is as a percentage of the total, within each group. For example, if a dataset has 100 and the subgroup size is 40% vs 60%, it means that for the previous period, 40 rows out of the 100 match that criteria, while for most recent period, 60 rows out of the 100 match that criteria.
- "Subgroup averages" describes what’s the average for that specific subgroup, or subset of rows in the data, within each group (Previous period vs Recent period). That column reflects the calculation type that was selected, so it could be a Subgroup sum, rate, or count. The grey label shows the percentage change between the two groups.
- The "Impact"column describes how the overall average (or sum, rate, count) of the recent period changes when the subgroup is present. For example, if the overall “Average order value” for the recent period (e.g. Last 2 weeks) is 100, a subgroup may have an impact of 20, meaning that having that subgroup in the data is increasing the average by 20. Another subgroup may have an impact of -10, meaning that this subgroup drives down the average order value by 10.
- Note: Subgroups might overlap, which means that if all of the impact numbers from the different subgroups are added up, it will not get the overall “Average order value”.
There are multiple actions that can be taken for each fact in the table. These can be accessed by hovering over the “...” next to each fact. These include:
- "Hide fact" hides the fact for everyone. All hidden facts can be shows by clicking on the table settings and toggle “Show hidden facts”.
- "Add comment" enables the addition of commentary visible to other users
- "Drill down" enables the creation of new analysis on the specific subgroup that comprises the fact. For more information on this area, please refer to the drill down documentation.
- "Save to fact board" enables users to save interesting facts to a fact board that is accessible on the bottom left side. Users will often use this feature to create a story for their stakeholders across multiple metrics that is easily digestible. Other users can then view the fact board and leave additional comments.
In addition, clicking on a given fact opens up a window that can be used to dive deeper into a fact and check its relevance and importance.
Note: Also see Exploring a fact