Significance Tests on Trend Plots
Trends that are significantly increasing or decreasing are color-coded (these colors can be modified using Statistical Assumptions).
Where a Date is used as the Date/Filter question of a trend chart, significance is computed by splitting the time periods into two halves, where ties go with the left half (see Comparing Two Independent Groups). For example, if the Aggregation of the question is Months, and there are five months, January, February, March, April and May, significance is computed by comparing the pooled data from January and February with the data from April and May (March is excluded).
Where a Pick One question is used as the Date/Filter question the trend is shown with a column chart and significance is shown via the color-coding of the columns.
For reasons of computational speed, a shortcut is used in computing significance tests for trend charts involving averages. Each bar is compared as a complex sample two sample t-test. The shortcut is that the second group’s standard error is computed as a function of the existing standard errors. First, all the standard errors are combined sequentially, whereby the first two groups’ standard errors are combined, then this combined standard error is combined with the third group, and so on, using the following formula to combine pairs of standard errors:
[math]\displaystyle{ e_{a+b}^2=\frac{[n_a (n_a-1) e_a^2 +n_b (n_b-1) e_b^2+(n_a n_b)/(n_a+n_b ) (m_a-m_b )^2 ]}{ (n_a+n_b )(n_a+n_b-1)} }[/math]
where [math]\displaystyle{ n_a }[/math] is the effective sample size of the first group, [math]\displaystyle{ e_a^2 }[/math] is the squared standard error of the first group, [math]\displaystyle{ m_a }[/math] is the relevant statistic (proportion, mean or coefficient, depending upon the data) of the first group and the second group’s terms are denoted with the subscript b (see: Baker, R. W. R. and J. A. Nissim (1963), "Expressions for Combining Standard Errors of Two Groups and for Sequential Standard Error," Nature, 198 (8 June 1963).