Genome-wide association studies using an adaptive two-stage analysis for a case-control design
© Song et al; licensee BioMed Central Ltd. 2007
Published: 18 December 2007
A new type of test is presented for genome-wide association studies using a case-control design. It is referred to as the adaptive two-stage (ATS) analysis, being based on both the Hardy-Weinberg disequilibrium trend test (HWDTT) and the Cochran-Armitage trend test (CATT). The procedure for the ATS is to screen single-nucleotide polymorphisms (SNPs) using the HWDTT in a first stage, and then test a reduced number of SNPs that pass the screening step in a second stage using the CATT. In the Genetic Analysis Workshop 15 simulated data set, this ATS analysis captured, after Bonferroni correction, the region from 32447.149 kb to 32859.819 kb and the region around 37363.880 kb that are close to the actual trait loci on chromosome 6. We compared the ATS with other ways of combining the p-values of the HWDTT and the CATT, the classical form of Fisher's test and a weighted form of Fisher's test. Results showed that the proposed ATS has good performance and could detect the regions containing a susceptibility locus.
The advance of genotyping technologies and reduction of genotyping costs are resulting in genome-wide association studies using 100,000 to 500,000 (100 k–500 k) single-nucleotide polymorphisms (SNPs) across the whole genome in which tests for association are performed between each SNP and a disease in a case-control design. However, one of the big challenges of genome-wide association studies is the issue of multiple testing .
Zhang et al.  proposed an adaptive two-stage (ATS) analysis using two trend tests, the Hardy-Weinberg disequilibrium trend test (HWDTT) and the Cochran-Armitage trend test (CATT). All samples are used in both stages in the same way that Van Steen et al.  applied a two-stage analysis of family-based association. The adaptive two-stage analysis proposed here uses the HWDTT in the first stage to screen the SNPs and then tests a reduced number of SNPs that pass this screening step using the CATT in the second stage. The conservative Bonferroni-corrected p-value of an allele-based test is obtained for each SNP, but it is only necessary to correct for the number of SNPs included in the second-stage analysis.
As an alternative approach, Fisher's combination of p-values, referred to as Fisher's test, was considered by Zhang et al. . Because the HWDTT and CATT are asymptotically independent under the null hypothesis, Fisher's test statistic  is given by T = -2log(p HWDTT ) - 2log(p CATT ), which under the null has a chi-square distribution with 4 df. Recently, Hwang et al.  extended Fisher's test to a "weighted" version that aims to maximize overall statistical power for a given significance level (0 ≤ α ≤ 1) using a nonparametric distribution with a Gaussian Kernel density.
In this study, we applied the ATS analysis to the Genetic Analysis Workshop (GAW15) simulated data set in order to find susceptibility disease genes. We compared the results of the ATS with those of the CATT, the HWDTT, the classical Fisher test (CFT), and the weighted Fisher test (WFT). The ATS was Bonferroni-corrected for multiple testing, so, for the sake of comparison, the CATT, HWDTT, and Fisher tests (CFT and WFT) are also adjusted using the same correction method.
For the ATS analysis of association, Zhang et al.  applied the HWDTT and the CATT to case-control studies. Song and Elston  and Zhang et al.  showed that these two statistics are asymptotically independent under the null hypothesis of no association. Therefore, they used all samples for both stages of the analysis. For the first stage of the proposed ATS analysis, the HWDTT is applied to test each SNP at the significance level α1 chosen on the basis of the conditional power of the HWDTT. The smallest α1 is chosen such that the power is at least 1 - β, where β is the type II error.
f(a, b) = (1 - 2b - a)2b(1 - b) + 2ab(b + a/2)(1 - 2b - a) + (b + a/2)2a(1 - a),
= f(r' p1 + s' q1, r' p2 + s' q2)/(r's'), r' ≈ r/n and s' ≈ s/n,
= nVar(D1 - D0),
Φ is the distribution function of the standard normal N(0, 1), and
is the 100(1 - α1/2)th percentile of N(0, 1).
The SNPs for which the null hypotheses are rejected in the first stage are tested in the second stage analysis by the CATT at the level α2 = α'/(mα1), where α' is obtained by the parametric bootstrap to control the overall type I error rate of the ATS analysis. Then α2 controls the overall type I error rate to α (taken to be 0.05) for a total of m simultaneous hypothesis tests (SNPs). As in Van Steen et al. , the overall p-value of the ATS is the p-value of the second analysis, which here is the CATT.
We used the GAW15 simulated Problem 3 data set for rheumatoid arthritis (RA), which includes 100 replicates. Each replicate contains 1500 families with an affected sibling pair and 2000 unaffected control subjects. To obtain a sample of cases and controls, we randomly chose one case from each affected sib pair. Thus, from each replicate we selected 1500 cases with RA and 2000 controls. In order to compare the performance of all methods in a small sample size, we randomly sampled 200 cases and 200 controls from each of the 100 replicate samples of 1500 cases and 2000 controls. To examine type I error rate, we concentrated on 100 markers that were at least 20,000 kb distant from the identified peaks on chromosome 6. Therefore, the total number of marker tests to examine type I error was 10,000 (100 markers × 100 replicates). To examine power, we concentrated on all 674 markers on chromosome 6 using only one replicate of 200 cases and 200 controls. Among these 674 markers, 5 markers are causative, in the region between 32447.149 kb and 37363.880 kb on chromosome 6.
Type I error rates
α = 0.05
α = 0.001
Hardy-Weinberg disequilibrium trend test
Cochran-Armitage trend test
Classical Fisher's test
Weighted Fisher's test
The locations of the SNP markers that are significantly associated with RA after Bonferroni correction at the significance level α = 0.05
2.65 × 10-15
4.96 × 10-14
0.53 < 0.77
2.7 × 10-15 < 5.8 × 10-5
<1.0 × 10-17
<1.10 × 10-16
0.65 < 0.83
1.0 × 10-17 < 6.3 × 10-15
<1.0 × 10-17
<1.10 × 10-16
5.36 × 10-15
3.44 × 10-9
0.27 < 0.65
5.4 × 10-15 < 5.7 × 10-5
1.19 × 10-6
0.0003 < 0.02
0.0003 < 0.0011
Applying the ATS with the optimal α2, the three SNPs in the region between 32447.149 kb and 32772.203 kb were associated with RA. In particular, after Bonferroni correction the ATS showed that the SNP at 37363.880 kb was associated with RA. In the region between 32447.149 kb and 32859.819 kb, the CATT and CFT had Bonferroni-corrected average p-values < 1.34 × 10-12 and p < 5.80 × 10-7, respectively. In addition, the corrected p-value of CFT is 0.000802 for a marker at location 37363.880 kb. However, the Bonferroni-corrected p-value of WFT is not significant. This could indicate that WFT with Bonferroni correction may be too conservative, because it already minimizes the number of false positives and false negatives.
We have presented the use of a new method for genome-wide association studies with optimal choice of significance level to maximize the power and at the same time asymptotically control the overall type I error. The ATS analysis uses two independent test statistics-here the HWDTT and the CATT. We compared the performance of the HWDTT, CATT, Fisher's tests combining the HWDTT and CATT, and the ATS in this data set with Bonferroni correction for multiple testing and found that the ATS had good performance. Compared to WFT or CFT, the ATS showed higher power in this study. CFT captured the region that is close to a trait locus and gave higher power than WFT, but had p < 0.05 in regions that were distant from the true locations, so that the falsepositive rate of CFT seems to be higher than that of WFT in these data. This agrees with the original paper  reporting a lower false-positive rate for WFT.
In this study, we applied all test statistics to the GAW15 simulated data. However, the simulated effect near the peak is so strong that all test statistics were able to detect the susceptibility disease gene on chromosome 6 with a sample size as small as 200 cases and 200 controls; the Bonferroni corrected p-values were significant for the CATT, CFT, and ATS. Zhang et al.  showed that the ATS is more powerful than the CATT and CFT when applied to real data in an association study of 96 cases and 50 controls that used 103,611 SNPs for a genome-wide association study of age-related macular degeneration .
Finally, we should note the limitations of the ATS method we used. The ATS analysis will be more costly than other two-stage analysis studies, which uses separate portions of the sample for each stage, because the ATS analysis uses all subjects in both stages. In addition, the ATS analysis is more computationally intensive than the other tests because it is a necessary to obtain the adjusted overall level for α' using the parametric bootstrap.
Using the ATS analysis, a sample size as small as 200 cases and 200 controls showed good performance after Bonferroni correction for association with a susceptibility disease gene in the region between 32447.149 kb and 37363.880 kb on chromosome 6.
This article has been published as part of BMC Proceedings Volume 1 Supplement 1, 2007: Genetic Analysis Workshop 15: Gene Expression Analysis and Approaches to Detecting Multiple Functional Loci. The full contents of the supplement are available online at http://www.biomedcentral.com/1753-6561/1?issue=S1.
- Wang WYS, Barratt BJ, Clayton DG, Todd JA: Genome-wide association studies: theoretical and practical concerns. Nat Rev Genet. 2005, 6: 109-118. 10.1038/nrg1522.View ArticlePubMedGoogle Scholar
- Zheng G, Song K, Elston RC: Adaptive two-stage analysis of genetic association in case-control designs. Hum Hered. 2007, 63: 175-186. 10.1159/000099830.View ArticlePubMedGoogle Scholar
- Van Steen K, McQueen MB, Herbert A, Raby B, Lyon H, DeMeo DL, Murphy A, Su J, Datta S, Rosenow C, Christman M, Silverman EK, Laird NM, Weiss ST, Lange C: Genomic screening and replication using the same data set in family-based association testing. Nat Genet. 2005, 37: 683-691. 10.1038/ng1582.View ArticlePubMedGoogle Scholar
- Elston RC: On Fisher's method of combining p-values. Biometrical J. 1991, 33: 339-345. 10.1002/bimj.4710330314.View ArticleGoogle Scholar
- Hwang D, Rust A, Ramsey S, Smith S, Leslie DM, Weston AD, Atauri PD, Aitchison JD, Hood L, Siegel AF, Bolouri H: A data integration methodology for systems biology. Proc Natl Acad Sci USA. 2005, 102: 17296-17301. 10.1073/pnas.0508647102.View ArticlePubMed CentralPubMedGoogle Scholar
- Song K, Elston RC: A powerful method of combining measures of association and Hardy-Weinberg equilibrium for fine-mapping in case-control studies. Stat Med. 2005, 25: 105-126. 10.1002/sim.2350.View ArticleGoogle Scholar
- Klein RJ, Zeiss C, Chew EY, Tsai JY, Sackler RS, Haynes C, Henning AK, SanGiovanni JP, Mane SM, Mayne ST, Bracken MB, Ferris FL, Ott J, Barnstable C, Hoh J: Complement factor H polymorphism in age-related macular degeneration. Science. 2005, 308: 385-389. 10.1126/science.1109557.View ArticlePubMed CentralPubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.