Volume 3 Supplement 1
Data modeling as a main source of discrepancies in single and multiple marker association methods
© Ledur et al; licensee BioMed Central Ltd. 2009
Published: 23 February 2009
Genome-wide association studies have successfully identified several loci underlying complex diseases in humans. The development of high density SNP maps in domestic animal species should allow the detection of QTLs for economically important traits through association studies with much higher accuracy than traditional linkage analysis. Here we report the association analysis of the dataset simulated for the XII QTL-MAS meeting (Uppsala). We used two strategies, single marker association and haplotype-based association (Blossoc) that were applied to i) the raw data, and ii) the data corrected for infinitesimal, sex and generation effects.
Both methods performed similarly in detecting the most strongly associated SNPs, about ten loci in total. The most significant ones were located in chromosomes 1, 4 and 5. Overall, the largest differences were found between corrected and raw data, rather than between single and multiple marker analysis. The use of raw data increased greatly the number of significant loci, but possibly also the rate of false positives. Bootstrap model aggregation removed most of discrepancies between adjusted and raw data when SMA was employed.
Model choice should be carefully considered in genome-wide association studies.
Genome-wide association studies (GWAS) have successfully identified loci underlying several complex diseases [1, 2] and quantitative traits, like height in humans . The development of high density SNP maps in domestic animal species should allow the detection of QTLs for economic important traits through association studies with much higher accuracy than traditional linkage analysis. The simplest method to analyze GWAS is single marker association (SMA). Multiple marker analyses are also used to reduce the numbers of false positives and to increase power . Nevertheless, the advantage of haplotype-based methods upon SMA has not yet been proven. To address this issue, we compare SMA with an haplotype-based method – Blossoc  – recently developed to take advantage of high density SNP maps genotyped in large sample sizes, still being fast and accurate in detecting causal loci. Simulation studies have demonstrated that this method outperforms SMA in a more complex situation such as mutation heterogeneity and complex haplotype structures . We applied these two strategies to the raw data and to the data corrected for infinitesimal (polygenic), sex and generation effects to evaluate to what extent population structure (i.e., pedigree relationships) and environmental effects could affect the results.
A total of 4665 animals with genotypes and phenotypes, the first 4 generations of the data set provided by the QTL-MAS Workshop , were included in the analyses.
Raw versus corrected data
Initially, association analyses were performed using the raw data (Y = μ + SNP + e) fitted for each SNP. Next, the data were analyzed with a mixed model including the infinitesimal (a), sex (S) and generation (G) effects. Residuals from this mixed model were then used as input data in the haplotype-based analysis. For the corrected SMA, we used the same mixed model except that the SNP effect was estimated simultaneously: Y = μ + S + G + a + SNP + e. Mixed model analyses were carried out with QxPak, which employs a maximum likelihood approach .
Single Marker Association (SMA)
An additive model was initially tested at each SNP. We first established a list of SNPs showing an association with p < 10-8 (F-test), with the restriction that minimum distance between selected SNPs was 5 cM. When two significant SNPs were found within a 5 cM region, the most significant one was retained. However, not all of these putative QTLs are necessarily genuine QTLs. Recently, bootstrap model aggregation (bagging; ) was proposed to control for false positives in genome-wide analysis using complex crosses [9, 10]. Hence, from the list of selected SNPs, we bootstrapped the data and we built multiple additive QTL models by forward selection. A SNP was included in the model if its p-value, conditional on all other SNPs already in the model, was lower than 10-3, otherwise, the model building was stopped. We ran 1000 iterates. The frequencies of each SNP in the models correspond to their support of being a true QTL, and are called bootstrap posterior probabilities (BPP; ). To speed-up the analysis, we considered a threshold of BPP ≥ 0.25 for assigning a true association. It is important to note that this threshold depends on the population and the phenotype and requires specific calibration by simulations. Therefore, 0.25 is here arbitrary and is likely to not properly control false positives. These results are presented in Additional file 1. SMA and bagging were run using a home made R script.
For the corrected-data SMA, an additive model was used with the same p-value threshold and minimum distance to select associated SNPs as with SMA on raw data. Significance tests in QxPak are based on likelihood ratio test. Intensive computational procedures to further control for false positives were not feasible with this mixed model approach, nor with the haplotype-based analyses.
Multiple Marker Association (Blossoc)
Blossoc, a linkage disequilibrium (LD) association mapping tool, was used for the haplotype-based analyses. This method attempts to build 'perfect' phylogenetic trees for each marker and scores these according to non-random clustering of affected individuals, judging high-scoring areas as likely candidates for containing disease affecting variation . Although initially designed for case-control studies, this method can also be applied to quantitative traits. Blossoc was designed to handle very dense sets of markers with high LD, so blocks of compatibility include several markers. We used a window of a minimum of 10 markers for building the phylogeny around markers. Blossoc generates scores for each marker, but gives a smooth curve, because neighboring markers are included to score a locus, so scores for close markers are more dependent than SMA. However, we expect that high clustering scores from Blossoc are highly correlated to small P-values from SMA, as demonstrated by Mailund et al. . The Hannan and Quinn criteria (HQ), which is similar to the Bayesian Information Criterion (BIC), was used to indicate significant association . Threshold was established based on corrected data and set at scores ≥15, which was reached by 7.3% of the SNPs. Selected peaks were also the local maximum in 10 cM regions along the genome.
Comparison among approaches
The agreement between methods and between data corrections was based on the percentage of coincident associated SNPs. A coincident associated SNP pair or match was defined as a pair of associated SNPs in two analyses whose distance was shorter than 5 cM. The percentage of SNP matches was calculated as the ratio between the number of matches and the sum of the matches and the number of SNPs uniquely detected by either of the two analyses to be compared. The degree of concordance of matching SNPs was the absolute difference in cM of the estimated location of coincident SNPs between analyses.
Analyses were performed on a Linux server with dual Xeon processors and 8 Gb RAM. The total CPU time required for the analyses is shown in the Additional file 2.
Results and discussion
SNPs identified as associated with the phenotypic trait by different methods and approaches.
SMA Additive effect (SE)3
SMA corrected (QxPak)
Total # SNPs
Raw versus corrected data
Incorporating known population structure into the phenotype modeling reduced the noisiness of the association profile (Figure 1). Peaks were sharper with corrected than with raw data for both SMA and Blossoc methods. Nevertheless, raw and corrected profiles were quite correlated (r = 0.70 for SMA and r = 0.66 for Blossoc).
Three to five-fold more SNPs were selected using raw data than with corrected data (Table 1). Nonetheless, all SNPs selected with corrected data were recovered in the analyses with raw data within each method. Disagreement, therefore, is mostly due to these additional SNPs. Selection seems therefore more liberal on raw data. Additional procedures to control for false positives are clearly required. The bootstrap model aggregating (bagging) is expected to control such false positives. When applied to SMA on raw data, the bagging reduced considerably the list of putative QTLs from 33 to 15 (with a BPP ≥ 0.25). All but two of these had BPPs higher than 0.6. Those two were not recovered in the corrected data, nor were four SNPs with medium to high BPPs, but the other SNPs were also selected using the mixed model approach (Additional file 1). For Blossoc, an adjusted threshold for raw data (>65) reduced the associated SNPs from 49 to 19.
Comparison between methods
Only ~50% of the SNPs detected using raw data coincide between SMA and Blossoc methods. This percentage increased to 67% when using corrected data. The disagreement between the corrected methods was due to 4 SNPs: SNP 331 was detected with SMA (QxPak). This SNP showed high LD with SNP 402 (D' ≈ 1, r2 = 0.3), which was highly associated with the phenotype. The equivalent SNP in the SMA raw (323) showed low BPP (0.1). Therefore, SNP 331 is probably a false positive. SNP 3952 was detected with Blossoc and also with SMA raw (BPP = 0.99), suggesting that it is a true QTL. The SNP identified in the beginning of Chromosome 3 (2133) by the SMA method (BPP = 0.89) was also detected with Blossoc on raw data, but was not selected with Blossoc on corrected data. This SNP showed a well defined peak with corrected Blossoc, close to the significance threshold (HQ = 13). Therefore, SNP 2133 is probably also a true QTL. These results indicate that the thresholds defined here for both SMA and Blossoc on corrected data might be too conservative. Another SNP towards the middle end of this chromosome (2601) was detected only with Blossoc. This was the most distinct result found between methods (Figure 1) and could reflect a difference between single and haplotype-based methods, although the possibility of it being a false positive can not be discarded.
The agreement in matching SNPs was lower when using raw data (maximum distance of 4.1 cM), and increased greatly when corrected data was used (maximum distance of 0.4 cM). Nevertheless, the establishment of a threshold is a complicated issue and has a profound influence on the results, especially when methods with different nature of scores are compared. Our results indicate that 8 SNPs are confidently associated to the trait, as found by all methods evaluated here with a small variation in cM among coincident SNPs.
Interactions within and between loci and with sex
Top significant epistatic interactions with P < 10-6 and distance between SNPs <10 cM.
1.6 × 10-2
5.8 × 10-5
1.6 × 10-4
2 × 10-2
1.3 × 10-3
1.1 × 10-2
7.2 × 10-4
Comparison with the true QTLs
Proportion of true positives and power to detect true QTLs in each analysis.
Blossoc (15) 3
Both SMA and haplotype-based methods performed similarly in detecting the most strongly associated SNPs. The use of raw data increased the number of positive results in comparison to corrected phenotypes. The concordance among matching SNPs increased when using adjusted data compared to raw data. The largest discrepancies found in this study were between different phenotype modeling rather than between single and multiple marker approaches. Thus, model choice should be carefully considered in this kind of studies. Bagging seems a promising approach to control for inflation and false positives when the population structure is hidden.
List of abbreviations used
quantitative trait loci
single marker association
genome-wide association studies
Hannan and Quinn criteria.
Thanks to Thomas Mailund for help with Blossoc software. MCL was supported by a grant from BID/Agrofuturo (Brazil). NN was supported by a Beatriu de Pinós post doc grant from the Generalitat de Catalunya (Spain). Work funded by MEC grants AGL2004-0103/GAN and AGL2007-65563-C02-01/GAN (Spain).
This article has been published as part of BMC Proceedings Volume 3 Supplement 1, 2009: Proceedings of the 12th European workshop on QTL mapping and marker assisted selection. The full contents of the supplement are available online at http://www.biomedcentral.com/1753-6561/3?issue=S1.
- Yeager M, Orr N, Hayes RB, et al: Genome-wide association study of prostate cancer identifies a second risk locus at 8q24. Nat Genet. 2007, 39: 645-649. 10.1038/ng2022.View ArticlePubMedGoogle Scholar
- The Wellcome Trust Case Control Consortium: Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls. Nature. 2007, 447: 661-678. 10.1038/nature05911.PubMed CentralView ArticleGoogle Scholar
- Visscher PM: Sizing up human height variation. Nat Genet. 2008, 40: 489-490. 10.1038/ng0508-489.View ArticlePubMedGoogle Scholar
- Li J, Zhou Y, Elston RC: Haplotype-based quantitative trait mapping using a clustering algorithm. BMC Bioinformatics. 2006, 7: 258-10.1186/1471-2105-7-258.PubMed CentralView ArticlePubMedGoogle Scholar
- Mailund T, Besenbacher S, Schierup MH: Whole genome association mapping by incompatibilities and local perfect phylogenie. BMC Bioinformatics. 2006, 7: 454-10.1186/1471-2105-7-454. doi:10.1186/1471-2105-7-454.PubMed CentralView ArticlePubMedGoogle Scholar
- Sandø Lund M, Sahana G, de Koning D-J, Su G, Carlborg Ö: Comparison of analyses of the QTLMAS XII common dataset. I: Genomic selection. BMC Proceedings. 2009, 3 (Suppl 1): S1-10.1186/1753-6561-3-s1-s1.View ArticleGoogle Scholar
- Pérez-Enciso M, Misztal I: Qxpak: A versatile mixed model application for genetical genomics and QTL analyses. Bioinformatics. 2004, 20: 2792-2798. 10.1093/bioinformatics/bth331.View ArticlePubMedGoogle Scholar
- Breiman L: Bagging predictors. Machine Learning. 1996, 24: 123-140.Google Scholar
- Valdar W, Solberg LC, Gauguier D, Burnett S, Klenerman P, Cookson WO, Taylor MS, Rawlins JNP, Mott R, Flint J: Genome-wide genetic association of complex traits in heterogeneous stock mice. Nat Genet. 2006, 38: 879-887. 10.1038/ng1840.View ArticlePubMedGoogle Scholar
- Navarro N, Klingenberg CP: Mapping multiple QTLs of geometric shape of the mouse mandible. Systems Biology and Statistical Bioinformatics. Edited by: Barber S, Baxter PD, Mardia KV. 2007, Leeds University Press, 125-128.Google Scholar
- Kao C-H, Zeng Z-B: Modelling epistasis of quantitative trait loci using cockerham's model. Genetics. 2002, 160: 1243-1261.PubMed CentralPubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.