Volume 5 Supplement 9

## Genetic Analysis Workshop 17: Unraveling Human Exome Data

# Regularized regression method for genome-wide association studies

- Jin Liu
^{1}Email author, - Kai Wang
^{2}, - Shuangge Ma
^{3}and - Jian Huang
^{1, 2}

**5(Suppl 9)**:S67

https://doi.org/10.1186/1753-6561-5-S9-S67

© Liu et al; licensee BioMed Central Ltd. 2011

**Published: **29 November 2011

## Abstract

We use a novel penalized approach for genome-wide association study that accounts for the linkage disequilibrium between adjacent markers. This method uses a penalty on the difference of the genetic effect at adjacent single-nucleotide polymorphisms and combines it with the minimax concave penalty, which has been shown to be superior to the least absolute shrinkage and selection operator (LASSO) in terms of estimator bias and selection consistency. Our method is implemented using a coordinate descent algorithm. The value of the tuning parameters is determined by extended Bayesian information criteria. The leave-one-out method is used to compute *p*-values of selected single-nucleotide polymorphisms. Its applicability to a simulated data from Genetic Analysis Workshop 17 replication one is illustrated. Our method selects three SNPs (C13S522, C13S523, and C13S524), whereas the LASSO method selects two SNPs (C13S522 and C13S523).

## Background

Genome-wide association studies (GWAS) are a modern approach to genetic studies. Although GWAS successfully dissect genetic factors that underlie complex traits, they raise many challenging statistical issues. A prominent issue is how to identify single-nucleotide polymorphisms (SNPs) that are in linkage disequilibrium (LD) with a genetic variant of weak effect. To identify such SNPs, investigators use the modern approach of regularized regression, for instance, the least absolute shrinkage and selection operator (LASSO) [1]. However, existing regularized regression methods do not take into account LD information among adjacent SNPs. The fused LASSO [2] may be suitable for this purpose. However, the ambiguity in the choice of the reference allele for scoring genotypes makes it not applicable. Presumably, incorporating LD information into the analysis would be highly beneficial in delineating association signals by achieving smoothness and reducing randomness in single-SNP analysis. To make use of LD information, we have developed an L2 penalty that encourages a smaller difference in genetic effect at adjacent SNPs that are in stronger LD. This penalty is used in combination with the minimax concave penalty (MCP) [3], which is efficient in shrinking many nuisance predictors to exactly zero. In what follows, we describe the new method and then present its application to the Genetic Analysis Workshop 17 (GAW17) simulated data set of unrelated individuals.

## Methods

*p*be the number of SNPs and

*n*

_{ j }the number of subjects whose genotypes are nonmissing at the

*j*th SNP. The centered phenotype of the

*i*th subject with nonmissing genotype at SNP

*j*is denoted

*y*

_{ ij }. The genotype at a SNP is scored as 0, 1, or 2 depending on the number of copies of the reference allele in the subject. Let

*x*

_{ ij }denote the standardized genotype scores satisfying Σ

_{ i }

*x*

_{ ij }= 0. Then:

*ρ*

_{1}and

*ρ*

_{2}. The first part is the MCP [3]

*ρ*

_{1}(·;

*λ*,

*γ*), defined by:

*γ*= ∞) and a hard threshold (

*γ*= 1) as special cases.

*λ*

_{1}is a tuning parameter. The second part of the penalty is the quadratic absolute difference in genetic effect between two successive SNPs:

We choose *ς*_{
j
} in expression (2) to be the absolute value of the Pearson correlation between the genotype scores of SNP *j* and SNP (*j* + 1). The second penalty was motivated by the fact that the adjacent SNPs are usually highly correlated.

The loss function in expression (2) is a sum of the marginal loss function at each SNP. We use a marginal loss function instead of a joint loss function because it is easier to deal with missing genotypes that way. Huang et al. [5] discussed the asymptotic properties of a marginal loss function with a bridge penalty under certain regularity conditions.

*λ*

_{1}and

*λ*

_{2}, we reparameterize them through:

The value of tuning parameter *γ* in the MCP is chosen to be 3 [6]. *η* is fixed at 0.1, and *τ* is determined by using the extended Bayesian information criterion (EBIC) [7]. We use the leave-one-out (LOO) method [8] to evaluate the significance of the selected SNPs.

## Results

The GAW17 data set consists of 24,487 SNP markers throughout the genome for 697 individuals. We analyze the unrelated individuals data with quantitative trait Q1 in replicate 1. All SNPs are included in the analysis. We coded the seven population groups as dummy variables. We first regress the quantitative trait Q1 on sex, age, smoking status, and group dummy variables in order to remove their confounding effects. This procedure helps to adjust for population stratification. Then, we use the residuals from this regression as the response and fit them using the SMCP model and the LASSO model. The selected tuning parameter *τ* is 1.655 for the SMCP model with *η* = 0.1 and 0.184 for the LASSO model.

*FLT1*. For each method, these two SNPs have significant LOO

*p*-values. The SMCP model selected three more SNPs, one (C13S524) from gene

*FLT1*and the other two (C12S707 and C12S711) from gene

*PRR4*. Only one SNP (C13S524) from gene

*FLT1*is significant. The boxplots for these five SNPs selected by the SMCP and LASSO models are shown in Figure 4.

SNPs selected by the SMCP and LASSO models for trait Q1 in replicate 1

SNP | Position | Gene | Univariate estimate | Univariate | SMCP estimate | LOO | LASSO estimate | LOO |
---|---|---|---|---|---|---|---|---|

C12S707 | 11065657 |
| 0.53 | 2.0 × 10 | 0.002 | 7.9 × 10 | ||

C12S711 | 11065733 |
| 0.61 | 7.6 × 10 | 0.007 | 3.0 × 10 | ||

C13S522 | 27899910 |
| 1.22 | 2.1 × 10 | 0.169 | 5.7 × 10 | 0.096 | 1.6 × 10 |

C13S523 | 27899912 |
| 0.94 | 2.6 × 10 | 0.173 | 6.2 × 10 | 0.134 | 1.6 × 10 |

C13S524 | 27899915 |
| 1.88 | 2.2 × 10 | 0.058 | 1.1 × 10 |

Mean and standard error (in parentheses) of true positives and false positives for selected SNPs over 200 replicates for trait Q1

SMCP model | LASSO model | Regular regression | |
---|---|---|---|

True positive | 3.35 (1.52) | 2.48 (1.19) | 7.03 (1.81) |

False positive | 18.42 (36.20) | 8.64 (21.53) | 174.35 (87.87) |

## Discussion

The penalized approach is a modern variable selection method developed to handle large *p*, small *n* problems. Application of this approach to GWAS is highly anticipated. Compared to traditional GWAS, in which SNPs are analyzed one by one, a penalized method is able to handle a collection of SNPs simultaneously. We have used a method that takes into account the LD information among adjacent SNPs in order to reduce the randomness seen in the traditional one-SNP-at-a-time analysis. For trait Q1 in replicate 1, the SMCP model selected three SNPs (C13S522, C13S523, and C13S524) from the associated gene *FLT1* and two SNPs that are false positives. In comparison, the LASSO model selected two SNPs (C13S522 and C13S523), both of which are true positives. We note that the SNPs provided for GAW17 are a small subset of the SNPs that are genotyped. The strength of LD for this set of SNPs has been greatly reduced. In addition, the GAW17 data were simulated to mimic rare variants. The SMCP method is specially designed to map rare variants. Even so, the SMCP model is able to select three SNPs, more than the LASSO model can. In comparison, the results of the regular simple linear regression are much noisier.

## Conclusions

The SMCP model is a novel penalized regression method. By taking into account the LD information between adjacent SNPs, the SMCP model is a useful tool that is better at delineating an association signal while reducing random noise. The algorithm used for the SMCP model is available in R package SMCP.

## Declarations

### Acknowledgments

We thank the two anonymous reviewers for their comments and suggestions. The work of JL and JH is partly supported by National Institutes of Health (NIH) grant R01 CA120988 and National Science Foundation grant DMS 0805670. The work of SM is partly supported by NIH grants R01 CA120988, R03 LM009754, and R03 LM009828.

This article has been published as part of *BMC Proceedings* Volume 5 Supplement 9, 2011: Genetic Analysis Workshop 17. The full contents of the supplement are available online at http://www.biomedcentral.com/1753-6561/5?issue=S9.

## Authors’ Affiliations

## References

- Tibshirani R: Regression shrinkage and selection via the LASSO. J R Stat Soc B. 1996, 58: 267-288.Google Scholar
- Tibshirani R, Saunders M, Zhu J, Knight K: Sparsity and smoothness via the fused LASSO. J R Stat Soc B. 2005, 67: 91-108. 10.1111/j.1467-9868.2005.00490.x.View ArticleGoogle Scholar
- Zhang CH: Nearly unbiased variable selection under minimax concave penalty. Ann Stat. 2010, 38: 894-942. 10.1214/09-AOS729.View ArticleGoogle Scholar
- Liu J, Wang K, Ma S, Huang J: Accounting for linkage disequilibrium in genome-wide association studies: a smoothed minimax concave penalty approach. 2011, Technical Report 410, Department of Statistics and Actuarial Science, University of IowaGoogle Scholar
- Huang J, Horowitz J, Ma S: Asymptotic properties of bridge estimators in sparse high-dimensional regression models. Ann Stat. 2008, 36: 587-613. 10.1214/009053607000000875.View ArticleGoogle Scholar
- Breheny P, Huang J: Coordinate descent algorithms for nonconvex penalized regression methods. Ann Appl Stat. 2011, 5: 232-253. 10.1214/10-AOAS388.PubMed CentralView ArticlePubMedGoogle Scholar
- Chen J, Chen Z: Extended Bayesian information criteria for model selection with large model spaces. Biometrika. 2008, 95: 759-771. 10.1093/biomet/asn034.View ArticleGoogle Scholar
- Wu TT, Chen YF, Hastie T, Sobel E, Lange K: Genome-wide association analysis by LASSO penalized logistic regression. Bioinformatics. 2009, 25: 714-721. 10.1093/bioinformatics/btp041.PubMed CentralView ArticlePubMedGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.