Volume 5 Supplement 9

## Genetic Analysis Workshop 17: Unraveling Human Exome Data

# Does pathway analysis make it easier for common variants to tag rare ones?

- Hae-Won Uh
^{1, 2}Email author, - Roula Tsonaka
^{1}and - Jeanine J Houwing-Duistermaat
^{1}

**5(Suppl 9)**:S90

**DOI: **10.1186/1753-6561-5-S9-S90

© Uh et al; licensee BioMed Central Ltd. 2011

**Published: **29 November 2011

## Abstract

Analyzing sequencing data is difficult because of the low frequency of rare variants, which may result in low power to detect associations. We consider pathway analysis to detect multiple common and rare variants jointly and to investigate whether analysis at the pathway level provides an alternative strategy for identifying susceptibility genes. Available pathway analysis methods for data from genome-wide association studies might not be efficient because these methods are designed to detect common variants. Here, we investigate the performance of several existing pathway analysis methods for sequencing data. In particular, we consider the global test, which does not consider linkage disequilibrium between the variants in a gene. We improve the performance of the global test by assigning larger weights to rare variants, as proposed in the weighted-sum approach. Our conclusion is that straightforward application of pathway analysis is not satisfactory; hence, when common and rare variants are jointly analyzed, larger weights should be assigned to rare variants.

## Background

Genome-wide association studies (GWAS) have found hundreds of single-nucleotide polymorphisms (SNPs) that are significantly associated with several complex traits. In most cases, however, these SNPs explain only a small proportion of the known genetic variance. A possible explanation is that causal variants have a lower minor allele frequency (MAF) than common SNPs. Moreover, rare variants are weakly correlated with common SNPs, because MAFs must be similar for two variants to be highly correlated [1]. It follows that common variants may have only a limited capacity to tag rare variants. This limitation in GWAS, in which common variants with a frequency of 5% or higher were used, leads to a direct search for associations with multiple rare variants. Recently, efforts have been made to genotype rare variants, such as in the 1000 Genomes Project (http://www.1000genomes.org). The low frequency of rare variants, however, may result in low power to detect associations. Given currently available sample sizes, there is a need for powerful methods to detect association with multiple rare variants. We investigate whether pooling variants by pathway into a composite test provides an alternative strategy for identifying susceptibility genes.

Pathway analysis methods have been developed in the context of gene expression data analysis. There are two general approaches: competitive and self-contained. The distinction lies in the definition of the null hypothesis and in the calculation of the *P*-value [2, 3]. Concerning the definition of the null hypothesis, a competitive test compares differential expression of the gene set to a standard defined by the complement of that gene set. In contrast, a self-contained test compares the gene set to a fixed standard that does not depend on the measurements of genes outside the gene set. Concerning the calculation of the *P*-value, the competitive test bases the calculation of the *P*-value for the gene set on a distribution in which the gene is the sampling unit, whereas the self-contained test takes the subject as the sampling unit.

Recently, these methods have been extended to data from GWAS to detect pathway association. Compared to expression data, several distinctive features in the data from GWAS require different methodological considerations. In contrast to gene expression data, in which each gene contains one expression value, in data from GWAS each gene contains many SNPs that are in linkage disequilibrium (LD). Here lies the distinction between one- and two-stage approaches; the first approach ignores these biological features, and hence the second approach might be more powerful [4]. Incorporation of LD information, however, might be less essential if we focus on rare variants using sequencing data because of weak correlation of rare variants with common SNPs.

In this paper, using the data provided by Genetic Analysis Workshop 17 (GAW17) [5] and several pathway analysis methods, we test the vascular endothelial growth factor (VEGF) pathway that influences quantitative trait Q1. Because we have a target gene set (we knew the “answers” to the GAW17 simulation), the natural choice is the self-contained methods that consider only the genes or SNPs involved in the specific gene set. The first method to be applied is the global test (GT) [6]; this test was designed for gene expression data and uses all SNPs without consideration of gene-level effects (one-stage approach). Next we consider two two-stage approaches that were designed for detecting common variants: the gene set ridge regression in association studies (GRASS) algorithm [4] and a new test called the empirical Bayes (EB) method [7]. At the gene-level, the GRASS algorithm uses LD information within a gene using principal components analysis, and at the pathway level the GRASS algorithm uses ridge regression. The EB method uses a mixed-effects model with a general random effects structure at the pathway level and uses the empirical Bayes estimates of the random effects of the first stage as covariates in the model for the phenotype. Because the GRASS algorithm can deal with only binary outcome, the GAW17 affected-unaffected phenotype serves as the outcome variable for these analyses.

The methods we use were designed to detect multiple common variants with small effects. To better deal with the low frequency of rare variants, we propose to weight counts of each rare variant (MAF < 1%) on the basis of the estimated variance under the null hypothesis of no association. We propose the weighted global test (WGT), in which the weights are defined as in the weighted-sum method [8] for rare variants and take a value of 1 for common variants in the GT.

Once significant pathways are identified, we might want to pinpoint the associated genes for further analysis. We consider three methods at the gene level: the combined multivariate and collapsing (CMC) method [9], the weighted-sum approach [8] that analyzes only rare variants, and the WGT. For details of the first two methods, we refer to Dering et al. [10].

All programming has been conducted in R (http://www.r-project.org). The R package globaltest can be obtained at http://www.bioconductor.org, and the source code for GRASS (SNPath) can be downloaded at http://linchen.fhcrc.org/grass.html.

## Methods

### Study sample

We consider data from 697 unrelated individuals. We analyze the 125 SNPs (28 common and 97 rare SNPs) in 9 genes from the VEGF pathway, which influences quantitative risk factor Q1. The MAFs range from 0.07% to 16.5%. The dichotomous phenotype Affected serves as the outcome variable (488 control subjects and 209 case subjects). We apply the pathway analysis methods to the 200 simulated GAW17 data sets to study the power.

### Pathway analysis methods

We begin by establishing some notation. For *N* individuals at *J* loci, we let *x*_{
i
} = (*x*_{
i
}_{1}, …, *x*_{
iJ
})′ be a column vector in which *x*_{
ij
} is the genotype at locus *j* in individual *i*. We code each genotype as 0, 1, or 2, corresponding to the number of minor alleles present at that locus. We also let *Y*_{
i
} denote the disease status of individual *i*, which is coded 0 for control subjects and 1 for case subjects. We then let *X* = (*X*_{1}, …, *X*_{
N
})′ be an *N* × *J* matrix of genotype data and let *Y* = (*Y*_{1}, …, *Y*_{
N
})′ be the *N* × 1 vector of disease status. In addition, for two-stage approaches, we denote *g* = 1, …, *G* for *G* genes in a pathway.

*Y*on gene expression measurements

*X*of a set of

*J*SNPs on

*N*samples:

*h*denotes the link function. Under an assumption that all regression coefficients are sampled from a common distribution with mean 0 and variance

*τ*

^{2}, instead of testing

*H*

_{0}:

*β*= (

*β*

_{1}, …,

*β*

_{ J }) = 0, one can test a new null hypothesis:

*H*

_{0}:

*τ*

^{2}= 0. Using the notation:

where *R* = (1/*m*)*XX*′, *μ* = *h*^{−1}(*α*), and *μ*_{2} is the second central moment of *Y* under the null hypothesis . It can be shown that *Q* is asymptotically normally distributed. However, the *p*-value is calculated based on permutations of samples (case and control labels).

*w*= (

*w*

_{1}, …,

*w*

_{ J })′ are added to the model as follows:

*n*

_{ j }be the total number of subjects genotyped for variant

*j*, be the number of mutant alleles observed in the control subjects, and be the total number of individuals genotyped for variant

*j*. The weight:

*q*

_{ j }computed from control subjects only:

We assign the weight 1 to common SNPs.

*k*≤

*J*eigen-SNPs. At the pathway level, the group ridge regression is applied, and the statistic can be written:

The significance of the statistic is determined by permutation of case and control labels.

*X*

_{ igj }be the genotype at locus

*j*in gene

*g*for individual

*i*. Let

*b*

_{ i }be the random effect for subject

*i*, and let

*b*

_{ ig }be the random effect of gene

*g*of individual

*i*. Under Hardy-Weinberg equilibrium,

*X*

_{ igj }given

*b*

_{ i }and

*b*

_{ ig }is assumed to follow a binomial distribution with the number of trials being 2 and a probability

*π*

_{ igj }. The probability is modeled as follows:

Intuitively, the EB estimate can be interpreted as follows: The more minor alleles an individual has over all the SNPs in a gene, the higher the EB estimate will be for this gene.

### Calculation of type I error rate and power

Because none of the methods have been applied to pathway analysis with multiple common and rare variants, we investigate the type I error rate and power of each method. To determine the type I error rate, we simulate phenotype under the null hypothesis of no association; we generate 1,000 samples from the normal distribution and dichotomize the phenotypes by taking the top 30% as case subjects and the rest as control subjects. The type I error rates of the methods are then calculated as the proportion of significant replicates at the nominal level of 5% out of 1,000 replicates. For the type I error rate, 95% of the empirical estimates of 1,000 replicates are expected to fall between 0.036 and 0.064. The empirical power is determined by calculating the number of times the *P*-values are smaller than the preset threshold of 0.05 divided by 200, the number of simulated phenotypes.

## Results

*P*-values were obtained by analyzing functional and nonfunctional SNPs (28 common SNPs and 97 rare SNPs in 9 genes). As shown in Table 1, type I error rates for all methods were at the 5% level. The powers of the GT (41%) and GRASS algorithm (43%) were comparable, but the EB method had little power (5%) to establish association. The WGT, in which rare variants received more weight, as described in the Methods section, had an increased power of 65%.

Type I error rate and empirical power of tests for 125 SNPs in the VEGF pathway

Method | Type I error rate | Empirical power |
---|---|---|

Global test | 0.044 | 0.41 |

GRASS | 0.047 | 0.43 |

Empirical Bayes | 0.055 | 0.05 |

Weighted global test | 0.041 | 0.65 |

*VEGFC*, containing only one rare SNP, was not analyzed. Except for

*FLT1*, the power of all three methods was low, and the CMC method outperformed the other methods. For

*FLT1*, for which more rare variants were included, the two methods that assign more weight to rare variants performed better.

Empirical power of tests for genes in the VEGF pathway

Gene | Number of SNPs | Empirical power | ||||
---|---|---|---|---|---|---|

Total | Common | Rare | CMC | Weighted-sum | Weighted global test | |

| 18 (5) | 3 (1) | 15 (4) | 0.31 | 0.28 | 0.12 |

| 10 (2) | 3 (0) | 7 (2) | 0.27 | 0.10 | 0.14 |

| 35 (11) | 10 (3) | 25 (8) | 0.80 | 0.83 | 0.84 |

| 10 (2) | 2 (0) | 8 (2) | 0.03 | 0.02 | 0.02 |

| 8 (4) | 1 (1) | 7 (3) | 0.03 | 0.02 | 0.03 |

| 21 (3) | 6 (0) | 15 (3) | 0.13 | 0.04 | 0.15 |

| 16 (10) | 2 (2) | 14 (8) | 0.16 | 0.09 | 0.08 |

| 6 (1) | 1 (0) | 5 (1) | 0.07 | 0.05 | 0.08 |

| 1 (1) | 0 (0) | 1 (1) |

*r*

^{2}measure. Figure 1 shows weak correlations (

*r*

^{2}≈ 0) between the 125 SNPs. Then, we examined the EB estimates, which reflect the summarized information per gene, for all individuals (Figure 2). Overall, there was little evidence that common variants tagged rare ones. Otherwise, the EB estimates of the subjects with rare variants (green circles) would have had higher EB values to contribute to overall statistics. For

*FLT1*and

*KDR*the contribution of subjects with rare variants was comparable to the contribution of subjects with common variants.

## Discussion and conclusions

We investigated the performance of several pathway analysis methods to detect multiple rare variants that are associated with disease. The empirical power for all methods was low. The powers of the GT and GRASS algorithm were comparable, even though the GT did not use gene-level information (such as LD in a gene and the size of genes). As depicted in Figure 1, rare and common SNPs were weakly correlated with each other. Adding LD information, therefore, would not improve efficiency. The GRASS algorithm uses principal components analysis at the gene level, and the robustness of the principal components analysis for summarizing rare variants should be investigated. By giving more weight to rare variants, the power of the WGT increased from 41% to 65%. Improvement by using a variable threshold for rare variants or other methods might be possible. The power of the EB method was poor, which implied that the EB method cannot deal with rare variants well. This was also confirmed by investigating the EB estimates of individuals with rare variants (Figure 2). A larger number of common and rare variants within a gene might improve the EB approach. Improvements might also be possible by better summarizing the information on rare variants at the gene level by collapsing rare variants and including family data.

We also studied the type I error rate by using (200) dichotomized Q4 phenotypes, because Q4 phenotypes are assumed not to be associated with any SNP in the VEGF pathway that influences Q1. This resulted in extremely inflated type I error rates. To investigate possible correlation between dichotomized phenotypes Q4 and the Affected status, we constructed a simple 2 × 2 table. The concordance rates for 200 data sets were 68.2–75.9% with an average of 72.5%; that is, 72.5% of subjects had the same case-control status in both phenotypes. Simulating phenotype under the null hypothesis of no association seems a better practice for estimating type I error rate.

Concerning the conjecture of whether pathway analysis would be helpful for detecting multiple common and rare variants jointly, both Figures 1 and 2 show little evidence of common variants tagging rare ones. In Figure 1 we used the *r*^{2} measure. If both of two loci have rare alleles, it is possible for *D*′ to be 1 and *r*^{2} to be small. Hence, *D*′ is hard to interpret with rare alleles, and we chose to use *r*^{2}, which is a better measure for this situation. New methods might be needed to accommodate the specific features of the sequencing data.

When pinpointing specific genes, except *FLT1*, the empirical power of all three methods was low. For *FLT1* there were eight rare and three common causal variants; the effect sizes of the common variants ranged from 0.61 to 0.74. In contrast, the power to detect *KDR*, which has eight rare and two common variants and roughly the same genetic profile as *FLT1*, was very low. A possible explanation could be that the amount of information contained in the two genes is different. Here, the EB estimates at the gene level could be a useful tool; in Figure 2 the median value of *FLT1* was higher than that of *KDR*. In addition, when common and rare variants are analyzed together, the common variants might play a significant role. The effect sizes of the common variants in *FLT1* (0.61–0.74) were larger that those in *KDR* (0.14 and 0.30).

We investigated the use of pathway analysis methods by jointly considering common and rare variants for sequencing data. We report promising performance of the WGT, which gives larger weights to rare variants compared to other methods intended for detecting common variants. Our conclusion is that straightforward application of pathway analysis is not satisfactory; hence, when common and rare variants are jointly analyzed using sequencing data, larger weights should be assigned to rare variants.

## Declarations

### Acknowledgments

HWU and JJHD were supported by the Program Grant NOW 917.66.344 from the Netherlands Organization for Scientific Research. The Genetic Analysis Workshop is supported by National Institutes of Health grant R01 GM031575.

This article has been published as part of *BMC Proceedings* Volume 5 Supplement 9, 2011: Genetic Analysis Workshop 17. The full contents of the supplement are available online at http://www.biomedcentral.com/1753-6561/5?issue=S9.

## Authors’ Affiliations

## References

- Asimit J, Zeggini E: Rare variant association analysis methods for complex traits. Annu Rev Genet. 2010, 44: 293-308. 10.1146/annurev-genet-102209-163421.View ArticlePubMedGoogle Scholar
- Tian L, Greenberg SA, Kong SW, Altschuler J, Kohane IS, Park PJ: Discovering statistically significant pathways in expression profiling studies. Proc Natl Acad Sci USA. 2005, 102: 13,544-13,549. 10.1073/pnas.0506577102.View ArticleGoogle Scholar
- Goeman JJ, Bühlmann P: Analyzing gene expression data in terms of gene sets: methodological issues. Bioinformatics. 2007, 23: 980-987. 10.1093/bioinformatics/btm051.View ArticlePubMedGoogle Scholar
- Chen LS, Hutter CM, Potter JD, Liu Y, Prentice RL, Peters U, Hsu L: Insights into colon cancer etiology using a regularized approach to gene set analysis of GWAS data. Am J Hum Genet. 2010, 86: 860-871. 10.1016/j.ajhg.2010.04.014.PubMed CentralView ArticlePubMedGoogle Scholar
- Almasy LA, Dyer TD, Peralta JM, Kent JW, Charlesworth JC, Curran JE, Blangero J: Genetic Analysis Workshop 17 mini-exome simulation. BMC Proc. 2011, 5 (suppl 9): S2-10.1186/1753-6561-5-S9-S2.PubMed CentralView ArticlePubMedGoogle Scholar
- Goeman JJ, van de Geer SA, van Houwelingen HC: Testing against a high-dimensional alternative. J R Stat Soc Ser B Stat Methodol. 2006, 68: 477-493. 10.1111/j.1467-9868.2006.00551.x.View ArticleGoogle Scholar
- Houwing-Duistermaat JJ, Uh HW, Tsonaka R: Pathway analysis for family data using nested random-effects models. BMC Proc. 2011, 5 (suppl 9): S22-10.1186/1753-6561-5-S9-S22.PubMed CentralView ArticlePubMedGoogle Scholar
- Madsen BE, Browning SR: A groupwise association test for rare mutations using a weighted sum statistic. PLoS Genet. 2009, 5: e1000384-10.1371/journal.pgen.1000384.PubMed CentralView ArticlePubMedGoogle Scholar
- Li B, Leal SM: Methods for detecting associations with rare variants for common diseases: application to analysis of sequence data. Am J Hum Genet. 2008, 83: 311-321. 10.1016/j.ajhg.2008.06.024.PubMed CentralView ArticlePubMedGoogle Scholar
- Dering C, Pugh E, Ziegler A: Statistical analysis of rare sequence variants: an overview of collapsing methods. Genet Epidemiol. 2011, X (suppl X): X-X.Google Scholar
- Le Cessie S, van Houwelingen HC: Testing the fit of a regression model via score tests in random effects models. Biometrics. 1995, 51: 600-614. 10.2307/2532948.View ArticlePubMedGoogle Scholar
- Houwing-Duistermaat JJ, Derkx BH, Rosendaal FR, van Houwelingen HC: Testing familial aggregation. Biometrics. 1995, 51: 1292-1301. 10.2307/2533260.View ArticlePubMedGoogle Scholar
- Barrett JC, Fry B, Maller J, Daly MJ: Haploview: analysis and visualization of LD and haplotype maps. Bioinformatics. 2005, 21: 263-265. 10.1093/bioinformatics/bth457.View ArticlePubMedGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.