Joint distribution of rank statistics considering the location and scale parameters and its power study

The ranking method used for testing the equivalence of two distributions has been studied for decades and is widely adopted for its simplicity. However, due to the complexity of calculations, the power of the test is either estimated by a normal approximation or found when an appropriate alternative is given. Here, via the Finite Markov chain imbedding technique, we are able to establish the marginal and joint distributions of the rank statistics considering the shift and scale parameters, respectively and simultaneously, under two different continuous distribution functions. Furthermore, the procedures of distribution equivalence tests and their power functions are discussed. Numerical results of a joint distribution of rank statistics under the standard normal distribution and the powers for a sequence of alternative normal distributions with means from −20 to 20 and standard deviations from 1 to 9 and their reciprocal are presented. In addition, we discuss the powers of the rank statistics under the Lehmann alternatives.

2010 Mathematics Subject Classification

Primary 62G07; Secondary 62G10

Suppose that on the basis of observations X₁,…,X _m ;Y₁,…,Y _n from the cumulative distribution functions F and G, two major topics in the hypothesis testing are to test the equivalence of either the center or the dispersion of the two populations of interest. The hypotheses are stated, for some θ ≠ 0,

which is known as the shift alternative and, for some σ≠1,

Wilcoxon (1945) proposed the ranking method for testing the significance of the difference of the two populations means, also known as the Wilcoxon rank-sum test, and defined a statistic W _Y , as the sum of the ranks of the y^′s in the combined and ordered sequence of x^′s and y^′s, equivalent to

Mann and Whitney (1947) introduced an elaboration of the ranking test, proposed the statistic U_X=\mathit{\text{mn}}-W_Y+\frac{n(n+1)}{2}, and proved that the limiting distribution of the test statistic U _X is

as m and n go to infinity in any arbitrary manner where

and

with

where X,X^′ and Y,Y^′ are independently distributed, X,X^′ with the distribution F, and Y,Y^′ with the distribution G. Intuitively, the power for the right-sided test can be found as

where c is the value such that

Over the years, there have been studies on finding the exact or approximate power for the rank-sum test. By choosing an appropriate alternative distribution function, Shieh et al. (2006) derived the exact power for the uniform, normal, double exponential and exponential shift models. Rosner and Glynn (2009) discussed power against the family of alternatives of the form

where the underlying distributions F _X and F _Y are normal. Collings and Hamilton (1988) presented a bootstrap method to find the empirical distribution functions in order to approximate the power against the shift alternative. Lehmann (1953) derived the power function as

where s _j is the rank of y _j in the combined samples for the alternative hypothesis of

where k is a positive integer. However, Lehmann (1998) pointed out that the power function of the rank-sum test, Equation (2), was only qualitative. Since the numerical values for assessing the probabilities in Equation (1) are considerably complicated in computation when F and G are continuous distributions with F≠G.

As the rank-sum test is widely adopted for testing the center differences of two distributions, it is natural to study the efficiency of a rank-sum test for variability (Ansari and Bradley 1960). For decades, studies have focused on proposing new definitions of the rank statistic and using the methods of Chernoff and Savage to show the relative efficiency of the proposed statistic to the F-test, see for example Mood (1954), Siegel and Tukey (1960), Ansari and Bradley (1960), and Klotz (1962). Ansari and Bradley (1960) mentioned that if the means of the X and Y samples cannot be considered equal, differences in location have a severe impact on all the tests of dispersion. Klotz (1962) showed the power of a rank test can be found by integrating the joint density of X and Y samples over that part of the m+n dimensional space defined by the alternative orderings which lie in the critical region of the test, for which conditions are very strict.

Our approach aims at releasing some of the conditions for finding the distribution of the proposed rank statistic. We systematically imbed the random vector U _n into a Markov chain to induce the marginal and joint distributions of the rank statistics considering the shift and scale parameter, respectively, under any form of two distribution functions. A joint distribution of rank statistics, to the best of our knowledge, has not been studied in the literature. The main strength of using the finite Markov chain imbedding approach (FMCI) is to derive the distribution of the rank statistic without giving any conditions. Therefore, under the null hypothesis of F=G, we are able to identify a proper critical region and, under the alternative assumption, the power of the test can be determined naturally. The distribution of the random vector U _n , independent of the form of the distribution function F, is also demonstrated under the null hypothesis of the distribution equivalence.

The main contributions of this paper are as follows. In Section 2.1, we introduce the procedures of deriving the distribution of the rank statistic considering the shift parameter and its power function by using FMCI. The procedures are general and can be applied to either two identical distribution functions of interest or two different continuous density functions. In Section 2.2, we address the steps for finding the distribution of the rank statistic considering the scale parameter and its power function. In Section 2.3, we retrieve the joint distribution of the rank statistics considering the location and scale parameters simultaneously as well as its power function. Numerical results of a joint distribution and some powers of the rank statistics against shift parameter and scale parameter, individually and simultaneously, are presented in Section 3. We also discuss the powers of the rank statistics under the Lehmann alternatives. We end this paper with a short conclusion in Section 4.

2.1 Distributions of the rank statistic in the shift case

Let {X₁,…,X _m } and {Y₁,…,Y _n } be two independent samples from the continuous cumulative density distributions F(x) and G(x−θ), respectively. Given x={x₁,…,x _m } and x_[i] is the i^th smallest number in the sample, we have

for i=1,2,…,m+1 where x_[0]=−∞ and x_[m+1]=∞. Therefore, we define the sampling distribution of Y in the (m+1) intervals as

Given m, for t=1,2,…,n, let

where u _i (t) is the number of y^′s in the interval [ x_[i−1],x_[i]) among y₁,…,y _t . For each u _n =(u₁(n),⋯,u_m+1(n)), we have a corresponding rank-sum of y’s in the combined sample

Theorem 1

The statistic R _l is equivalent to the statistic W _Y , which is addressed by Wilcoxon in 1945.

Proof

Let

The rank statistic W _Y , sum of the ranks of y’s observations, can be determined by

The first summation of the first term in Equation (5) can be interpreted as the number of y observations larger than x_[i] which is \sum _{j=i+1}^{m+1}{u}_j\left(n\right) in our expression. It is not difficult to see that \sum _{i=1}^{m+1}{u}_i\left(n\right) equals n, the size of y sample. Therefore, the equation can be rewritten as

It is then easy to see that

Next, we demonstrate that for two random samples from the same population, the distribution of the random vector U _n is independent of the form of the distribution function.

Theorem 2

Distribution-free property of U _n .

Proof

We know the joint PDF of the ordered sample of x^′s is given by

and, when F=G, the conditional probability of the random vector U _n given X=(x₁,x₂,…,x _m ) is

where x_[0]=−∞ and x_[m+1]=∞. By taking the expected value of the conditional probability, we have

Using variable transformation, it is clear to see that the random variables F(x_[1]),…,F(x_[m]) have a Dirichlet distribution with parameters u₁(n)+1,u₂(n)+1, …,u_m+1(n)+1. Therefore, we have

which is independent of the distribution function.

This is the reason that the distribution of the rank statistic U _n is distribution-free under the null hypothesis. However, the distribution of the random vector U _n is discrete uniform with the mass function one over the number of possible outcomes of the random vector U _n only when assuming F=G. In other words, the distribution of the random vector U _n can be found by the traditional combinatorial analysis when F=G. Unfortunately, when F≠G, we will not be able to establish the distribution of U _n through Equation (7) as solving the multiple integral in Equation (8) is either tedious given some appropriate alternative distribution function or difficult. Our understanding is that finding the power of the test has not been solved in most cases. To overcome this situation, we bring in the finite Markov chain imbedding approach.

Let Ω _t ,t=0,1,…,n, be the state space which has

possible states, Γ _n ={0,1,…,n} be an index set, and {Z _t :t∈Γ _n } be a non-homogeneous Markov chain on the state space Ω _t . As a transition probability matrix M _t for this chain, t=1,…,n, consider

where

and p _i is defined in Equation (3).

Theorem 3

R _l (U _n |X) is finite Markov chain imbeddable, and

where\mathit{B}\left(C_r\right)=\sum _{k:R_l\left({\mathit{U}}_n\right)=r}{e}_k,e_kis a1\times \left(\genfrac{}{}{0ex}{}{m+n}{n}\right)unit row vector corresponding to state u _n , ξ(=P(Z₀=1)=1) is the initial probability and M _t , t=1,…,n, are the transition probability matrices of the imbedded Markov chain defined on the state space Ω _t .

Proof

For each u _n =(u₁(n),⋯,u_m+1(n)) in the state space Ω _n , we have a corresponding rank R _l as shown in Equation (4). Intuitively, the minimum rank r _{l s} is n(n+1)/2 and the maximum rank r _{l b} is n(2m+n+1)/2. In accordance with the possible values of the rank R _l , we define a finite partition {C _r :r=r _{l s} ,…,r _{l b} } such that

where \mathit{B}\left(C_r\right)=\sum _{k:R_l\left({\mathit{U}}_n\right)=r}{e}_k,e_k is a 1\times \left(\genfrac{}{}{0ex}{}{m+n}{n}\right) unit row vector corresponding to state U _n , we then obtain the conditional probability of the rank R _l .

Then, the Law of Large Numbers is used to determine the probability of U _n for any continuous F and G

where X _i is the i^th sample of size m from the distribution function F. It is easy to see that

To test

for some θ≠0, the power function is approximated by

where

Note that the alternative hypothesis is subject to the purpose of the test. This simply needs to be slightly modified if a one-sided test is adopted.

2.2 Distributions of the rank statistic in the scale case

We studied the distribution and the power function of the rank statistic R _l considering a shift in location. Now, the distribution and the power function of the rank statistic considering the scale parameter will be addressed. For this purpose, we consider F(x)=G(x σ⁻¹) and state the null and alternative hypotheses as

To do so, we begin with the procedure of finding the distribution of the rank statistic, denoted R _s , considering the scale parameter through the random vector U _n . The array of ranks are given by

if m+n is even, and

if m+n is odd. We first introduce how to determine the rank-sum of y^′s observations in the combined samples, R _s , with respect to

where u _i (n) means the number of y observations belonging to [ x_[i−1],x_[i]). Let m e d(x,y) be the median among x^′s and y^′s and belongs to [ x_[i],x_[i+1]) which will then break U _n into two parts {\mathit{U}}_n^{-} and {\mathit{U}}_n^{+}. If m+n is odd and m e d(x,y)=x_[i], then

is a 1×i vector and

is a 1×(m+1−i) vector. The second possible case is, if m+n is odd and \mathit{\text{med}}(x,y)=y_{\left[\sum _{k=1}^i{u}_k\left(n\right)+j\right]}, then {\mathit{U}}_n^{-}, a row vector with length i+1, has the form

and {\mathit{U}}_n^{+}, a row vector with length m+1−i, is given by

The third possible case is, if m+n is even and x_[i] is the smallest number larger than m e d(x,y), the vectors are now defined as

and

The last possibility is, if m+n is even, y_{\left[\sum _{k=1}^i{u}_k\left(n\right)+j\right]} is the smallest number larger than m e d(x,y). The vectors are now defined as

and

Let n⁻ be the length of the vector {\mathit{U}}_n^{-} and n⁺ be the length of the vector {\mathit{U}}_n^{+}.

Theorem 4

R _s (U _n |X) is finite Markov chain imbeddable, and

where\mathit{B}\left(C_r\right)=\sum _{k:R_s\left({\mathbf{U}}_n\right)=r}{e}_k,e_kis a1\times \left(\genfrac{}{}{0ex}{}{m+n}{n}\right)unit row vector corresponding to state U _n , ξ(=P(Z₀=1)=1) is the initial probability and M _t , t=1,…,n are the transition probability matrices of the imbedded Markov chain defined on the state space Ω _t .

Proof

For each U _n in the state space Ω _n , we have a corresponding

The smallest possible value of R _s (U _n ) is

and the largest possible value is

In accordance with Equation (11), we use the possible value of R _s as a rule of the partition. The rest of the proof follows along the same line as that of Theorem 3, and here, is omitted.

Similarly, we apply the LLN to conclude that

which establishes the distribution of R _s .

Through FMCI we, again, successfully retrieved the distribution of R _s under selected alternative distributions, for which the procedures are similar to those in the previous section. In addition, it is quite intuitive to approximate the power function by

where

2.3 Joint distributions of the rank statistics in the shift and scale case

We have derived the marginal distributions of R _l and R _s in terms of U _n , respectively, which yield the following theorem.

Theorem 5

(R _l (U _n |X),R _s (U _n |X)) is finite Markov chain imbeddable, and

whereis a1\times \left(\genfrac{}{}{0ex}{}{m+n}{n}\right)unit row vector corresponding to state u _n , ξ(=P(Z₀=1)=1) is the initial probability and M _t , t=1,…,n are the transition probability matrices of the imbedded Markov chain defined on the state space Ω _t .

Proof

By Equations (4) and (11), we know each u _n in the state space Ω _n has corresponding values of R _l and R _s . The combinations of the values R _l and R _s are used to be the standard of the partition. The rest of the proof follows along the same line as that of Theorem 3.

The joint distribution of the ranks considering both the location and scale parameters which can be determined through our algorithm is yet to be studied in the literature. Our result allows us to test the homogeneity of the distribution functions F(x)=G((x−θ)σ⁻¹). We state the hypotheses as follows

Also we are able to identify a proper critical region under the null hypothesis and discuss its power when F≠G. For example, a rectangular critical region can be

where r_1l, r_2l, r_1s and r_2s are the critical values such that

or an elliptic critical region

for some positive constants a and b such that

According to the above defined rejection region, the power of the test can be found as

or

Note that unless having a conjecture about the values of θ and σ, we tend to use a two-sided test. However, with the knowledge of the center and shape of the distribution of interest, deciding a sectorial critical region is a better choice, for which an example is demonstrated in the numerical studies.

3.1 A joint distribution of R _l and R _s

Let {X₁,…,X₅}∼N(0,1) and {Y₁,…,Y₇}∼N(θ,σ). Figure 1 gives the joint distribution of the random variables R _l and R _s under the null hypothesis of θ=0 and σ=1. The marginal distributions of R _l and R _s can be easily established from their joint distribution. Figure 1 also shows that the two random variables R _l and R _s are dependent. We construct two critical regions as shown in Figure 2, according to their joint distribution. Outside the yellow area in Figure 2 is the selected rectangular critical region C_0.1738 and outside the red shadow is the elliptic one C 0.1738′.

Joint distribution of R _l and R _s in the case where m = 5, n = 7 and F = G ∼ N (0,1).

Full size image

Critical Regions at size 17.38% for R _l and R _s for m = 5 and n = 7.

Full size image

3.2 Powers for a joint test using R _l and R _s

The alternative of interest is stated in the preceding section (see Equation (14)). The power functions of the test statistics R _l and R _s for a sequence of normally distributed populations with θ from -20 to 20 with an increment of 0.5 and σ from 1 to 10 with an increment of 1, and its reciprocal under two types of critical regions are provided in Figures 3 and 4. We adopt a two-sided test because of the selected values of the parameters. It should be slightly modified the critical region in the previous step in order to calculate the powers if a one-sided test is adopted. Both critical regions roughly perform equally well as shown in Figures 3 and 4. Figure 5 presents the performance of the two critical regions for given various parameter settings. Figures 5(a) and (b) show that given a standard deviation of 1 or a mean of 0, the powers of the two critical regions, rectangular and elliptic, are high and similar. However, when the variation of the alternative population reduces (σ=1/10) or increases (σ=10), the elliptic critical region performs better than the rectangular one as shown in Figures 5(c) and (d). Therefore, we suggest that when conducting a test for the equivalence of two distributions, an elliptic rejection area should be used.

Power functions of R _l and R _s for m = 5 and n = 7 under C _α .

Full size image

Power functions of R _l and R _s for m = 5 and n = 7 under C α ′ .

Full size image

Power comparisons of the joint test R _l and R _s for m = 5 and n = 7 with the values of the parameters σ or θ given on top of figure (a), (b), (c), and (d).

Full size image

Next, we consider the problem of determining an optimum rank test. To conduct a test of distributions equivalency, we can use either R _l or R _s as the test statistic. As mentioned earlier, the marginal distribution R _l or R _s can be easily established from their joint distribution. Figures 6 and 7 provide the power functions for the test statistics R _l and R _s at the level of significance 17.38%, respectively. Figure 7 shows that the rank test against scale parameter is badly effected by the centre of the alternative population. This was seen before by Ansari and Bradley (1960). By comparing Figures 6 and 7 with Figure 4, it seems that the joint test would be much more reliable than either R _l or R _s alone for distributions equivalence tests. A joint test for distributions equivalency would like a better option under most circumstances.

Power functions of R _l given m = 5 and n = 7.

Full size image

Power functions of R _s given m = 5 and n = 7.

Full size image

3.3 Lehmann alternatives

Consider the one-sided alternative F(x;θ,σ) > G(x;θ,σ), Lehmann (1953) proposed a test of H _o :F(x;θ,σ) = G(x;θ,σ) against H _a :F(x;θ,σ)^k= G(x;θ,σ) which is known as the family of Lehmann alternative. Note F(x;θ,σ)^k is the cumulative distribution of max1≤i≤k(x _i ) when X _i ∼ F and, under the alternative hypothesis, G(x;θ,σ) is stochastically larger than F(x;θ,σ). First of all, we know

Therefore, the larger the R _l is, the stronger the evidence against the null hypothesis will be. For the variation of the distribution per se, the codomain of the density function is compressed to larger numbers; therefore, in most cases, we have V a r(X _k ) < V a r(X). We then propose to reject the null hypothesis when R _s is large. For example, given F ∼ U(0,1) and G = F^k, it is easy to see

and

for all k. We first find the marginal and joint distributions of the ranks R _l and R _s in order to define critical regions for R _l and R _s individually and simultaneously. Due to the properties of the mean and variance of the alternative distribution, as shown in Equations (17), (18) and (19), we are cautious to define the critical regions. Table 1 provides powers for the tests as we choose uniform, standard Normal, student-t with 3 degrees of freedom, exponential distributions for the hypothesized distribution, a couple of different settings for sample sizes m and n, and 2, 3, 6 for k. Clearly, a joint test considering both R _l and R _s for the equality of distributions is best suited in comparison with tests considering only one of the rank statistics.

Our proposed algorithm provides a solution for finding the power of distribution equivalence tests considering the shift and scale parameters, respectively and simultaneously. Numerical studies show that a joint test should be adopted for the test homogeneity of distributions as well as under Lehmann alternatives. Also an elliptic critical region is a better choice rather than a rectangular one for a joint test. In practice, it is reasonable to have neither the normality assumption nor equal mean/variance of the interested distributions. However, our algorithm highly depends on the technology equipments as the possible states in Ω _n grow rapidly when the sample sizes increase. Therefore, we can, so far, only target small sample sizes in our work.

The author would like to thank James C. Fu and anonymous referee whose comments led to significant improvements of this manuscript.

Affiliations

1. Department of Statistics, University of Manitoba, Winnipeg, Canada

   • Wan-Chen Lee

Corresponding author

Correspondence to Wan-Chen Lee.

Competing interests

The author declares that she has no competing interests.

Reprints and Permissions