Risk ratios and Scanlan’s HRX
- Hoben Thomas^{1}Email author and
- Thomas P. Hettmansperger^{2}
https://doi.org/10.1186/s40488-017-0071-6
© The Author(s) 2017
Received: 5 April 2017
Accepted: 27 July 2017
Published: 15 November 2017
Abstract
Risk ratios are distribution function tail ratios and are widely used in health disparities research. Let A and D denote advantaged and disadvantaged populations with cdfs F _{ A }(x) and F _{ D }(x) respectively, F _{ A }(x)≤F _{ D }(x). Consider a selection setting where those selected have x>c a critical value. Scanlan observed in empirical data that as c is lowered the failure ratio F R(c)=F _{ D }(c)/F _{ A }(c) and success ratio S R(c)=[1−F _{ D }(c)]/[1−F _{ A }(c)] can both be increasing with decreasing c, a surprising result Scanlan calls Heuristic Rule X (HRX). The consequences of HRX for disparities research have not been well understood, and appear to be often ignored. The analytical conditions for HRX to hold have not, heretofore, been proven. In the normal case, HRX holds if the variances are equal. In general, HRX is not a robust condition. Settings and distributional conditions necessary for HRX to hold are discussed, including mixture settings of normal and other variables.
Keywords
Mathematics Subject Classification
Introduction
James P. Scanlan, a Washington D.C. lawyer, has written extensively on statistical issues of discrimination for more than two decades. He has contributed prodigiously to commentaries, workshop presentations, legal briefs, news articles, web posts, lengthy letters to organizations, including the American Statistical Association, various slide files as well as several journal publications. Typically his focus is on various measures of different population disparities. Most of this work is freely available on his burgeoning website www.jpscanlan.com. Many of Scanlan’s contributions have focused on health disparities and commonly associated statistical measures of disparities. His most important contributions have addressed what epidemiologists refer to as risk ratios, or relative risk.
Risk ratios are probability distribution function tail ratios, either empirical or theoretical, or sometimes functions thereof. Scanlan views risk ratios as having been improperly understood and wrongly interpreted; as he sees it, his goal is to provide a more enlightened perspective on their use. This is a core theme in his contributions. There is a very large and often controversial literature on the use of risk ratios stretching back well more than 50 years (Sheps 1958) and which is continuing (Talih and Huang 2016; Weissman et al. 2011).
The conundrum is the following: Suppose c is a test score above which there is success, and below which there is failure. If c is shifted downward (lowered) then S R(x) increases toward one. However under certain mild conditions the failure ratio, F R(x) unexpectedly increases away from one. This is the property HRX.
Scanlan has argued in numerous places with forcefulness and often at great length about properties of these ratios he has long identified; however, he uses neither the above notion nor does he characterize matters in the terms we use here. Consider the graphs of pairs (x,F R(x)), and (x,S R(x)) with the risk ratio graphed against x. Scanlan would argue that the corresponding trajectories of these graphs are grossly misunderstood…even by professionals whose business, presumably, is to understand them. For example he starts his “Divining Difference” 1994 Chance article with the statement that “There are few statistical phenomena that are at once so fundamental and so widely misunderstood as the seemingly paradoxical relationship between disparities (i.e., SR and FR above)…. The misunderstanding of that relationship is responsible for immense confusion in the appraisal of a wide range of phenomena disparately affecting different demographic groups (Scanlan 1994, p. 38)”.
He prefers to characterize the difficulty this way: “The main problem with existing research lies in the failure to recognize the following statistical tendency, which we’ll call heuristic rule X (HRX): When two groups differ in their susceptibility to an outcome, the rarer the outcome, the greater the disparity in experiencing the outcome and the smaller the disparity in avoiding the outcome. (Scanlan 2006, p. 47)”.
Readers (ourselves included) often find such statements hard to parse partly because he typically provides an insufficient framework at the outset, visual or conceptual, within which to parse the prose. Scanlan himself has come, recently, to recognize this difficulty although he appears reluctant to alter his presentation style (Scanlan 2016a, footnote 3, p. 7).
The goal here is to explore analytically and empirically HRX, and to show under what conditions HRX holds. It seems remarkable that given the central importance of distribution functions to mathematical statisticians and probablists, that after more than 20 years of writing on the matter only one article has addressed HRX, or Scanlan’s rule, within a more formal framework (Lambert and Subramanian 2014). Perhaps this is because Scanlan has not contributed to the mainstream sources most statisticians read. Whatever the reason, Lambert and Subramanian state but do not prove a result which is proven here in Theorem 2.1 and which holds in more generality. In particular, their statement (Lambert and Subramanian 2014, p. 568–569) applies to continuous random variables on [0,∞). So it does not apply to the most important case which Scanlan has employed in numerous settings as motivational framework for claiming HRX effects, the normal shift model. Stated here are conditions for continuous and discrete random variables and certain finite mixtures for which HRX holds. HRX is not, in general, a robust condition but can be very sensitive to model departures.
Blacks and whites below percentage poverty line values x
x | F _{ B }(x) | F _{ W }(x) | F R(x) | S R(x) |
---|---|---|---|---|
600 | .919 | .795 | 1.16 | .40 |
500 | .869 | .715 | 1.22 | .46 |
400 | .786 | .605 | 1.30 | .54 |
300 | .662 | .457 | 1.45 | .62 |
250 | .581 | .373 | 1.56 | .67 |
200 | .488 | .285 | 1.71 | .72 |
185 | .458 | .258 | 1.78 | .73 |
175 | .437 | .230 | 1.83 | .74 |
150 | .374 | .191 | 1.96 | .77 |
135 | .333 | .167 | 1.99 | .80 |
130 | .319 | .156 | 2.04 | .81 |
125 | .310 | .149 | 2.08 | .81 |
100 | .247 | .108 | 2.29 | .84 |
75 | .179 | .072 | 2.49 | .88 |
50 | .118 | .044 | 2.68 | .92 |
It is important to recognize what Scanlan views as important. A naive glance at the F R(100)=2.29 might prompt the conclusion that discrimination is the root cause of more than twice the proportion of blacks being below the poverty line than whites. Scanlan does not dispute this possibility. Rather, he argues that the property of HRX must be considered before a discrimination or bias conclusion is made. Thus, HRX, a purely statistical property of tail ratios may be the basis for the disparity, and not discrimination. Thus, HRX is a possible explanation that must be considered when disparities are interpreted.
Now suppose that both blacks and whites, through some effective social policy, experienced an additive shift such that those now at x=50, or half the poverty line income, were now at x=100, which can be viewed as effectively rescaling the x variable. While the overall proportions of both blacks and whites below the poverty line would both be substantially smaller, the corresponding FR would be much higher, going from 2.29 prior to the additive shift to.118/.044=2.68 afterwards. Hence, as Scanlan says “…the rarer the outcome, the greater the disparity in experiencing the outcome.” Similarly, for the other ratio, “…the smaller the disparity in avoiding the outcome” namely the SR ratio associated with those avoiding poverty. The SR disparity is reduced from.84 to.92.
The change in these ratios, as x changes is the key critical empirical fact of Table 1 to note: As x increases, both FR and SR decrease. Scanlan argues that people (even professionals) often fail to appreciate how these ratios behave under varying values of x, at least in some settings. Without addressing what might be a plausible distribution of poverty rates, Scanlan has suggested that “any set of data reflecting more or less normal distributions of factors” will reveal HRX. (Scanlan 2006, p. 47–48). This claim will be considered below.
Early on, Scanlan considered risk ratios as they are defined above with the distribution of the advantaged group in the denominator. Consequently as Table 1 shows, both FR and SR decrease with increase in x. More recently, Scanlan has placed the larger of the tail areas in the numerator. So for example in Table 1, SR becomes for Scanlan 1/S R, and consequently he now claims, in some of his writings, ….” the two relative differences tend to change in opposite direction …(Scanlan 2014a, p. 330). Here “relative difference” is defined as the risk ratio minus one.
As suggested, Scanlan has addressed myriad settings where population disparities in outcomes occur, infant mortality, arrest frequencies, mortgage lending rates, school discipline rates and the like. The Scanlan signature model (SSM) which forms the conceptual basis for many of his empirical claims consists of two normal distributions with different means and equal variances, the normal shift model.
What is often surprising is that, as the results of the empirical example in Table 1 indicated, both S R(x) and F R(x) show decreases with increases in x or alternatively, increases with decreasing x, and in this case, over the entire range of x. Again, this is HRX. According to Scanlan: “In 2000, however, this pattern was virtually unknown to health researchers or anyone else…” (Scanlan 2014a, p. 328).
To understand HRX likely involves graphs, and grasping the trajectory of risk ratios S R(x) and F R(x) over x. Consequently, given the importance for Scanlan of this motivating case, graphs similar to Fig. 2 would seem natural candidates for display. It is thus puzzling that Scanlan apparently has never provided such a graph. He does provide poverty data risk ratio graphs in Scanlan (2006). No graphs appear in his most comprehensive publication (Scanlan 2014a). Two shifted normal densities appear in Scanlan (1994), but these do not illustrate HRX. He does table two, or sometime four decision c values and their corresponding numerical values (Scanlan 2014a, Table 1; Scanlan 2016b, Table 1, p. 416). In his presentation slide files empirical graphs of F R(x) and 1/S R(x) appear, but they are not graphed against x as might be expected. Rather, these ratios are graphed against the failure rate F _{ A }(x). Furthermore, the F _{ A }(x) abscissa is numbered backwards reading from left to right.99,.98., ….01 (e.g., Scanlan 2014b). It seems fair to say such graphs can certainly lead to discomfort if not confusion.
With the above as background, next consider conditions under which HRX holds, and conditions for HRX to hold for selected distributions. Some other related analytical results as presented as well.
Analytical results
2.1 Definitions and main results
Definition 1
As above, let F _{ D }(x) and F _{ A }(x) be two cdfs with either probability density functions (pdfs) or probability mass functions (pmfs) f _{ D }(x) and f _{ A }(x) with support sets _{ D } and _{ A }, respectively. As defined at the outset above, F R(x) and S R(x) are failure and success ratios respectively. Assume both are non-increasing for x∈_{ D }∩_{ A }, with F R(x)≥1 and S R(x)≤1 then F _{ D }(x) and F _{ A }(x) are said to have the HRX property, or simply F _{ D }(x) and F _{ A }(x) are HRX.
As noted above, Lambert and Subramanian (2014) consider without proof conditions under which continuous F _{ D }(x) and F _{ A }(x) are HRX, assuming x∈[0,∞). They relate HRX to a monotone likelihood ratio (MLR) property and stochastic ordering.
Definition 2
F _{ D }(x) and F _{ A }(x) have the MLR property if f _{ D }(x)/f _{ A }(x) is non-increasing for x∈_{ D }∩_{ A }.
Definition 3
F(x) is called log-concave provided logf(x) is concave.
Definition 4
F _{ D }(x) and F _{ A }(x) form a location shift model when F _{ A }(x)=F _{ D }(x−θ),θ>0, and F _{ D }(x) is a continuous distribution.
The main result is stated in the following theorem which uses methods in Shaked and Shanthikumar (2007, Section 1.C.1).
Theorem 1
If F _{ D }(x) and F _{ A }(x) have the MLR property, Definition 2, then they have property HRX of Definition 1. That is, MLR implies HRX.
Proof
Hence, F R(x) is non-increasing on \({{\mathcal {S}}_D} \cap {{\mathcal {S}}_A}\). A similar argument shows S R(x) is also non-increasing on \({{\mathcal {S}}_D} \cap {{\mathcal {S}}_A}\). □
Wellner (2012) proved the following lemma:
Lemma 1
The pdfs f(x),f(x−θ) have MLR property if and only if f is log-concave. Consequently a corollary to Theorem 1 is:
Corollary 1
Given a location shift model (Definition 4), if F _{ D }(x) is log-concave, then F _{ D }(x) and F _{ A }(x)=F _{ D }(x−θ),θ>0, are HRX.
Example 1
Symmetric log-concave densities are often used in location shift models. These include the normal (noted above), as well as the uniform, logistic and Laplace.
Example 2
F _{ D }(x) and F _{ A }(x) need not be symmetric. This is the case for distributions with positive support. Assume the advantaged group mean exceeds the disadvantaged group mean, then the lemma can be used to establish HRX from Theorem 1. The following densities are log-concave: extreme value, gamma with shape parameter at least one, exponential, beta with both parameters at least one, and the Weibull with shape parameter at least one.
The family of t distributions with finite degrees of freedom is not log-concave; hence by the lemma, t distributions do not satisfy the MLR property. This family includes the Cauchy density. The Pareto and lognormal are also not log-concave. We next consider the situation for which HRX holds for a subset of \(\mathcal {S}_{\mathcal {D}}\cap \mathcal {S}_{\mathcal {A}}\).
Example 3
Mixtures provide flexible models, as will be illustrated below. Consider two component mixtures \(\phantom {\dot {i}\!}F_{D}(x)=\lambda F{_{D_{1}}}(x)+(1-\lambda) F_{D_{2}}(x)\) and \(F_{A}(x)=\alpha F{_{A_{1}}}(x)+(1-\alpha) {F_{A_{2}}}(x)\phantom {\dot {i}\!}\) with 0<λ<1,0<α<1. The following theorem provides conditions under which F _{ D }(x) and F _{ A }(x) are HRX.
Theorem 2
Given the above mixtures, suppose according to Definition 2, the following pairs have the MLR property \(({f_{D_1}}(x), {f_{A_1}}(x))\phantom {\dot {i}\!}\), \(({f_{D_2}}(x), {f_{A_1}}(x))\phantom {\dot {i}\!}\) and \(\phantom {\dot {i}\!}({f_{A_1}}(x), {f_{A_2}}(x))\), then the mixtures f _{ D }(x) and f _{ A }(x) are HRX.
Proof
The numerator is decreasing by the MLR property. The denominator is increasing because \(\phantom {\dot {i}\!}\frac {f_{A_{1}}(x)}{f_{A_{2}}(x)}\) is decreasing. Hence, the ratio is decreasing and HRX follows from Theorem 1. □
A simple example of Theorem 2 occurs when the mixtures are defined by a log-concave location shift model with location parameters \(\theta _{D_{1}}<\theta _{D_{2}}<\theta _{A_{1}}<\theta _{A_{2}}.\) More complicated models are possible.
Recall the dilemma of HRX. Consider a criterion value c above which there is success. If c is lowered so that S R(c) increases toward one, the unexpected consequence is that F R(c) also increases. There is an alternative way to view this situation. Consider P(D|F) as the proportion of D members in the failure pool and P(D|S) as the proportion of D members in the success pool. Further, let P(D) and P(A) be the relative proportions in the D∪A population. We have the corresponding dilemma: When c is lowered so that S R(c) increases, it also happens that P(D|S) increases. Similarly, with increases in F R(c) there are unexpected increases in P(D|F); the proportion of the D population in the failure pool increases. This result is developed in the following theorem.
Theorem 3
Suppose F _{ D }(x)and F _{ A }(x) satisfy Definition 1 and are HRX. Then P(D|S) and P(D|F)are non-decreasing functions of S R(x) and F R(x) respectively.
Proof
This is a non-decreasing function of F R(c). A similar argument shows P(D|S) is a non-decreasing function of S R(c). □
Suppose c is decreased. Under HRX both S R(c) and F R(c) increase. By Theorem 3 both P(D|S) and P(D|F) increase.
2.2 When HRX fails to hold
Example 4
Theorem 4
Proof
To apply Theorem 4 requires at a minimum the solution of Eq. 1. A more practical approach is to plot F R(x) and S R(x) and by inspection determine the HRX interval, noting whether the HRX interval contains the relevant critical values of c. As noted earlier, the t distribution is not log-concave, and hence the MLR property does not hold.
2.3 Data, inference, asymptotics
It is of interest to consider the variance, covariance and correlation between the risk ratio estimates \(\widehat {SR}(c)\) and \(\widehat {FR}(c)\) given Olkin’s (1998) observation that “the risk ratio for dying is unrelated to the risk ratio for surviving…” and earlier Sheps (1958) commented that FR “has no predictable relation” to SR.
A simulation of 1000 F R(c),S R(c) pairs, each based on sample size 1000, with c=−.33 under SSM, yields ρ=−.91, while the Pearson r=−.87. Clearly the risk ratios are correlated.
Discussion
Scanlan argues in his 2014 Society article “Race and Mortality Revisited” that since his2000 “Race and Mortality” Society article that “almost nothing said” about health disparities “has had a sound statistical basis (Scanlan2014a, p. 330).” This is quite an indictment. Without considering the merits of the statement, there seems little doubt that Scanlan’s efforts have not elicited the attention they deserve; it is also clear that some writers have avoided if not ignored his work. Scanlan (2014a, p. 344) discusses at length the history of his interaction with the authors of “Commission Paper: Healthcare Disparities Measurement” (Weissmann et al.2011) prior to its final release. It is an 84 page document and contains 125 references. None reference Scanlan. Penman-Aguilar et al. (2016), another health disparities summary document, contains 60 references. Scanlan does not appear. (He issued a sharp critique, Scanlan2016b).
Scanlan’s own writing can be hard to penetrate, as was noted at the outset, and his lack of notation, avoidance of graphs, especially in his published articles would appear to be clear hindrances to understanding. Simple graphs, such as Fig. 1, would appear to make HRX much more easily understandable. At least graphs should supplement tabled values, to facilitate understanding of HRX which certainly can be elusive.
Recall SSM denotes Scanlan’s signature model and is displayed in Fig. 2. SSM is ubiquitous in its use in Scanlan’s documents and is the motivation for invoking HRX under SSM in myriad settings. SSM is a restrictive model framework; it assumes there is a measurable variable, such as test scores, over which there is assumed to be a pair of normal or at least approximately normal distributions, with equal variances; it is assumed that the empirical data of focus are in rough correspondence to the SSM model. It further assumes there is some fixed cutting or decision score, so that the risk ratios are plausibly defined. Many test score settings seem appropriately so modeled by SSM. A serious problem arises when SSM is applied to settings which may lack any resemblance to this scenario, and for which there are little or no data, nor any statistical or substantive theory available for guidance.
An example concerns arrest warrants. Arrests are counts. One might model arrests as Poisson or binomial variables but they are clearly not normal variables nor is a shift model appropriate for count data. Scanlan (2016c) seems unperturbed. He reports that The Department of Justice filed suit against the city of Ferguson, Missouri claiming disparate impact because the city issued too many arrest warrants than they should have, given the city’s 67% black population makeup. “What the DOJ fails to understand, however, is that reducing the number of citations and arrest warrants will tend to increase, not decrease, the proportion of African Americans make up (sic) of persons cited and arrested” (Scanlan2016c). An abbreviated statement of SSM to motivate its application then follows. Yet there appear to be no data on relative arrest frequencies, nor any suggestion as to what distribution such frequencies might plausibly follow, should such data be available. The U. S. Department of Justice investigation of Ferguson (2015) is of little help. It provides only crude raw frequency or percentage data. There appears to be no data nor theory to defend the appropriateness of SSM. Furthermore, in city policing, the idea that numerous police officers in complex law enforcement settings would be expected to behave in a fashion roughly similar to the way a college admissions officer behaves in setting an SAT test selection criterion seems hopelessly unrealistic. (A more appropriate approach would seem to be to view police arrest decisions as random effects.) Furthermore, Scanlan’s claim “The pattern is essentially universal” is certainly false; HRX is not robust, and can be very fragile as is illustrated by Figs. 3 and 5.
There are other settings for which the appropriateness of SSM appears questionable. School discipline is an example. More African Americans are often disciplined than whites, and discrimination is often claimed. Whether SSM is appropriate for such settings is never addressed. Recently, Scanlan (2017) considered racial differences in incarceration rates, and with similar SSM reasoning states that “Similar patterns will tend to appear when any outcome is increasingly restricted to those most susceptible to it—not in every instance of course, but a good deal of the time (p. 2)” (emphasis added).
This is not to say HRX is wrong as an explanation for settings where substantial disparities are found, only that there is insufficient evidence to suggest HRX, under SSM, provides a plausible and creditable motivating framework for some of Scanlan’s settings of interest. Scanlan’s goal is to influence public policy, often judicial policy. However too often his basis for claiming HRX is based on reasoning by analogy: If HRX under SSM holds in test score settings, it is appropriate, he reasons, for this same outcome to apply to a diverse range of settings which show no resemblance to SSM. Such reasoning is unlikely to sway policy makers. To invoke SSM in frameworks where SSM is unrealistic can only weaken the credibility of Scanlan’s arguments in other arenas where his arguments have cogency, and that outcome would be unfortunate.
The analysis here leaves open important analytical questions that deserve attention. What has been given here are sufficient conditions to assure that HRX holds over the region of support for x and conditions for HRX to hold for certain discrete and continuous distributions. Whether necessary conditions can be given remains open. An important question which is discussed in the analytical section above, concerns the problem of specifying conditions under which HRX holds over regions of practical relevance. That HRX fails under normality when test scores turn negative is of no practical concern.
Dynamic graphs with sliders to adjust the model parameters can result in real-time displays of the risk ratios using Mathematica’s Manipulate command (Wolfram Research Inc.2017). These graphs are very helpful for exploring the behavior of S R(x) and F R(x). It would appear that, under normality, as long as the mean of the disadvantaged group is substantially smaller than the mean of the advantaged group, considerable variation in the variance parameters of each distribution can be tolerated for HRX to hold over non-negative x or the region of interest. Figure 4 provides a real illustrative example, and so of course does Fig. 1. Another set of issues are statistical. Some asymptotic results were given above for estimates of S R(x) and F R(x) and their correlation, but there are many open questions of interest. For example, given data, can an interval of x for which HRX holds be specified? This question relates to Theorem 4 and the discussion that follows that theorem. Can a test of the appropriateness of HRX be developed?
A critically important question is raised by Scanlan’s concerns: How does one evaluate, in data, the relative importance of HRX given possible bias or discrimination? It seems highly unlikely, even if HRX were more widely understood, that matters of social policy would be altered substantially from current practice unless it were possible to separate the influence on risk ratios of HRX from the influence of discrimination or bias. Scanlan’s HRX is an interesting property that deserves much wider attention.
Declarations
Acknowledgements
There are no acknowledgements to be made at this time.
Competing interests
The authors declare they have no competing interests. There was no funding associated with this manuscript. The manuscript has not been submitted elsewhere.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Authors’ Affiliations
References
- College Board: Total Group Profile Report. (2016). https://reports.collegeboard.org/pdf/total-group-2016.pdf. Accessed 19 May 2017.
- Ferguson, United States Department of Justice Civil Rights Division: Investigation of the Ferguson Police Department. March 4, 2015 (2015). https://www.courts.mo.gov/file.jsp?id=95274. Accessed 18 May, 2017.
- Lambert, PJ, Subramanian, S: Disparities in socio-economic outcomes: some positive propositions and their normative implications. Soc. Choice Welf. 43, 565–576 (2014).View ArticleMATHGoogle Scholar
- National Center for Education Statistics: Fast Facts. SAT Scores. (2014). https://nces.ed.gov/fastfacts/display.asp?id=171. Accessed 18 May 2017.
- Olkin, I: Odds ratios revisited. Evid.-Based Med. 3, 71 (1998).Google Scholar
- Penman-Aguilar, A, Talih, M, Huang, D, Moonesinghe, R, Bouye, K, Beckles, G: Measurement of health disparities, health inequities, and social determinants of health to support the advancement of health equity. J Public Health Manag. Pract. 22(1 Supp), S33–S42 (2016).View ArticleGoogle Scholar
- Scanlan, JP: Divining difference. Chance. 7(4), 38–39, 45 (1994).View ArticleGoogle Scholar
- Scanlan, JP: Race and mortality. Society. 37(2), 29–35 (2000).View ArticleGoogle Scholar
- Scanlan, JP: Can we actually measure health disparities?Chance. 19(2), 47–51 (2006).View ArticleGoogle Scholar
- Scanlan, JP: Race and mortality revisited. Society. 51, 328–346 (2014a).View ArticleGoogle Scholar
- Scanlan, JP: Rethinking the Measurement of Demographic Differences in Outcome Rates Methods Workshop, Maryland Population Research Center University of Maryland College Park, Maryland, October 14 (2014b). Available from www.jpscanlan.com.
- Scanlan, JP: Amicus brief submitted to United States District Court Eastern District of Missouri, Eastern Division. No. 4:16-cv-000180-CDP (2016a). Available from www.jpscanlan.com.
- Scanlan, JP: The mismeasure of health disparities. J. Public Health Manag. Pract. 22, 415–419 (2016b).View ArticleGoogle Scholar
- Scanlan, JP: Things the DoJ doesn’t know about racial disparities in Ferguson. The Hill, February 22 (2016c).Google Scholar
- Scanlan, JP: Racial Impact Statement Laws in New Jersey and Elsewhere. Federalist Soc., March 20 (2017).Google Scholar
- Shaked, M, Shanthikumar, JG: Stochastic Orders. Springer, New York (2007).View ArticleMATHGoogle Scholar
- Sheps, MC: Shall we count the living or the dead?N. Engl. J. Med. 259, 1210–1214 (1958).View ArticleGoogle Scholar
- Talih, M, Huang, DT: Measuring progress toward target attainment and the elimination of health disparities in Healthy People 2020. Healthy People Stat Notes. 27, 1–20 (2016).Google Scholar
- United States Census Bureau 2004: CPS Poverty Table: POV-01. The CPS 2005 Annual Social and Economic Supplement asked participants to report their poverty status for 2004 (2005). https://www.census.gov/data/tables/time-series/demo/income-poverty/cps-pov/pov-01.2004.html. Accessed 3 Feb 2017.
- Weissman, JS, Betancourt, JR, Green, AR, Meyer, GS, Tan-McGrory, A, Nudel, JD, Zeidman, JA, Carrillo, JE: Commissioned Paper: Healthcare Disparities Measurement. Disparities Solution Center of Massachusetts General Hospital (2011). https://mghdisparitiessolutions.files.wordpress.com/2015/10/dsc-commissioned-paper.pdf. Accessed 6 Aug 2017.
- Wellner, J: Log-concave distributions: definitions, properties, and consequences. Presentation, University of Paris-Diderot, January 23 (2012). http://www.proba.jussieu.fr/pageperso/picard/Paris-Jan-p1-small.pdf. Accessed 10 Mar 2017.
- Wolfram Research Inc: Mathematica, Version 11.1. Champaign, IL (2017).Google Scholar