scipy.stats.somersd#

scipy.stats.somersd(x, y=None, alternative='two-sided')[source]#

Calculates Somers’ D, an asymmetric measure of ordinal association.

Like Kendall’s \(\tau\), Somers’ \(D\) is a measure of the correspondence between two rankings. Both statistics consider the difference between the number of concordant and discordant pairs in two rankings \(X\) and \(Y\), and both are normalized such that values close to 1 indicate strong agreement and values close to -1 indicate strong disagreement. They differ in how they are normalized. To show the relationship, Somers’ \(D\) can be defined in terms of Kendall’s \(\tau_a\):

\[D(Y|X) = \frac{\tau_a(X, Y)}{\tau_a(X, X)}\]

Suppose the first ranking \(X\) has \(r\) distinct ranks and the second ranking \(Y\) has \(s\) distinct ranks. These two lists of \(n\) rankings can also be viewed as an \(r \times s\) contingency table in which element \(i, j\) is the number of rank pairs with rank \(i\) in ranking \(X\) and rank \(j\) in ranking \(Y\). Accordingly, somersd also allows the input data to be supplied as a single, 2D contingency table instead of as two separate, 1D rankings.

Note that the definition of Somers’ \(D\) is asymmetric: in general, \(D(Y|X) \neq D(X|Y)\). somersd(x, y) calculates Somers’ \(D(Y|X)\): the “row” variable \(X\) is treated as an independent variable, and the “column” variable \(Y\) is dependent. For Somers’ \(D(X|Y)\), swap the input lists or transpose the input table.

Parameters

x: array_like: 1D array of rankings, treated as the (row) independent variable. Alternatively, a 2D contingency table.
y: array_like, optional: If x is a 1D array of rankings, y is a 1D array of rankings of the same length, treated as the (column) dependent variable. If x is 2D, y is ignored.
alternative{‘two-sided’, ‘less’, ‘greater’}, optional: Defines the alternative hypothesis. Default is ‘two-sided’. The following options are available: * ‘two-sided’: the rank correlation is nonzero * ‘less’: the rank correlation is negative (less than zero) * ‘greater’: the rank correlation is positive (greater than zero)

Returns

resSomersDResult

A SomersDResult object with the following fields:

correlationfloat
The Somers’ \(D\) statistic.

pvaluefloat
The p-value for a hypothesis test whose null hypothesis is an absence of association, \(D=0\). See notes for more information.

table2D array
The contingency table formed from rankings x and y (or the provided contingency table, if x is a 2D array)

See also

kendalltau: Calculates Kendall’s tau, another correlation measure.
weightedtau: Computes a weighted version of Kendall’s tau.
spearmanr: Calculates a Spearman rank-order correlation coefficient.
pearsonr: Calculates a Pearson correlation coefficient.

Notes

This function follows the contingency table approach of [2] and [3]. p-values are computed based on an asymptotic approximation of the test statistic distribution under the null hypothesis \(D=0\).

Theoretically, hypothesis tests based on Kendall’s \(tau\) and Somers’ \(D\) should be identical. However, the p-values returned by kendalltau are based on the null hypothesis of independence between \(X\) and \(Y\) (i.e. the population from which pairs in \(X\) and \(Y\) are sampled contains equal numbers of all possible pairs), which is more specific than the null hypothesis \(D=0\) used here. If the null hypothesis of independence is desired, it is acceptable to use the p-value returned by kendalltau with the statistic returned by somersd and vice versa. For more information, see [2].

Contingency tables are formatted according to the convention used by SAS and R: the first ranking supplied (x) is the “row” variable, and the second ranking supplied (y) is the “column” variable. This is opposite the convention of Somers’ original paper [1].

References

1: Robert H. Somers, “A New Asymmetric Measure of Association for Ordinal Variables”, American Sociological Review, Vol. 27, No. 6, pp. 799–811, 1962.
2(1,2): Morton B. Brown and Jacqueline K. Benedetti, “Sampling Behavior of Tests for Correlation in Two-Way Contingency Tables”, Journal of the American Statistical Association Vol. 72, No. 358, pp. 309–315, 1977.
3: SAS Institute, Inc., “The FREQ Procedure (Book Excerpt)”, SAS/STAT 9.2 User’s Guide, Second Edition, SAS Publishing, 2009.
4: Laerd Statistics, “Somers’ d using SPSS Statistics”, SPSS Statistics Tutorials and Statistical Guides, https://statistics.laerd.com/spss-tutorials/somers-d-using-spss-statistics.php, Accessed July 31, 2020.

Examples

We calculate Somers’ D for the example given in [4], in which a hotel chain owner seeks to determine the association between hotel room cleanliness and customer satisfaction. The independent variable, hotel room cleanliness, is ranked on an ordinal scale: “below average (1)”, “average (2)”, or “above average (3)”. The dependent variable, customer satisfaction, is ranked on a second scale: “very dissatisfied (1)”, “moderately dissatisfied (2)”, “neither dissatisfied nor satisfied (3)”, “moderately satisfied (4)”, or “very satisfied (5)”. 189 customers respond to the survey, and the results are cast into a contingency table with the hotel room cleanliness as the “row” variable and customer satisfaction as the “column” variable.


27	25	14	7	0
7	14	18	35	12
1	3	2	7	17

For example, 27 customers assigned their room a cleanliness ranking of “below average (1)” and a corresponding satisfaction of “very dissatisfied (1)”. We perform the analysis as follows.

>>> from scipy.stats import somersd
>>> table = [[27, 25, 14, 7, 0], [7, 14, 18, 35, 12], [1, 3, 2, 7, 17]]
>>> res = somersd(table)
>>> res.statistic
0.6032766111513396
>>> res.pvalue
1.0007091191074533e-27

The value of the Somers’ D statistic is approximately 0.6, indicating a positive correlation between room cleanliness and customer satisfaction in the sample. The p-value is very small, indicating a very small probability of observing such an extreme value of the statistic under the null hypothesis that the statistic of the entire population (from which our sample of 189 customers is drawn) is zero. This supports the alternative hypothesis that the true value of Somers’ D for the population is nonzero.

scipy.stats.weightedtau

scipy.stats.linregress