banner



How To Find Iqr With Mean And Standard Deviation

  • Inquiry commodity
  • Open Access
  • Published:

Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range

  • 122k Accesses

  • 2628 Citations

  • 20 Altmetric

  • Metrics details

Abstract

Groundwork

In systematic reviews and meta-analysis, researchers often pool the results of the sample mean and standard departure from a set of similar clinical trials. A number of the trials, however, reported the report using the median, the minimum and maximum values, and/or the first and tertiary quartiles. Hence, in gild to combine results, one may have to gauge the sample hateful and standard deviation for such trials.

Methods

In this paper, we propose to meliorate the existing literature in several directions. Beginning, we show that the sample standard deviation estimation in Hozo et al.'s method (BMC Med Res Methodol 5:13, 2005) has some serious limitations and is always less satisfactory in do. Inspired past this, we advise a new interpretation method past incorporating the sample size. Second, we systematically study the sample mean and standard divergence interpretation problem under several other interesting settings where the interquartile range is likewise available for the trials.

Results

Nosotros demonstrate the performance of the proposed methods through simulation studies for the three often encountered scenarios, respectively. For the first two scenarios, our method greatly improves existing methods and provides a near unbiased gauge of the truthful sample standard deviation for normal data and a slightly biased estimate for skewed data. For the third scenario, our method still performs very well for both normal data and skewed data. Furthermore, nosotros compare the estimators of the sample hateful and standard deviation under all 3 scenarios and present some suggestions on which scenario is preferred in real-world applications.

Conclusions

In this newspaper, nosotros discuss different approximation methods in the estimation of the sample hateful and standard deviation and suggest some new estimation methods to improve the existing literature. Nosotros conclude our work with a summary tabular array (an Excel spread sheet including all formulas) that serves as a comprehensive guidance for performing meta-assay in different situations.

Peer Review reports

Groundwork

In medical enquiry, it is mutual to find that several similar trials are conducted to verify the clinical effectiveness of a certain treatment. While individual trial study could fail to evidence a statistically significant handling effect, systematic reviews and meta-analysis of combined results might reveal the potential benefits of treatment. For example, Antman et al. [ane] pointed out that systematic reviews and meta-analysis of randomized command trials would take led to earlier recognition of the benefits of thrombolytic therapy for myocardial infarction and may save a big number of patients.

Prior to the 1990s, the traditional arroyo to combining results from multiple trials is to comport narrative (unsystematic) reviews, which are mainly based on the experience and subjectivity of experts in the surface area [2]. However, this approach suffers from many critical flaws. The major one is due to inconsistent criteria of different reviewers. To claim a handling outcome, different reviewers may use different thresholds, which oftentimes lead to opposite conclusions from the same study. Hence, from the mid-1980s, systematic reviews and meta-analysis have become an imperative tool in medical effectiveness measurement. Systematic reviews employ specific and explicit criteria to place and assemble related studies and usually provide a quantitative (statistic) gauge of amass issue over all the included studies. The methodology in systematic reviews is usually referred to equally meta-assay. With the combination of several studies and more than data taken into consideration in systematic reviews, the accuracy of estimations will get improved and more precise interpretations towards the treatment event can be achieved via meta-assay.

In meta-analysis of continuous outcomes, the sample size, mean, and standard deviation are required from included studies. This, however, can be difficult because results from different studies are often presented in unlike and non-consistent forms. Specifically in medical inquiry, instead of reporting the sample hateful and standard deviation of the trials, some trial studies only report the median, the minimum and maximum values, and/or the first and third quartiles. Therefore, we need to estimate the sample mean and standard departure from these quantities then that we can pool results in a consistent format. Hozo et al. [three] were the first to accost this estimation problem. They proposed a unproblematic method for estimating the sample mean and the sample variance (or equivalently the sample standard deviation) from the median, range, and the size of the sample. Their method is now widely accepted in the literature of systematic reviews and meta-analysis. For instance, a search of Google Scholar on November 12, 2014 showed that the article of Hozo et al.'s method has been cited 722 times where 426 citations are made recently in 2013 and 2014.

In this newspaper, we will show that the estimation of the sample standard divergence in Hozo et al.'south method has some serious limitations. In item, their estimator did non incorporate the information of the sample size so consequently, it is always less satisfactory in practice. Inspired past this, we propose a new estimation method that will greatly meliorate their method. In addition, we will investigate the estimation trouble under several other interesting settings where the first and 3rd quartiles are as well available for the trials.

Throughout the paper, we define the following summary statistics:

a = the minimum value,

q 1 = the commencement quartile,

1000 = the median,

q 3 = the third quartile,

b = the maximum value,

n = the sample size.

The {a,q 1,m,q 3,b} is often referred to as the 5-number summary [4]. Note that the 5-number summary may non always be given in full. The three frequently encountered scenarios are:

C ii = { a , q i , thousand , q 3 , b ; n } ,

Hozo et al.'southward method just addressed the interpretation of the sample mean and variance nether Scenario C one while Scenarios C 2 and C 3 are also common in systematic review and meta-analysis. In Sections 'Methods' and 'Results', we written report the interpretation problem under these three scenarios, respectively. Simulation studies are conducted in each scenario to demonstrate the superiority of the proposed methods. We conclude the paper in Section 'Word' with some discussions and a summary table to provide a comprehensive guidance for performing meta-assay in different situations.

Methods

Estimating 10 ̄ and S from C 1

Scenario C ane assumes that the median, the minimum, the maximum and the sample size are given for a clinical trial study. This is the same assumption as made in Hozo et al.'s method. To estimate the sample hateful and standard deviation, we outset review the Hozo et al.'south method and point out some limitations of their method in estimating the sample standard departure. We then propose to improve their estimation by incorporating the information of the sample size.

Throughout the paper, we let X 1,X 2,…,X n be a random sample of size due north from the normal distribution Northward(μ,σ 2), and X (ane)Ten (2)10 (n) be the ordered statistics of 10 ane,X two,,X north . As well for the sake of simplicity, we assume that n = 4Q + 1 with Q being a positive integer. And then

a = X ( one ) X ( two ) X ( Q + 1 ) = q one X ( Q + two ) X ( 2 Q + ane ) = thousand X ( 2 Q + 2 ) Ten ( 3 Q + i ) = q 3 X ( 3 Q + 2 ) X ( 4 Q + i ) = X ( n ) = b.

(1)

In this section, we are interested in estimating the sample mean Ten ̄ = i = i northward Ten i and the sample standard deviation Due south = i = 1 n ( 10 i - X ̄ ) 2 / ( north - 1 ) 1 / ii , given that a,m,b, and n of the data are known.

Hozo et al.'s method

For ease of note, let Yard = 2Q + 1. Then, 1000 = (n + 1)/ii. To guess the mean value, Hozo et al. applied the following inequalities:

a X ( 1 ) a a X ( i ) yard ( i = 2 , , M - 1 ) thousand X ( One thousand ) m 1000 Ten ( i ) b ( i = Chiliad + ane , , northward - ane ) b Ten ( northward ) b.

Calculation up all above inequalities and dividing by n, we have LB one X ̄ UB i , where the lower and upper premises are

LB 1 = a + m 2 + 2 b - a - yard 2 north , UB one = m + b 2 + 2 a - m - b two due north .

Hozo et al. so estimated the sample mean by

LB 1 + UB one ii = a + 2 thousand + b 4 + a - 2 one thousand + b 4 n .

(ii)

Annotation that the second term in (ii) is negligible when the sample size is large. A simplified mean estimation is given as

X ̄ a + 2 thou + b 4 .

(3)

For estimating the sample standard deviation, by bold that the data are non-negative, Hozo et al. applied the following inequalities:

aX ( 1 ) X ( 1 ) two aX ( one ) aX ( i ) X ( i ) 2 mX ( i ) ( i = 2 , , Yard - ane ) mX ( 1000 ) X ( M ) 2 mX ( Thousand ) mX ( i ) X ( i ) 2 bX ( i ) ( i = M + 1 , , due north - 1 ) bX ( northward ) 10 ( n ) 2 bX ( n ) .

(4)

With some unproblematic algebra and approximations on the formula (4), we have LSB 1 i = one north X i ii USB one , where the lower and upper bounds are

LSB 1 = a 2 + thousand 2 + b 2 + ( M - 2 ) a ii + am + g ii + mb ii , USB one = a two + m ii + b 2 + ( One thousand - 2 ) am + m ii + mb + b 2 2 .

Then by (iii) and the approximation i = 1 north X i 2 ( LSB 1 + USB 1 ) / 2 , the sample standard deviation is estimated by Due south = S 2 , where

S 2 = 1 due north - 1 i = ane north X i two - n X ̄ ii one northward - 1 a 2 + m ii + b 2 + ( n - 3 ) two ( a + m ) 2 + ( thou + b ) 2 iv - due north ( a + 2 one thousand + b ) 2 16 .

When due north is big, it results in the following well-known range dominion of pollex:

Note that the range rule of thumb (five) is contained of the sample size. It may not work well in do, especially when n is extremely modest or large. To overcome this problem, Hozo et al. proposed the following improved range rule of pollex with respect to the different size of the sample:

S i 12 ( b - a ) 2 + ( a - 2 m + b ) 2 4 1 / 2 n 15 b - a 4 15 < n 70 b - a vi northward > seventy ,

(vi)

where the formula for northward ≤ fifteen is derived under the equidistantly spaced data assumption, and the formula for n > 70 is suggested by the Chebyshev'southward inequality [5]. Note also that when the data are symmetric, we have a + b ≈ 2m and so

1 12 ( b - a ) 2 + ( a - 2 m + b ) two four 1 / 2 b - a 12 .

Hozo et al. showed that the adaptive formula (6) performs better than the original formula (5) in most settings.

Improved estimation of South

We recollect, withal, that the adaptive formula (6) may still be less authentic for practical use. Outset, the threshold values 15 and 70 are suggested somewhat arbitrarily. Second, given the normal data N(μ,σ 2) with σ > 0 being a finite value, nosotros know that σ ≈ (b - a)/6 → as n. This contradicts to the assumption that σ is a finite value. Third, the non-negative data assumption in Hozo et al.'s method is also quite restrictive.

In this section, we propose a new estimator to farther improve (6) and, in addition, we remove the non-negative assumption on the data. Allow Z 1,…,Z n exist independent and identically distributed (i.i.d.) random variables from the standard normal distribution N(0,1), and Z (i)Z (n) exist the ordered statistics of Z 1,…,Z n . And so X i = μ+σ Z i and X (i) = μ+σ Z (i) for i = one,…,n. In particular, we take a = μ+σ Z (1) and b = μ+σ Z (n). Since E(Z (1)) = -Eastward(Z (north)), nosotros take E(b - a) = iiσ Due east(Z (due north)). Hence, by letting ξ(n) = iiE(Z (northward)), we choose the following interpretation for the sample standard deviation:

Note that ξ(north) plays an important role in the sample standard difference estimation. If we allow ξ(n) ≡ 4, then (7) reduces to the original rule of thumb in (5). If nosotros let ξ ( due north ) = 12 for due north ≤ 15, 4 for fifteen < n ≤ seventy, or 6 for n > lxx, and then (seven) reduces to the improved rule of thumb (6).

Adjacent, nosotros present a method to approximate ξ(due north) and found an adaptive rule of thumb for standard departure estimation. By David and Nagaraja'south method [6], the expected value of Z (due north) is

E ( Z ( north ) ) = north - z [ Φ ( z ) ] north - i ϕ ( z ) dz ,

where ϕ ( z ) = 1 2 π e - z ii / two is the probability density office and Φ ( z ) = - z ϕ ( t ) dt is the cumulative distribution function of the standard normal distribution. For ease of reference, we have computed the values of ξ(n) by numerical integration using the calculator in Table 1 for northward up to 50. From Table i, it is evident that the adaptive formula (6) in Hozo et al.'s method is less accurate and also less flexible.

Table 1 Values of ξ ( n ) in the formula ( seven ) and the formula ( 12 ) for n ≤ 50

Total size table

When n is large (say n > 50), we can apply Blom's method [7] to approximate E(Z (northward)). Specifically, Blom suggested the following approximation for the expected values of the club statistics:

E Z ( r ) Φ - 1 r - α n - 2 α + 1 , r = 1 , , n ,

(viii)

where Φ -1(z) is the inverse function of Φ(z), or equivalently, the upper zthursday percentile of the standard normal distribution. Blom observed that the value of α increases as northward increases, with the lowest value being 0.330 for n = 2. Overall, Blom suggested α = 0.375 equally a compromise value for practical utilize. Further discussion on the pick of α can exist seen, for example, in [8] and [9]. Finally, by (7) and (8) with r = n and α = 0.375, nosotros approximate the sample standard departure by

S b - a 2 Φ - 1 n - 0.375 northward + 0.25 .

(9)

In the statistical software R, the upper zth percentile Φ -one(z) tin exist computed by the control "qnorm(z)".

Estimating X ̄ and S from C ii

Scenario C ii assumes that the beginning quartile, q one, and the third quartile, q three, are also available in improver to C 1 . In this setting, Bland'south method [10] extended Hozo et al.'s results by incorporating the additional information of the interquartile range (IQR). He further claimed that the new estimators for the sample mean and standard deviation are superior to those in Hozo et al.'s method. In this section, we first review the Bland's method and point out some limitations of this method. We then, accordingly, suggest to improve this method by incorporating the size of a sample.

Bland'due south method

Noting that n = 4Q + 1, we take Q = (n - i)/4. To estimate the sample mean, Bland's method considered the following inequalities:

a X ( ane ) a a Ten ( i ) q 1 ( i = 2 , , Q ) q one X ( Q + 1 ) q 1 q i 10 ( i ) one thousand ( i = Q + 2 , , 2 Q ) m X ( 2 Q + 1 ) thou chiliad X ( i ) q three ( i = 2 Q + 2 , , 3 Q ) q three X ( 3 Q + 1 ) q 3 q 3 X ( i ) b ( i = 3 Q + two , , n - i ) b 10 ( n ) b.

Adding upwards all above inequalities and dividing past n, it results in LB two 10 ̄ UB 2 , where the lower and upper bounds are

LB 2 = a + q ane + k + q iii 4 + 4 b - a - q 1 - thousand - q 3 4 n , UB 2 = q i + chiliad + q three + b iv + 4 a - q one - m - q 3 - b 4 n .

Banal so estimated the sample mean by (LB 2 + UB 2)/2. When the sample size is big, by ignoring the negligible second terms in LB 2 and UB ii, a simplified hateful estimation is given equally

X ̄ a + 2 q one + 2 m + 2 q iii + b 8 .

(ten)

For the sample standard difference, Bland considered some similar inequalities as in (4). Then with some uncomplicated algebra and approximation, it results in LSB two i = ane n X i 2 USB ii , where the lower and upper bounds are

LSB 2 = 1 eight ( north + 3 ) a 2 + q ane 2 + m 2 + q 3 2 + 8 b two + ( n - five ) ( aq 1 + q 1 chiliad + mq 3 + q 3 b ) , USB ii = 1 eight 8 a 2 + ( n + three ) q one two + g 2 + q 3 two + b ii + ( n - 5 ) ( aq one + q 1 m + mq 3 + q 3 b ) .

Next, by the approximation i = 1 due north X i two ( LSB 2 + USB 2 ) / two ,

Due south 2 i 16 a two + ii q ane ii + 2 m two + two q 3 2 + b 2 + 1 8 ( aq one + q i yard + mq 3 + q 3 b ) - 1 64 ( a + ii q 1 + two m + ii q 3 + b ) 2 .

(11)

Bland's method then took the square root S 2 to estimate the sample standard deviation. Note that the computer (11) is contained of the sample size n. Hence, it may not exist sufficient for general utilise, especially when n is small or big. In the next section, we propose an improved estimation for the sample standard deviation by incorporating the boosted information of the sample size.

Improved interpretation of S

Call back that the range b-a was used to estimate the sample standard deviation in Scenario C one . Now for Scenario C two , since the IQR q 3-q i is also known, another approach is to estimate the sample standard deviation by (q 3-q 1)/η(n), where η(north) is a function of due north. Taking both methods into account, we propose the following combined estimator for the sample standard deviation:

S one 2 b - a ξ ( n ) + q 3 - q 1 η ( n ) .

(12)

Post-obit Section 'Improved estimation of S', we take ξ(n) = 2E(Z (due north)). Now we wait for an expression for η(northward) so that (q 3 - q 1)/η(north) as well provides a good estimate of Due south. By (1), we have q ane = μ + σ Z (Q+1) and q 3 = μ + σ Z (3Q+1). Then, q 3 - q 1 = σ(Z (iiiQ+1) - Z (Q+1)). Further, by noting that E(Z (Q+one)) = -East(Z (3Q+i)), we take Due east(q 3 - q 1) = iiσ E(Z (3Q+1)). This suggests that

η ( northward ) = 2 E Z ( 3 Q + 1 ) .

In what follows, we propose a method to compute the value of η(n). By [6], the expected value of Z (threeQ+1) is

E Z ( 3 Q + i ) = ( 4 Q + i ) ! ( Q ) ! ( 3 Q ) ! - z [ Φ ( z ) ] 3 Q [ 1 - Φ ( z ) ] Q ϕ ( z ) dz.

In Table 2, we provide the numerical values of η(n) = twoEast(Z (3Q+1)) for Q ≤ fifty using the statistical software R. When n is big, we suggest to use the formula (8) to approximate η(north). Specifically, noting that Q = (north - 1)/4, we take η(n) ≈ 2Φ -ane((0.75n - 0.125)/(n + 0.25)) for r = iiiQ + 1 with α = 0.375. Then consequently, for the scenario C 2 we estimate the sample standard deviation by

S b - a four Φ - ane n - 0.375 n + 0.25 + q 3 - q 1 4 Φ - i 0.75 n - 0.125 n + 0.25 .

(13)

Table 2 Values of η ( n ) in the formula ( 12 ) and the formula ( xv ) for Q ≤l, where northward =four Q +1

Total size table

We annotation that the formula (xiii) is more concise than the formula (11). The numerical comparison between the ii formulas will be given in the section of simulation study.

Estimating X ̄ and S from C 3

Scenario C three is an alternative manner to report the study other than Scenarios C i and C 2 . It reports the first and 3rd quartiles instead of the minimum and maximum values. I main reason to report C 3 is because the IQR is usually less sensitive to outliers compared to the range. For the new scenario, we notation that Hozo et al.'s method and Bland's method will no longer exist applicable. Specially, if their ideas are followed, we take the post-obit inequalities:

- X ( i ) q i ( i = ane , , Q ) q 1 Ten ( Q + 1 ) q 1 q 1 X ( i ) chiliad ( i = Q + 2 , , ii Q ) m Ten ( 2 Q + 1 ) 1000 one thousand X ( i ) q 3 ( i = 2 Q + 2 , , iii Q ) q 3 X ( iii Q + 1 ) q 3 q iii X ( i ) , ( i = 3 Q + 2 , , north )

where the first Q inequalities are unbounded for the lower limit, and the final Q inequalities are unbounded for the upper limit. At present calculation up all above inequalities and dividing by north, we accept - 10 ̄ . This shows that the approaches based on the inequalities practice not apply to Scenario C iii .

In contrast, the following procedure is commonly adopted in the recent literature including [eleven, 12]: "If the written report provided medians and IQR, we imputed the means and standard deviations as described by Hozo et al. [[3]]. Nosotros calculated the lower and upper ends of the range by multiplying the difference between the median and upper and lower ends of the IQR by ii and adding or subtracting the product from the median, respectively". This procedure, all the same, performs very poorly in our simulations (non shown).

A quantile method for estimating Ten ̄ and S

In this department, we suggest a quantile method for estimating the sample mean and the sample standard departure, respectively. In detail, nosotros outset revisit the estimation method in Scenario C 2 . By (10), nosotros have

X ̄ a + two q 1 + 2 one thousand + ii q 3 + b 8 = a + b 8 + q 1 + m + q iii four .

Now for Scenario C 3 , a and b are non given. Hence, a reasonable solution is to remove a and b from the estimation and keep the 2nd term. By doing so, we have the interpretation course equally X ̄ ( q one + grand + q three ) / C , where C is a abiding. Finally, noting that E(q 1 + m + q three) = iiiμ + σ E(Z (Q+i) + Z 2Q+ane + Z (3Q+ane)) = 3μ, nosotros let C = three and define the estimator of the sample mean as follows:

X ̄ q i + thou + q 3 3 .

(fourteen)

For the sample standard deviation, post-obit the idea in constructing (12) we suggest the post-obit estimation:

S q 3 - q 1 η ( due north ) ,

(15)

where η(n) = 2East(Z (3Q+ane)). As mentioned above that Due east(q 3 - q 1) = 2σ E(Z (3Q+1)) = σ η(n), therefore, the reckoner (15) provides a good estimate for the sample standard deviation. The numerical values of η(n) are given in Tabular array 2 for Q ≤ 50. When north is big, by the approximation Eastward(Z (3Q+one)) ≈ Φ -1((0.75northward - 0.125)/(north + 0.25)), we tin can also estimate the sample standard departure by

S q three - q 1 2 Φ - 1 0.75 north - 0.125 n + 0.25 .

(16)

A similar reckoner for estimating the standard difference from IQR is provided in the Cochrane Handbook [xiii], which is defined every bit

S q three - q 1 1.35 .

(17)

Notation that the reckoner (17) is likewise independent of the sample size n and thus may not exist sufficient for full general use. As nosotros tin see from Tabular array 2, the value of η(northward) in the formula (15) converges to most 1.35 when n is big. Notation also that the denominator in formula (16) converges to 2 Φ -ane(0.75) which is 1.34898 as n tends to infinity. When the sample size is small, our method will provide more accurate estimates than the formula (17) for the standard difference estimation.

Results

Simulation study for C ane

In this section, we conduct simulation studies to compare the performance of Hozo et al.'s method and our new method for estimating the sample standard deviation. Post-obit Hozo et al.'s settings, we consider five different distributions: the normal distribution with hateful μ = 50 and standard deviation σ = 17, the log-normal distribution with location parameter μ = four and scale parameter σ = 0.3, the beta distribution with shape parameters α = 9 and β = 4, the exponential distribution with rate parameter λ = 10, and the Weibull distribution with shape parameter k = 2 and scale parameter λ = 35. The graph of each of these distributions with the specified parameters is provided in Boosted file i. In each simulation, nosotros first randomly sample nobservations and compute the true sample standard deviation using the whole sample. We then utilize the median, the minimum and maximum values of the sample to approximate the sample standard departure past the formulas (6) and (9), respectively. To appraise the accurateness of the ii estimates, we ascertain the relative fault of each method as

relative error of South = the estimated S - the truthful South the truthful Southward .

(18)

With 1000 simulations, we written report the average relative errors in Figure 1 for the normal distribution with the sample size ranging from 5 to 1001, and in Figure ii for the iv non-normal distributions with the sample size ranging from v to 101. For normal data which are near commonly assumed in meta-analysis, our new method provides a nearly unbiased estimate of the true sample standard deviation. Whereas for Hozo et al.'southward method, nosotros exercise observe that the best cutoff value is about n = xv for switching between the estimates ( b - a ) / 12 and (b - a)/4, and is about n = 70 for switching between (b - a)/four and (b - a)/half-dozen. However, its overall performance is not satisfactory by noting that the gauge always fluctuates from -xx% to 20% of the true sample standard deviation. In addition, we note that ξ(27)≈4 from Tabular array 1 and ξ(n)≈6 when Φ -1((n - 0.375)/(n + 0.25)) = three, that is, n = (0.375 + 0.25 Φ(iii))/(1 - Φ(3)) ≈ 463. This coincides with the simulation results in Figure 1 where the method (b - a)/4 crosses the 10-axis between n = 20 and n = xxx, and the method (b - a)/vi crosses the x-axis between n = 400 and n = 500.

Figure 1
figure 1

Relative errors of the sample standard deviation estimation for normal information, where the red lines with solid circles represent Hozo et al.'s method, and the green lines with empty circles stand for the new method.

Full size image

Effigy ii
figure 2

Relative errors of the sample standard difference estimation for non-normal data (log-normal, beta, exponential and Weibull), where the carmine lines with solid circles correspond Hozo et al.'due south method, and the green lines with empty circles represent the new method.

Full size epitome

From Figure 2 with the skewed data, our proposed method (9) makes a slightly biased judge with the relative errors nigh 5% of the true sample standard deviation. Nevertheless, it is still obvious that the new method is much better compared to Hozo et al.'s method. We also note that, for the beta and Weibull distributions, the best cutoff values of n should be larger than lxx for switching betwixt (b-a)/four and (b-a)/6. This again coincides with Tabular array ane in Hozo et al. [iii] where the suggested cutoff value is n = 100 for Beta and n = 110 for Weibull.

Simulation written report for C 2

In this section, nosotros evaluate the performance of the proposed method (13) and compare information technology to Banal'due south method (xi). Post-obit Bland'southward settings, nosotros consider (i) the normal distribution with hateful μ = 5 and standard departure σ = i, and (ii) the log-normal distribution with location parameter μ = five and calibration parameter σ = 0.25, 0.5, and 1, respectively. For simplicity, nosotros consider the sample size being due north = Q + 1, where Q takes values from 1 to 50. As in Department 'Simulation study for C ane

', we assess the accuracy of the two estimates by the relative mistake defined in (18).

In each simulation, we draw a full of n observations randomly from the given distribution and compute the true sample standard deviation of the sample. We then use and just utilise the minimum value, the outset quartile, the median, the third quartile, and the maximum value to approximate the sample standard divergence past the formulas (xi) and (13), respectively. With one thousand simulations, we report the average relative errors in Effigy iii for the 4 specified distributions. From Figure 3, we observe that the new method provides a nigh unbiased gauge of the true sample standard deviation. Even for the very highly skewed log-normal data with σ=1, the relative mistake of the new method is also less than ten% for most sample sizes. On the contrary, Banal's method is less satisfactory. Every bit reported in [10], the formula (11) just works for a small range of sample sizes (In our simulations, the range is nearly from 20 to 40). When the sample size gets larger or the distribution is highly skewed, the sample standard deviations volition be highly overestimated. Additionally, we note that the sample standard deviations will be seriously underestimated if n is very pocket-sized. Overall, it is axiomatic that the new method is meliorate than Bland's method in virtually settings.

Effigy iii
figure 3

Relative errors of the sample standard deviation estimation for normal data and log-normal data, where the red lines with solid circles correspond Bland'south method, and the light-green lines with empty circles correspond the new method.

Full size epitome

Simulation study for C three

In the third simulation study, nosotros comport a comparison report that not but assesses the accuracy of the proposed method under Scenario C 3 , but also addresses a more than realistic question in meta-analysis, "For a clinical trial written report, which summary statistics should be preferred to report, C 1 , C 2 or C 3 ? and why?"

For the sample mean estimation, we consider the formulas (3), (ten), and (14) under three different scenarios, respectively. The accuracy of the mean estimation is as well assessed by the relative error, which is defined in the same way as that for the sample standard deviation estimation. Similarly, for the sample standard difference estimation, nosotros consider the formulas (nine), (13), and (15) under 3 different scenarios, respectively. The distributions we considered are the same as in Section 'Simulation report for C ane

', i.e., the normal, log-normal, beta, exponential and Weibull distributions with the aforementioned parameters as those in previous ii simulation studies.

In each simulation, nosotros first draw a random sample of size n from each distribution. The true sample mean and the truthful sample standard deviation are computed using the whole sample. The summary statistics are as well computed and categorized into Scenarios C one , C 2 and C 3 . We then use the aforementioned formulas to estimate the sample mean and standard divergence, respectively. The sample sizes are n = fourQ + 1, where Q takes values from ane to 50. With 1000 simulations, we report the average relative errors in Figure iv for both X ̄ and S with the normal distribution, in Effigy 5 for the sample mean interpretation with the not-normal distributions, and in Figure 6 for the sample standard deviation estimation with the non-normal distributions.

Figure 4
figure 4

Relative errors of the sample mean and standard deviation estimations for normal data, where the black solid circles represent the method nether scenario C 1 , the red solid triangles represent the method under scenario C two , and the dark-green empty circles represent the method under scenario C 3 .

Full size image

Figure 5
figure 5

Relative errors of the sample mean interpretation for non-normal data (log-normal, beta, exponential and Weibull), where the blackness lines with solid circles represent the method under scenario C ane , the red lines with solid triangles represent the method under scenario C two , and the green lines with empty circles represent the method under scenario C 3 .

Full size image

Figure 6
figure 6

Relative errors of the sample standard deviation interpretation for non-normal data (log-normal, beta, exponential and Weibull), where the blackness lines with solid circles represent the method under scenario C 1 , the red lines with solid triangles represent the method under scenario C 2 , and the green lines with empty circles stand for the method under scenario C 3 .

Full size paradigm

For normal data which meta-analysis would commonly assume, all 3 methods provide a most unbiased estimate of the truthful sample mean. The relative errors in the sample standard divergence estimation are also very modest in most settings (inside 1% in general). Among the three methods, however, we recommend to estimate X ̄ and Due south using the summary statistics in Scenario C 3 . One main reason is considering the first and 3rd quartiles are usually less sensitive to outliers compared to the minimum and maximum values. Consequently, C three produces a more stable interpretation than C i , and also C two that is partially affected by the minimum and maximum values.

For non-normal data from Effigy 5, we note that the mean estimation from C 2 is always meliorate than that from C 1 . That is, if the additional data in the first and third quartiles is available, nosotros should always use such information. On the other hand, the estimation from C 2 may not be consistently better than that from C 3 fifty-fifty though C 2 contains the additional information of minimum and maximum values. The reason is that this additional information may contain extreme values which may not be fully reliable and thus atomic number 82 to worse estimation. Therefore, we need to be cautious when making the selection between C two and C iii . It is too noteworthy that (i) the mean estimation from C three is not sensitive to the sample size, and (2) C 1 and C 3 always pb to reverse estimations (1 underestimates and the other overestimates the true value). While from Figure half dozen, we discover that (i) the standard deviation estimation from C 3 is quite sensitive to the skewness of the data, (ii) C 1 and C 3 would also lead to the contrary estimations except for very small sample sizes, and (iii) C 2 turns out to be a good compromise for estimating the sample standard deviation. Taking both into account, we recommend to report Scenario C 2 in clinical trial studies. However, if nosotros do non have all data in the 5-number summary and have to make a decision between C 1 and C 3 , we recommend C i for modest sample sizes (say northward ≤ 30), and C three for large sample sizes.

Discussion

Researchers ofttimes use the sample mean and standard difference to perform meta-analysis from clinical trials. Yet, sometimes, the reported results may but include the sample size, median, range and/or IQR. To combine these results in meta-analysis, we need to estimate the sample mean and standard departure from them. In this newspaper, nosotros offset show the limitations of the existing works then propose some new estimation methods. Here we summarize all discussed and proposed estimators under unlike scenarios in Table three.

Table 3 Summary table for estimating X ̄ and S nether unlike scenarios

Full size table

We note that the proposed methods are established under the supposition that the information are normally distributed. In meta-analysis, however, the medians and quartiles are ofttimes reported when data practise not follow a normal distribution. A natural question arises: "To which extent it makes sense to employ methods that are based on a normal distribution assumption?" In practise, if the entire sample or a large part of the sample is known, standard methods in statistics can be applied to guess the skewness or even the density of the population. For the current written report, however, the information provided is very express, say for example, only a, m, b and n are given in Scenario 1. Under such situations, it may non be feasible to obtain a reliable approximate for the skewness unless we specify the underlying distribution for the population. Annotation that the underlying distribution is unlikely to be known in practice. Instead, if we arbitrarily choose a distribution (more than likely to be misspecified), and then the estimates from the incorrect model can be fifty-fifty worse than that from the normal distribution assumption. As a compromise, we look that the proposed formulas under the normal distribution assumption are amidst the best we can achieve.

Secondly, nosotros note that even if the means and standard deviations can be satisfyingly estimated from the proposed formulas, it however remains a question to which extent it makes sense to use them in a meta-analysis, if the underlying distribution is very disproportionate and one must presume that they don't represent location and dispersion adequately. Overall, this is a very practical nevertheless challenging question and may warrant more than enquiry. In our future enquiry, we advise to develop some examination statistics (likelihood ratio test, score exam, etc) for pre-testing the hypothesis that the distribution is symmetric (or normal) under the scenarios we considered in this article. The result of the pre-test will so suggest the states whether or not we should nonetheless include the (very) asymmetric data in the meta-analysis. Other proposals that address this issue volition too be considered in our future written report.

Finally, to promote the usability, we have provided an Excel spread sail to include all formulas in Tabular array 3 in Boosted file 2. Specifically, in the Excel spread sheet, our proposed methods for estimating the sample mean and standard difference can be applied by simply inputting the sample size, the median, the minimum and maximum values, and/or the kickoff and third quartiles for the appropriate scenario. Furthermore, for ease of comparison, nosotros accept also included Hozo et al.'southward method and Bland's method in the Excel spread sheet.

Conclusions

In this newspaper, we discuss different approximation methods in the interpretation of the sample mean and standard deviation and propose some new estimation methods to improve the existing literature. Through simulation studies, we demonstrate that the proposed methods profoundly meliorate the existing methods and enrich the literature. Specifically, we betoken out that the widely accepted calculator of standard deviation proposed by Hozo et al. has some serious limitations and is always less satisfactory in practise because the figurer does not fully incorporate the sample size. Every bit we explained in Section 'Estimating X ̄ and South from C 1 ', using (b - a)/vi for n > 70 in Hozo et al.'due south adaptive estimation is untenable because the range b - a tends to be infinity as n approaches infinity if the distribution is not bounded, such equally the normal and log-normal distributions. Our estimator replaces the adaptively selected thresholds ( 12 , 4 , 6 ) with a unified quantity 2Φ -one((due north - 0.375)/(n + 0.25)), which can exist quickly computed and apparently is more than stable and adaptive. In improver, our method removes the not-negative data assumption in Hozo et al.'due south method and and then is more applicable in practise.

Bland's method extended Hozo et al.'due south method by using the boosted information in the IQR. Since extra information is included, it is expected that Bland'southward estimators are superior to those in Hozo et al.'s method. However, the sample size is still not considered in Bland'southward method for the sample standard difference, which once again limits its capability in real-world cases. Our simulation studies show that Bland's reckoner significantly overestimates the sample standard departure when the sample size is large while seriously underestimating it when the sample size is pocket-sized. Again, we incorporate the information of the sample size in the interpretation of standard departure via ii unified quantities, 4Φ -1((n - 0.375)/(north + 0.25)) and 4Φ -ane((0.75n - 0.125)/(north + 0.25)). With some actress simply lilliputian computing costs, our method makes significant improvement over Bland'southward method when the IQR is available.

Moreover, we pay special attention to an overlooked scenario where the minimum and maximum values are not available. Nosotros bear witness that the methodology following the ideas in Hozo et al.'s method and Bland'south method volition lead to unbounded estimators and is not feasible. On the contrary, we extend the ideas of our proposed methods in the other two scenarios and again construct a unproblematic just still valid estimator. After that, we take a step forwards to compare the estimators of the sample hateful and standard deviation under all three scenarios. For simplicity, we take only considered three most usually used scenarios, including C 1 , C 2 and C iii , in the electric current commodity. Our method, however, can be readily generalized to other scenarios, e.g., when only {a,q 1,q 3,b;north} are known or when additional quantile information is given.

References

  1. Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC: A comparison of results of meta-analyses of randomized command trials and recommendations of clinical experts: treatments for myocardial infarction. J Am Med Assoc. 1992, 268: 240-248. 10.1001/jama.1992.03490020088036.

    CAS  Commodity  Google Scholar

  2. Cipriani A, Geddes J: Comparison of systematic and narrative reviews: the example of the atypical antipsychotics. Epidemiol Psichiatr Soc. 2003, 12: 146-153. ten.1017/S1121189X00002918.

    Article  PubMed  Google Scholar

  3. Hozo SP, Djulbegovic B, Hozo I: Estimating the hateful and variance from the median, range, and the size of a sample. BMC Med Res Methodol. 2005, 5: 13-x.1186/1471-2288-5-xiii.

    Article  PubMed  PubMed Central  Google Scholar

  4. Triola M. F: Unproblematic Statistics, 11th Ed. 2009, Addison Wesley

    Google Scholar

  5. Hogg RV, Craig AT: Introduction to Mathematical Statistics. 1995, Maxwell: Macmillan Canada,

    Google Scholar

  6. David HA, Nagaraja HN: Club Statistics, 3rd Ed. 2003, Wiley Series in Probability and Statistics

    Volume  Google Scholar

  7. Blom G: Statistical Estimates and Transformed Beta Variables. 1958, New York: John Wiley and Sons, Inc.

    Google Scholar

  8. Harter HL: Expected values of normal order statistics. Biometrika. 1961, 48: 151-165. 10.1093/biomet/48.1-2.151.

    Commodity  Google Scholar

  9. Cramér H: Mathematical Methods of Statistics. 1999, Princeton University Press

    Google Scholar

  10. Bland G: Estimating hateful and standard deviation from the sample size, three quartiles, minimum, and maximum. International Journal of Statistics in Medical Research, in printing. 2014,

    Google Scholar

  11. Liu T, Li Thousand, Li 50, Korantzopoulos P: Clan between c-reactive poly peptide and recurrence of atrial fibrillation subsequently successful electrical cardioversion: a meta-assay. J Am Coll Cardiol. 2007, 49: 1642-1648. ten.1016/j.jacc.2006.12.042.

    CAS  Article  PubMed  Google Scholar

  12. Zhu A, Ge D, Zhang J, Teng Y, Yuan C, Huang Yard, Adcock IM, Barnes PJ, Yao X: Sputum myeloperoxidase in chronic obstructive pulmonary disease. Eur J Med Res. 2014, 19: 12-10.1186/2047-783X-nineteen-12.

    Commodity  PubMed  PubMed Key  Google Scholar

  13. Higgins JPT, Green South: Cochrane Handbook for Systematic Reviews of Interventions. 2008, Wiley Online Library

    Book  Google Scholar

Pre-publication history

  • The pre-publication history for this paper tin can be accessed here:http://www.biomedcentral.com/1471-2288/14/135/prepub

Download references

Acknowledgements

The authors would like to thank the editor, the associate editor, and two reviewers for their helpful and effective comments that greatly helped improving the final version of the article. Ten. Wan's research was supported by the Hong Kong RGC grant HKBU12202114 and the Hong Kong Baptist University grant FRG2/13-14/005. T.J. Tong'south research was supported by the Hong Kong RGC grant HKBU202711 and the Hong Kong Baptist Academy grants FRG2/xi-12/110, FRG1/13-14/018, and FRG2/13-xiv/062.

Author information

Affiliations

Corresponding author

Correspondence to Tiejun Tong.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

TT, XW, and JL conceived and designed the methods. TT and WW conducted the implementation and experiments. All authors were involved in the manuscript preparation. All authors read and approved the final manuscript.

Xiang Wan, Wenqian Wang contributed equally to this piece of work.

Electronic supplementary material

Authors' original submitted files for images

Rights and permissions

Open Admission This article is licensed under a Creative Commons Attribution 4.0 International License, which permits employ, sharing, adaptation, distribution and reproduction in whatever medium or format, as long as you requite appropriate credit to the original author(s) and the source, provide a link to the Artistic Commons licence, and signal if changes were made.

The images or other third political party material in this commodity are included in the article's Artistic Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article'due south Artistic Commons licence and your intended utilize is not permitted by statutory regulation or exceeds the permitted apply, you volition demand to obtain permission directly from the copyright holder.

To view a re-create of this licence, visit https://creativecommons.org/licenses/past/four.0/.

The Artistic Commons Public Domain Dedication waiver (https://creativecommons.org/publicdomain/goose egg/ane.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the information.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Wan, X., Wang, Due west., Liu, J. et al. Estimating the sample hateful and standard divergence from the sample size, median, range and/or interquartile range. BMC Med Res Methodol 14, 135 (2014). https://doi.org/10.1186/1471-2288-14-135

Download citation

  • Received:

  • Accustomed:

  • Published:

  • DOI : https://doi.org/ten.1186/1471-2288-14-135

Keywords

  • Interquartile range
  • Median
  • Meta-analysis
  • Sample hateful
  • Sample size
  • Standard difference

Source: https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/1471-2288-14-135

Posted by: aguirremardeen1966.blogspot.com

0 Response to "How To Find Iqr With Mean And Standard Deviation"

Post a Comment

Iklan Atas Artikel

Iklan Tengah Artikel 1

Iklan Tengah Artikel 2

Iklan Bawah Artikel