Unit 3 of 4 · B.Com Sem 2

Unit 3: Correlation & regression analysis

Business Statistics notes · PTU syllabus (BCOMGE 201-18)

3 min read4 topics15 exam questions
On this page
  1. Unit summary
  2. Correlation and its types
  3. Karl Pearson's coefficient of correlation
  4. Spearman's rank correlation
  5. Regression analysis
  6. Key terms
  7. Quick revision
  8. Important questions

Unit summary

Business variables move together — sales with advertising, price with demand. Correlation measures how strongly two variables are related and regression predicts one from the other. This unit covers simple, multiple and partial correlation, linear and non-linear correlation, scatter diagrams, Pearson's correlation coefficient, rank correlation, the principle of least squares, and regression coefficients with their properties.

After this unit you can

  • Identify the types of correlation from a scatter diagram
  • Compute Pearson's coefficient of correlation and Spearman's rank correlation
  • Explain multiple and partial correlation
  • Fit regression lines by the method of least squares and use them for prediction
  • State the properties of regression coefficients and the relation between correlation and regression

PTU syllabus topics

  • Meaning of correlation — simple
  • multiple
  • partial
  • linear and non-linear
  • scatter diagram
  • Pearson's correlation coefficient
  • Rank correlation
  • principle of least squares
  • regression coefficient and its properties
  • relationship between correlation and regression
1

Topic 1

Correlation and its types

Correlation is the statistical measure of the degree and direction of the linear relationship between two variables. It does not prove cause and effect.

ComparisonTypes of correlation
Meaning
Example

Positive

Both variables move in the same direction

Income and expenditure

Negative

Variables move in opposite directions

Price and demand

Zero

No relationship

Shoe size and marks

Simple

Two variables

Advertising and sales

Multiple

One variable with two or more others together

Yield and rainfall plus fertiliser

Partial

Relation of two variables, others held constant

Yield and rainfall, fertiliser fixed

Linear

Constant change — a straight line

Cost and quantity

Non-linear (curvilinear)

Unequal change — a curve

Fertiliser and yield beyond a point

Scatter diagram

GraphPerfect and high positive correlation (r near +1)
YXO

Points cluster tightly along a rising line

GraphHigh negative correlation (r near −1)
YXO

Points cluster along a falling line

GraphNo correlation (r near 0)
YXO

Points are scattered with no pattern

Reading a scatter diagram

Meaning
Rising patternPositive correlation
Falling patternNegative correlation
Tight bandHigh degree of correlation
Wide spreadLow degree
CurveNon-linear relationship
No patternZero correlation

Degree of correlation

Value of r
+1 or −1Perfect positive or negative
0.75 to 0.99Very high
0.50 to 0.74Moderate to high
0.25 to 0.49Low
below 0.25Negligible
0No linear correlation
2

Topic 2

Karl Pearson's coefficient of correlation

Key formulasPearson's coefficient r
  • Covariance form

    r = Cov(x, y) ÷ (σx σy), where Cov(x, y) = Σ(x − x̄)(y − ȳ) ÷ n

  • Raw-score form

    r = [nΣxy − ΣxΣy] ÷ square root of {[nΣx² − (Σx)²][nΣy² − (Σy)²]}

  • Deviation form

    r = Σdxdy ÷ square root of (Σdx² × Σdy²), dx = x − x̄, dy = y − ȳ

  • Range

    −1 ≤ r ≤ +1

  • Coefficient of determination

    r² — share of variation in y explained by x

  • Probable error

    PE = 0.6745 (1 − r²) ÷ √n

Key termsProperties of r
Limits
Between −1 and +1
Independent of change of origin and scale
Adding or multiplying both variables by constants (same sign) leaves r unchanged
Symmetric
r(x, y) = r(y, x)
Geometric mean
r is the GM of the two regression coefficients
Independent variables
r = 0 (but r = 0 does not prove independence)
Only linear
Measures linear association
xyxyx²y²
12214
248416
3515925
44161616
55252525
Σ = 15Σ = 20Σ = 66Σ = 55Σ = 86

Example

n = 5. r = (5 × 66 − 15 × 20) ÷ square root of {(5 × 55 − 15²)(5 × 86 − 20²)} = 30 ÷ square root of (50 × 30) = 30 ÷ 38.73 = +0.775 — high positive correlation.

Exam tip

Steps for r: tabulate x, y, xy, x², y²; take the totals; substitute in the raw-score formula; interpret the sign and size.

3

Topic 3

Spearman's rank correlation

Used when data are ranks or cannot be measured exactly (beauty, honesty) or when the relationship is not linear.

Key formulasSpearman's rank correlation
  • Without ties

    ρ = 1 − [6 Σd²] ÷ [n (n² − 1)], d = difference of ranks

  • With tied ranks

    Add the correction m(m² − 1) ÷ 12 to Σd² for each group of m tied items

  • Range

    −1 to +1

StudentRank in Maths R₁Rank in Stats R₂d = R₁ − R₂d²
A12−11
B2111
C34−11
D4311
E5500
Total04

Example

ρ = 1 − (6 × 4) ÷ [5 × (25 − 1)] = 1 − 24 ÷ 120 = 0.8 — strong agreement between the two rankings.

ProcessRanking with tied values
  1. 1Arrange values and give ranks 1, 2, 3 …
  2. 2Tied items get the average of the ranks they occupy — two values tied at ranks 3 and 4 each get 3.5
  3. 3Compute d and d²
  4. 4Add the correction factor m(m² − 1) ÷ 12 for every tie group
  5. 5Apply the formula
ComparisonPearson vs Spearman
Pearson's r
Spearman's ρ

Data

Measured values

Ranks (or values converted to ranks)

Assumption

Linear relation, roughly normal data

Distribution-free

Sensitive to outliers

Yes

Less

Computation

Longer

Quick for small samples

Multiple and partial correlation

Key formulasMultiple and partial correlation (three variables)
  • Partial correlation

    r₁₂.₃ = (r₁₂ − r₁₃ r₂₃) ÷ square root of [(1 − r₁₃²)(1 − r₂₃²)]

  • Multiple correlation

    R₁.₂₃ = square root of [(r₁₂² + r₁₃² − 2 r₁₂ r₁₃ r₂₃) ÷ (1 − r₂₃²)]

  • Range

    Partial: −1 to +1; multiple: 0 to 1

  • Meaning

    r₁₂.₃ = relation of 1 and 2 with 3 held constant

Example

If r₁₂ = 0.8, r₁₃ = 0.6 and r₂₃ = 0.5: r₁₂.₃ = (0.8 − 0.3) ÷ square root of (0.64 × 0.75) = 0.5 ÷ 0.693 = 0.72.

4

Topic 4

Regression analysis

Regression is the statistical technique of estimating the average value of one variable from the known value of another. The line of best fit is obtained by the principle of least squares: it minimises the sum of the squares of the vertical differences between actual and estimated y.

GraphRegression line fitted by least squares
Y (dependent)X (independent)Oy = a + bx

The dashed vertical gaps are the errors; the line is placed so that the sum of their squares is least

Key formulasRegression lines
  • Regression of y on x

    y − ȳ = byx (x − x̄), with byx = r σy ÷ σx = Cov(x, y) ÷ σx²

  • Regression of x on y

    x − x̄ = bxy (y − ȳ), with bxy = r σx ÷ σy

  • Normal equations (y = a + bx)

    Σy = na + bΣx ; Σxy = aΣx + bΣx²

  • Direct formula

    b = [nΣxy − ΣxΣy] ÷ [nΣx² − (Σx)²] ; a = ȳ − b x̄

Example

From the earlier data: byx = 30 ÷ 50 = 0.6 and bxy = 30 ÷ 30 = 1. Regression of y on x: y − 4 = 0.6 (x − 3), i.e. y = 2.2 + 0.6x. For x = 6, y = 5.8.

Key termsProperties of regression coefficients
Geometric mean
r = ± square root of (byx × bxy)
Same sign
byx, bxy and r always have the same sign
Not both greater than 1
If one coefficient exceeds 1, the other is less than 1
Arithmetic mean
(byx + bxy) ÷ 2 ≥ r
Origin and scale
Regression coefficients are independent of change of origin but not of scale
Intersection
The two regression lines meet at (x̄, ȳ)
Angle
Lines coincide if r = ±1 and are perpendicular if r = 0
ComparisonCorrelation vs regression
Correlation
Regression

Purpose

Strength and direction of the relationship

Estimating one variable from the other

Variables

Symmetric — no dependent variable

Dependent and independent

Result

Single coefficient r

Equation (line)

Limits

−1 to +1

Coefficients can be any size

Cause and effect

Not implied

Assumed direction

GraphTwo regression lines intersect at the means
YXO(x̄, ȳ)y on xx on y

The smaller the angle between the lines, the higher the correlation

ProcessUsing regression for prediction
  1. 1Draw a scatter diagram to check the relationship is linear
  2. 2Compute x̄, ȳ, byx and bxy
  3. 3Write the regression equation
  4. 4Substitute the known x to estimate y
  5. 5Predict only within the observed range of x

Key terms

Correlation
Degree and direction of linear relationship between two variables
Scatter diagram
Plot of paired values showing the pattern of relationship
Pearson's r
Covariance divided by the product of the standard deviations
Rank correlation
Correlation computed on ranks
Partial correlation
Correlation of two variables with others held constant
Regression
Estimating the average value of one variable from another
Least squares
Fitting a line by minimising the sum of squared errors
Regression coefficient
Slope of a regression line (byx or bxy)

Quick revision

  • r lies between −1 and +1 and is independent of change of origin and scale.
  • r = [nΣxy − ΣxΣy] ÷ √{[nΣx² − (Σx)²][nΣy² − (Σy)²]}.
  • Spearman ρ = 1 − 6Σd² ÷ n(n² − 1).
  • byx = r σy/σx; bxy = r σx/σy; r² = byx × bxy; lines meet at (x̄, ȳ).
  • Correlation shows association, not causation; regression gives the prediction equation.

Important exam questions

Practice questions written to the PTU exam pattern for this unit's syllabus: short answers (Section A style) and long answers (Sections B and C style).

Short-answer questions

  1. Q1.Define correlation. Name its types.
  2. Q2.What does a scatter diagram show?
  3. Q3.State the limits and two properties of Pearson's r.
  4. Q4.Write Spearman's rank correlation formula.
  5. Q5.Differentiate between simple, multiple and partial correlation.
  6. Q6.State the principle of least squares.
  7. Q7.State three properties of regression coefficients.
  8. Q8.Differentiate between correlation and regression.
  9. Q9.If byx = 0.8 and bxy = 0.45, find r.

Long-answer questions

  1. Q1.Explain the types of correlation with scatter diagrams.
  2. Q2.Calculate Pearson's coefficient of correlation for the given data and interpret it.
  3. Q3.Calculate the rank correlation coefficient, including a case with tied ranks.
  4. Q4.Explain multiple and partial correlation with formulas.
  5. Q5.Derive the two regression lines and state the properties of regression coefficients.
  6. Q6.Fit a regression line of y on x by least squares and estimate y for a given x.

Stuck on this unit?

Message SBS on WhatsApp for help with Business Statistics, or to ask about studying B.Com at Synetic.

WhatsApp us