Correlation Analysis: Pearson, Spearman & Significance

The scatter plot let you see how tightly two variables track. Correlation turns that impression into a single number — and a correlation matrix gives you every pairwise number in your dataset at once.

In the last lesson you learned to read the strength of a relationship by eye. A correlation coefficient makes that judgment exact. It's a single number, written r, that always lands between −1 and +1. The sign tells you the direction — positive means they rise together, negative means one falls as the other rises — and the magnitude tells you the strength. An r near ±1 means the points fall almost perfectly on a line; an r near 0 means there's essentially no linear relationship at all.

A whole matrix at once

The real efficiency comes from doing this for every pair of numeric columns simultaneously. Stratum's Correlation analysis produces a correlation matrix: a grid where every row and column is a variable, and each cell holds the r between that pair. The diagonal is always 1 — every variable correlates perfectly with itself — and the matrix is symmetric, so you really only need to read one triangle.

A Pearson correlation matrix for the housing numeric columns
Every pairwise correlation in one grid — the diagonal is always 1.

Pearson, Spearman & Kendall

The Method picker chooses the coefficient. The default is Pearson's, which measures linear association — it's at its best when the relationship is a straight line. But a relationship can be strong and not straight, and Pearson will understate it. Spearman's coefficient fixes this by working on the ranks of the values rather than the values themselves. That makes it measure any monotonic relationship — one that consistently moves the same direction even if it bends — and, as a bonus, it's far more resistant to outliers, since a single extreme value can only ever be the highest or lowest rank. The picker also offers Kendall's tau, another rank-based measure that's especially robust in small samples.

The Spearman correlation option selected
Spearman works on ranks — better for curved relationships and resistant to outliers.

A practical habit: if two methods disagree sharply for a pair, that's a signal. It usually means either curvature or an outlier is at work, and it's your cue to go back to the scatter plot and look.

Is it real? p-values and confidence intervals

An observed correlation could be a genuine pattern, or it could be noise that happened to line up in this particular sample. The p-value addresses that: it estimates how likely you'd see a correlation this strong if the true relationship were actually zero. A small p-value (conventionally below 0.05) says the correlation is unlikely to be a fluke. By default the matrix is a plain grid of numbers; turn on Highlight p-value and Stratum colors only the statistically significant cells — blue for positive, red for negative, deeper for a smaller p — leaving non-significant cells and the diagonal blank, so the relationships worth trusting stand out at a glance.

The correlation matrix highlighted by p-value significance
Highlight p-value colors only the significant cells — blue positive, red negative, deeper for a smaller p.
How precise is that r? A coefficient is a point estimate from one sample — the true correlation could be a bit higher or lower. Turn on Show CI and Stratum appends a confidence interval to every cell, computed with the Fisher z-transform. A wide interval means the estimate is shaky (often a small sample); a tight one means the relationship is pinned down. Reading the interval, not just the single number, keeps you honest about how much the data actually supports.

A word on missing data — and on causation

Real datasets have gaps. Stratum handles each pair on its own — every correlation is computed from the rows where both of its two variables are present (the matrix footer labels this "listwise"). That keeps as much data as possible for each cell, though it does mean different cells can rest on slightly different row counts.

And the warning that can never be repeated too often: correlation is not causation. A strong r tells you two variables move together. It says nothing about whether one causes the other, whether the arrow runs the other way, or whether some third variable drives them both. Correlation is where investigation starts, not where it ends.

The fastest way to act on the matrix is to drill in. With at least two columns selected in Parameters, right-click a strong cell and choose Drill Down to Scatter; Stratum opens the underlying scatter plot, so you can confirm with your own eyes that the number reflects a real, sensible pattern.

A scatter plot for one strongly correlated pair of variables
Drill from a cell to its scatter plot to confirm the relationship is real.

Follow along

Dataset
housing_market.csv
You'll use
The numeric columns — SqFt, ListPrice, PricePerSqFt, Age_years, DaysOnMarket, LotSize_sqft, Bedrooms, Bathrooms — in a Pearson/Spearman matrix with significance highlighting
Up next
Lesson 13 — The Summary Report

You've now measured relationships across the whole dataset. Next we step back to a single variable at a time and master the report that summarizes it completely — mean, spread, shape, and all.