Two series can appear related because each retains its own history. Persistence makes consecutive observations similar and reduces the new information contributed by each observation. This experiment connects that memory to spurious regression: an apparently persuasive fit between independently generated processes.
From mean reversion to a unit root
A first-order autoregressive process follows:
We fix and . For , a shock decays at rate and variance converges to . Negative produces alternating signs. Because the initial value is fixed, the process has a transient rather than starting in its stationary distribution.
At , it becomes a random walk. Shocks never dissipate:
Variance increases linearly, not exponentially. A unit root is nonstationary; “explosive” is usually reserved for , outside this experiment’s range.
- Var(X₂₅₀ | X₀ = 0)
- —
- Long-run variance
- —
- Trajectory seed
- —
Moving ρ keeps the same innovations, isolating persistence. A new trajectory changes the seed. The vertical scale stays at least −35…35 for comparison and expands if needed.
Independent walks, misleading regression
- R²
- —
- Durbin–Watson (DW)
- —
- β̂₁
- —
- Walks seed
- —
R² > DW is a warning heuristic, not a formal test. Independent draws do not always satisfy it. Samples are never filtered to force the result; seeds make the displayed draws reproducible.
Simulated observations
| t | AR(1) | Xₜ | Yₜ |
|---|
When a fit misleads
The second plot generates two independent walks and fits . Accumulated shocks can create coincident trends, an apparent slope and high without a causal relationship or shared mechanism.
Residuals retain their time order when computing Durbin–Watson:
Highly persistent residuals tend to produce a small DW. The comparison , associated with the Granger–Newbold discussion, is a warning heuristic here. It is not a test with a specified significance level, need not occur in every draw and cannot validate a regression when absent.
Empirical warning. Investigate stationarity, deterministic trends and possible cointegration before interpreting a levels regression. Differencing may help for some processes, but changes the question and does not replace diagnosis. Seeds change reproducibly: samples are not searched or filtered to guarantee an impressive correlation.
References: BYU–Idaho, white noise and random walks and statsmodels, Durbin–Watson definition.