Canon 0065 · covariance becomes a flow

When uncertainty flows continuously

R. E. Kalman and R. S. Bucy turn continuous observation into an innovation-driven dynamical system, while a nonlinear Riccati equation continuously decides how much the signal should count.

Canon 0065 · covariance becomes a flow

When uncertainty flows continuously

Rajesh Ranjan Mahapatra

R. E. Kalman and R. S. Bucy turn continuous observation into an innovation-driven dynamical system, while a nonlinear Riccati equation continuously decides how much the signal should count.

© 2026 Rajesh Ranjan Mahapatra. 25 min read

When uncertainty flows continuouslyAll AI Research Library

TLDR

Five things to retain
  1. The filter is a dynamical system.It runs a copy of the message model and feeds measurement innovation back through a time-varying gain.
  2. Covariance obeys its own law.A continuous matrix Riccati equation balances dynamics, process noise and information gained from observation.
  3. The gain follows uncertainty.Once the variance equation is solved, the optimal linear filter coefficients require no separate optimisation.
  4. Steady state needs structure.Observability, controllability and bounded coefficients support convergence and filter stability.
  5. Adaptation is not identification.Time-varying parameters fit the same ideal form only when environmental changes are already known.
01 · the missing continuum

Between samples, uncertainty does not stand still

The 1960 paper made discrete estimation recursive. The 1961 paper asks what happens when a message and its observations evolve continuously, so that both the estimate and the error covariance must obey differential equations.

Kalman and Bucy position the work against the Wiener–Kolmogorov tradition without claiming an empty field. They credit nonstationary time-domain work by Shinbrot, Steeg, Pugachev and Parzen; Follin’s time-varying gain and error-variance relations; Hanson’s optimality proof; Bucy’s wider derivation; and Kalman’s combination of state transition with Hilbert-space projection. Their central conclusion converged despite different routes: instead of attacking a Wiener–Hopf integral equation directly, solve a nonlinear covariance differential equation, then obtain the filter from it.

Continuous time is not just the discrete update performed very quickly. The observed signal contains a white-noise component represented by covariance intensity and a Dirac delta. The measurement arrives as an infinitesimal information stream. The filter’s state derivative is driven by an innovation signal; the covariance changes continuously according to a Riccati flow. A discrete jump equation and a continuous differential equation can approximate one another under carefully chosen limits, but they are not interchangeable strings of symbols.

The paper promises a unified route across multivariate, stationary and nonstationary cases, finite and infinite observation intervals. It separates description from mathematics, gives rigorous derivations within its formal conventions, explores analytic Riccati solutions through Hamiltonian equations, and studies when a steady-state covariance exists and attracts other solutions. That scope is much larger than attaching Bucy’s name to a continuous-time gain formula.

Worked example · a sampled gauge versus a continuous trace

A gauge read once per second yields discrete corrections: predict for one second, then jump when the reading arrives. A continuously monitored voltage produces a trace whose noise is specified per unit time. Modelling the latter as an infinite list of independent measurements without rescaling variance would create infinite information. The Kalman–Bucy formulation instead uses noise intensity R and a differential covariance law.

Causal probe · halve the sampling interval

Take a discrete sensor model and halve its interval. If measurement variance and process variance are left unchanged per sample, the physical information and disturbance rates double. The limiting filter therefore changes for an artefactual reason. Scale discrete covariances from continuous intensities before taking a limit; only then should trajectories approach a consistent continuous-time flow.

Discrete estimation ticks are contrasted with continuous covariance flowThe upper lane shows separated prediction and correction blocks at sampling ticks. The lower lane shows an uninterrupted state and covariance stream driven by observation innovation.FROM TICKS TO FLOW1960 · discretepredictcorrectpredictcorrectpredictcorrect1961 · continuousestimate x̂(t|t)covariance P(t) evolves at every instant
Figure 1. Continuous-time filtering replaces alternating sample updates with coupled differential flows for estimate and covariance.Source scope: Kalman and Bucy 1961, Introduction and Summary of Results.
02 · the contract

Three assumptions make the estimation problem definite

The paper states its statistical contract before presenting the filter. The assumptions are not decoration: each excludes a different ambiguity in a continuous observation problem.

Assumption A1 supplies the message model dx/dt=F(t)x+G(t)u(t), possibly time varying, driven by zero-mean white noise u with covariance intensity Q(t). The observation is z(t)=H(t)x(t)+v(t), where v is independent zero-mean white measurement noise with intensity R(t). The process and observation noises are mutually uncorrelated. A sufficiently accurate linear model is basic; the filter does not infer it merely by observing z.

Assumption A2 makes R(t) positive definite. Physically, no observation component is exact. Algebraically, R⁻¹ exists in the gain K=PH′R⁻¹. The authors say additive white noise is unnecessary for sampled processes and anticipate removing the restriction in continuous time by other means, but their presented theory uses it. Sending R to zero inside the displayed formula without treating a noiseless constraint separately leaves the theorem’s domain.

The initial process is determined in one of two ways. A3 constructs a steady-state message from excitation extending to the infinite past and needs a uniformly asymptotically stable model. A3′ instead begins measurement at a finite time t₀ with known covariance of x(t₀). The authors prefer A3′ because it avoids demanding stable message dynamics and permits cases where the unconditional message variance grows indefinitely. Theorem 1 uses A1, A2 and A3′.

The optimisation target is equally important. The derivation minimises mean-square estimation error among linear operations on the observation history; it is built from means, covariances and orthogonality, not from a claim that every physical disturbance has a Gaussian density. With Gaussian processes the same estimate also has the familiar conditional-mean interpretation, but Gaussianity is not the reason the linear least-squares equations close. This distinction matters when translating the paper into software. A numerical package may emit the same gain for Gaussian and non-Gaussian noises that share Q and R, yet their tail risks and complete posterior distributions can differ. The covariance P certifies the declared second-order criterion; it does not by itself certify distributional calibration, immunity to outliers or correctness of the state model.

dx/dt = F(t)x(t) + G(t)u(t) z(t) = H(t)x(t) + v(t) cov[u(t),u(τ)] = Q(t)δ(t−τ) cov[v(t),v(τ)] = R(t)δ(t−τ) cov[u(t),v(τ)] = 0

Worked example · unstable message, usable filter

Let dx/dt=ax+u with a positive. The uncontrolled message variance may grow, so an infinite-past stationary construction is unavailable. A3′ still defines a finite-time problem: start at t₀ with a known covariance, observe through non-zero H and integrate the filter forward. Instability of the message does not by itself make finite-horizon estimation meaningless.

Causal probe · make one channel exact

Reduce one eigenvalue of R towards zero while leaving H fixed. The corresponding gain direction becomes arbitrarily strong and the paper’s inverse becomes ill-conditioned; at zero the positive-definite assumption fails. A robust formulation must separate that exact constraint or transform the model. Silently using a numerical pseudo-inverse changes the stated problem.

Three assumption gates lead to the continuous-time filtering theoremA message model gate, a noisy observation gate and an initial covariance gate feed the theorem. Red side paths show exact observation, unknown model and missing initial law outside the stated result.THE MODEL CONTRACTA1linear messagewhite process noiseA2R(t) positiveno exact channelA3′finite t₀known initial P₀Theorem 1relations I–V solve estimationunknown modelsingular Runspecified start
Figure 2. The main theorem begins only after dynamics, noise intensities and an initial covariance are supplied.Source scope: Kalman and Bucy 1961, Section 4, assumptions A1, A2 and A3′.
03 · canonical filter

Run the model, measure its error, feed the error back

The optimal filter has a strikingly reusable architecture: a copy of the message dynamics plus an innovation feedback channel. Only the gain changes with the uncertainty.

The filtered estimate obeys d x̂(t|t)/dt=F(t)x̂(t|t)+K(t)ẑ(t|t), where ẑ=z−H x̂ is the innovation or observed residual. The filter first predicts what the sensor should report from its internal state, subtracts that prediction from the actual observed signal, and feeds the mismatch through K. The same structure holds when F, G, H, Q and R vary with time.

This is relation I in the paper’s five-equation summary. It says the optimal filter is itself a linear feedback dynamical system. Copying the message model supplies the open-loop evolution. Closing the innovation path corrects directions seen by H. The feedback interpretation matters: the estimate does not simply average sensor values, and the correction is not attached after the dynamics. It continuously changes the state trajectory that generates the next predicted observation.

The filter starts at zero in the paper’s centred formulation under A3′, with the initial uncertainty carried by P₀. A non-zero known mean can be handled by centring. For extrapolation to a future time t₁≥t, relation V applies the state-transition matrix Φ(t₁,t) to the current filtered estimate. The authors explicitly say no similarly simple formula is then known for interpolation to an earlier target.

Worked example · a biased first guess

A known initial mean of five is not a contradiction of the paper’s zero initial filter state. Subtract the known mean from the physical state and observation model, filter the centred zero-mean process, then add the deterministic mean trajectory back. If the mean is unknown and treated as zero without adding uncertainty or a state component, the early estimate is biased by an unacknowledged modelling choice.

Causal probe · cut the innovation wire

Set K(t)=0 while leaving the message model and data unchanged. The estimator becomes a pure open-loop copy: measurements no longer affect x̂, although the physical process remains observable. If a claimed filter still tracks sensor corrections after this intervention, some unreported pathway is using observations.

The canonical Kalman-Bucy filter is a model copy with innovation feedbackAn observed signal and a predicted observation enter a subtractor. The innovation passes through the gain and joins a copy of the message dynamics to update the estimated state.COPY THE MODEL · CLOSE THE INNOVATION LOOPobservedz(t)+−gainK(t)+model copyF(t)estimatex̂(t|t)H(t)predicted z
Figure 3. Relation I makes the filter a feedback system: predicted observation is subtracted, and only innovation drives correction.Source scope: Kalman and Bucy 1961, relation I and Fig. 9.
04 · error dynamics

The estimation error inherits the model and both noises

Subtracting filter from message exposes the mechanism that covariance must summarise: process excitation pushes error in, measurement noise enters through the gain, and feedback tries to remove what the sensor can reveal.

Define x̃(t|t)=x(t)−x̂(t|t). Relation II gives d x̃/dt=F x̃+G u−K[v+H x̃]. The deterministic part is (F−KH)x̃. Process noise enters through G; observation noise enters with −K. Increasing gain can suppress a visible state error faster, but it also injects more measurement noise. The optimal gain is therefore a covariance-weighted compromise, not “as large as possible”.

The covariance P(t)=cov[x̃,x̃] records the second-order size and orientation of this error. Differentiate P using the error equation and white-noise covariance intensities. Terms F P+P F′ transport and stretch uncertainty. G Q G′ adds process uncertainty. The measurement correction contributes −P H′R⁻¹H P after the optimal K is substituted. The result is relation IV, the continuous matrix Riccati equation.

Because the negative information term is quadratic in P, covariance evolution is nonlinear even though the state and observation equations are linear. Two initial covariances do not generally average into the solution from their average. The gain K=P H′R⁻¹ inherits that time variation. This is the paper’s organising insight: compute P, and the remaining filter coefficients follow.

x̃(t|t) = x(t) − x̂(t|t) d x̃/dt = F x̃ + G u − K[v + H x̃] P(t) = cov[x̃(t|t),x̃(t|t)] K(t) = P(t)H′(t)R⁻¹(t)

Worked example · gain has two effects

In a scalar model with H=1, double K. The deterministic error decay rate becomes more negative by K, so an existing error is corrected faster. But the observation-noise term −Kv doubles in amplitude and quadruples its covariance contribution. The optimum balances these changes using P/R; choosing gain from tracking speed alone ignores half the error equation.

Causal probe · remove process excitation only

Set Q to zero while preserving F, H, R and the initial covariance. The filter still begins uncertain and observations still reduce that uncertainty, but no new unobserved disturbance replenishes it. In an observable constant scalar case P can approach zero rather than a positive noise-balanced equilibrium. If a simulation retains the old positive floor, it has failed to remove the Q term.

Process noise, measurement noise and corrective feedback shape estimation errorA central error state receives process excitation through G and measurement noise through negative K. A visible-error feedback branch through H and K suppresses the state while both noises enlarge covariance.WHAT MOVES THE ERROR?process noiseG u+error dynamics(F−KH)x̃estimation errorx̃(t|t)visible errorH x̃measurement noise−K vgain suppresses visible error and injects sensor noise
Figure 4. Relation II exposes the trade-off from which the optimal gain and covariance equation are derived.Source scope: Kalman and Bucy 1961, relation II, equations (22)–(23) and Fig. 10.
05 · five relations

One covariance solution specifies the whole filter

The paper’s descriptive summary is unusually operational. Five relations form a dependency chain from covariance flow to gain, filter trajectory and future prediction.

Relation IV is the computational centre: dP/dt=FP+PF′−PH′R⁻¹HP+GQG′. Given P(t₀)=P₀, Theorem 1 states that a unique non-negative covariance solution exists for all later time under A1, A2 and A3′. Relation III converts it immediately into K=PH′R⁻¹. Relation I then runs the filter; relation II characterises the error; relation V propagates an estimate to a future target through Φ.

The ordering prevents a common circular explanation. Gain is not tuned first and then used to discover covariance. The covariance implied by model, noise intensities and observations’ geometry determines the gain that minimises the declared error. Nor is a single stationary gain assumed. Time-varying parameters or an unsettled initial covariance produce a time-varying K.

The covariance equation contains n(n+1)/2 distinct scalar first-order equations because P is symmetric. That can still be demanding, but it replaces an expanding observation record or a Wiener–Hopf integral equation with fixed-dimensional state. The authors distinguish a mathematically expressed formula from a computation that can actually accept numbers; their conclusion treats practical numerical organisation as part of solving the problem.

Relation V also fixes the boundary between filtering and prediction. The filtered state x̂(t|t) uses observations available through the present time. To predict a later state t₁, the estimate is carried forward by the homogeneous transition matrix Φ(t₁,t), because future process noise has zero mean and no future observation has yet arrived. The predicted mean therefore advances deterministically, while its prediction-error covariance must also account for process excitation accumulated between t and t₁. Quoting only the state formula can conceal that widening uncertainty. A forecast is not a future filtered estimate: when a new observation arrives, relation I opens the innovation channel again and corrects the trajectory.

Worked example · calculate in the dependency order

For scalar F=0, G=H=1, Q=4 and R=1, P′=4−P². At P=1, covariance grows and K=P rises; at P=3, covariance falls and K declines. The positive equilibrium is P=2, hence K=2. Choosing K=2 is justified only after solving the Riccati balance, not because two is a plausible correction speed.

Causal probe · change only sensor geometry

Rotate H in a multivariate system while preserving R, Q and the eigenvalues of P₀. The negative term PH′R⁻¹HP now removes uncertainty in different directions, changing off-diagonal covariance and gain. A component-wise implementation that responds only to diagonal variances will miss the intervention even though the observation geometry changed.

Five fundamental relations form a directed dependency graphThe variance equation feeds the gain, which feeds both filter and error dynamics. The filtered estimate feeds future prediction. Model and noise assumptions enter the variance equation first.THE FIVE-EQUATION MACHINEmodel + noiseF, G, H, Q, R, P₀IV · variance equationP′ = FP+PF′−PH′R⁻¹HP+GQG′III · gainK = PH′R⁻¹I · optimal filterx̂′ = Fx̂+KẑII · error dynamicsx̃′ = Fx̃+Gu−K(v+Hx̃)V · predictionx̂(t₁|t)=Φ(t₁,t)x̂(t|t)
Figure 5. Relations I–V are not a flat formula list: covariance determines gain; gain determines the filter and error system; filtered state supports prediction.Source scope: Kalman and Bucy 1961, Sections 2 and 7.
06 · executable laboratory

Watch the scalar Riccati equation find its balance

Choose dynamics, process intensity, observation strength, observation-noise intensity, initial covariance and elapsed time. The laboratory integrates the covariance flow and compares it with the exact constant-coefficient solution.

exact P(T)waiting
RK4 P(T)waiting
equilibrium P∞waiting
gain K(T)waiting
Interactive scalar covariance flowA curve shows covariance moving from its initial value towards the positive Riccati equilibrium. A dashed horizontal line marks equilibrium and a moving point marks final time.P′ = 2aP + q − (h²/r)P²waiting
Exact checks across 1,024 Riccati flows
  • waiting
  • waiting
  • waiting

The scalar constant-coefficient equation is P′=2aP+q−cP² with c=h²/r. It has one positive equilibrium P∞=(a+√(a²+cq))/c and one non-positive root. Covariance below P∞ rises; covariance above it falls. The exact solution follows from the ratio between distances to the two roots. The numerical trace uses fourth-order Runge–Kutta with enough steps to make the difference visible as an audit rather than hidden by the plotting routine.

This laboratory isolates covariance, the quantity that determines gain K=Ph/r. It does not simulate literal white-noise sample paths or claim that a smooth slider is a stochastic observation. The point is to expose the nonlinear balance among dynamics, process excitation and measurement information.

Worked example · an unstable state can have finite filter covariance

Set a=0.5, q=1, h=1 and r=1. Without observation, covariance obeys P′=P+1 and grows. With observation, the negative P² term dominates for large P. The positive equilibrium is (0.5+√1.25)≈1.618. Complete observation continually removes enough uncertainty to balance unstable growth and process noise.

Causal probe · weaken only the observation

Reduce h while holding a, q, r and P₀ fixed. The coefficient c=h²/r shrinks, the negative information term weakens, equilibrium covariance rises and gain geometry changes. If the trajectory is unaffected, the implementation has omitted H from either the Riccati term or the gain.

Four terms compete in the continuous covariance derivativeTwo transport arrows labelled FP and PF transpose, a process-noise inflow and a quadratic observation-information outflow meet at a covariance reservoir. The net level moves towards equilibrium.THE RICCATI BALANCEcovariance P(t)symmetric · non-negativedetermines Kdynamic transportFP + PF′process inflowGQG′observation information−PH′R⁻¹HPP′ is their signed sum
Figure 6. Linear transport and process-noise inflow compete with a quadratic information outflow, producing nonlinear covariance motion.Source scope: Kalman and Bucy 1961, relation IV and equations (23)–(24).
07 · long memory

Infinite past becomes an equilibrium question

A finite starting covariance yields a forward solution. An indefinitely long observation record requires more: the limit as the start retreats to the infinite past must exist.

Theorem 1 handles finite t₀. For steady-state estimation, Theorem 3 studies the limit of the covariance solution that began from perfect knowledge P₀=0 as t₀ tends to minus infinity. The limit exists if either the message model is uniformly asymptotically stable or the model is completely observable in the stated sense. Complete observability uses an information matrix accumulated over a past interval and requires it to be positive definite.

The paper connects that matrix to Fisher information for a special estimation problem and invokes the Cramér–Rao inequality. In a constant model, observability reduces to a rank condition involving H′,F′H′,…,(F′)ⁿ⁻¹H′. The important idea is directional: every state direction must leave enough trace in observations over some interval. Finite unconditional message variance is sufficient through stability, but informative observation can support estimation even when the uncontrolled message variance does not settle.

When matrices are constant, the limiting covariance is constant and therefore an equilibrium of the Riccati equation. Theorem 5 says the stationary Wiener problem can be solved by setting the Riccati right-hand side to zero and choosing the non-negative solution, provided the conditions of Theorems 3 and 4 hold. Merely finding an algebraic root is not enough when those conditions fail; one of the paper’s examples is included to demonstrate that warning.

Worked example · two algebraic roots

For P′=q−cP² with positive q and c, algebra gives roots ±√(q/c). Covariance cannot use the negative root. The positive root attracts all non-negative initial values: below it P rises, above it P falls. The non-negative criterion and dynamical direction select the physically meaningful stationary solution together.

Causal probe · hide one unstable direction

Add an unstable state component that neither H nor the observed component’s dynamics can reveal. Its observability information remains singular. The covariance in that direction grows without bound even if every visible direction reaches equilibrium. A single bounded diagonal entry cannot certify a finite multivariate steady state.

Finite-start covariance trajectories converge towards a steady-state pathSeveral covariance curves begin at different times and levels, then approach a shared moving equilibrium. A side panel contrasts a hidden unstable direction whose variance diverges.WHEN THE PAST BECOMES INFINITElimiting covariance P̄(t)different finite starts lose their influencehidden unstabledirectionvariance growsobservability decides
Figure 7. Infinite-past estimation is a limit theorem, not an instruction to initialise a filter with an arbitrary stationary covariance.Source scope: Kalman and Bucy 1961, Theorems 3 and 5 and Remarks (g)–(i).
08 · stability

Optimality does not automatically make a stable filter

The paper says this plainly, then gives uniform observability, controllability and boundedness conditions under which the filter is stable and covariance forgets its initial value.

An optimal filter can still have unbounded response to bounded input. The authors ask for uniformly complete observability and uniformly complete controllability of the message model, positive lower and upper bounds on Q and R, and a bound on F. Under these conditions, Theorem 4 states that the optimal filter is uniformly asymptotically stable and every covariance solution starting from a symmetric non-negative P₀ converges to the limiting P̄(t).

Controllability here belongs to the process-excitation geometry through the dual model; observability belongs to the sensor geometry. Their uniform versions require information over bounded windows rather than at a single instant. The conditions are invariant under the filtering–regulation duality. This is how results about deterministic control support results about stochastic estimation without erasing the difference between their physical roles.

The convergence statement makes the variance equation a stable computational method in the authors’ theoretical sense: initial covariance errors decay under the conditions. They expect relative insensitivity to round-off and point to Lyapunov methods for convergence-rate bounds. Modern finite-precision practice still checks symmetry and non-negativity because discretisation can violate structures preserved by the exact differential equation.

These are windowed conditions, not snapshots. A sensor may reveal no information about one state at a particular instant and still make the system uniformly observable because the dynamics rotate that state into view over a bounded interval. Conversely, a sequence of individually non-zero measurements can remain collectively blind to a direction. The corresponding observability and controllability matrices are therefore integrated over time windows and required to have uniform positive bounds. This prevents a proof from depending on an ever longer wait for usable information. It also explains why inspecting H(t) at a single time, or counting sensors, is not a substitute for testing the geometry of the complete time-varying model.

Worked example · initial uncertainty is forgotten

Run the same observable scalar model from P₀=0.1 and P₀=100. The early gains differ drastically. If Theorem 4’s conditions hold, both covariance trajectories converge to the same limiting path; after sufficient time, the effect of the initial guess becomes negligible. This does not mean all model errors are forgotten: only the initial covariance under the fixed correct model.

Causal probe · preserve observability, remove excitation

Let Q lose positive lower boundedness in one direction while H remains informative. Theorem 4’s stated hypothesis no longer applies even though estimation may still behave well in a special case. Reporting the observed convergence as if it proved the full theorem reverses logic: a sufficient condition can fail without forcing failure, but the guarantee has been withdrawn.

Uniform observability and controllability support filter stability and covariance convergenceFour condition cards feed a theorem gate. Two outputs show a stable filter and covariance trajectories converging. A warning states that optimality alone bypasses neither condition.THEOREM 4 · A GUARANTEE WITH FOUR GATESuniform completeobservabilityuniform completecontrollabilityQ, R boundedabove and belowF boundedover timetheorem gateall conditions visiblefilter is uniformlyasymptotically stableevery P₀≥0 convergesto the limiting covarianceoptimality alone is not a stability theorem
Figure 8. The paper’s central stability result is conditional and separates optimality from dynamical robustness.Source scope: Kalman and Bucy 1961, Theorem 4 and Remarks (j)–(l).
09 · analytic lift

A nonlinear Riccati flow hides inside a linear Hamiltonian system

Theorem 2 represents the covariance solution by lifting it into a larger linear canonical system, evolving blocks, then taking a matrix fraction.

The authors introduce a quadratic Hamiltonian and its canonical differential equations for paired vectors. The enlarged system is linear even though the covariance equation is nonlinear. Partition its state-transition matrix into blocks. A matrix fractional expression built from those blocks and P₀ recovers P(t), provided the denominator block is invertible. This is the continuous analogue of turning a nonlinear ratio into linear numerator-and-denominator dynamics.

The representation clarifies theory and duality, but the paper refuses to oversell it. When coefficients vary with time, computing the Hamiltonian transition matrix can be as difficult as solving the original Riccati equation. What has been established is an equivalence of analytic difficulty with a linear variable-coefficient system, not a universal closed elementary formula.

The lift also connects estimation to the calculus of variations, where Riccati equations and canonical Hamiltonian systems already occur. Under duality, covariance for filtering corresponds to the quadratic performance matrix for regulation. The shared linear lift explains part of that formal resemblance while leaving observation noise and control cost in their distinct physical places.

Worked example · scalar fraction from two roots

The scalar Riccati equation P′=2aP+q−cP² can be solved by a ratio of distances to its two equilibrium roots. Each numerator and denominator component evolves exponentially in a two-dimensional linear system; their quotient produces the nonlinear P trajectory. The laboratory uses that exact fractional form to audit numerical integration.

Causal probe · make coefficients time varying

Replace constant a with a seasonal a(t). The algebraic equilibrium formula ceases to describe the full path, yet the Hamiltonian lift remains a linear system with time-varying coefficients. If a solver continues to return the constant-root expression, it has mistaken a representation theorem for coefficient constancy.

A nonlinear covariance path is recovered from a larger linear Hamiltonian flowThe covariance and initial condition enter a lifting gate, two coupled linear canonical states evolve, and a matrix fraction projects them back to the nonlinear covariance.NONLINEAR BELOW · LINEAR ABOVERiccati stateP(t₀)=P₀liftcanonical state xlinear differential flowcanonical state wlinear differential flowmatrix fraction of transition blocksreturns P(t)
Figure 9. Theorem 2 trades a nonlinear covariance equation for a higher-dimensional linear Hamiltonian evolution plus a matrix fraction.Source scope: Kalman and Bucy 1961, equations (26)–(29) and Section 10.
10 · applications and limits

An ideal adaptive form is not an adaptive estimator

The paper ends by distinguishing what changes when the environment changes from the harder question of how those changes become known.

Section 11 uses examples to duplicate, simplify or extend earlier filtering results. Scalar cases expose stationary and nonstationary variance behaviour. Paired regulation diagrams demonstrate duality. Periodic coefficients bring Floquet theory into the covariance problem. A second-order case shows that closed expressions and limiting behaviour depend sharply on parameter conditions. The examples are analytic stress tests of the theory, not evidence that one fixed filter fits every signal.

Section 12 calls a system adaptive when it changes parameters in response to measured changes in its environment. In the ideal filter, environment changes appear as time dependence in F, G, H, Q and R. If those changes were detected instantaneously and exactly, only parameter values would change; the form of relations I–IV would remain. That supplies a benchmark against which an actual adaptive filter can be compared. It does not identify the parameters, detect regime changes or quantify delay in doing so.

The conclusion separates theoretical from computational work. Theory asks for general form, existence, physical realisability, stability and characterisation by quantities such as signal-to-noise ratio or information rate. Computation asks whether numbers can actually be substituted at moderate system order. The authors call the variance equation both practically useful and theoretically clean, while retaining open problems: non-white noise in a convenient continuous canonical form, Lyapunov study of variance equations, and deeper links to variations and information theory.

Today’s audit adds discretisation, conditioning and model criticism. Integrate P with a structure-preserving method when possible. Check innovations for temporal correlation and scale. Compare declared covariance with realised error on held-out trajectories. Report how parameter estimates were obtained. A filter may be mathematically optimal under A1–A3′ and poorly calibrated in the world because those premises fail.

Worked example · delayed adaptation

A sensor’s noise intensity doubles at noon. An oracle that instantly replaces R follows the paper’s ideal time-varying form. A practical system first has to detect the change from residuals, distinguish it from a process disturbance, estimate its size and update R. During that delay its gain is wrong. Calling the original equations “adaptive” does not make the detection problem disappear.

Causal probe · preserve residual size, add serial structure

Construct two innovation sequences with the same mean and variance; randomly permute one so it is white while the other remains strongly autocorrelated. A scalar error summary sees no difference, but the correlation reveals that the latter still contains predictable information. The orthogonal-innovation premise therefore requires temporal diagnostics, not just a small root-mean-square residual.

Known time variation passes through the ideal filter while unknown adaptation stays outsideAn environment changes five model matrices. An oracle detection gate lets those known values update the same filter structure. A red boundary separates parameter identification, delay, misspecification and cognitive claims.THE IDEAL ADAPTIVE BENCHMARKenvironment changesF, G, H, Q, Rdetected exactlywithout delaysame filterstructureNOT SUPPLIED BY THE IDEAL FORMchange-pointdetectionparameteridentificationrobustness towrong modelsnon-whitenoiserecursive estimation also does not implyself-directed agency, understanding or consciousness
Figure 10. Time-varying parameters preserve the ideal architecture only after their values are known; adaptation’s identification problem remains outside it.Source scope: Kalman and Bucy 1961, Sections 12–13; lower cognitive boundary is an explicit scope clarification.
Verification ledger

Claims, conditions and practical checks

ClaimConditionAudit handle
Relations I–V solve the finite-start optimal linear estimation problem.A1, A2 and A3′; specified P₀ and model matrices.Check initial covariance, dimensions, independence and R positive definiteness.
The gain is K=PH′R⁻¹.P solves the corresponding variance equation; R is invertible.Substitute into error covariance derivative and verify the negative information term.
Covariance remains a valid error covariance.Exact Riccati flow from symmetric non-negative P₀ under theorem assumptions.Monitor symmetry and eigenvalues; compare numeric and exact small cases.
A steady-state covariance exists.Theorem 3’s stability or complete-observability route.Evaluate the information matrix or constant-system rank condition.
Filter stability and covariance convergence follow.All uniform observability, controllability and boundedness hypotheses of Theorem 4.Report which gate is established rather than citing optimality alone.
An algebraic Riccati root solves the stationary Wiener problem.Constant matrices plus Theorems 3–4; select the non-negative solution.Residual of algebraic equation and convergence from multiple P₀ values.
Memory studio

Twelve cards for rebuilding the paper

Continuous riverEstimate and covariance change between every pair of clock ticks.
A1 modelLinear, possibly time-varying dynamics are driven by white process noise.
A2 sensorPositive-definite R means every observed channel contains noise.
A3′ startFinite t₀ plus known P₀ avoids assuming a stationary message.
Model copyThe filter runs F and closes an innovation feedback loop.
Error wireGain suppresses visible error and injects measurement noise.
Gain keyK=PH′R⁻¹: solve covariance before claiming the weight.
Riccati balanceTransport plus process noise minus observation information.
Infinite pastSteady state is a covariance limit, not an arbitrary initial choice.
Four gatesUniform observation, excitation and bounds support stability.
Hamiltonian liftA larger linear flow projects back to nonlinear covariance.
Adaptive boundaryKnown time variation changes parameters; discovering it is another problem.
Place in the canon

From sampled correction to continuous receding uncertainty

Canon 0064 introduced Kalman’s discrete state-space estimation: a new measurement corrects a predicted state, and a covariance recursion determines the correction. Canon 0065 carries the programme into continuous time. The innovation becomes a continuous feedback signal, the covariance becomes a matrix differential equation, and the discrete algebraic update becomes a Riccati flow. The paper also supplies the stability and steady-state theory that its predecessor explicitly left open.

Canon 0066 turns from estimation to receding-horizon action: García, Prett and Morari’s 1989 survey of model predictive control. That shift keeps a family resemblance: model, prediction, new data, repeated computation: while changing the objective from inferring an unobserved state to choosing control moves under constraints. The estimation–regulation duality in this paper is therefore a bridge, not an excuse to collapse inference and action.

Publication brief

What this companion adds

This companion reconstructs the 1961 paper around its five fundamental relations and theorem conditions. It distinguishes continuous covariance intensity from discrete sample variance; makes A1, A2 and A3′ visible; traces the innovation-feedback architecture; derives the signed terms of the Riccati flow; separates finite-start, infinite-past and stationary problems; and presents the Hamiltonian representation as an equivalence of analytic difficulty rather than a magical closed formula.

Ten original animated diagrams replace reproduced journal figures. The executable scalar laboratory compares a fourth-order numerical solution with the exact constant-coefficient Riccati trajectory across 1,024 parameter states. Its scope is deliberately covariance, not simulated white-noise paths. The evidence boundary retains the paper’s optimal-linear and white-noise assumptions, its sufficient stability conditions, its idealised treatment of known time variation and its open problems. Nothing in continuous recursive estimation establishes understanding, autonomous purpose or consciousness.

References

Primary and comparative sources

  1. R. E. Kalman and R. S. Bucy, “New Results in Linear Filtering and Prediction Theory”, Journal of Basic Engineering 83(1), 95–108 (1961). DOI record.
  2. Complete primary PDF hosted by Rutgers University. Fourteen-page scan.
  3. CiNii Research, bibliographic record and ASME publisher-PDF linkage. Record.
  4. R. E. Kalman, “A New Approach to Linear Filtering and Prediction Problems”, Journal of Basic Engineering 82(1), 35–45 (1960). DOI record.
  5. R. E. Kalman, “Contributions to the Theory of Optimal Control”, Boletín de la Sociedad Matemática Mexicana 5, 102–119 (1960). RAND record.
  6. G. Welch and G. Bishop, “An Introduction to the Kalman Filter”, UNC Chapel Hill, TR 95-041, revised 2006. Accessible tutorial mirror.