TLDR
- State is a minimal record.It contains just enough of the past to predict future behaviour under future inputs.
- Reachability is structural.A plant is completely controllable when a finite control signal can drive every initial state to the origin.
- Visibility is structural.A plant is completely observable when finite output measurements determine every state coordinate.
- Cancellation hides physics.A reduced transfer function may erase an internal mode that input cannot affect or output cannot expose.
- The two tests are dual.Transpose dynamics, exchange input and output constraints, and reverse time to turn control into observation.
Ask what control requires before choosing a controller
Kalman begins with an ambition modelled on Shannon. Information theory had identified laws of transmission independent of a particular radio or coding device. Control theory, he argues, still understood its fundamentals superficially and too often organised knowledge around methods tied to specific plant descriptions.
The technological setting was changing. Digital computers, sampled control and multivariable plants created problems that the familiar single-loop, frequency-domain toolbox did not answer cleanly. Kalman does not dismiss that applied theory. He asks for a prior layer: intrinsic properties of an unalterable plant and constructive tests that say what kind and how much information a desired form of control needs.
He calls this a “pure theory of control”, while warning that it cannot ignore physical realisability. Unlike a law of nature discovered by inspecting physical objects, a general law about human-made systems is reached by abstract analysis across models. The intended theory resembles mathematics in method, yet remains answerable to whether its mathematical plants and feedback laws can be built.
The paper’s declared scope is narrower than its title. The complete results concern finite-dimensional linear systems, then chiefly stationary, single-input, single-output plants. Both continuous and discrete time appear, with sampling used to translate one into the other. Gaussian random excitation enters the filtering dual. Nonlinear, time-varying and multivariable extensions are discussed, but the clean rank tests and theorems rely on the linear setting.
The constructive emphasis matters. Kalman says the note grew from attempts to understand computation methods already used in control synthesis. Definitions of controllability and observability are not labels pasted onto familiar calculations; they organise algorithms for dead-beat control, quadratic regulation, minimum-time observation and Wiener filtering. A property of the plant becomes a gate on what any controller or observer can accomplish.
Worked example · method versus possibility
An engineer has a powerful optimiser and a detailed cost function. If one internal direction never responds to any available actuator, more optimisation cannot move that coordinate. The right first question is not which solver to run but whether the input geometry makes the target reachable.
Causal probe · replace the controller, keep the plant
Try proportional feedback, model-predictive control and a nonlinear search policy on the same linear plant. If the input matrix leaves one invariant state direction untouched, every policy fails there. This invariance separates a structural limit of the plant from a weakness of one design method.
The present is the smallest sufficient record of the past
The plant is the physical object to be controlled: an automobile, aircraft or chemical reactor in Kalman’s examples. Inputs are physical quantities one can change; outputs are behaviours one can measure. State connects them across time.
Kalman defines state as the smallest collection of numbers that must be specified at an initial time to predict future behaviour under future inputs. It is a minimal record of relevant history, not necessarily a vector of directly readable instrument values. Position and velocity may form a mechanical state; stored charge, concentration or temperature fields can play the same role after an appropriate finite-dimensional model is chosen.
The transition function maps an initial state and later inputs to a later state. It satisfies identity at the initial time and a composition rule: advance to an intermediate time, then advance again, and the result equals a single advance over the whole interval. By causality, later behaviour depends on the past through the current state. Every output must consequently be a function of state.
For the developed theory, state space is an n-dimensional real vector space. Continuous dynamics use a linear differential equation; discrete dynamics use a linear difference equation. Inputs form an m-dimensional vector, outputs a p-dimensional vector, and state-transition and input/output matrices encode their geometry. The paper later simplifies to stationary, single-input, single-output plants and assumes the discrete transition matrix is nonsingular.
This representation differs from a transfer function. An input–output formula records how applied signals appear at measured terminals, often assuming zero initial state. A state model also represents autonomous internal motion and nonzero initial conditions. Two state models can generate the same transfer function while containing different invisible or unreachable coordinates. Minimality therefore becomes a substantive structural question.
Worked example · velocity hides behind position
A cart’s position at noon is not enough to predict its position one second later; current velocity is also required. If position and velocity together determine the future for any applied force, they form a state. Measuring only position gives an output, not the full state.
Causal probe · append a useless coordinate
Add a third state that evolves autonomously but never affects the original dynamics or measured output. The enlarged equations still reproduce the same terminal behaviour, yet the new coordinate is neither needed for prediction of observed outputs nor part of a minimal realisation. A raw state count is not automatically system complexity.
Can the input reach every direction of state?
A state is controllable when some finite-duration control signal transfers it to the origin. A plant is completely controllable when every state has that property. The definition turns an engineering intuition into a coordinate-independent question.
For a stationary discrete-time single-input plant, Kalman builds a sequence of vectors from the input direction and repeated inverse transitions. Complete controllability holds exactly when n such directions are linearly independent. In the now-standard forward-time convention, the equivalent reachability matrix collects B, AB, …, An−1B and asks whether its rank is n. Each column is the state displacement produced by an input applied at a different step.
The rank test has a geometric form. Start with the input direction and close it under the state transition. If the smallest invariant subspace containing that direction is the whole state space, every direction is reachable. If it is smaller, the controller is confined to a subspace no matter how cleverly it varies the signal.
Continuous time receives the analogous condition: input vector d, Fd, …, Fn−1d must be independent. Kalman notes that Pontryagin had used the independence requirement in another context, but the new definition supplies its intuitive control meaning. The test is constructive and finite; one does not need to enumerate every possible waveform.
Controllability is relative to the declared actuators and model. A car may be controllable in planar position with steering and acceleration, but not in vertical position. A failed actuator changes B and can collapse rank without changing the free dynamics A. Numerical near-dependence also matters in practice: exact rank says possible in ideal arithmetic, while a poorly conditioned matrix warns that reaching some directions demands enormous, noise-sensitive input.
Worked example · two commands span a plane
Let B point vertically. One command changes only the second state. If A couples that state into the first before the next command, AB tilts horizontally. When B and AB are not parallel, two scalar commands can reach any point in the two-dimensional state plane.
Causal probe · cut one coupling
Set the off-diagonal link that carries the actuated coordinate into the hidden coordinate to zero. The input magnitude, horizon and optimiser remain unchanged, but B and AB become parallel. Rank falls from two to one and horizontal targets become unreachable.
Minimum time forces feedback
Kalman’s first fundamental theorem states that a completely controllable n-state discrete plant has a unique law transferring every state to the origin in the minimum number, at most n, of sampling periods.
The construction uses a basis made from successive input images and its dual basis. At each step, feedback cancels the coefficient associated with the direction that must disappear first. The state moves from the full controllable subspace into a nested subspace of one lower dimension, then repeats until nothing remains. The proof is short because the controllability definition has already exposed the right geometry.
Feedback is not assumed as a stylistic preference. The command must depend on the present state because the correction needed to remove the appropriate coordinate depends on where the plant actually is. Kalman emphasises that the feedback form is forced by the minimum-time requirement. This is the structural heart beneath sampled-data “dead-beat” response: after finitely many samples, the error is identically zero.
Continuous time creates a warning. If an arbitrary sampling interval is allowed, a controllable continuous plant can be driven to the origin in an arbitrarily short time by shrinking the interval and applying the discrete construction. The implied control signals can become unbounded and physically impossible. Mathematical reachability without input constraints is not a promise of safe, inexpensive or realisable control.
Relax minimum time and other objectives become available. Allow p≥n steps and one can reduce control energy, spread actuator movement or honour bounds. The theorem therefore separates possibility, fastest ideal action and practical design. Controllability opens the door; it does not choose the preferred path through it.
Worked example · two-stage steering
For a two-state controllable plant, solve xtarget=ABu0+Bu1. Independence of B and AB gives a unique pair of commands for any target. Reversing signs reaches the origin from a given state. If actuator magnitude is capped, the same transfer may require more than two stages.
Causal probe · shrink the sampling period
Halve the sampling period while demanding arrival in the same number of samples. Physical time halves, but the commands needed to create the same state change can rise sharply. If a design claims arbitrarily fast control without reporting input amplitude, it is exploiting an omitted constraint.
A clean transfer function can hide an uncontrolled state
Classical algebra often cancels a common pole and zero and calls the reduced transfer function the same system. Kalman shows what is lost: the cancelled internal coordinate can remain in the state model even though the terminal input–output equation no longer displays it.
His example places two identical first-order systems in parallel. The total output makes a common factor cancellable. In state space, however, one combination of the two internal outputs responds to control while an independent combination does not. Replacing two coordinates by their sum deletes the difference coordinate. Control of the visible sum is not control of the full plant.
For stationary single-input, single-output systems, complete controllability corresponds, in engineering language, to the input exciting every natural frequency: no pole can cancel in the transfer function. The same warning applies symmetrically at the output. A mode that reaches no sensor can disappear from the external relation while continuing to evolve internally, perhaps unstably.
Sampling can create a new loss. Distinct continuous-time oscillatory modes can map to the same discrete eigenvalue when their imaginary parts differ by an integer multiple of the sampling frequency. The sampled model then admits cancellation or repeated directions that were separate in continuous time. Kalman gives explicit resonant periods where a previously controllable plant becomes uncontrollable after sampling.
This is not an argument against transfer functions or sampling. It is a demand to audit the realisation and the chosen period. Signal-flow simplification is safe for a specified zero-state input–output calculation but may be unsafe for initial-condition response, internal stability or state regulation. State-space rank tests show what algebraic cancellation hides.
Worked example · the invisible difference mode
Two tanks have identical first-order outflow and receive tied inflow. A sensor reports their sum. The sum responds predictably, but an initial level difference can persist or decay independently and cannot be corrected separately. Cancelling a common factor in the sum transfer function erases that physical imbalance.
Causal probe · excite the initial condition
Compare two realisations with the same reduced transfer function, starting both from zero: their measured responses match. Now initialise only the cancelled mode. One internal trajectory changes while the terminal output may remain zero. Zero-state equivalence does not establish equal internal behaviour.
Existence is tied to the ability to move state
Kalman next uses controllability to ground the deterministic regulator problem. The performance index sums a positive-definite quadratic measure of state along the closed-loop motion, with a positive weighting parameter across samples.
Bellman’s principle of optimality supplies the recursion: whatever first command is chosen, the remaining commands must be optimal for the state that results. Because dynamics are linear and the state cost is quadratic, the finite-horizon value is a positive-definite quadratic form. Iterating the recursion produces a sequence of matrices; the proof shows that controllability bounds this sequence and its monotonic growth converges.
The general theorem says that, with positive-definite state weighting, the infinite-horizon optimal regulator exists for every positive weight if and only if the plant is completely controllable. The optimal law is unique, stationary and linear. Under the stated parameter condition μ>1, the closed loop is asymptotically stable and the value function itself is a Lyapunov function.
The necessity argument is revealing. If an uncontrollable subspace contains an unstable direction, no input can change it and the accumulated positive-definite cost diverges for some initial states. Optimisation cannot rescue a state component outside the input’s reach. The sufficiency argument uses the finite-time controllability law as one feasible policy with finite cost, proving the optimum is bounded above.
Kalman lists extensions: terminal control gives time-varying laws; control-energy cost can be added; several controls and nonstationary systems can be treated; nonquadratic criteria generally yield nonlinear laws and difficult computation. He warns that weakening positive definiteness changes conclusions. Penalising only one state combination can allow unpenalised unstable motion, so an apparently finite optimum need not stabilise the whole plant.
Worked example · a feasible law proves finiteness
If dead-beat feedback drives every state to zero within n steps, only finitely many positive stage costs occur. That law may not minimise the sum, but it gives a finite upper bound. Dynamic programming can then search for a gentler law without confronting infinite cost everywhere.
Causal probe · stop charging for one unstable mode
Replace positive-definite Q by a semidefinite matrix that assigns zero weight to an unstable coordinate. The optimiser may ignore that coordinate and still report finite cost. Inspect total state motion, not merely the declared objective, before interpreting optimality as stability.
Can the output distinguish every direction of state?
Observability is the measurement-side counterpart. Kalman defines a costate: a linear question about state: as observable when its exact value can be determined from output measurements over a finite interval. A plant is completely observable when every costate can be answered.
The language of costates avoids a hidden coordinate choice. A state vector lives in X; a costate is a linear functional in the dual space X*. Coordinate values are evaluations of dual-basis costates. If every costate is observable, every state coordinate in any basis can be recovered. If one costate is not observable, that aspect of the plant’s behaviour cannot be inferred from the measurements.
For a stationary discrete single-output plant, repeated output covectors form a finite test. In standard notation, stack C, CA, …, CAn−1. Complete observability holds exactly when the resulting matrix has rank n. Each row asks how one initial-state direction appears at a different measurement time. A vector in the null space produces zero output across the whole test window and is therefore indistinguishable from zero.
Observability depends on both dynamics and sensor placement. A sensor can read only one state directly, yet coupling may carry every other coordinate into that measured channel over time. Conversely, many samples of the same projection add no new information. More data points do not repair a structurally blind measurement.
The theorem assumes exact linear dynamics and noiseless observation for finite-time reconstruction. In real systems, numerical conditioning governs sensitivity to noise and modelling error. A matrix can have full mathematical rank while one singular value is so small that reconstructing its associated direction amplifies measurement error catastrophically. Exact observability is possibility; practical estimation also needs a scale.
Worked example · infer position from delayed speed
A sensor reads only the second coordinate. If the first coordinate flows into the second under A, y0 reveals x2 and y1 mixes x1 with the known x2. Two independent equations recover both initial coordinates.
Causal probe · duplicate the measurement
Add ten sensors that all measure the same linear combination. The output vector is longer but its row space may remain one-dimensional. Count independent state questions, not instruments or samples, when assessing observability.
A model copy corrects itself from output error
Kalman’s third fundamental theorem constructs the fastest observation scheme for a completely observable discrete plant. A predictor carries an internal copy of the plant, compares predicted and measured output, and feeds the discrepancy back into its state estimate.
The scheme begins with an arbitrary estimate. The free predictor advances that estimate through the same transition as the plant. At each sample, measured output minus predicted output supplies a scalar error. A correction vector maps that error into state space. With coefficients chosen from the observability basis, every costate becomes exact in the minimum number, at most n, of measurements.
The proof mirrors dead-beat control. Instead of driving a physical state through nested reachable subspaces, the observer drives estimation error through nested invisible subspaces. Subtracting predictor dynamics from plant dynamics shows that the error itself obeys a closed linear system. The correction law annihilates one remaining uncertainty coordinate per sample.
Kalman draws plant and predictor side by side. The observer is physically realisable with an analogue or digital computer because a full sampling period is available for the next estimate. This architecture is the ancestor of the modern state observer: model prediction plus innovation feedback. It also connects directly to the recursive filter introduced in Canon 0064, where noise prevents finite exactness and covariance controls the gain.
The paper derives a striking control consequence. If a plant is completely observable but its input is constrained, every state variable can still be reduced to zero in minimum time precisely when the output-based closed loop uses the corresponding feedback law. Observation is not a passive afterthought; it determines when state feedback can be implemented from available measurements.
Worked example · two outputs reconstruct two states
With y0=cx2, recover x2=y0/c. The next free output is y1=c(k2x1+dx2). If c and k2 are nonzero, solve x1=(y1/c−dx2)/k2. The formula is the inverse of the two-row observability map.
Causal probe · perturb one output sample
Add a tiny error to y1. The reconstructed x1 error is divided by ck2. As the coupling or sensor scale approaches zero, exact rank persists until zero but noise amplification explodes. This exposes the gap between observable and well-observed.
Transpose the dynamics, exchange the constraints, reverse time
The parallel proofs are not coincidence. Kalman formalises them with a dual plant in the costate space: replace the transition by its adjoint, interchange input and output constraints, and reverse the direction of time.
Under this transformation, an input vector becomes an output covector and an output covector becomes an input vector. The controllability matrix of one system is the transpose of the observability matrix of its dual, apart from the time convention. Therefore a plant is completely controllable exactly when its dual is completely observable, and conversely. The minimum-time observation problem becomes the minimum-time control problem for the dual.
Kalman then dualises quadratic regulation. A positive semidefinite quadratic form in costate space can be represented through orthogonal state directions. Those directions become independent Gaussian random excitations whose covariance is the quadratic weight. After reversing time, the regulator’s accumulated quadratic cost becomes the mean-square state-estimation error of a randomly driven plant.
The conclusion is the paper’s major bridge: the optimal regulator problem in the dual space is the Wiener filtering problem in the original space. Calculation methods developed for deterministic optimal feedback immediately generate the equations of the optimal linear filter. Stability of the optimal predictor is tied to complete observability of the stochastic process model.
This is not Feldbaum’s “dual control” from Canon 0068. Feldbaum names the two operational roles of an action that both directs and learns. Kalman’s principle is an algebraic correspondence between two systems and two problems. The terms share a word but answer different questions; conflating them would erase both contributions.
Worked example · transpose a reachability test
For (A,B), build 𝒞=[B,AB]. Give the dual system dynamics Aᵀ and output Bᵀ. Its observability matrix is [Bᵀ;BᵀAᵀ]=𝒞ᵀ. Row rank equals column rank, so controllability of the first system and observability of the dual succeed or fail together.
Causal probe · forget to exchange input and output
Transpose A but keep the original B and C in their old roles. Matrix dimensions may still fit in a square example, yet the rank correspondence can fail. Duality is a complete transformation: adjoint, exchanged constraints and time reversal: not a decorative transpose.
A minimal plant is both controllable and observable
Combining the two sides yields Kalman’s main existence result in this setting: the usual regulation problem has the stated solution when the plant is completely controllable and completely observable. Unreachable or unseen coordinates must be separated before the external behaviour can be represented minimally.
If the full state is measured directly, controllability is the decisive gate for state feedback. When control must be built from outputs, observability is also required to recover the relevant state. A realisation that is both completely controllable and completely observable contains no internal direction disconnected from its terminals. Later work would formalise this as a minimal realisation of the transfer behaviour.
Kalman is candid about boundaries. Discrete time and single input/output can be relaxed, though explicit tests become more complicated. Nonlinear systems remain largely open; he hopes at least for topological descriptions. Exact yes/no properties are not enough for engineering scale, leading him to ask whether controllability and observability can become quantitative measures connected to information and achievable control quality.
The published discussion reinforces the caution. L. I. Rozonoer praises the natural concepts and duality but questions calling the account a general theory while nonlinear cases lack a clear apparatus. Kalman agrees that the paper does not pretend to present the completed development; he defends the heading as a programme and points to connections with Pontryagin’s nonlinear results.
The durable lesson is a disciplined separation. State describes internal predictive possibility; controllability asks what interventions can change; observability asks what measurements can distinguish; a particular controller or estimator is constructed only after those gates are checked. None of these ranks establishes autonomous purpose, intelligence in the broad sense or conscious experience. They describe access to modelled state directions under declared inputs and outputs.
Worked example · remove before designing
A four-state realisation has controllability rank three and observability rank three, with only two states both reachable and visible. Reduce it to that two-state intersection for terminal input–output design, while separately auditing the discarded internal modes for stability and physical safety. Algebraic minimality does not authorise ignoring dangerous hidden energy.
Causal probe · rescale the state coordinates
Measure one state in metres instead of millimetres using an invertible coordinate transformation. A, B and C entries change, but controllability and observability ranks must not. If a diagnostic changes its yes/no verdict, it is testing coordinate magnitudes rather than an intrinsic plant property.
Open and close the paths through a two-state plant
The laboratory makes the structural tests visible. Input enters state x₂; coupling k₁ carries it into x₁. Output measures x₂; coupling k₂ carries hidden x₁ back into that measured coordinate. Zero either path and a rank disappears.
The fixed dynamics are A=[[0.8,k₁],[k₂,0.4]], input B=[0,b]ᵀ and output C=[0,c]. Thus det𝒞=−k₁b² and det𝒪=−k₂c². The demonstration reaches target [1,1] from zero in two commands and reconstructs initial state [1,1] from two free outputs whenever the required determinant is nonzero. Four values of each coupling, input scale, sensor scale and coordinate rescaling produce 1,024 exact audited states.
Claims, conditions and audit handles
| Claim | Condition | Audit handle |
|---|---|---|
| State is a minimal predictive record. | The chosen model class and future-input interface are fixed. | Remove or merge coordinates and test whether every future output remains predictable. |
| Full controllability means every state can be driven to zero. | Linear finite-dimensional dynamics and unconstrained finite input. | Rank [B,AB,…] and inspect conditioning and actuator bounds separately. |
| Full observability means every state can be reconstructed. | Known dynamics and declared outputs over a finite exact window. | Rank [C;CA;…] and test noise amplification separately. |
| Cancellation removes a mode. | Only from the reduced terminal relation, not necessarily from physical state. | Excite nonzero initial conditions in the cancelled subspace. |
| Controllability and observability are dual. | Adjoint dynamics, exchanged constraints and reversed time. | Compare 𝒞(A,B) with 𝒪(Aᵀ,Bᵀ)=𝒞ᵀ. |
| Full rank implies a practical design. | Only after scale, noise, uncertainty and constraints are checked. | Report singular values, control effort, estimator sensitivity and safety margin. |
Twelve cards for rebuilding the paper
From learning through action to structural possibility
Canon 0068 reconstructed Feldbaum’s dual control: an action may direct a plant and change what the controller can learn for later decisions. Canon 0069 asks more prior questions. Given fixed input and output channels, which internal directions can action reach and measurement reveal at all? Its duality is algebraic, not Feldbaum’s epistemic–directive dual effect.
Canon 0070 moves to active classification in partially observable Markov decision processes, where sensing actions are chosen to reduce classification uncertainty. The sequence therefore proceeds from structural access, through belief state, to explicit information-seeking policies: first know whether a state is reachable or visible, then decide how evidence should guide action.
What this companion adds
This companion follows the complete 1960 proceedings primary from its Shannon-inspired programme through state, controllability, dead-beat control, quadratic regulation, observability, fastest observation, the Principle of Duality, Wiener filtering and open problems. It preserves the paper’s restricted linear setting and its published discussion rather than presenting later textbook notation as if all of it appeared unchanged in Moscow.
Ten original animated diagrams, ten worked examples and ten causal probes expose the difference between external behaviour and internal realisation, exact rank and numerical conditioning, structural possibility and practical control. The executable laboratory audits 1,024 exact parameter states for determinant/rank equivalence, controllability–observability duality and invariance under coordinate rescaling. The final boundary keeps state access distinct from broad intelligence or consciousness claims.
Primary and comparative sources
- R. E. Kalman, “On the General Theory of Control Systems”, Proceedings of the First International Congress of the International Federation of Automatic Control, Moscow, 481–492 (1960). DOI record.
- Complete proceedings scan of the governing primary, University of Toronto control archive. .
- ScienceDirect, bibliographic record: IFAC Proceedings Volumes 1(1), 491–502 in the later issue pagination. Publisher record.
- M. Raginsky, “The State-Space Revolution in the Study of Complex Systems”, in Foundational Papers in Complexity Science. Open historical introduction.
- R. E. Kalman, “Mathematical Description of Linear Dynamical Systems”, Journal of the Society for Industrial and Applied Mathematics, Series A: Control 1(2), 152–192 (1963). DOI record.
- A. C. Antoulas, E. D. Sontag and Y. Yamamoto, “Controllability and Observability”, Wiley reference article. DOI record.
- R. Hermann and A. J. Krener, “Nonlinear Controllability and Observability”, IEEE Transactions on Automatic Control 22, 728–740 (1977). DOI record.