Insight Editions · No. 248
The Road to Reality
A Complete Guide to the Laws of the Universe
Roger Penrose
Penrose’s attempt to give the reader the real mathematics of physics, from numbers and manifolds to relativity, quantum theory, strings and twistors, and his verdict on where physics must go.
A study guide to The Road to Reality by Roger Penrose. Shared free for personal reading; not for sale and not endorsed by the authors or publishers. Please read and buy the original.
Physics is written in mathematics, and the honest road to reality runs through it. Penrose builds the whole toolkit, then argues that quantum theory is incomplete and that gravity must fix it.
From Pythagoras to twistors: numbers, calculus, manifolds, groups, bundles, infinity; relativity, quantum theory, the standard model, QFT, cosmology; strings, loops and Penrose's own programme.
1 in 1010123 (specialness of the Big Bang); τ ≈ ħ/EG (gravitational collapse time); ∞∞9 vs ∞∞3 (functional freedom); ~19 free parameters in the standard model.
Readers who want the real mathematics of modern physics, and a sharp, contrarian guide to where fundamental theory stands.
The Book on One Page
The Road to Reality is a 1,100-page attempt to give a lay reader the actual mathematics of physics, not analogies for it. Penrose spends the first half building the tools and the second half testing every major theory against them. His verdict: the mathematics works astonishingly well, but the two pillars of physics do not fit, and the fix will need gravity to change quantum mechanics.
The frame. Penrose begins with three worlds (the Platonic-mathematical, the physical and the mental) and three mysteries linking them: why a tiny fragment of mathematics governs physics so precisely, why a tiny fragment of physics produces minds, and why minds can grasp mathematical truth. Every later chapter is a case study in the first mystery, and the last chapters return to the other two.
The mathematical road (Chapters 1 to 16). From the irrationality of √2 and the consistency of hyperbolic geometry he climbs to real and complex numbers, then shows why the complex numbers are "magical": one derivative implies infinitely many, ∮dz/z = 2πi drives contour integration, and Riemann surfaces were the first manifolds. Fourier analysis becomes a splitting into positive and negative frequency, the step that later makes a field quantum. Then come quaternions and spinors (objects that need 4π to return to themselves), n-manifolds, forms with d² = 0 and the general Stokes theorem, groups and Lie algebras, connections and curvature, fibre bundles whose curvature is a force field, and finally Cantor's ladder of infinities, Turing machines and Gödel.
The physical road (Chapters 17 to 26). Spacetime sheds structure step by step (Aristotle → Galileo → Newton–Cartan → Minkowski → Einstein) until gravity is curvature read as tidal distortion. Maxwell's field becomes a gauge connection; Einstein's equation G = 8πGT is derived from Newton's 4πGM volume law. Lagrangians and Hamiltonians compress mechanics into one function on phase space, and the quantum substitution p → −iħ∂/∂x turns that machinery into Schrödinger's equation. Quantum theory then runs on two incompatible procedures, smooth U and abrupt R, and entanglement, spin geometry, Dirac's electron, the standard model and QFT are all built in that light.
The cosmological puzzle (Chapters 27 and 28). The Second Law hides the most precise number in physics: the Big Bang occupied one part in 1010123 of available phase space, because its gravitational degrees of freedom were unexcited. Penrose argues that inflation, anthropic reasoning and the no-boundary proposal cannot explain this, and states the Weyl curvature hypothesis instead.
The measurement problem (Chapters 29 and 30). Penrose sorts quantum interpretations into six camps and finds that none gives a scale where the quantum gives way to the classical. His own answer is gravitational objective reduction: a superposition of two mass distributions decays in about τ ≈ ħ/EG, which is testable.
The roads ahead (Chapters 31 to 34). Strings get careful exposition and a firm objection (excess functional freedom in extra dimensions); loop quantum gravity gets praise for spin networks and quantised area but no answer on dynamics; twistor theory makes the light ray primary and the point derived. The final verdict: we are much further from a final theory than fashion suggests, general relativity is the century's greatest achievement, and the next revolution will involve gravity, time asymmetry and the measurement problem together.
| Ch | Title | One-line payload |
|---|---|---|
| Pref. | Preface | Equations stay in; expect bigger revolutions than the 20th century's |
| Prol. | Prologue | Am-tep to Amphos: from appeasing gods to seeking laws |
| 1 | The roots of science | Three worlds, three mysteries; mathematical truth is objective |
| 2 | An ancient theorem and a modern question | Pythagoras needs the parallel postulate; hyperbolic geometry is consistent |
| 3 | Kinds of number in the physical world | Reals from Eudoxos to Dedekind; integers count charge |
| 4 | Magical complex numbers | i² = −1 gives every root and explains power-series convergence |
| 5 | Geometry of logarithms, powers, and roots | eiθ = cos θ + i sin θ; the 2πi ambiguity seeds analysis |
| 6 | Real-number calculus | C∞ is not enough; analyticity makes an "honest" function |
| 7 | Complex-number calculus | One derivative gives all; Cauchy's formula and analytic continuation |
| 8 | Riemann surfaces and complex mappings | Functions choose their domains; conformal maps; Riemann sphere |
| 9 | Fourier decomposition and hyperfunctions | Positive/negative frequency splitting; hyperfunctions as jumps |
| 10 | Surfaces | Vector fields, 1-forms, Cauchy–Riemann on real 2-surfaces |
| 11 | Hypercomplex numbers | Quaternions, Clifford and Grassmann algebras; spinors need 4π |
| 12 | Manifolds of n dimensions | Forms, d² = 0, ∫dφ = ∮φ; tensors and diagrams |
| 13 | Symmetry groups | Groups to Lie algebras; exact symmetry underlies gauge forces |
| 14 | Calculus on manifolds | Connections, parallel transport, curvature, torsion, geodesics |
| 15 | Fibre bundles and gauge connections | Force fields are curvature of bundle connections |
| 16 | The ladder of infinity | Cantor's diagonal, ℵ's, Turing, Gödel |
| 17 | Spacetime | Four spacetimes; gravity as curvature, seen as tides |
| 18 | Minkowskian geometry | Sign flip gives twin effect, hyperbolic velocities, E = mc² |
| 19 | The classical fields of Maxwell and Einstein | dF = 0; Einstein's equation from Newton's 4πGM |
| 20 | Lagrangians and Hamiltonians | Phase space, symplectic form, Liouville, Noether |
| 21 | The quantum particle | p → −iħ∇; Schrödinger; uncertainty; ψ as reality |
| 22 | Quantum algebra, geometry, and spin | U vs R; Hilbert space; Majorana stars |
| 23 | The entangled quantum world | Hardy and Stapp; bosons/fermions; quanglement |
| 24 | Dirac's electron and antiparticles | Clifford square root; spin, moment, positron |
| 25 | The standard model of particle physics | Zig-zag electron, chirality, electroweak, QCD; "not the ultimate answer" |
| 26 | Quantum field theory | Fock space, vacua, Feynman graphs, renormalisation |
| 27 | The Big Bang and its thermodynamic legacy | Second Law needs a Big Bang special to 1 in 1010123 |
| 28 | Speculative theories of the early universe | Inflation and anthropics fail the test; Weyl curvature hypothesis |
| 29 | The measurement paradox | Six ontologies; none supplies a scale |
| 30 | Gravity's role in quantum state reduction | Objective reduction, τ ≈ ħ/EG, the mirror experiment |
| 31 | Supersymmetry, supra-dimensionality, and strings | Deep mathematics; excess functional freedom |
| 32 | Einstein's narrower path; loop variables | Ashtekar, loops, spin networks, quantised area |
| 33 | More radical perspectives; twistor theory | Light ray primary; sheaf cohomology; googly problem |
| 34 | Where lies the road to reality? | Fashion, beauty, refutability; gravity will reform quantum theory |
| Epil. | Epilogue | Antea at the window: the next frontier |
Each chapter opens with its payload in the lede, then follows Penrose's own section order. Worked examples, thought experiments and short Python snippets (with their real output) make the mathematics concrete. 2026 UPDATE boxes record what physics and mathematics have learned since 2004; CRITICAL LENS boxes flag disputed claims and errors, never silently corrected.
Why a Physics Book Must Carry Real Mathematics
Penrose sets out to convey the 2,500-year search for the principles that govern the universe, refusing to strip out the equations because the understanding itself lives in the mathematics. He also warns that he will take a more sober view than the "optimists" who think physics is nearly finished, and that he expects changes of direction greater than those of the 20th century.
Penrose opens with a deliberate provocation: the book is full of formulae, despite the publishing folklore that each equation halves the readership. His judgment is that the principles behind the physical world cannot be conveyed without genuine mathematical concepts, so he would rather lose readers than lose truth. He describes himself as an "incurable optimist" about conveying understanding, and suspects that many people who say they cannot handle fractions have been put off by the "stern face" of a parent or teacher rather than by any real incapacity.
The fraction problem: what is 3/8?
The preface turns on a small story. A friend of Penrose's mother, a retired ballet dancer whose father was a Fellow of the Royal Society, told him she had never "got the hang of cancelling". Penrose, young and glib, tried to explain it and failed. On reflection he decided she may have been seeing a real difficulty that practised mathematicians stop noticing: the question of how mathematical entities get their existence and how they relate to physical reality.
At about age 11, his teacher asked the class what a fraction such as 3/8 actually is. Pieces of pie were rejected as imprecise physical approximations. "Something with a 3 at the top and an 8 at the bottom" was taken seriously, which surprised him. In hindsight the teacher was heading for the equivalence class.
- Representation. A fraction is specified by an ordered pair of whole numbers (a, b), b ≠ 0.
- The problem. 6/16 = 3/8 as numbers, but the pair (6, 16) ≠ (3, 8).
- The fix. Declare (a×n, b×n) ~ (a, b) for any non-zero whole n. Cancelling is built into the definition.
- The definition. The fraction 3/8 is the infinite collection {(3,8), (−3,−8), (6,16), (−6,−16), (9,24), …}, with rules for adding and multiplying such collections and for identifying whole numbers as special fractions.
Penrose's verdict is double-edged. The equivalence-class device is "very powerful as a pure-mathematical tool for establishing consistency and mathematical existence", but it yields "top-heavy-looking entities" that hardly convey what 3/8 is. His own way of thinking: 3/8 is an entity which, added to itself 8 times, gives 3. The "infinite collection of pairs" is one way of certifying consistency, not what the fraction is; the fraction has a Platonic existence of its own. The magic is that fractions work even though nothing in our direct experience is exactly quantified by them, unlike natural numbers, which precisely count things.
The equivalence-class idea is not a schoolroom curiosity. It underlies Einstein's general relativity and the gauge theories of particle physics, which is why Penrose devotes the first 16 chapters entirely to mathematics before reaching physics proper.
Four ways to read this book
| Reader | How to use the book |
|---|---|
| Formula-averse | Skip all formulae and read the words, the way young Penrose read chess magazines for the characters without following the notation. Skip chapters freely; use the cross-references. |
| Formula-tolerant | Read the formulae but take the exercise claims on trust; no loss of continuity. |
| Skill-builder | Work the exercises, graded by three icons: very straightforward, needs a bit of thought, not to be undertaken lightly. Solutions were posted at an Oxford website. |
| Expert | Skip the exercises; read for Penrose's often heterodox perspective on supersymmetry, inflation, the Big Bang, black holes, string/M-theory, loop variables, twistors and quantum foundations. |
The book is, he says, really about the relation between mathematics and physics. Mathematical beauty drove the great 20th-century successes, Dirac's equation, quantum mechanics and general relativity, but in each case observation was the final arbiter. Many modern proposals for fundamental physics have no experimental data or even prospect of it, so the question is whether mathematical desiderata alone can guide us. He flags his contentious opinions as such and offers the book as an honest introduction usable in classes.
The shape of the road
Penrose's map of the book, by chapter blocks, shows how heavily the mathematics is front-loaded:
| Chapters | Block | What it builds |
|---|---|---|
| 1-16 | Mathematics | Proof and Platonism, numbers from ℕ to ℂ, calculus, Riemann surfaces, Fourier and hyperfunctions, manifolds, symmetry groups, bundles, infinity and logic |
| 17-20 | Classical physics | Spacetime, Minkowski geometry, Maxwell and Einstein fields, Lagrangians and Hamiltonians |
| 21-26 | Quantum theory | The quantum particle, spin, entanglement, Dirac's electron, the standard model, quantum field theory |
| 27-28 | Cosmology | The Big Bang, the Second Law, the special initial state, inflation and alternatives |
| 29-30 | Foundations | The measurement paradox and gravity's role in state reduction |
| 31-33 | Quantum gravity | Supersymmetry and strings, loop variables, twistor theory |
| 34 | Verdict | Where the road to reality may lie |
The first block is not a detour. Each later physics chapter leans on a specific piece of it: complex numbers for quantum amplitudes, manifolds and bundles for relativity and gauge fields, positive frequency for particles, hyperfunctions and sheaf cohomology for twistors.
Penrose's "sober view" was itself a minority position in 2004, aimed squarely at string theory and inflation. Two decades on, the absence of supersymmetry at the LHC and the continuing lack of testable string predictions make his caution look prescient to many physicists, but inflation remains the mainstream account of the early universe, so the preface's scepticism should be read as one expert's bet, not consensus.
Am-tep, Amphos and the Search for Why
A parable in two scenes, three and a half millennia apart, traces how humans moved from appeasing angry gods to looking for precise universal laws, and ends at the door of Pythagoras.
Am-tep, chief craftsman to a Priest-King on a Bronze Age island (the setting matches Minoan Crete and the Thera/Santorini eruption), wakes to a red column of fire rising from the northern sea, a spreading parasol cloud, earthquake rumblings, a blast wave that smashes his pots, and a tsunami that wrecks the harbour. His first thought is that the Bull-God was offended by his design on a sacrificial cup. The priests prepare human sacrifice; an earthquake collapses the temple roof, entombing priests and victims "in mid-ritual" for over 3,500 years (an allusion to the excavated sanctuary at Anemospilia).
Years later, sailing away with his family, Am-tep notices that the stars and the Moon have not moved one iota despite the catastrophe. If the heavens, far greater than the Daemon, are indifferent to it, why should the Daemon care about patterns on pots or rituals? The question "why?" survives him, unanswered.
A thousand and more years later, his descendant Amphos, forty generations into the family goldsmith trade, studies plants, insects and crystals. Looking at the constellations he sees that the stars look like randomly scattered seeds, not a god's design. His leap: do not seek meaning in particular arrangements; seek a deeper universal order in the way things behave. Seeds land at random, yet each grows by the same precise inner laws. Order requires precision in the laws, and precision in our ways of thinking. Hearing of a sage who taught that truth comes from number and geometry, not myth, Amphos sails to Croton, joins a brotherhood of 571 wise men and 28 wise women, and meets Pythagoras.
The prologue encodes the book's first move: separate contingent arrangements (initial conditions, where stars happen to be) from universal dynamical laws (how anything behaves). That split between laws and initial conditions returns in Penrose's cosmology chapters, where he argues the initial state of the universe itself demands explanation.
The Roots of Science
Science began when the Greeks learned to separate the true from the merely supposed, first in mathematics, through proof. Penrose then states his framework for the whole book: three worlds (Platonic-mathematical, physical, mental) linked by three deep mysteries, with mathematical "existence" understood as objectivity of truth.
1.1 From whims of gods to mathematical regularity
Early humans explained nature through beings with human drives (pride, anger, love, revenge), so the only lever was appeasement. Gradually, regularities asserted themselves: the Sun's motion and the day, its position against the stars and the seasons, the Moon's phases fixed by its geometry relative to the Sun, the tides tracking the Moon, and finally even the planets' apparent motions. If the heavens were ruled by gods, the gods themselves seemed bound by exact mathematical laws. The real heavenly influences became tangled with astrology for centuries.
Earthly regularities were noticed separately: everything nearby falls the same way (gravity); matter changes form but not quantity (conservation of mass); rigid bodies keep shape, giving rigid motion and a precise 3-dimensional Euclidean geometry whose straight lines coincide with light rays. Over-enthusiasm produced the Greek pairing of Platonic solids with elements.
1.2 Mathematical truth and proof
Before nature could be understood reliably, the Greeks had to learn how to tell true from false within mathematics. Thales of Miletus (c.625–547 BC) may have introduced proof; the Pythagoreans (Pythagoras of Samos, c.572–497 BC) used it to establish non-obvious results. Pythagoras is credited with noticing that beautiful harmonies correspond to simple ratios of string lengths, giving the Pythagorean scale, and with the theorem linking arithmetic to the geometry of space. The brotherhood at Croton was sworn to secrecy; at least one leaker reportedly died by drowning.
- Proof. An impeccable argument by pure logical reasoning from previously established assertions or from axioms taken as self-evident.
- Theorem. An assertion so established. It holds as true today as when proved: the timelessness of mathematics.
- Catch for geometry. Number theorems are unambiguous; geometrical theorems are true of Euclidean geometry, which is only one geometry among many and not exactly the geometry of physical space (special and general relativity do better).
Penrose's note on scales gives a concrete example of ratios: the pure diatonic scale has frequencies in ratios 24 : 27 : 30 : 32 : 36 : 40 : 45 : 48. A modern piano uses equal temperament, white-note frequencies 1 : α² : α⁴ : α⁵ : α⁷ : α⁹ : α¹¹ : α¹² with α = 21/12 = 1.05946…, a compromise between Pythagorean purity and easy key changes.
Plato (Athens, c.429–347 BC) clarified what geometric truth refers to: not marks in sand or carved marble but idealized entities in a separate world of mathematical forms. Physical squares and spheres approximate these ideals; the true ones live elsewhere.
1.3 Is Plato's world real?
The Platonic view is the blueprint of science: scientists propose precise mathematical models, test them against observation and experiment, and require internal consistency, which only makes sense for a precisely specified, hence mathematical, model. If a model "exists", it exists in the Platonic world. Penrose concedes the alternative (models exist only in minds) but argues individual minds are imprecise, unreliable and inconsistent, whereas mathematics shows a robustness beyond any single mind. "Agreed by all" collapses into circularity ("all those in their right minds"? "all PhDs"?), and majority opinion must never be the criterion of scientific truth.
Platonic existence = objectivity. A mathematical assertion "exists" in Plato's world precisely when it is objectively true, independent of opinion and culture. On this reading Platonism is neither mystical nor unscientific.
Fermat (1637) wrote in the margin of Diophantos's Arithmetica that xⁿ + yⁿ = zⁿ has no positive integer solutions for n > 2, with a "truly marvellous proof" too large for the margin. Andrew Wiles published a proof in 1995. If truth were subjective, a mathematician X who produced a "counter-example" before 1995 would have made the theorem false, and Fermat's own proof might have been valid until X spoke. Penrose: virtually all mathematicians find this patently absurd. (Note: a 1 April 1994 email rumour that Noam Elkies had a counter-example was a spoof by Henri Darmon; Elkies had genuinely refuted Euler's conjecture x⁴ + y⁴ + z⁴ = w⁴ in 1988.)
Fermat's statement is logically simple (a Π₁-sentence), so its objectivity is especially clear. Harder cases exist. The axiom of choice is "obviously true" to most, questionable to some (Penrose leans toward doubt), and a matter of chosen formal system to others. Gödel and Cohen showed it independent of Zermelo–Fraenkel set theory, but Penrose notes this does not prove it can never be settled. This gives a spectrum: weak Platonists accept objectivity only for clear-cut statements like Fermat's; strong Platonists extend it to the axiom of choice. If choice is a matter of decision, Plato's world contains neither it nor its negation, only statements like "X follows from choice".
The Mandelbrot set is his prime exhibit of mathematical robustness: an endlessly elaborate structure from a very simple rule (given in §4.5), "no invention of any human mind". Not even Mandelbrot, nor its earlier discoverers R. Brooks and J. P. Matelski (1981), foresaw its detail. Every computer and every mathematician reveals the same structure, so its existence lies neither in minds nor in printouts but in the Platonic world, timelessly.
1.4 Three worlds and three deep mysteries
- Mathematics → physics. Why does the physical world obey mathematical laws with such phenomenal precision, subtlety and beauty? Prejudice: the entire physical world is governed by mathematics (perhaps by future notions beyond "equations", possibly with strictly probabilistic randomness).
- Physics → mind. How does appropriately organized matter, specifically wakeful human (or animal) brains, produce conscious awareness? Prejudice: all mentality is rooted in physicality (a cat's brain may evoke mentality; a rock need not).
- Mind → mathematics. How do we perceive mathematical truth, beyond calculating reliably, grasping even what "zero, one, two" mean? Prejudice: no mathematical truth lies beyond the reach of reason in principle (examined against Gödel in §16.6).
The narrow base of each connecting cone records three modest facts: most mathematics is irrelevant to physics (though surprises happen), most physical structures are not minds, and little of our mental life concerns mathematical truth. The wide mouths record his prejudices. Penrose admits unease with total mathematical control of our own actions but argues the unease comes from a limited notion of "mathematical control": he would rather be governed by Plato's world than by the "simplistic base motives" (greed, pleasure-seeking, aggression) some read into strict science.
Penrose sets aside mystery 2 for most of the book (it returns in §34.7), insisting "major revolutions are required in our physical understanding" before real progress on consciousness. Note 1.8 adds an irony: a thorough anti-Platonist ("maths is all in the mind") must hold that no true statement is beyond reason, since truth only arises through perceiving a proof.
1.5 The Good, the True and the Beautiful
Plato had three absolute ideals: the True, the Beautiful and the Good. Penrose is willing to extend his Platonic world to all three. Beauty guides both mathematical discovery and (ambiguously) the acceptance of physical theories (§34). Morality is tied to the existence of sentient beings; he insists scientific questions should not be divorced from their moral implications, though truth must be separated from falsehood before good from bad. He closes with the deepest puzzle in his diagram: each world encompasses the next, a circularity suggesting the three may be aspects of one deeper truth we cannot yet conceive.
Terms to know
| Term | Meaning in Penrose's usage |
|---|---|
| Proof | Impeccable logical argument from axioms or established results |
| Axiom / postulate | Assumption taken as self-evident / assumed but less certain (Euclid's distinction) |
| Platonic world | The world of objective mathematical truths; existence there = objectivity |
| Weak / strong Platonist | Accepts objectivity only for clear-cut statements / also for things like the axiom of choice |
| Π₁-sentence | A logically simple "for all numbers…" statement, like Fermat's Last Theorem |
| Axiom of choice | Set-theory axiom independent of ZF (Gödel, Cohen); Penrose leans to doubting it |
| Three mysteries | Maths → physics, physics → mind, mind → maths |
Imagine two civilizations that never meet, one computing in base 10 on silicon, the other in base 7 on some exotic chemistry. Each iterates z ↦ z² + c and zooms into the region near c = −0.745 + 0.113i. Penrose's claim is that both will find the same seahorse spirals at the same coordinates, to whatever depth their machines allow. Nothing in their cultures or hardware chose those shapes. That shared discovery, he argues, is what "existence in the Platonic world" means: objectivity, not mysticism. A sceptic can reply that both merely executed the same algorithm; Penrose's answer is that the algorithm's output was not foreseeable by anyone who wrote it down.
Fermat-style objectivity returns in §16.6 (Gödel and mathematical insight); the three-worlds diagram frames §34.7 on consciousness; the precision of physical laws is quantified in §19.8, §26.7, §27.13.
Test yourself
- Q. Why does Penrose say Platonism is not mystical? Because he defines Platonic existence as nothing more than objectivity of truth, independent of opinion or culture.
- Q. What does the narrow base of each cone in Fig. 1.3 express? That only a small part of each world connects to the next (little maths is physics, few physical systems are minds, little thought is about mathematics).
- Q. Why is the axiom of choice a harder case than Fermat's Last Theorem? It is independent of ZF set theory, so its truth may depend on the chosen formal system; Fermat's statement is a simple Π₁-sentence.
Penrose's mathematical Platonism is a respectable but contested position. Formalists and fictionalists (Field), structuralists, and social constructivists reject "existence" claims; many working mathematicians are Platonists by day and formalists when challenged. His Mandelbrot argument shows intersubjective robustness of a computation, which non-Platonists also accept; it does not by itself prove existence outside minds. The arrow from physics to mind (prejudice 2) is also the one most philosophers would contest, from both dualist and eliminativist directions.
Proof is now being mechanized. The Lean proof assistant and its library Mathlib have formalized large parts of undergraduate and research mathematics, and in 2024 DeepMind's AlphaProof and AlphaGeometry 2 reached silver-medal level at the International Mathematical Olympiad, with gold-level performance reported by several AI systems at the 2025 IMO. These systems sharpen Penrose's third mystery rather than settle it: they find and check proofs inside formal systems, which is exactly what his Gödelian argument says cannot exhaust mathematical understanding. Penrose shared the 2020 Nobel Prize in Physics for showing that black-hole formation is a robust prediction of general relativity.
For an architect of AI systems, the three-worlds picture is a clean way to separate the model (Platonic), the running system (physical) and human understanding (mental). Most production failures sit on the arrows: a correct model mismatched to the world, or a working system no human can interpret.
An Ancient Theorem and a Modern Question
Two transparent proofs of Pythagoras's theorem both turn out to lean on Euclid's fifth (parallel) postulate. Drop that postulate and a fully consistent hyperbolic geometry appears, in which triangles' angles fall short of π by an amount proportional to their area. Which geometry describes physical space is an empirical question, and hyperbolic geometry certainly describes the space of relativistic velocities.
2.1 Two proofs of the Pythagorean theorem
The theorem: for a right-angled triangle with legs a, b and hypotenuse c, a² + b² = c². Penrose picks two proofs chosen for transparency, each exposing different hidden assumptions.
Proof 1, the two-square tessellation. Tile the plane with squares of two sizes (side a and side b) in a repeating pattern. Mark the centres of the larger squares (or any point and all its translates): they form a lattice of larger tilted squares that also tiles the plane. Each tilted square, cut by the original markings, consists of pieces that can be translated without rotation into one small square plus one large square, so area(tilted) = a² + b². Translating the tilted lattice so its vertices sit on original corners shows the tilted side is the hypotenuse of a right triangle with legs a and b. Hence c² = a² + b².
The hidden assumption is that squares exist at all. Penrose tries to build one: three equal segments AB = BC = CD with right angles at B and C, A and D on the same side of BC. Is AD the same length, and are angles DAB and CDA right angles? Symmetry makes them equal to each other, but proving them right angles needs Euclid's theory of parallels and transversals: angle DAB equals the complement of ADC, and an angle can only equal its complement if it is a right angle.
2.2 Euclid's postulates
Euclid separated axioms (essentially definitions of point, line and so on) from five postulates that seemed true of our world but less certain.
- A unique straight segment joins any two points.
- Any segment can be extended continuously without limit.
- A circle exists with any centre and any radius.
- All right angles are equal: in effect, space is homogeneous and isotropic, so a shape can be moved rigidly anywhere and remain congruent.
- Parallel postulate. If a transversal c meets lines a and b with interior angles on one side summing to less than two right angles, then a and b meet on that side. Equivalent Playfair's axiom: through a point P not on line a there is exactly one parallel to a.
Postulates 1-4 together describe a 2-dimensional metric space, homogeneous, isotropic and infinite, which matches modern cosmology's large-scale picture remarkably well. Euclid's background was the motion of idealized rigid bodies and congruence. With the fifth postulate one proves that a transversal making interior angles summing to two right angles meets two parallel lines, and every other transversal does the same: exactly what the square construction needs. Without the parallel postulate, squares with four right angles cannot be shown to exist. Whether physical "squares" exist on cosmological scales is, for Penrose, a matter for observation. (Hilbert later exposed further hidden, mainly topological, assumptions in Euclid.)
2.3 The similar-areas proof
Proof 2. Drop a perpendicular from the right angle to the hypotenuse, dividing the triangle into two smaller ones. Area of the whole = sum of the two parts. All three triangles are similar (same angles: each small one shares an angle with the big one and has a right angle; the third angle agrees because angle sums are always the same). Areas of similar figures scale as the square of any linear dimension; take the hypotenuse. The small triangles' hypotenuses are a and b, so c² = a² + b².
Two assumptions hide here. First, the angle sum of a triangle is π (180°, Euclid's "two right angles"; the radian, with ° = π/180, is the natural measure). The standard proof extends CA to E and draws AD parallel to CB; the parallel postulate makes ∠EAD = ∠ACB and ∠DAB = ∠CBA, and the three angles at A sum to π. Second, similar figures of different sizes exist (again using parallels) and area scales quadratically, which for non-rectangular shapes needs limiting procedures and hence a theory of the real numbers (Chapter 3).
2.4 Hyperbolic geometry: the conformal picture
Penrose turns to M. C. Escher's woodcut Circle Limit I, an accurate picture of hyperbolic (Lobachevskian) geometry, where the parallel postulate fails, Pythagoras fails, angle sums fall short of π, and a shape of given size generally has no larger similar copy. The whole infinite hyperbolic plane is squashed into the interior of a Euclidean disc; the rim is infinity. The fish crowding toward the rim is an illusion of our Euclidean viewpoint: to a fish, every place looks the same and the rim is infinitely far away.
- Points: the interior of a Euclidean circle.
- Straight lines: arcs of Euclidean circles (or diameters) meeting the boundary orthogonally.
- Angles: identical to Euclidean angles: that is what "conformal" means.
- Distance between A and B: log( QA·PB / QB·PA ), where P and Q are where the hyperbolic line through A, B meets the boundary circle, and QA etc. Are Euclidean lengths; multiply by C−1/2, the pseudo-radius, for general units.
- Lambert's area formula: π − (α + β + γ) = CΔ. The angle defect is proportional to area; with units chosen so C = 1, the area is the defect.
The area formula is a striking simplification: in Euclidean geometry no formula gives area from angles alone, and area from side lengths is messy. In this geometry figures can be moved rigidly as freely as in Euclid's, so congruence makes sense: all Escher's white fish are congruent, as are all black fish.
Try it in Python: distances that never reach the rim
Along a diameter of the unit disc, Penrose's formula gives d(a, b) = log[(1−a)(1+b) / ((1−b)(1+a))]. Distances add up along a line (his Exercise 2.3), and the rim recedes to infinity:
from math import log
def d(a, b): # points a<b on a diameter of the unit disc
return log((1-a)*(1+b)/((1-b)*(1+a)))
print(round(d(0,.5),4), round(d(.5,.8),4),
round(d(0,.5)+d(.5,.8),4), round(d(0,.8),4))
for r in (0.9, 0.99, 0.999999): print(r, round(d(0,r),3))
Output: 1.0986 1.0986 2.1972 2.1972, then 2.944, 5.293, 14.509. The step from 0 to 0.5 is as long as the step from 0.5 to 0.8, and getting within a millionth of the rim still leaves infinite distance to go.
2.5 Other representations
Models make consistency obvious: since hyperbolic geometry can be built inside Euclidean geometry, the parallel postulate cannot be proved from the other postulates.
| Model | Lines appear as | Angles | Distance A to B |
|---|---|---|---|
| Conformal (Beltrami 1868; "Poincaré" 1882) | circular arcs ⟂ boundary | true | log(QA·PB / QB·PA) |
| Projective (Beltrami 1868; "Klein" 1871) | straight chords | distorted | ½ log(RA·SB / RB·SA), R, S = ends of chord |
| Hemispheric (Beltrami) | vertical semicircles on the upper hemisphere | true | via projection |
| Pseudo-sphere (Beltrami 1868; Minding 1839) | geodesics on a surface of revolution of a tractrix | true, locally | equals surface distance, but only a local piece |
| Half-plane ("Poincaré") | semicircles ⟂ an edge | true | metric (dx² + dy²)/y² |
To pass from conformal to projective, expand radially by 2R²/(R² + rc²). Beltrami's hemisphere links them: project the projective disc vertically up onto the northern hemisphere (chords become vertical semicircles), then project stereographically from the south pole back down to get the conformal disc. Stereographic projection is conformal and sends circles to circles (or lines), facts used repeatedly later (§8.3, §18.4, §22.9, §33.6).
No model is "what hyperbolic geometry is". Each is a Euclidean picture of a structure with its own Platonic existence. A creature raised in hyperbolic space would find Euclidean geometry the exotic one and model it hyperbolically.
Squares in hyperbolic geometry. Draw two perpendicular lines through O and cut them with a circle centred at O: the four intersections form a quadrilateral with equal sides and equal angles, but the angles are less than a right angle, and the bigger the square, the smaller its angles. Five such squares can meet at each vertex, with angles 2π/5 = 72°.
2.6 History: discovering what was supposedly impossible
- c.300 BC Euclid's Elements; centuries of attempts to derive the fifth postulate.
- 1603 Thomas Hariot: area of a spherical triangle Δ = R²(α + β + γ − π).
- 1676 Newton studies the tractrix.
- 1733 Girolamo Saccheri (Jesuit) assumes the postulate false, seeks a contradiction, derives a "host of strange-looking" theorems, and concludes lamely that the "hypothesis of acute angle" is false because "repugnant to the nature of the straight line".
- later 1700s Johann Heinrich Lambert (1728–1777): area formula; hints of a "sphere of imaginary radius".
- c.1800s Gauss accepts a consistent non-Euclidean geometry but, cautious, never publishes.
- c.1826 / by 1829 Lobachevsky and János Bolyai independently publish.
- 1839 Minding: pseudo-sphere has constant negative curvature.
- 1854 Riemann notes the constant negative curvature of the metric 4(dx² + dy²)/(1 − x² − y²)².
- 1868 Beltrami: projective, conformal, hemispheric, half-plane and pseudo-sphere models.
- 1871 / 1882 Klein and Poincaré rediscover the projective and conformal models, which now carry their names.
Saccheri was using proof by contradiction (reductio ad absurdum), possibly a Pythagorean invention, which G. H. Hardy called "a far finer gambit than any chess gambit: a chess player may offer the sacrifice of a pawn or even a piece, but a mathematician offers the game." (Intuitionists, a small minority, reject it as non-constructive.) Saccheri could never find a contradiction because none exists: hyperbolic geometry is consistent.
Lambert's imaginary sphere is the key insight. Setting C = −1/R² turns Hariot's formula into Lambert's, so positive C needs R = (−C)−1/2, an imaginary radius; the real quantity C−1/2 is the pseudo-radius, and −C is the Gaussian curvature. Penrose thinks it "somewhat unfair" that the honour of discovery usually goes to Gauss rather than Lambert, and notes how often names attach to the wrong people: the "Gauss–Bonnet" theorem in its modern form is due to Blaschke, with the proof method due to Olinde Rodrigues.
Worked example: the largest hyperbolic triangle
Push all three vertices of a hyperbolic triangle out to the boundary circle (an ideal triangle). Its angles all become 0, so Lambert's formula gives area = π − 0 = π (with C = 1). No hyperbolic triangle, however huge its sides, can exceed area π: an infinitely large triangle has finite area. Compare Euclid, where area grows without bound with the sides. And Penrose's distance formula log(QA·PB/QB·PA) is the logarithm of a cross-ratio of four points on a circle, the quantity Möbius maps preserve (Chapter 8), which is why hyperbolic distance is invariant under the disc's symmetries.
Terms to know
| Term | Meaning |
|---|---|
| Parallel postulate | Euclid's fifth; equivalent to Playfair's unique parallel |
| Hyperbolic geometry | Uniform geometry of negative curvature; many parallels; angle sums below π |
| Conformal | Angle-preserving (infinitesimal shapes kept) |
| Pseudo-radius | C−1/2; the length scale of a hyperbolic plane |
| Angle defect | π − (α + β + γ), proportional to area in hyperbolic geometry |
| Stereographic projection | Projection of a sphere from a pole onto a plane; conformal, circles to circles |
| Tractrix / pseudo-sphere | Curve traced by a dragged weight / its surface of revolution, of constant negative curvature |
| Reductio ad absurdum | Proof by deriving a contradiction from the negation |
You are a fish in Escher's hyperbolic world and want to know whether your universe is flat. Lay out a triangle with three long ropes and measure its angles. If they sum to less than π, Lambert's formula π − (α + β + γ) = CΔ gives the curvature from the defect divided by the area. Small triangles show almost no defect, which is why Gauss's mountain-top survey could never have detected the curvature of real space: the effect scales with area, so you need triangles comparable in size to the pseudo-radius. Cosmologists do exactly this with the cosmic microwave background, using the apparent angular size of sound-wave patches of known physical size as their giant triangle.
Penrose's exercises for Chapter 2
- 2.1: show that Euclid's form of the parallel postulate implies Playfair's uniqueness of parallels.
- 2.2: see why multiplying the distance formula by C−1/2 accounts for Lambert's constant.
- 2.3: prove that hyperbolic distances add along a hyperbolic line, using log ab = log a + log b.
- 2.4: derive the radial stretch 2R²/(R² + r²) taking the conformal model to the projective one (Beltrami's hemisphere helps).
- 2.5-2.6: prove that stereographic projection is conformal and maps circles to circles, hence that the hemispheric model is conformal with vertical semicircles as lines (hint: the projecting cone is cut by two planes of opposite tilt).
- 2.7: build hyperbolic tilings mixing regular pentagons and squares.
- 2.8: prove Hariot's formula Δ = R²(α + β + γ − π) by cutting and pasting "lunes" between antipodal points, using total area 4πR².
Hyperbolic geometry returns as relativistic velocity space (§18.4), in the Möbius/celestial sphere story (§18.5), and in cosmology's open-universe debate (§27.11, §28.10, §34.4). Stereographic projection recurs in §8.3, §22.9, §33.6.
Test yourself
- Q. Which assumption do both Pythagoras proofs share? The parallel postulate (existence of squares, angle sum π, similar figures of different sizes).
- Q. In hyperbolic geometry, what happens to a square's angles as it grows? They shrink, staying below 90°; five can meet at a vertex with 72° corners.
- Q. Why could Saccheri never find his contradiction? Because hyperbolic geometry is consistent: Beltrami's Euclidean models prove it.
Penrose's history is careful but his credit to Lambert is a personal judgment; most historians still date clear acceptance of a consistent non-Euclidean geometry to Gauss, Bolyai and Lobachevsky, since Lambert never asserted consistency. Note also a disputed point he raises: whether Gauss's 1820s geodetic survey triangle (Hohenhagen, Brocken, Inselsberg) was an attempt to test the geometry of space. The consensus is that he was "just doing geodesy"; Penrose finds it hard to believe Gauss was not also watching for a discrepancy.
2.7 Relation to physical space
Hyperbolic geometry works in any dimension: in 3D the bounding circle becomes a bounding sphere. There are exactly three homogeneous, isotropic geometries: elliptic (positive curvature; the sphere, finite, violating postulates 1-3), Euclidean (zero curvature) and hyperbolic (negative curvature). Escher drew all three with angels and devils (Circle Limit IV for the hyperbolic case).
General relativity makes Euclid only an extraordinarily accurate approximation, with ripples from matter that average out on cosmic scales. In 2004 Penrose reported conflicting evidence: widely publicised CMB results (BOOMERanG, MAXIMA, DASI, WMAP) suggesting flat (Euclidean) space, versus analyses by Gurzadyan and collaborators suggesting hyperbolic; some theorists favoured elliptic. He openly prefers the hyperbolic case.
What is undisputed: the space of velocities in special relativity is a 3-dimensional hyperbolic geometry (§18.4). That explains why a projectile fired forward at near light speed from a near-light-speed vehicle never exceeds c relative to the ground. And Pythagoras survives: all Riemannian geometries, including the curved spacetime of general relativity, require the theorem to hold in the limit of small distances, and its spirit lives on in the unitary metric of quantum mechanics.
Observation has moved against Penrose's 2004 preference. Planck 2018 combined with baryon acoustic oscillation data gives spatial curvature Ωk = 0.0007 ± 0.0019, consistent with flat space to a few parts in a thousand; DESI BAO results (2024-25) agree. Some analyses of Planck data alone hint at closed (elliptic) geometry, a minority debate. A slightly hyperbolic universe is not excluded at the 10−3 level, but the Gurzadyan evidence Penrose cited has not been borne out. Hyperbolic geometry meanwhile found a new life in machine learning: Poincaré-disc embeddings (Nickel and Kiela, 2017) and hyperbolic neural networks represent hierarchies and trees with far fewer dimensions than Euclidean embeddings, because hyperbolic area grows exponentially with radius, just like the number of nodes in a tree.
The hyperbolic-embedding trick is practical for enterprise knowledge graphs: taxonomies, org charts, product hierarchies and regulatory rule trees embed with low distortion in a Poincaré disc. If a Euclidean embedding of a deep hierarchy needs hundreds of dimensions, a hyperbolic one may need tens.
Kinds of Number in the Physical World
The proof that no fraction squares to 2 forced the Greeks beyond the rationals to what we call real numbers, which Eudoxos captured geometrically and Dedekind and Cantor later built from pure arithmetic. Physics has trusted the reals across a range that grew from about 1017 in Euclid's day to at least 1043 today, while the integers turned out, only in the 20th century, to count electric charge and every other additive quantum number.
3.1 A Pythagorean catastrophe
If all lengths were ratios of whole numbers, geometry would be finite and easy. But Pythagoras's theorem gives a unit square a diagonal whose square is 1² + 1² = 2, and no fraction has square 2.
- Suppose (a/b)² = 2 with positive integers a, b. Then a² = 2b², so a² > b² > 0.
- 2b² is even, so a is even (odd squares are odd): a = 2c.
- Then 4c² = 2b², i.e. b² = 2c², with b² > c² > 0: the same equation with smaller numbers.
- Repeating gives a² > b² > c² > d² > …, an endless strictly decreasing sequence of positive integers, which is impossible. Contradiction.
Penrose prefers this to the familiar "assume a/b in lowest terms" version, because the existence of a lowest-terms form itself needs proving (via Euclid's algorithm). He stresses why we track every assumption: change the kind of number and some assumptions fail. For real numbers the argument breaks precisely at the descent step, since a decreasing sequence of positive reals (1, ½, ¼, …) need not end; and every real counts as "even" because division by 2 always works. If a, b were merely rational, the descent would fail too, even though the result is still true.
3.2 The real-number system
Decimals. A fraction's decimal expansion is always ultimately periodic (Penrose's four examples end in repeating blocks 3, 6, 285714 and 135; 1/7 = 0.142857142857… is the familiar case). Irrationals never repeat.
Continued fractions, the Greek route (via Euclid's algorithm applied to ratios of lengths), write a number as a + 1/(b + 1/(c + 1/(d + …))) with positive integers a, b, c, d. Example: 52/9 = 5 + 1/(1 + 1/(3 + 1/2)). Rationals always give finite continued fractions, a point in their favour over decimals.
Joseph-Louis Lagrange proved that a continued fraction is ultimately periodic exactly when the number is a quadratic irrational, a + √b with a, b rational and b not a perfect square: the irrationals that ruler-and-compass constructions produce first. For √N the pattern is striking: A, then a palindrome B, C, …, C, B, then 2A, repeating. For √14: 3; 1, 2, 1, 6, 1, 2, 1, 6, …. Theaetetos, Plato's contemporary, seems to have known much of this, and Stelios Negrepontis finds traces of the repeating palindromes in Plato's Statesman.
Try it in Python: continued fractions
The recipe of Exercise 3.1: take the integer part, subtract it, take the reciprocal, repeat.
import mpmath as mp; mp.mp.dps = 60
def cf(x, n=13):
out = []
for _ in range(n):
a = int(mp.floor(x)); out.append(a); x = 1/(x - a)
return out
for name, x in [('sqrt2', mp.sqrt(2)), ('sqrt14', mp.sqrt(14)),
('golden', (1+mp.sqrt(5))/2), ('e', mp.e), ('pi', mp.pi)]:
print(name, cf(x))
| Number | Continued fraction (computed) | Pattern |
|---|---|---|
| √2 | 1; 2, 2, 2, 2, … | periodic (quadratic irrational) |
| √14 | 3; 1, 2, 1, 6, 1, 2, 1, 6, … | A = 3, palindrome 1, 2, 1, then 2A = 6 |
| Golden ratio | 1; 1, 1, 1, … | the "most irrational" number |
| e | 2; 1, 2, 1, 1, 4, 1, 1, 6, 1, 1, 8, … | not periodic, but regular |
| π | 3; 7, 15, 1, 292, 1, 1, 1, 2, 1, 3, 1, 14, … | no known pattern; the 292 explains why 355/113 is so good |
Quadratic irrationals are not enough: Euclid's Book X deals with numbers like √(a + √b), and ruler-and-compass geometry needs everything built from naturals by +, −, ×, ÷ and square roots. The bold step is to allow completely general infinite continued fractions, which gives the real numbers.
Eudoxos, Dedekind and Cantor
Eudoxos (4th century BC, Plato's student) worked with ratios of lengths, so no unit was needed and any number of ratios could be multiplied without "hyper-volumes".
a : b > c : d if there exist positive integers M, N with M·a > N·b while N·d > M·c. "Less than" is defined symmetrically; the ratios are equal when neither holds. With rules for sums and products, this is in effect an abstract theory of real numbers, anticipating Dedekind by two millennia.
The Greeks took the number system as given by physical space, which looked like a Platonic absolute. Once consistent non-Euclidean geometries existed (and since nobody knows space's structure at indefinitely small or large scales), mathematicians in the 19th century cut numbers loose from physical measure.
Dedekind's cut: arrange all rationals in order and slice the line into a left set and a right set, every left member smaller than every right one. If the left set has no largest member and the right no smallest, the cut defines an irrational. Adjoining these to the rationals gives all the reals, with arithmetic defined simply and, crucially, limits: the infinite continued fraction 1 + 1/(2 + 1/(2 + …)) is √2, and the series 4(1 − 1/3 + 1/5 − 1/7 + …) is π. The ability to take limits is what gives the reals their strength, and it underpins the definition of area (§2.3) and all of calculus.
3.3 Real numbers in the physical world
Mathematics develops with a momentum of its own, driven by consistency and elegance, and repeatedly lands on structures that mirror nature more deeply than the ones it started from: "as though Nature herself is guided by the same kind of criteria". The reals are the prime example.
- Euclid's day: evidence for Euclidean distance from about 10−5 m to 1012 m (about 7 Earth-Sun distances, roughly Jupiter's orbit): a range of 1017.
- Today: cosmology to 1026 m, particle physics to 10−17 m: at least 1043, an increase by 1026.
- Volumes: (1017)³ = 1051 then; (1043)³ = 10129 now.
- Spacetime 4-volumes: including time's comparable range, at least 10172.
- Only proposed breakdown scale: the Planck length, about 10−35 m, 18 orders below current reach.
More important than range is calculus. From Archimedes through Galileo, Newton, Maxwell, Einstein, Schrödinger and Dirac, every successful dynamical theory needs derivatives, and so the full infinitesimal structure of the reals; velocity, momentum and energy all inherit it.
Is the continuum really right? Early quantum theory suggested granularity (energy quanta; action and spin in discrete units), but properly understood quantum mechanics does not imply discrete space, time or energy. Still, doubts persist. Schrödinger called the continuum "something quite exorbitant, an enormous extrapolation of what is accessible to us"; Einstein, in his last published words, argued that quantum phenomena "must lead to an attempt to find a purely algebraic theory". In the late 1950s Penrose himself devised spin networks, a combinatorial physics built on the discreteness of spin, which later fed into twistor theory and was adopted by loop quantum gravity (Ashtekar, Lewandowski, Smolin, Rovelli). Yet for 24 centuries tested physics has rested on the reals.
3.4 Do natural numbers need the physical world?
Zero waited for Indian mathematicians: Brahmagupta (7th century), then Mahavira (9th) and Bhaskara (12th). Counting looks tied to a world of persistent, distinguishable things; Penrose imagines universes where objects keep changing number, where there are only finitely many things, or where everything is an amorphous featureless substance. Even there, he argues, natural numbers would matter, because they can be built from the abstract notion of set alone.
- 0 = Ø = { }, the empty set.
- 1 = {Ø}, which is not the same as Ø (it has one member).
- 2 = {Ø, {Ø}}.
- 3 = {Ø, {Ø}, {Ø, {Ø}}}, and so on: each number is the set of all previous ones.
- The same idea extends to ordinal numbers, the first infinite one being Cantor's ω.
So the naturals, and via Dedekind the whole real line, can be conjured by pure thought with no reference to the physical world, yet the reals fit physics with astonishing accuracy: a sharp instance of mystery 1. (Caveat from §16.6: "construct" is loose, because most real numbers cannot be computed by any procedure.)
3.5 Discrete numbers in the physical world
"Minus three cows" means nothing, and negative integers long served only bookkeeping (bank balances). Penrose distinguishes signed directional quantities from genuine scalar ones, and finds that only about a century ago did the integers acquire direct physical meaning.
- 1874 George Johnstone Stoney estimates the basic unit of charge; 1891 coins "electron".
- 1909 Robert Millikan's oil-drop experiment shows charges come in integer multiples of e.
- 1929–31 Paul Dirac's antiparticles: every additive quantum number has a sign-reversed partner.
- 1959 Lyttleton and Bondi propose a proton-electron charge mismatch of 1 part in 1018 to drive cosmic expansion; quickly refuted by experiment, but "an excellent example of creative thinking".
- Quarks: charges +2/3, +2/3, −1/3 sum to the proton's +1; charge is still integral, in units of e/3.
Additive quantum numbers (charge, baryon number and the like) are summed over constituents, and all known ones are integers, with negative values genuinely occurring. But an antiproton is not "minus one proton": mass is not additive in relativity and is never negative for a real particle, so a true "minus one proton" would be a virtual antiproton with negative energy, which has no independent existence.
The rationals have no established fundamental role, beyond curiosities like the fractional quantum Hall effect and a possible role for rational probabilities in spin networks. The next and most striking step is the complex numbers, distrusted for centuries and now fundamental to quantum mechanics.
Worked example: Euclid's algorithm builds a continued fraction
For 52/9: 52 = 5·9 + 7; 9 = 1·7 + 2; 7 = 3·2 + 1; 2 = 2·1. The quotients 5, 1, 3, 2 are exactly the continued fraction 52/9 = 5 + 1/(1 + 1/(3 + 1/2)). Applied to two lengths instead of two integers, the same procedure never stops when the ratio is irrational: the Greeks' route to the reals. Penrose's note adds that this is why the "lowest terms" shortcut in the √2 proof secretly needs Euclid's algorithm.
Terms to know
| Term | Meaning |
|---|---|
| Rational / irrational | Ratio of integers / not expressible so |
| Continued fraction | a + 1/(b + 1/(c + …)); finite exactly for rationals |
| Quadratic irrational | a + √b, b non-square; exactly the eventually periodic continued fractions (Lagrange) |
| Dedekind cut | Split of the rationals into lower and upper sets; defines a real number |
| Limit | The value a sequence settles to; the key strength of the reals |
| Additive quantum number | Summed over constituents (charge, baryon number); always an integer |
| Antiparticle | Same mass, all additive quantum numbers reversed (Dirac) |
| Planck scale | About 10−35 m; where the continuum might fail |
Penrose invites us to imagine a universe of amorphous, featureless substance in which nothing persists long enough to be counted. Would its inhabitants (if any) ever invent 1, 2, 3? His answer is that they could still reach the naturals through pure set theory: from the empty set Ø, form {Ø}, then {Ø, {Ø}}, and so on, with no physical objects at all. The thought experiment separates two questions people often run together: where numbers come from psychologically (counting things) and whether they depend on the world (they do not, if von Neumann's construction is accepted). The reals then follow by Dedekind cuts, which is why their fit to physical space is a genuine mystery rather than a tautology.
Penrose's exercises for Chapter 3
- 3.1: compute continued fractions for √2, √14-type surds and π = 3.14159… on a calculator by "take the integer part, subtract, invert".
- 3.2: assuming eventual periodicity, show the continued fractions represent the stated quadratic irrationals by solving the quadratic they satisfy.
- 3.3-3.4: see why Eudoxos's criterion correctly orders ratios, and formulate his rules for sum and product of ratios.
Real-number calculus is built in Chapter 6; the uncomputable reals reappear in §16.6; spin networks in §32.6; antiparticles and charge in §§24.2, 8 and quarks in §§25.3-7.
Test yourself
- Q. Why does the descent proof fail for real numbers? A decreasing sequence of positive reals need not terminate, and every real is 'even'.
- Q. What did Eudoxos achieve? An abstract theory of ratios of lengths with a criterion for greater/less/equal, in effect the real numbers, two millennia before Dedekind.
- Q. Is an antiproton 'minus one proton'? No: additive quantum numbers flip, but mass is not additive and stays positive; 'minus one proton' would be a virtual antiproton.
Penrose's claim that the reals are tested over 1043 of scale conflates the range of distances with the precision with which the continuum is probed: experiments never test the uncountable infinity of the reals, only finite-precision measurements. Many physicists and philosophers (e.g. Gisin, Ellis) argue that "real numbers are not really real" physically. Penrose himself acknowledges this tension in §16.6 and in his spin-network work.
The discreteness question is still open. Loop quantum gravity predicts discrete spectra of area and volume built from Penrose's spin networks, but there is no observational evidence for spacetime granularity: Fermi gamma-ray burst timing (e.g. GRB 090510) bounds linear Lorentz-violation energy scales above the Planck energy. The fractional quantum Hall effect has meanwhile produced anyons with fractional statistics, observed directly in 2020 interferometry experiments: the clearest place where rational numbers do real physical work.
Magical Complex Numbers
Adjoin a single number i with i² = −1 to the reals and, keeping the ordinary rules of algebra, you get a system where every number has every root, every polynomial equation has solutions, real cubics are solved by a detour through the imaginary, and the puzzling convergence of real power series is explained by singularities in the complex plane. For 350 years this magic seemed purely mathematical; the quantum world turned out to run on it.
4.1 The magic number i
Raphael Bombelli introduced the procedure in L'Algebra (1572), after Gerolamo Cardano's first encounters in Ars Magna (1545). A complex number is a + ib with a, b real.
- Addition: (a + ib) + (c + id) = (a + c) + i(b + d).
- Multiplication: (a + ib)(c + id) = ac + i(bc + ad) + i²bd = (ac − bd) + i(bc + ad).
- Division (c, d not both zero, so c² + d² > 0): (a + ib)/(c + id) = [(ac + bd) + i(bc − ad)] / (c² + d²).
- All the usual laws hold: w + z = z + w, w + (u + z) = (w + u) + z, wz = zw, w(uz) = (wu)z, w(u + z) = wu + wz, w + 0 = w, w·1 = w.
Checking these laws for complex numbers is far easier than checking them for reals via Dedekind cuts, which makes the centuries of suspicion odd. The reason was that people could not "see" complex numbers in the world. But Penrose points back to §3.3: we cannot see Dedekind cuts either, so "real" numbers are as much an imaginative product as complex ones. Yet nature, at its smallest scales, has "entrusted to these numbers the precise operations of her world" (Chapters 21-23).
4.2 Solving equations
- Square roots for free. i√a squares to −a; more strikingly, every complex number a + ib has a complex square root (explicit formula: ±[√((√(a² + b²) + a)/2) + i·sgn(b)·√((√(a² + b²) − a)/2)]). Adjoining √2 to the rationals got almost nowhere; adjoining √−1 to the reals gives all square roots at once.
- All roots. Cube roots, 999th roots, π-th roots, even i-th roots of any non-zero complex number exist (via logarithms, Chapter 5), usually with several values.
- Fundamental theorem of algebra. Every equation a₀ + a₁z + a₂z² + … + aₙzⁿ = 0 (aₙ ≠ 0) has a complex solution; equivalently the polynomial factorizes into linear factors aₙ(z − b₁)(z − b₂)…(z − bₙ). I was introduced for one equation, 1 + z² = 0: "We get all the rest free!"
Cardano reduced the general cubic to x³ = 3px + 2q. The solution, learned partly from Niccolò Fontana ("Tartaglia") in 1539 under an oath of secrecy and found earlier (before 1526) by Scipione del Ferro, is x = ∛(q + w) + ∛(q − w) with w = √(q² − p³). Cardano saw del Ferro's papers in Bologna in 1543, felt released from his oath, and published in 1545; Tartaglia never forgave him. If q² ≥ p³ there is one real root and the formula works. In the irreducible case q² < p³ there are three real roots, yet w is the square root of a negative number. Bombelli (1572) showed that, allowing complex numbers, the formula gives all three real roots: the imaginary parts of the two cube roots are complex conjugates and cancel. A problem with real data and real answers can only be solved by travelling through complex territory.
4.3 Convergence of power series
A power series a₀ + a₁x + a₂x² + … may diverge. Take 1 + x² + x⁴ + x⁶ + … = (1 − x²)−1:
- x = 1: partial sums 1, 2, 3, 4, … diverge; the formula gives 0−1 = ∞, which explains it.
- x = ½: converges to 4/3, matching (1 − ¼)−1.
- x = 2: partial sums 1, 5, 21, 85, … diverge, yet the formula offers −1/3.
Euler freely wrote things like 1 + 4 + 16 + 64 + … = −1/3, and it is fashionable to mock him, since rigorous convergence came only with Cauchy in the late 18th and early 19th century. Penrose defends him: there are senses (via analytic continuation and summation methods) in which such equations are "correct", and refusing them would be like refusing a real root of x² + 1 = 0 and missing complex numbers altogether. Quantum field theory routinely manipulates divergent series (§§26.7, 9; §31.13), sometimes with spectacular experimental confirmation and sometimes not, and the sense attached to them usually depends on complex numbers.
Now the puzzle. 1 − x² + x⁴ − x⁶ + … = (1 + x²)−1 has a perfectly smooth, finite answer for every real x, yet the partial sums still converge only for −1 < x < 1.
Try it in Python: the 1/(1 + x²) puzzle
def partial(x, n): return sum((-1)**k * x**(2*k) for k in range(n))
for x in (0.5, 1, 2):
print(x, [round(partial(x, n), 4) for n in (1,2,3,4,5,10)], 1/(1+x*x))
| x | Partial sums (1, 2, 3, 4, 5, 10 terms) | True value |
|---|---|---|
| 0.5 | 1, 0.75, 0.8125, 0.7969, 0.8008, 0.8 | 0.8 |
| 1 | 1, 0, 1, 0, 1, 0 (flaps, never settles) | 0.5 |
| 2 | 1, −3, 13, −51, 205, −209715 | 0.2 |
4.4 Caspar Wessel's complex plane
The complex plane was found independently by Caspar Wessel (1797), Jean-Robert Argand (1806), John Warren (1828) and Gauss (well before 1831): z = x + iy is the point (x, y), the x-axis is the real axis, the y-axis the imaginary axis.
For any power series in z there is a circle of convergence centred at 0: the series converges strictly inside and diverges strictly outside (the radius can be 0 or ∞; behaviour on the circle is delicate, relevant in §§9.6-7). The radius is the distance to the nearest singularity of the function. (1 − z²)−1 has poles at z = ±1; (1 + z²)−1 has poles at z = ±i. Both lie at distance 1, so both series share the unit circle, which crosses the real axis at ±1. The real-variable mystery is a complex-variable fact.
4.5 How to construct the Mandelbrot set
The set from Fig. 1.2 comes from iterating z ↦ z² + c. Fix a complex c, start at z = 0, and generate 0, c, c² + c, (c² + c)² + c, …. If the sequence is unbounded, colour c white; if it stays bounded, colour c black. The Mandelbrot set is the black region. Its endless complexity comes from the many ways the orbit can stay bounded: cycles and near-cycles dancing in elaborate patterns, involving deep complex analysis and number theory. Computer pictures cap the number of iterations (Fig. 1.2 used caps of 300 and 200); raising the cap does not necessarily improve the picture, because filaments get lost.
Try it in Python: who is in the set?
def in_M(c, cap=200):
z = 0
for _ in range(cap):
z = z*z + c
if abs(z) > 2: return False # once |z| > 2 it must escape
return True
for c in (0, -1, -2, 0.25, 0.26, 1j, -0.75+0.1j, -1.75):
print(c, in_M(c))
Output: 0, −1, −2, 0.25, i and −1.75 are in; 0.26 and −0.75 + 0.1i are out. The real axis section of the set is exactly [−2, ¼]: nudging c from 0.25 to 0.26 sends the orbit to infinity, and −0.75 + 0.1i sits just in the "neck" between the main cardioid and the period-2 disc.
Worked example: Bombelli's cubic
x³ = 15x + 4 has the obvious root x = 4. In Cardano's form x³ = 3px + 2q, p = 5, q = 2, so q² − p³ = 4 − 125 = −121 and the formula demands √−121 = 11i: x = ∛(2 + 11i) + ∛(2 − 11i). Bombelli noticed (2 + i)³ = 2 + 11i and (2 − i)³ = 2 − 11i, so x = (2 + i) + (2 − i) = 4. The imaginary parts cancel and a real root emerges from a complex detour. Factoring x³ − 15x − 4 = (x − 4)(x² + 4x + 1) gives the other two real roots −2 ± √3, reached by the other choices of cube root.
Terms to know
| Term | Meaning |
|---|---|
| Complex number | a + ib with a, b real and i² = −1 |
| Fundamental theorem of algebra | Every complex polynomial factorizes into linear factors |
| Irreducible case | Real cubic with three real roots whose formula needs √(negative) |
| Power series | a₀ + a₁z + a₂z² + …; may converge or diverge |
| Circle of convergence | Largest disc about 0 (up to the nearest singularity) where a power series converges |
| Pole | Singularity where a function behaves like 1/(z − α)ⁿ |
| Mandelbrot set | Values of c for which z ↦ z² + c from 0 stays bounded |
Picture an analyst who can only ever evaluate functions at real x. She sums 1 − x² + x⁴ − …, watches it converge on (−1, 1) and blow up outside, and searches in vain for anything special about x = ±1: the function 1/(1 + x²) is smooth and modest there. To her the boundary is an inexplicable law of nature. Step one dimension sideways into the complex plane and the cause is obvious: poles at ±i, exactly one unit away. Penrose's broader point is that a theory restricted to the quantities we can directly see may show regularities with hidden causes, and that complex numbers repeatedly supply those causes.
Penrose's exercises for Chapter 4
- 4.1-4.2: verify the division formula and all the field laws (commutative, associative, distributive, identities) for complex numbers.
- 4.3: check the explicit square root of a + ib.
- 4.4-4.5: check 1 + x² + x⁴ + … = (1 − x²)−1 formally and explain why changing signs gives the series for (1 + x²)−1 (replace x by ix).
- 4.6: show that a polynomial with root b is exactly divisible by (z − b), hence the full factorization into linear factors.
Complex numbers become the amplitudes of quantum mechanics (Chapters 21-23), drive contour integration (Ch. 7), and underlie twistor theory (Ch. 33). Divergent-series manipulations reappear in renormalization (§§26.7, 9) and string theory (§31.13).
Test yourself
- Q. What single equation was i introduced to solve, and what came 'free'? 1 + z² = 0; in return, every polynomial equation has complex solutions.
- Q. Why does 1 − x² + x⁴ − … diverge at x = 2 though 1/(1 + x²) is finite there? Its circle of convergence has radius 1, set by the poles at ±i.
- Q. What decides membership in the Mandelbrot set? Whether the orbit 0, c, c² + c, … under z ↦ z² + c stays bounded.
Penrose's "magic" is rhetorical but defensible: the properties he lists all follow from algebraic closure and analyticity, so "magic" is shorthand for unexpected fertility. Whether complex numbers are physically necessary in quantum mechanics was long debated, since one can rewrite the theory with real pairs. That debate shifted in 2021-22: Renou et al. proposed, and Chen et al. and Li et al. carried out, network Bell-type experiments showing that real-number quantum theory (with standard tensor-product composition) cannot reproduce observed correlations. Penrose's intuition that nature uses complex numbers essentially is now experimentally supported, within that framework.
Circle-of-convergence thinking is a general lesson for model risk: a model fitted and validated on one slice of inputs (the real line) can fail at a boundary set by structure you never sampled (the poles at ±i). Stress tests should probe the hidden singularities, not only the observed range.
Geometry of Logarithms, Powers, and Roots
In the complex plane, adding is translating and multiplying is rotating-and-scaling, so i is a quarter-turn and i² = −1 is simply a half-turn. The argument of a complex number is a logarithm (log w = log r + iθ), which is why all of trigonometry fits inside the single formula eiθ = cos θ + i sin θ. The 2πi ambiguity of the logarithm, an apparent nuisance, is the seed of complex analysis, and roots of unity even turn up as multiplicative quantum numbers in particle physics.
5.1 Geometry of complex algebra
- Parallelogram law (addition): 0, w, w + z, z are the vertices of a parallelogram. The map z ↦ z + w is a translation sending 0 to w.
- Similar-triangle law (multiplication): triangles (0, 1, w) and (0, z, wz) are similar (no reflection). The map z ↦ wz fixes 0 and is a rotation combined with a uniform expansion, sending 1 to w; it preserves shapes (a fact used in §8.2 for conformal maps).
Polar form: modulus r = |z| = √(x² + y²) and argument θ (the phase in quantum theory), with x = r cos θ, y = r sin θ, θ = tan−1(y/x). Convention may force −π < θ ≤ π, but Penrose prefers the "more profound" view that θ is defined only up to integer multiples of 2π, as if the point could wind round the origin any number of times.
5.2 The idea of the complex logarithm
Multiplying complex numbers multiplies moduli and adds arguments: multiplication turned into addition, which is exactly what logarithms do (log ab = log a + log b), as on the slide rule. Logarithms were introduced in 1614 by John Napier and made practical by Henry Briggs in 1624. Penrose regrets that calculators have removed our direct experience of this "beautiful and deeply important logarithmic operation".
Building bz step by step retraces history: positive integer powers; b⁰ = 1 (following Brahmagupta's zero) to keep bm+n = bmbn; b−1 = 1/b; b1/n = an n-th root; rational and, by limits, real exponents for positive b. A negative b hits √b at z = ½ and forces us down "the slippery slope" to complex numbers.
5.3 Multiple-valuedness and natural logarithms
bz is many-valued (b1/2 = ±√b; n values of b1/n; infinitely many for irrational exponents). Choosing the base e tames this:
- e = 1 + 1/1! + 1/2! + 1/3! + … = 2.718281828…, with n! = 1×2×…×n.
- ez = 1 + z + z²/2! + z³/3! + …, convergent for all z (infinite circle of convergence), satisfying ea+b = eaeb.
- log w = z if w = ez. For w = reiθ ≠ 0: log w = log r + iθ: real part an ordinary logarithm, imaginary part the argument.
- Ambiguity: log w is defined up to adding 2πin, because e2πi = 1.
- Euler: eπi + 1 = 0, uniting 0, 1, i, π, e.
- Cotes-Euler formula: eiθ = cos θ + i sin θ. Roger Cotes (1714) had the equivalent log(cos θ + i sin θ) = iθ; Euler's form appeared about 30 years later (1748); De Moivre was a co-discoverer.
Every complex number can be written w = reiθ, so reiθ·seiφ = rs·ei(θ+φ): the similar-triangle law in one line. Trigonometry collapses: expanding ei(a+b) = eiaeib gives cos(a + b) = cos a cos b − sin a sin b and sin(a + b) = sin a cos b + cos a sin b; expanding (eiθ)³ gives cos 3θ = cos³θ − 3 cos θ sin²θ and sin 3θ = 3 sin θ cos²θ − sin³θ. The 2πi ambiguity "seems just an awkward irritation" but is "absolutely central" to complex analysis (§7.2).
5.4 Complex powers
Define wz = ez log w, which inherits the ambiguity: each extra 2πi in log w multiplies wz by e2πiz. Penrose's rule: write wz only after specifying a particular log w (for ez, the tacit choice is log e = 1). Then (wa)b = wab provided log wa is specified as a log w. Exercise 5.10 is a cautionary "paradox": e = e1+2πi, so e = (e1+2πi)1+2πi = e1+4πi−4π², which is false; the error is an unstated change of logarithm.
- ii = ei·log i: specifying log i = πi/2 gives ii = e−π/2 = 0.2078795…, a real number. Other choices multiply this by e2πn: 111.32…, 0.20788, 0.000388, …. Every value of ii is real.
- n-th roots of unity: log 1 = 0, 2πi, 4πi, … gives 1, ε, ε², …, εn−1 with ε = e2πi/n, the vertices of a regular n-gon on the unit circle. They form the cyclic group ℤₙ under multiplication.
For n = 3: 1, ω, ω² with ω = e2πi/3, ω³ = 1, ω−1 = ω². Multiplying by ω rotates the equilateral triangle 120° anticlockwise; by ω², 120° clockwise.
Try it in Python: Euler, ii and roots of unity
import cmath, math
print(cmath.exp(1j*math.pi) + 1) # Euler: ~0 (rounding 1.2e-16 i)
print(1j**1j, math.exp(-math.pi/2)) # both 0.20787957635076193
print([round(math.exp(-math.pi/2 - 2*math.pi*n), 6) for n in (-1, 0, 1)])
print(sum(cmath.exp(2j*math.pi*k/5) for k in range(5))) # 5th roots sum to ~0
t = 0.7
print(math.cos(3*t), math.cos(t)**3 - 3*math.cos(t)*math.sin(t)**2)
Output: 1.22e−16 i (zero up to rounding), 0.20787957635076193 twice, [111.317778, 0.20788, 0.000388], a sum of fifth roots equal to zero up to 10−16, and −0.5048461046 for both sides of the triple-angle formula. Python's 1j**1j silently uses the principal logarithm, exactly the "specified choice" Penrose insists on.
5.5 Relations to modern particle physics
Additive quantum numbers are integers (§3.5). Penrose finds that multiplicative quantum numbers are roots of unity, though most are only approximate (not valid for all particles or all interactions).
| Quantum number | n | Values | Status |
|---|---|---|---|
| Parity (bosons) | 2 | ε = ±1; mirror image is the particle itself (+1) or its antiparticle (−1), and reflecting twice is the identity, so ε² = 1 | approximate: violated by weak interactions |
| Fermion/boson number | 2 | −1 fermion, +1 boson ("two fermions make a boson"; "a boson and a fermion make a fermion") | exact as far as known; fermions need two full 2π turns to return to their original state |
| Fermion parity (Penrose's proposal) | 4 | ±i for fermions, ±1 for bosons; a double reflection equals a 2π rotation | non-standard terminology |
| "Quarkiness" (Penrose's term) | 3 | e−2πiq with q = charge in units of −e: ω for quarks (q = 2/3 or −1/3), ω² for antiquarks, 1 for anything that can exist freely | captures confinement: only quarkiness-1 composites exist alone; extends to the finite field 𝔽₄ in §16.1 |
Worked example: one formula, a page of trigonometry
From eiθ = cos θ + i sin θ: cos θ = (eiθ + e−iθ)/2, sin θ = (eiθ − e−iθ)/2i. Compare the hyperbolic functions cosh t = (et + e−t)/2, sinh t = (et − e−t)/2: so cos(it) = cosh t and sin(it) = i sinh t. Circular and hyperbolic trigonometry are the same functions on perpendicular axes of the complex plane, which is the analytic shadow of Lambert's "sphere of imaginary radius" in Chapter 2. And (eiθ)ⁿ = einθ is De Moivre's theorem (cos θ + i sin θ)ⁿ = cos nθ + i sin nθ.
An ordinary slide rule multiplies by adding logarithmic lengths. A complex slide rule would need two scales at once: log r along one direction and the angle θ along the other, and because θ repeats every 2π the second scale must be wrapped round a cylinder. Multiplying two complex numbers is then a sliding plus a twisting of the cylinder. Keep sliding round the cylinder and you never return to the same logarithm: you move up the 2πi ladder, which is exactly Riemann's spiral ramp (Chapter 8) seen from another angle. Penrose's lament about lost slide rules is a lament for this kind of geometric feel.
Penrose's exercises for Chapter 5
- 5.1-5.3: examine degenerate cases of the parallelogram and similar-triangle laws, verify them by trigonometry, and show without computation that z ↦ wz is a rotation-plus-scaling (from distributivity and w(iz) = i(wz)).
- 5.4-5.6: spell out log ab = log a + log b; prove ea+b = eaeb from the series using the binomial theorem; show z + πi is a logarithm of −w.
- 5.7-5.8: derive the addition formulas and the triple-angle formulas from eiθ.
- 5.9: show the values of wz lie at intersections of two equiangular spirals, and find the special cases.
- 5.10: resolve the "paradox" e = (e1+2πi)1+2πi = e1+4πi−4π².
- 5.11-5.15: the 2πi/log b ambiguity of logb; why log i = πi/2 is allowed; why other values of ii are powers 4n + 1 of the principal one; generating all n-th roots; (wa)b = wab with consistent logarithms.
Rotation by i underlies spinors (§§11.3, 22.8); phases eiθ are quantum phases (§21); roots of unity become finite groups (§13.1) and the field 𝔽₄ (§16.1); parity and fermion signs return in §§23.7-8, 25.3-4.
Test yourself
- Q. Why is the argument of a complex number 'really a logarithm'? Because log(reiθ) = log r + iθ: the imaginary part of the log is the argument.
- Q. Why are all values of ii real? ii = ei log i with log i = i(π/2 + 2πn), giving e−π/2 − 2πn.
- Q. What is 'quarkiness'? Penrose's ℤ₃ multiplicative quantum number e−2πiq: free particles must have quarkiness 1.
Two slips in the book's notes: note 5.6 writes De Moivre's theorem as sin nθ + i cos nθ = (sin θ + i cos θ)ⁿ and Euler's formula as eiθ = sin θ + i cos θ. Both have sine and cosine swapped: the correct forms are (cos θ + i sin θ)ⁿ = cos nθ + i sin nθ and eiθ = cos θ + i sin θ (the main text has the latter right). Also, "quarkiness" and fermion parity ±i are Penrose's private bookkeeping; the standard way to express confinement uses the centre ℤ₃ of SU(3) (the "triality"), which is the same mathematics under a standard name.
Phases are now engineering, not just mathematics. Quantum computers manipulate exactly these unit-modulus complex numbers: the T gate multiplies a qubit amplitude by eiπ/4, and the quantum Fourier transform at the heart of Shor's algorithm is built from n-th roots of unity. Google's Willow chip (December 2024) demonstrated error-corrected logical qubits improving below threshold as the code grew, and the exactness of phase relations is what error correction is fighting to preserve.
Treating multiplication as rotation explains why complex-valued representations (rotary position embeddings, RoPE) work so well in transformer language models: each position rotates a query/key pair by eimθ, so the dot product depends only on the difference of positions, the similar-triangle law at work inside every modern LLM.
Real-Number Calculus
Calculus pairs differentiation (local: slopes, rates, curvature) with integration (global: areas, totals), and the fundamental theorem makes each the inverse of the other. Penrose uses it to hunt for an "honest" function of the kind Euler would accept: C∞-smoothness is not enough, analyticity (local power series) is. With explicit formulas differentiation is easy and integration hard; with raw data or existence questions it is the reverse, and pushing differentiation past its limit leads to the Dirac delta function.
6.1 What makes an honest function?
Calculus was founded in the 17th century by Fermat, Newton and Leibniz, with roots in Archimedes (3rd century BC). It is "calculus" because it turns hard conceptual problems into the following of simple rules. For Euler (Penrose's idealized Euler, he admits), a function was something you could write down: x², sin x, log(3 − x + eˣ), a power series. Today a function is a mapping from a domain A to a target B, possibly just a look-up table.
- x²: smooth everywhere.
- |x| (absolute value): continuous but has a corner, so not differentiable at 0.
- θ(x) (Heaviside step: 0 for x < 0, 1 for x > 0, ½ at 0): discontinuous at 0. Named for Oliver Heaviside, better known for the radio-reflecting Heaviside layer. Once |x| is accepted, θ(x) = (x + |x|)/2x, though that gives 0/0 at the origin.
Euler would have balked at |x| and θ(x), and the real objection is not "no nice formula" but lack of smoothness.
6.2 Slopes and 6.3 higher derivatives
The slope at a point is dy/dx = f′(x), the limit of rise over run along the tangent line. The second derivative f″(x) = d²y/dx² is the slope of the slope. f′ = 0 at maxima and minima; f″ = 0 at points of inflection, where the bending changes side (the true curvature is f″/(1 + f′²)3/2, which vanishes with f″).
x³ versus x|x| look alike and both have slope 0 at the origin. But x³ → 3x² → 6x is impeccable, while x|x| → 2|x| → −2 + 4θ(x): a corner in the first derivative and a jump in the second. So x|x| has no well-defined curvature at 0.
- Cⁿ-smooth: n times differentiable with continuous n-th derivative. xⁿ|x| is Cⁿ but not Cⁿ⁺¹ at 0.
- C∞-smooth: Cⁿ for every n.
- Cω = analytic: equal to its power series in an interval around each point.
- Negative classes (§6.6): θ(x) is C−1; the delta function is C−2; each differentiation lowers the class by one.
Euler would have accepted 1/x as one function despite its infinite spike at 0, yet rejected a function glued from two pieces however smoothly. Penrose's killer example:
h(x) = 0 for x ≤ 0 and e−1/x for x > 0. It is C∞ everywhere: every derivative of e−1/x tends to 0 as x → 0⁺, matching the zero function on the left. Yet it is "two functions stuck together", which shows that C∞ does not capture Euler's notion.
6.4 The "Eulerian" notion: analyticity
Two routes fix this. The complex route (Chapter 7): require f to extend to a function f(z) that is once complex-differentiable, and, by genuine magic, it is then infinitely differentiable. The real route: power series. If f(x) = a₀ + a₁x + a₂x² + …, then aₙ = f⁽ⁿ⁾(0)/n! (Maclaurin's series, a name with "little historical justification"; about a general point p, f(x) = Σ f⁽ⁿ⁾(p)(x − p)ⁿ/n!, Brook Taylor (1685–1731)). For h(x), all coefficients vanish, so the series sums to 0, not to e−1/x: h is not analytic at 0. An analytic (Cω) function cannot be two different analytic functions glued together. Exercise 6.4 adds e−1/x²: C∞, not analytic at 0, yet "one function", which the power-series view cannot tell us but the complex view can.
Try it in Python: an infinitely flat join
import sympy as sp
x = sp.symbols('x', positive=True)
h = sp.exp(-1/x)
print([sp.limit(sp.diff(h, x, n), x, 0, '+') for n in range(5)])
print(float(h.subs(x, 0.5)))
Output: [0, 0, 0, 0, 0] and 0.1353…: every Taylor coefficient at 0 is zero, but the function is not.
6.5 The rules of differentiation
- Power rule: d(xⁿ) = n xⁿ⁻¹ dx (n need not be an integer).
- Sum rule: d[f + g] = df + dg; constant rule: d(af) = a df, da = 0.
- Leibniz law: d(fg) = f dg + g df.
- Chain rule: d f(g(x)) = f′(g(x)) g′(x) dx.
- Quotient rule: d(f/g) = (g df − f dg)/g².
- Standard results: d eˣ = eˣ dx; d log x = dx/x; d sin x = cos x dx; d cos x = −sin x dx; d tan x = sec²x dx; d sin⁻¹x = dx/√(1 − x²); d cos⁻¹x = −dx/√(1 − x²); d tan⁻¹x = dx/(1 + x²).
With these, anyone becomes "an expert at differentiation" without understanding why the rules work: "the power of a good calculus". Differentiation of formulas is mechanical ("readily put on a computer").
6.6 Integration
If g′(x) = f(x), the area under f between x = a and x = b (counted negative below the axis) is g(b) − g(a). ∫f(x)dx = g(x) + C (indefinite integral; ∫ is the inverse of d, and the constant C reflects freedom to slide the curve up and down) and ∫ₐᵇ f(x)dx = g(b) − g(a) (definite integral).
Integrating formulas is hard: the rule ∫xⁿdx = xⁿ⁺¹/(n + 1) fails at n = −1, and we are rescued only by the "greatest of good fortune" that d(log x) = dx/x. Often no known function will do, and integrals define new functions.
But for existence questions and numerical data the roles flip. Any continuous (C⁰) function on a closed interval a ≤ x ≤ b can be integrated, giving C¹, then C², and so on: integration smooths; differentiation roughens and can stop altogether. The requirement on the domain is compactness (§12.6).
Try it in Python: data loves integration, hates differentiation
import numpy as np
rng = np.random.default_rng(1); t = np.linspace(0, 2*np.pi, 2001); dt = t[1]-t[0]
y = np.sin(t) + 1e-3*rng.standard_normal(t.size) # 0.1% noise
d = np.gradient(y, dt); I = np.cumsum(y)*dt
print(np.max(np.abs(d - np.cos(t))), np.max(np.abs(I - (1 - np.cos(t)))))
Output: derivative error 0.808, integral error 0.0018. Noise of one part in a thousand wrecks the derivative (an 80% error) and barely touches the integral.
Beyond differentiability. Differentiating |x| gave (twice) θ(x) at the cost of rigour; differentiating θ(x), with its infinite slope at 0, gives the Dirac delta function δ(x): zero away from 0, "infinite" at 0, total area 1. It is not a function in the mapping sense but a distribution; Heaviside apparently had it years before Dirac. Euler would want "no truck with such things", but Penrose promises that complex numbers will provide an ironic magical resolution at the end of Chapter 9 (hyperfunctions).
Worked example: differentiating xˣ
Write xˣ = ex log x. Chain rule: d(xˣ) = ex log x · d(x log x) = xˣ(log x + 1) dx (Leibniz on x log x: log x·dx + x·(dx/x)). The slope vanishes where log x = −1, at x = 1/e ≈ 0.368, the minimum of xˣ, value e−1/e ≈ 0.692. Mechanical rules, no insight required: exactly Penrose's point about "the power of a good calculus".
Terms to know
| Term | Meaning |
|---|---|
| Function (modern) | Mapping from a domain to a target; may be a look-up table |
| Derivative | Slope dy/dx = f′(x); second derivative gives inflection points |
| Cⁿ / C∞ / Cω | n-times continuously differentiable / infinitely / analytic |
| Analytic | Equal to its Taylor series near every point |
| Taylor / Maclaurin series | Σ f⁽ⁿ⁾(p)(x − p)ⁿ/n! About p / about 0 |
| Fundamental theorem of calculus | Integration and differentiation are inverse operations |
| Indefinite / definite integral | g(x) + C with g′ = f / g(b) − g(a) |
| Delta function | Derivative of the step; a distribution, not a function (C−2) |
A transmitter has been silent forever (signal 0 for t ≤ 0) and then switches on smoothly as e−1/t. A receiver who knows the entire past signal, every derivative at t = 0 included, still cannot predict the switch-on: every Taylor coefficient at 0 is zero. That is precisely what makes h(x) useless to Euler and indispensable to communication. If all physical signals were analytic, a single instant of silence would guarantee eternal silence. Chapter 9 returns to this: information transfer needs functions that are smooth but not analytic, or rougher.
Penrose's exercises for Chapter 6
- 6.1: show θ(x) = (x + |x|)/2x away from 0.
- 6.2: prove that h(x) is C∞ (the classic undergraduate exercise Penrose himself did).
- 6.3: derive aₙ = f⁽ⁿ⁾(0)/n! using the differentiation rules.
- 6.4: show e−1/x² is C∞ but not analytic at 0.
- 6.5-6.7: show dex = exdx from the series; derive the power rule from Leibniz; derive the quotient rule.
- 6.8-6.10: practice: d/dx of (1 − x²)⁴ and (1 + x)/(1 − x); d(logax), d(logxa), d(xˣ); derive the whole table of standard derivatives from d(eix) and inverse-function tricks.
Differential forms (§§12.3-6) generalize d; the Euler-Lagrange calculus of Chapter 20 depends on these rules; the delta function and distributions matter in quantum mechanics (§21) and are completed by hyperfunctions in §9.7.
Test yourself
- Q. Why is h(x) C∞ but not analytic? All derivatives at 0 vanish from both sides, so its Taylor series is 0, which does not equal e−1/x.
- Q. When is integration 'easy' and differentiation 'hard'? With numerical data or existence questions: integration smooths, differentiation amplifies roughness and noise.
- Q. What is the differentiability class of θ(x) and δ(x)? C−1 and C−2.
Penrose openly says his "Euler" is "a hypothetical or idealized individual" whose views are plausible but not documented. Historically Euler's concept of function broadened during his career (his 1755 Institutiones calculi differentialis allowed arbitrary dependence), so the tidy contrast between an "analytic Euler" and modern mappings is a teaching device, not history.
Two of the chapter's contrasts now underpin software. Automatic differentiation, the engine of every deep-learning framework (PyTorch, JAX), applies exactly Penrose's mechanical rules (Leibniz, chain) to computational graphs, making "differentiation is easy for formulas" literal at the scale of trillion-parameter models. And the noise-fragility of derivatives is why modern scientific machine learning uses weak (integral) formulations and neural operators rather than finite-difference derivatives of measured data.
In risk and finance work, sensitivities (Greeks) computed by finite differences on noisy Monte Carlo prices are notoriously unstable; pathwise or adjoint (automatic) differentiation sidesteps the problem by differentiating the formula, not the data, which is this chapter's lesson applied.
Complex-Number Calculus
Require a complex function to be differentiable just once and you get, free, infinitely many derivatives and a convergent power series: complex smoothness is analyticity. The proof runs through contour integration, where the 2πi ambiguity of the logarithm becomes the engine: ∮dz/z = 2πi, and Cauchy's formula fixes a function's values inside a loop from its values on the loop. The resulting rigidity, analytic continuation, reaches as far as the Riemann hypothesis.
7.1 Complex smoothness: holomorphic functions
For a complex "slope" f′(z) to make sense whichever direction z moves in, f must satisfy the Cauchy-Riemann equations (relating derivatives of its real and imaginary parts; spelled out in §10.5). These make contour integration path-independent, which yields a formula for the n-th derivative, hence a Taylor series that converges inside any circle where f is complex-smooth. Any complex-smooth function is necessarily analytic. Euler would have been delighted, but the result came from Augustin Cauchy in 1821, 38 years after Euler's death.
Complex smoothness instantly exposes "gluing jobs" like h(x), and it vindicates Euler on 1/x: remove z = 0 from the plane and what remains is still connected, so the negative and positive halves of the real curve are joined through the complex plane. Such functions are called holomorphic. They matter for conformal maps and Riemann surfaces (Ch. 8), Fourier series (Ch. 9), quantum theory and QFT (§24.3, §26.3), twistor theory (Ch. 33) and string theory (§31).
7.2 Contour integration
∫ₐᵇ f(z)dz = g(b) − g(a) with g′ = f, but now there are many paths from a to b. Cauchy-Riemann guarantees that continuously deforming the path within the domain leaves the integral unchanged. If the domain has a hole (z = 0 for 1/z), paths that cannot be deformed into one another may give different answers.
- Homotopic deformation: slide a path continuously, never cutting it.
- Homologous deformation: additionally, segments traversed in opposite directions cancel, so a path may split into separate loops.
- Homotopic ⇒ homologous, not conversely. Contour integration respects homology. Both belong to topology, which returns repeatedly in the book.
∮ dz/z = 2πi for an anticlockwise loop once round the origin; 4πi for twice; −2πi clockwise. And ∮ zⁿ dz = 0 for every integer n ≠ −1 (Exercise 7.1), because zⁿ⁺¹/(n + 1) is single-valued. The non-trivial answer exists only because the logarithm is many-valued, the "awkward irritation" of Chapter 5 turned into the source of complex analysis's power.
7.3 Power series from complex smoothness
- Cauchy's integral formula: f(0) = (1/2πi) ∮ f(z)/z dz for a loop just around the origin (or anything homologous to it in the domain minus 0). What f does at the centre is fixed entirely by what it does on the surrounding loop.
- Higher derivatives: f⁽ⁿ⁾(0) = (n!/2πi) ∮ f(z)/zⁿ⁺¹ dz. Use this as the definition of the n-th derivative, feed it into aₙ = f⁽ⁿ⁾(0)/n!, and prove the series converges to f.
- Shifted to any point p: f(p) = (1/2πi) ∮ f(z)/(z − p) dz, f⁽ⁿ⁾(p) = (n!/2πi) ∮ f(z)/(z − p)ⁿ⁺¹ dz.
- Residue theorem (Ex. 7.4): for f holomorphic on and inside a contour except for poles, ∮ f dz = 2πi × Σ residues; at a pole of order n where f = h(z)/(z − α)ⁿ, the residue is h⁽ⁿ⁻¹⁾(α)/(n − 1)!.
Penrose dwells on the method: neither premise (complex-smooth) nor conclusion (analytic) mentions contours or many-valued logarithms, yet those are the route. The key, he says, is "mathematical playfulness": studying the logarithm and contour integrals for their own beauty supplied the tool. Contour integration also evaluates definite integrals and sums series:
| Exercise | Contour | Result |
|---|---|---|
| 7.5 | z⁻¹eiz round a half-annulus in the upper half-plane, ε → 0, R → ∞ | ∫−∞∞ (sin x / x) dx = π |
| 7.6 | z⁻² cot πz round a square of side 2N + 1, N → ∞ | 1 + 1/4 + 1/9 + 1/16 + … = π²/6 |
Try it in Python: integrals around a circle
import numpy as np, math
N = 4000; th = np.linspace(0, 2*np.pi, N, endpoint=False)
z = np.exp(1j*th); dz = 1j*z*(2*np.pi/N)
print(np.sum(dz/z), np.sum(dz/z**2), np.sum(z**3*dz)) # 2πi, 0, 0
w, dw = 0.5*z, 0.5*dz # loop of radius 1/2
print([(math.factorial(n)/(2j*np.pi)*np.sum(np.exp(w)/w**(n+1)*dw)).real
for n in range(4)]) # derivatives of e^z at 0
Output: 6.2831853072 i, 0, 0, then [1.0, 1.0, 1.0, 1.0]: the loop alone recovers every derivative of ez at the centre, exactly as Cauchy's formula says.
7.4 Analytic continuation
A function's domain D is taken to be an open region: every point has a small disc around it inside D (the open unit disc qualifies; the closed disc does not, nor does a curve or a point). Around each point p in D, f has a power series whose circle of convergence reaches to the nearest singularity. For 1/z the circle about p passes through 0, so covering D needs infinitely many circles.
Analytic continuation extends f by chaining overlapping power series along a path. The result is unique given the path: holomorphic functions are rigid, unable to "change their mind" the way h(x) does. Real-analytic functions are rigid too, but on the line there is only one way to go; in the plane, the path matters.
Starting from log z = (z − 1) − ½(z − 1)² + ⅓(z − 1)³ − … (radius 1 about z = 1) and continuing once anticlockwise round 0 adds 2πi; clockwise subtracts it. More complicated many-valued functions do more than add a constant.
ζ(z) = 1−z + 2−z + 3−z + …, a Dirichlet series, converges for Re z > 1; first studied by Euler, named for Riemann, who continued it to the whole plane minus z = 1. Its trivial zeros are −2, −4, −6, …. The Riemann hypothesis: every other zero has Re z = ½. Penrose calls it perhaps the most important unsolved problem in mathematics, with deep consequences for the distribution of primes. (Computed: the first two non-trivial zeros are ½ + 14.1347…i and ½ + 21.0220…i; ζ(2) = π²/6 = 1.6449….)
Worked example: a real integral by residues
∫−∞∞ dx/(1 + x²). Close the real line with a huge semicircle in the upper half-plane (whose contribution vanishes as R → ∞). Inside sits one pole, at z = i, where 1/(1 + z²) = 1/((z − i)(z + i)) has residue 1/(2i). So the integral is 2πi · 1/(2i) = π, matching tan⁻¹x evaluated from −π/2 to π/2. The poles at ±i that limited the power series in Chapter 4 now compute the integral.
Terms to know
| Term | Meaning |
|---|---|
| Holomorphic | Complex-differentiable on an open region; equivalent to complex-analytic |
| Cauchy-Riemann equations | Conditions on real and imaginary parts making f complex-differentiable |
| Contour integral | Integral along a path in the complex plane; ∮ for closed loops |
| Homology class | Paths equivalent under deformation allowing cancellation |
| Residue | Coefficient determining a pole's contribution, ∮ f dz = 2πi Σ residues |
| Open region | Every point has a small disc around it inside the region |
| Analytic continuation | Unique extension of a holomorphic function along a path |
| Riemann zeta function | ζ(z) = Σ n−z, continued to ℂ minus {1}; zeros encode primes |
The real and imaginary parts of any holomorphic function satisfy Laplace's equation, the equation of steady heat flow and of electrostatics. Cauchy's formula then has a physical twin: in a 2D room at thermal equilibrium, the temperature at every interior point is fixed by the temperatures along the walls; in particular, the temperature at the centre of a circular room is the average around its wall. You cannot hide a hot spot inside without it showing at the boundary. This is the rigidity Penrose describes, felt with a thermometer, and it is why boundary-value methods dominate engineering heat and potential problems.
Penrose's exercises for Chapter 7
- 7.1: explain why ∮ zⁿ dz = 0 for integers n ≠ −1.
- 7.2-7.3: confirm the n-th derivative formula by substituting the Maclaurin series; show at a formal level that Cauchy's coefficients reproduce f.
- 7.4: prove the residue theorem, with the residue formula h⁽ⁿ⁻¹⁾(α)/(n − 1)! At an order-n pole.
- 7.5: show ∫−∞∞ sin x/x dx = π via a half-annulus contour.
- 7.6: show Σ 1/n² = π²/6 by integrating z−2 cot πz round large squares.
- 7.7-7.8: find the power series of 1/z about p (radius |p|) and of log z about 1.
Holomorphicity reappears as conformal maps (Ch. 8), positive frequency (Ch. 9), QFT propagators (§24.3, §26.3) and twistor functions (Ch. 33); the exterior-calculus generalization of path independence is in §12.6.
Test yourself
- Q. Why is ∮dz/z = 2πi and not 0? Because log z is many-valued; going once round 0 adds 2πi.
- Q. What does Cauchy's formula say? A holomorphic function's value inside a loop is determined by its values on the loop.
- Q. What does the Riemann hypothesis assert? All non-trivial zeros of ζ lie on Re z = ½.
Penrose's "mathematical playfulness" story is persuasive but one-sided: Cauchy developed contour integration largely for evaluating real definite integrals in physics problems, so applications drove the beauty as much as the reverse. On the Riemann hypothesis, the claim of "most important unsolved problem" is common but debatable (P vs NP and Navier-Stokes are rivals in the Clay Millennium list).
The Riemann hypothesis remains open in 2026. Computations place about the first 1013 non-trivial zeros on the critical line (Gourdon's 2004 unrefereed run; Platt and Trudgian, 2021, verified rigorously up to height 3 × 1012). In 2024 Larry Guth and James Maynard proved a new zero-density estimate, the first substantial improvement on Ingham's 1940 bound, tightening our knowledge of how many zeros could lie off the line and improving results on primes in short intervals.
Analytic continuation is the mathematician's version of extrapolation with guarantees: inside its region of validity a holomorphic model is rigid, so local data fixes it globally, but the answer can depend on the route taken around singularities. Forecasting models built from local fits deserve the same scrutiny about which path took them from known to unknown territory.
Riemann Surfaces and Complex Mappings
Riemann dissolved the problem of "many-valued functions" by letting the function choose its own domain: a many-sheeted Riemann surface on which it is single-valued. Holomorphic maps are exactly the non-reflective conformal maps (preserving angles and infinitesimal shapes), the Riemann sphere compactifies the plane with a point at ∞, compact Riemann surfaces are classified by genus and moduli (3g − 3 for g ≥ 2), and the Riemann mapping theorem shows how flexible holomorphic maps are. The first manifolds in mathematics were Riemann surfaces.
8.1 The idea of a Riemann surface
Bernhard Riemann (1826–66), "one of the very greatest of mathematicians", pictured log z as living on a spiral ramp flattened onto the plane: each circuit of the origin moves you to a new sheet, so adding 2πi is no conflict. Before him, rigour meant cutting the plane along a ray from 0 to ∞, which Penrose (taught this way at university, a century after Riemann) calls "a brutal mutilation of a sublime mathematical structure". A holomorphic function "has a mind of its own": its true domain is not given in advance but read off from the function.
- za, a irrational: same infinite ramp as log z.
- zm/n (lowest terms): sheets rejoin after n turns: a branch point of order n.
- log z: sheets never rejoin: infinite order branch points at 0 and ∞. Remarkably the whole spiral ramp, with those two points filled by one point, is just a sphere (think of the Riemann sphere of w = log z).
- (1 − z³)1/2: branch points of order 2 at 1, ω, ω² and ∞; two sheets; the surface is a torus with four punctures, which can be filled to give exactly a torus.
Riemann surfaces were the first manifolds: spaces that are curved globally but locally look like Euclidean space, glued smoothly from patches with open-set overlaps (unlike the seam in h(x)). Manifolds underpin general relativity, and Riemann surfaces themselves star in string theory (§§31.5, 13) and twistor theory (§§33.2, 10). For log z, alternate patches are the plane minus the non-negative real axis and minus the non-positive real axis, glued half-plane to half-plane in a staircase.
8.2 Conformal mappings
Conformal geometry cares about shape, not size, at the infinitesimal scale: tiny circles may grow or shrink but never become ellipses; equivalently angles between curves are preserved. Escher's Circle Limit figures shrink toward the rim but keep their shapes, better and better for smaller details.
Zoom in on w = f(z) at a point with the same huge magnification in both planes; in the limit the map becomes linear, and for a holomorphic f it must be one of Chapter 5's maps: a rotation combined with a uniform scaling. So f is holomorphic exactly when the map is conformal and orientation-preserving, which is the geometric meaning of the Cauchy-Riemann equations.
- w = az + b: Euclidean motions plus scalings; the only non-reflective conformal maps of the whole plane onto itself. Map circles to circles and lines to lines.
- w = 1/z: maps the punctured plane to itself and circles to circles (lines counting as circles of infinite radius). With a reflection in the real axis it is an inversion.
- Möbius (bilinear) transformation: w = (az + b)/(cz + d), ad ≠ bc. Sends z = −d/c to "∞" and "∞" to a/c; maps circles to circles. Scaling a, b, c, d together changes nothing, so it has three complex parameters.
8.3 The Riemann sphere
Adjoin ∞ properly by using two coordinate patches, z and w = 1/z, overlapping everywhere except z = 0 (w = ∞) and w = 0 (z = ∞). Geometrically: put the z-plane through the equator of a unit sphere and project stereographically from the south pole (which represents z = ∞); the w-plane is the same plane upside down, projected from the north pole.
Stereographic projection maps circles to circles, so Möbius transformations map circles to circles on the sphere, and every non-reflective conformal self-map of the Riemann sphere is a Möbius transformation. This fact reappears in relativity (§18.5: the celestial sphere transforms by Möbius maps under Lorentz boosts) and in spinors and twistors. The rotation carrying the unit circle to the real axis is t = (z − 1)/(iz + i), z = (−t + i)/(t + i), which sends the upper half-plane of t to the unit disc of z, a map used in Chapter 9.
Try it in Python: the unit circle becomes the real line
import numpy as np
z = np.exp(1j*np.linspace(0, 2*np.pi, 7, endpoint=False))[1:]
print(np.round((z - 1)/(1j*z + 1j), 3))
Output: 0.482, 1.254, 4.381, −4.381, −1.254, −0.482, all with zero imaginary part (and z = 1 goes to 0). Points around the circle march along the entire real axis, with z = −1 sent to ∞.
8.4 The genus of a compact Riemann surface
The Riemann sphere is the simplest compact Riemann surface (the log ramp is non-compact until its two branch points are filled). Riemann himself classified compact Riemann surfaces, a result central to string theory.
- Topology = genus g, the number of handles: sphere 0; torus and teacup 1; a normal pretzel 3.
- Moduli m: complex parameters distinguishing conformally inequivalent surfaces of the same genus.
- Self-transformations s: complex parameters of continuous holomorphic self-maps.
- Genus 0: m = 0, s = 3 (Möbius). Every metric on a sphere is conformally the round sphere.
- Genus 1: glue opposite sides of a parallelogram 0, 1, 1 + p, p: one modulus p (with discrete equivalences p → 1 + p, −p, 1/p); s = 1 (translations z ↦ z + a). A thin "stringy" torus (tiny p) is not conformally equivalent to a fat one (p near i).
- Genus g ≥ 2: built from a polygon in the hyperbolic plane (an octagon for g = 2); m = 3g − 3, s = 0.
- Uniform law: m − s = 3g − 3 for every g, the start of a story culminating in the Atiyah-Singer index theorem (1963).
8.5 The Riemann mapping theorem
Any region bounded by a simple closed loop (corners and worse allowed, given mild "tameness") can be mapped holomorphically onto the unit disc. The map becomes unique once three boundary points a, b, c are sent to three chosen points on the circle in the same cyclic order (say 1, ω, ω²), or one boundary point and one interior point are fixed (say a → 1, j → 0). On the Riemann sphere, inside and outside are equivalent, so the exterior of a loop maps to the exterior of the unit circle, with ∞ ↦ ∞ and one boundary point fixed. (Only for an exact circle do the two versions fit together into a smooth sphere.)
The Zhukovsky (Joukowski) map w = ½(z + 1/z) sends the exterior of a suitable circle through z = −1 to the exterior of a wing-shaped curve, so the idealized (inviscid, incompressible, irrotational, 2D) flow past a 1930s aerofoil follows from flow past a circle. Penrose recalls being "very struck" by this as an undergraduate, and repeats a story that wings had that shape because the maths was easy: "I hope that this is not true!" Running it for a circle centred at −0.1 + 0.1i through −1 gives a wing of chord 2.03 and thickness 0.32, with a sharp trailing edge at w = −1.
Penrose cautions that this is luck: real wings need viscosity and 3D flow, and air is about 1020 molecules per cm³, so aerodynamics is an averaged description with no reason to inherit the holomorphic structure of fundamental physics. Complex structure is basic at the smallest scales (the Schrödinger equation, §21.2) but usually buried macroscopically, surfacing only in special cases: Maxwell's theory and other waves, and relativity's celestial sphere (§18.5).
Worked example: the cross-ratio
For four points, [z₁, z₂; z₃, z₄] = (z₁ − z₃)(z₂ − z₄) / ((z₁ − z₄)(z₂ − z₃)) is unchanged by every Möbius transformation, and four points lie on one circle exactly when it is real. Three points can be sent anywhere by a unique Möbius map (three complex parameters, matching s = 3 for genus 0), so the cross-ratio is the only invariant of four points. Penrose's hyperbolic distance in Chapter 2 is the logarithm of such a cross-ratio, which is why the disc's Möbius symmetries are hyperbolic rigid motions.
Terms to know
| Term | Meaning |
|---|---|
| Riemann surface | Many-sheeted domain on which a multivalued function is single-valued |
| Branch point | Point where sheets are joined; finite order n or infinite order |
| Manifold | Space locally like Euclidean space, glued from open patches |
| Conformal map | Preserves angles and infinitesimal shapes |
| Möbius transformation | (az + b)/(cz + d), ad ≠ bc; all conformal self-maps of the Riemann sphere |
| Riemann sphere | ℂ ∪ {∞}, patched by z and 1/z |
| Genus / moduli | Number of handles / complex parameters distinguishing surfaces of equal genus |
| Riemann mapping theorem | Any simply bounded region maps holomorphically onto the unit disc |
Sailors want a map on which compass bearings are straight lines, which requires a conformal map of the sphere. Stereographic projection is conformal; take its complex coordinate z and apply log z, itself conformal, and you get the Mercator projection: longitude becomes Im(log z), and the Riemann surface of the logarithm explains why the map repeats sideways every 360°. Conformality preserves shapes only infinitesimally, so areas balloon toward the poles and Greenland appears as large as Africa (it is about one fourteenth the size). Every web map you use runs on this chapter's mathematics.
Penrose's exercises for Chapter 8
- 8.1: explain why the sheets of zm/n rejoin after n turns.
- 8.2: construct the Riemann surface of (1 − z⁴)1/2 (branch points at the four fourth roots of unity; again a torus).
- 8.3: see why the log ramp with its two branch points filled is a sphere (use the Riemann sphere of w = log z).
- 8.4-8.5: show 1/z maps circles to circles, and that composing az + b, 1/z and cz + d gives a bilinear map.
- 8.6-8.7: check the two stereographic projections are related by w = 1/z, and verify the map t = (z − 1)/(iz + i).
- 8.8: show the replacements p → 1 + p, −p, 1/p give equivalent tori and find the special p with extra symmetry (the square torus p = i and the hexagonal torus p = ω).
Manifolds and their patches are formalized in §§10.2, 12.2; the Riemann sphere becomes the celestial sphere under Lorentz transformations (§18.5) and the space of spin directions (§22.9); Riemann surfaces are string worldsheets (§31.5).
Test yourself
- Q. What geometric property characterizes holomorphic maps? Conformal and orientation-preserving.
- Q. How many moduli does a genus-3 surface have? 3g − 3 = 6 complex moduli.
- Q. Why might Zhukovsky's success be 'luck'? Real airflow is viscous, 3D and statistical; holomorphic structure is usually buried at macroscopic scales.
Penrose's scorn for branch cuts is aesthetic. In numerical work, cuts remain indispensable: every software library (Python's cmath, NumPy, Mathematica) implements log, sqrt and arcsin with principal branches and explicit cuts, and many bugs in scientific code come from crossing a cut unawares. Riemann surfaces are the right concept; cuts are the right implementation. Note also that Penrose's anecdote about wing design is an untraceable rumour, which he flags as such.
Riemann surfaces and moduli spaces are now central to string-theory amplitudes: Witten's and Kontsevich's work on the moduli space of curves and, since 2013, Arkani-Hamed and Trnka's amplituhedron and related "positive geometries" recast scattering amplitudes as volumes of geometric objects. The amplituhedron encodes all-loop integrands of planar N = 4 super-Yang-Mills, and in 2023-25 the programme spread to non-supersymmetric theories through "surfaceology", which writes amplitudes as counting problems on surfaces, a direct descendant of Penrose's twistor programme.
The Riemann-surface move, "let the object define its own domain instead of forcing it onto a fixed one", is a sound modelling principle for enterprise data: a customer entity that genuinely has multiple valid states (several legal entities, several product relationships) is better modelled as a multi-sheeted structure with explicit transitions than by cutting it arbitrarily into one canonical record.
Fourier Decomposition and Hyperfunctions
Signals must be able to say something unexpected, so physics needs functions far less rigid than analytic ones. Fourier decomposes any periodic wave into pure tones; Penrose recasts this as a Laurent series on the unit circle of the Riemann sphere, which splits every function into positive- and negative-frequency parts, the splitting at the heart of quantum field theory. The most general "functions" of all, Sato's hyperfunctions, turn out to be nothing but jumps between holomorphic functions: Euler's honest functions come back as the building blocks of everything.
9.1 Fourier series
Analytic functions are rigid (§7.4): a fragment fixes the whole. That is fatal for signalling, where the sender must be able to "change one's mind" mid-message; wave theory is largely the study of how discontinuities and non-analyticities propagate. Joseph Fourier (1768–1830) showed how to decompose a periodic function, f(χ + l) = f(χ), into pure tones sin and cos (period 2π, or 2πχ/l rescaled) and their higher harmonics (n oscillations per period).
- Trigonometric: f(χ) = c + a₁cos ωχ + b₁sin ωχ + a₂cos 2ωχ + b₂sin 2ωχ + …
- Complex exponential: f(χ) = Σ αₙ einωχ over all integers n, with αₙ = ½(aₙ − ibₙ), α₋ₙ = ½(aₙ + ibₙ), α₀ = c. F is real exactly when α₋ₙ is the complex conjugate of αₙ.
- Laurent series: put z = eiωχ, F(z) = f(χ): F(z) = Σ αᵣ zʳ, a power series with negative as well as positive powers. Coefficients: αₙ = (1/2πi) ∮ z−n−1 F(z) dz (Ex. 9.2).
9.2 Functions on a circle
A periodic function lives on a circle; take the unit circle, l = 2π, ω = 1, z = eiχ. Then the n-th harmonics are just z±n, and Fourier analysis is Laurent analysis. The magic: what the series does off the circle tells us about F on it.
Split F = F₊ + α₀ + F₋ with F₋ = α₁z + α₂z² + … (positive powers; converges for |z| < A) and F₊ = α₋₁z−1 + α₋₂z−2 + … (a power series in w = 1/z; converges for |z| > B). If B < 1 < A, the series converges on an annulus containing the unit circle. That happens exactly when f is analytic; for non-analytic f the annulus collapses onto the circle or the circle becomes its boundary. (The naming F₋ for positive powers and F₊ for negative follows an "unfortunate" but universal quantum-mechanical sign convention, for which Penrose apologizes.)
9.3 Frequency splitting on the Riemann sphere
On the sphere the unit circle is the equator and the annulus a collar. Positive-frequency part: extends holomorphically into one hemisphere; negative-frequency part: into the other. Ignoring constants, the split is unique. An oriented loop's "inside" is where an anticlockwise clock face would sit; reversing orientation swaps the frequencies. The usual definition counts Fourier components (e−inχ positive, einχ negative, n > 0), but Penrose's holomorphic version is more general: Möbius maps that preserve each hemisphere but move the poles preserve the splitting while scrambling individual Fourier modes (Ex. 9.4). This formulation is what twistor theory uses (§33.10).
For time t running over the whole real line, use t = tan(χ/2) (equivalently the Möbius map t = (z − 1)/(iz + i) of §8.3, which sends the unit circle to the real axis, its inside to the upper half t-plane and outside to the lower). Positive-frequency functions of t extend holomorphically into the lower half-plane, negative-frequency into the upper, with care at t = ∞ handled by working on the Riemann sphere.
9.4 The Fourier transform
Let the period l → ∞: harmonics crowd together until every frequency is allowed, sums become integrals, and non-periodic "one-off" signals can be analysed. Scale l = 2πN, track the frequency p = r/N (in quantum mechanics, the momentum, with ħ = 1), replace αᵣ by a density g(p)dp, and zr = eiχp:
- f(χ) = (2π)−1/2 ∫ g(p) eiχp dp
- g(p) = (2π)−1/2 ∫ f(χ) e−iχp dχ
- The two relations are identical except for a sign, the symmetry that makes position and momentum interchangeable in quantum mechanics (§21.11).
9.5 Frequency splitting from the transform
f(χ) is of positive frequency if g(p) = 0 for all p ≥ 0 (only eiχp with p < 0). Euler would frown at such a g, a blatant gluing job of a non-zero function to zero, yet it encodes a perfectly holomorphic property of f: f extends holomorphically into the lower half-plane. The two definitions agree once the point χ = ∞ is treated hyperfunctionally. Penrose's geometry: grow the period-l circles, all touching at the origin, centred at C = −il/2π; as l → ∞ they flatten into the real axis, and C becomes ∞ on the Riemann sphere, lying on the very circle it was the centre of, which is why the discrete series turns into an integral.
9.6 What kind of function is appropriate?
Symmetry demands equal standards for f and its transform g, yet a nice positive-frequency f has a non-analytic g; behaviour at ∞ is rarely analytic; and signals must be non-analytic. So which is right, Euler's analytic functions or the modern "any mapping"?
Early in the 19th century Fourier shocked the "Eulerian" establishment, who met him with "a great deal of opposition", by showing that discontinuous waves have innocent-looking series: s(χ) = sin χ + ⅓ sin 3χ + ⅕ sin 5χ + ⅐ sin 7χ + … sums to a square wave of height ±π/4. As a Laurent series the annulus of convergence shrinks to the unit circle itself. Yet each half sums to a perfectly good holomorphic function: S₋ = log((1 + z)/(1 − z))-type logarithms inside, S₊ likewise outside, with 2i·s(χ) = S₋ + S₊. Mapping to the t-plane and following the logarithms from t = i and t = −i shows S₋ + S₊ = +iπ/2 on the top half of the circle and −iπ/2 on the bottom. The jump is produced by branch points at z = ±1 on the circle, which also stop either series converging past the circle.
Try it in Python: square wave and the Gibbs overshoot
import numpy as np
x = np.linspace(1e-4, np.pi/2, 200001)
for K in (1, 5, 50, 500):
s = sum(np.sin((2*k+1)*x)/(2*k+1) for k in range(K))
print(K, s.max())
print(np.pi/4)
Output: maxima 1.0, 0.9286, 0.92599, 0.92597 against a plateau of π/4 = 0.7854. The peak converges not to π/4 but to about 1.179 × π/4: a permanent 9% overshoot (of the full jump) next to the discontinuity, which more terms squeeze closer to the jump but never remove.
9.7 Hyperfunctions
Generalize the square wave: a function on a curve as the jump between a holomorphic function on one side and another on the other side, neither of which need extend across. This is Mikio Sato's hyperfunction (1958), defined with great economy.
- Take a real segment γ = (a, b), an open region R₋ below it and R₊ above, and holomorphic f on R₋, g on R₊.
- A hyperfunction is the pair (|f, g|) modulo pairs (h, h) with h holomorphic on R = R₋ ∪ γ ∪ R₊: (f, g) ~ (f + h, g + h). Adding h changes how f and g continue away from γ but not the jump. (The same equivalence-class idea as fractions in the Preface, "and no less confusing".)
- Excision theorem: the result is independent of the choice of R, as long as R contains γ; R − γ may even be connected, in which case hyperfunctions are "holomorphic functions on R − γ modulo holomorphic functions on R".
- On a circle on the Riemann sphere take R = the whole sphere: the only global holomorphic functions are constants, so a hyperfunction splits uniquely (mod constants) into positive- and negative-frequency parts.
Operations: sums (|f, g|) + (|f₁, g₁|) = (|f + f₁, g + g₁|); derivatives d/dz componentwise; product with an analytic q componentwise. But no product of two hyperfunctions, a limitation shared by every theory of generalized functions: δ(x)² has no meaning, which causes "many quantum field theorists no end of trouble". Integral: ∫ f along a contour just below the real line minus ∫ g just above it. Examples: the step θ(x) is the jump of (1/2πi) log z-type functions across ℝ (branch with log 1 = 0), and the delta function is the jump of −1/(2πiz), i.e. The familiar δ(x) = (1/2πi)[1/(x − i0) − 1/(x + i0)]; checking ∫ q(x)δ(x)dx = q(0) for analytic q is Ex. 9.14.
Hyperfunctions include all analytic functions, all C−1 functions (θ, square waves), and, by differentiation, all C−n for every n, including all distributions (C−∞). Duality makes the pattern exact: the dual of Cⁿ is C−2−n, the dual of C∞ is C−∞ (distributions), and the dual of the analytic functions Cω is C−ω = the hyperfunctions. The most general functions are built from Euler's holomorphic ones: "one of the supreme magical achievements of complex numbers".
| Smoothness class | Example | Dual class |
|---|---|---|
| Cω (analytic) | ex, sin x | C−ω = hyperfunctions |
| C∞ | h(x) glued at 0 | C−∞ = distributions |
| C⁰ | ∣x∣ | C−2 (e.g. δ) |
| C−1 | θ(x), square wave | C−1 |
Worked example: the sawtooth
The sawtooth f(χ) = χ on (−π, π), repeated, has f(χ) = 2(sin χ − ½ sin 2χ + ⅓ sin 3χ − …). Its coefficients fall like 1/n, the signature of a jump (a C−1 function); a continuous function with a corner, like |χ|, has coefficients falling like 1/n²; a C∞ function's fall faster than any power; an analytic function's fall exponentially, which is the annulus of convergence in disguise. Smoothness is readable directly from how fast the Fourier coefficients decay.
Terms to know
| Term | Meaning |
|---|---|
| Periodic function | f(χ + l) = f(χ); l is the period |
| Harmonic | Pure tone oscillating n times per period |
| Laurent series | Σ αᵣzʳ over all integers r, positive and negative powers |
| Annulus of convergence | Ring B < ∣z∣ < A where a Laurent series converges |
| Positive / negative frequency | Extends holomorphically into one / the other hemisphere of the Riemann sphere |
| Fourier transform | Continuous decomposition into all frequencies; f and g are mutual transforms |
| Distribution | Generalized function, dual of C∞ (C−∞) |
| Hyperfunction | Jump between holomorphic functions across a curve, modulo common holomorphic parts; dual of Cω |
Record a pure sine tone and then cut it abruptly to silence. The waveform now has a jump, and a jump is a C−1 function whose Fourier coefficients fall off only like 1/n: the cut injects energy at every frequency, which the ear hears as a click. Audio engineers fade out instead, replacing the jump with a smooth ramp whose spectrum dies off fast. Penrose's hyperfunction picture says the click is literally the jump between two holomorphic functions, one living "inside" the Riemann-sphere circle and one "outside", meeting at branch points where the cut occurs.
Penrose's exercises for Chapter 9
- 9.1-9.2: derive the complex coefficients αₙ from aₙ, bₙ, c, and obtain them as contour integrals αₙ = (2πi)−1∮z−n−1F(z)dz.
- 9.3-9.5: see why the frequency split is unique, identify the Möbius maps preserving each hemisphere (moving the poles but preserving the split), and check that the circle-to-line map gives t = tan(χ/2).
- 9.6: derive the inverse Fourier transform as a limit of the contour formula.
- 9.7-9.11: derive the Laurent form of the square-wave series, sum each half with the log series about z = 1, show S₋ and −S₊ differ by a constant multiple of i, and follow the logarithms to get the ±π/4 plateaus.
- 9.12-9.14: relate the two definitions of hyperfunction, sort out a domain subtlety in the product with analytic q, and check ∫ q(x)δ(x)dx = q(0).
Why the split matters for physics
In quantum theory a wavefunction's time dependence e−iEt/ħ has positive energy E exactly when it is built from positive-frequency components (the sign convention behind F₊ and F₋). In quantum field theory, the positive-frequency part of a field annihilates particles and the negative-frequency part creates them, so the distinction between particle and antiparticle, and the very notion of a vacuum, depends on the splitting. Because Penrose defines the split holomorphically, by extension into a half of the Riemann sphere, it survives transformations that scramble individual Fourier modes, which is the property twistor theory later exploits to describe massless fields.
Positive-frequency splitting defines particles versus antiparticles in QFT (§§24.3, 26.2-4); the Fourier transform links position and momentum (§21.11); hyperfunctions and sheaf cohomology return in twistor theory (§33.9).
Test yourself
- Q. Why are analytic functions unsuitable for signals? They are rigid: a small piece fixes the whole, so nothing unexpected can be sent.
- Q. What is the positive-frequency condition for a function of time? Its Fourier transform vanishes for p ≥ 0, equivalently it extends holomorphically into the lower half-plane.
- Q. What is a hyperfunction, in one line? A jump between holomorphic functions on either side of a curve, modulo holomorphic functions across it.
Penrose's preference for hyperfunctions over Schwartz distributions is minority practice: physicists and engineers overwhelmingly use distributions, which suffice for almost all applications and have a far richer toolkit. Hyperfunctions shine mainly in microlocal analysis and in twistor theory, Penrose's own programme, so the chapter's climax is partly an argument for his later chapters. Also note that the square-wave plateau is ±π/4: the extracted source text drops the "/4", but the result is standard.
Frequency splitting is no longer abstract. It underlies the Unruh effect and Hawking radiation (an accelerated or curved-spacetime observer splits positive and negative frequency differently), and analogue versions have been measured: Steinhauer's sonic black hole in a Bose-Einstein condensate (2016, 2019) observed Hawking-like entangled pairs, and 2021-25 experiments in fluids and optics reported stimulated analogue radiation. On the engineering side, the FFT (Cooley-Tukey 1965) remains among the most-run algorithms on Earth, and the Gibbs overshoot is why audio and image codecs use windowing and why JPEG shows "ringing" near sharp edges.
Fourier thinking is everywhere in modern AI: Fourier neural operators learn PDE solutions in frequency space, spectral analyses of transformer attention reveal low-frequency bias, and positional encodings in the original Transformer were sinusoids at geometrically spaced frequencies, a Fourier basis for position. For time-series risk monitoring in banking, a frequency decomposition separates seasonal cycles from the one-off jumps that, like a square wave's edge, carry the real information.
Surfaces
Penrose now leaves the comfortable world of one complex dimension and builds the toolkit for curved spaces of any dimension. Smoothness, partial derivatives, vector fields as "fields of arrows", 1-forms as contour systems, and the Cauchy–Riemann equations that let a real 2-surface carry a complex structure are introduced on the simplest case, a real 2-manifold, because everything said for a surface carries over almost word for word to the n-manifolds of modern physics.
10.1 Complex dimensions and real dimensions
Every "surface" met so far (the complex plane, the Riemann sphere, the Riemann surfaces of Chapter 8) is, in Penrose's recommended frame of mind, really a complex curve: points are labelled locally by a single complex parameter, so the space has one complex dimension. Splitting z into real and imaginary parts, z = x + iy, is possible, but it is not a holomorphic operation, and so long as we stay inside holomorphic structures a complex parameter counts as one dimension.
The opposite stance treats holomorphic operations as a special case of more general ones. The gateway is complex conjugation, z̄ = x − iy, which reflects the z-plane in the real axis. Holomorphic maps always preserve orientation; conjugation reverses it. Once conjugation is added to addition, multiplication and limits, any continuous function of x and y can be built, because
- x = (z + z̄)/2 and y = (z − z̄)/2i recover the real coordinates;
- any continuous function of x and y is a sum, product and limit of real numbers.
Penrose writes such non-holomorphic functions as F(z, z̄), a reminder that the moment z̄ appears we are on a 2-real-dimensional space. Two examples fix the idea: F = z² + z̄² gives f(x, y) = 2x² − 2y², and F = z z̄ gives x² + y² = |z|², the squared modulus.
A complex "surface" is a curve with one complex dimension as long as only holomorphic operations are used. Admit z̄ and the same object becomes a real 2-manifold. Which description is "right" depends on what structure we keep, and Penrose will return to the "purity" of holomorphic thinking in twistor theory (Chapter 33).
10.2 Smoothness and partial derivatives
A manifold of dimension n (an n-manifold) is the general arena: general relativity uses a 4-manifold for spacetime, string theories use more. Chapter 10 works with a real 2-manifold S because it is representative of the general case. Its only structure is smoothness; there is no conformal structure and no notion of holomorphic function on it.
Penrose's intuition pump is a sphere sitting in Euclidean 3-space, with h the height above the equatorial plane:
- h itself is smooth everywhere on the sphere, including the poles where the contour circles shrink to points.
- |h| is not smooth along the equator, where it has a crease like the graph of |x|.
- h² is smooth all over S, even though it is built from |h|.
To make smoothness precise we cover S with coordinate patches, glued together as for Riemann surfaces (the sphere needs at least two). On one patch, real coordinates (x, y) label points, and a smooth function Φ: S → ℝ (or ℂ), also called a scalar field, appears as Φ = f(x, y). Penrose insists on different letters: Φ lives on the manifold, f lives on a coordinate patch and "knows" what x and y are.
Partial derivatives and their traps
The partial derivative ∂f/∂x differentiates in x holding y fixed. Example: f = x² + xy² + y³ gives ∂f/∂x = 2x + y² and ∂f/∂y = 2xy + 3y². Being smooth in x for fixed y and smooth in y for fixed x is far from sufficient for smoothness in the pair. Exercise [10.3] makes this vivid with f = xy(x² + y²)−N:
- N = 2: smooth along every coordinate line, yet unbounded near the origin.
- N = 1: bounded but not continuous at the origin.
- N = ½: continuous, but not smooth along x = y.
A sufficient extra condition is that the partial derivatives be continuous in (x, y); that defines C¹. With C² the mixed partials agree, ∂²f/∂x∂y = ∂²f/∂y∂x, and exercise [10.5] shows they can differ for f = xy(x² − y²)/(x² + y²) at the origin, where second derivatives fail to be continuous.
Changing patches
On an overlap of an (x, y)-patch and an (X, Y)-patch, F(X, Y) = f(x, y) even though F and f can be wildly different expressions. The coordinate maps X = X(x, y), Y = Y(x, y) and their inverses are the transition functions; requiring them to be C∞ makes "Φ is smooth" independent of coordinates.
10.3 Vector fields and 1-forms
The coordinate-free derivative of Φ is dΦ = (∂f/∂x) dx + (∂f/∂y) dy. Here Penrose changes the meaning of "d". In Chapter 6, dx was a formal infinitesimal; now dΦ is a geometric object, a 1-form, and remarkably the old formal rules (such as d(log x) = dx/x) survive unchanged provided we never divide by dx.
The operator ∂/∂x must also be made sense of on S. Under a coordinate change the chain rule gives
∂/∂x = (∂X/∂x) ∂/∂X + (∂Y/∂x) ∂/∂Y,
which has the general form ξ = A ∂/∂X + B ∂/∂Y with smooth A, B. Any operator of this form is a vector field; it keeps the same form (with new coefficients a, b) in any other patch, so it extends across S.
Geometrically, a vector field is a field of little arrows on S (think of TV weather wind charts), vanishing where arrows shrink to points. Acting on Φ, ξ(Φ) = a ∂Φ/∂x + b ∂Φ/∂y is the rate of increase of Φ along the arrows, and longer arrows give proportionally larger rates. Properly the arrows are infinitesimal.
Take X = x, Y = y + x. Then ∂/∂X = ∂/∂x − ∂/∂y while ∂/∂Y = ∂/∂y. So ∂/∂X differs from ∂/∂x although X equals x, and ∂/∂Y equals ∂/∂y although Y differs from y. Nick Woodhouse calls this the second fundamental confusion of calculus: ∂/∂x depends on which other coordinates are held fixed, so it "is about y as much as x". The first confusion is mixing up Φ and f.
The 1-form dΦ is best pictured as a system of contour lines. Penrose's hiking-map image: Φ is height above sea level, dΦ is the slope. Along a contour the gradient is zero, so the contour direction at p is exactly the arrow ξ with ξ(Φ) = 0 (the "axis of tilt"). Crossing contours, ξ(Φ) is measured by how crowded the contours are in the direction of crossing.
10.4 Components and the scalar product
In a coordinate system, ξ = a ∂/∂x + b ∂/∂y has components (a, b), and dΦ = u dx + v dy has components (u, v) with u = ∂Φ/∂x, v = ∂Φ/∂y. They combine in the scalar (inner) product
dΦ • ξ = ξ(Φ) = au + bv.
- Vector field ξ. A differential operator; a field of arrows; components a, b transform like ∂/∂x.
- 1-form η. Anything that eats a vector field and returns a scalar, η • ξ; pictured as contour lines; components transform like dx.
- Duality. 1-forms (also called covectors) are dual to vector fields; not every 1-form is a gradient dΦ (§12.3 develops the general case).
- Contour rule. ξ points along the contours of dΦ exactly when dΦ • ξ = 0.
10.5 The Cauchy–Riemann equations
What extra structure turns a real 2-surface into a Riemann surface (a complex 1-manifold)? We need a way to recognise which complex-valued Φ are holomorphic, consistently on patch overlaps. On each patch Φ must be holomorphic in z = x + iy, and on overlaps Z = X + iY must be holomorphic in z (a holomorphic function of a holomorphic function is holomorphic).
Penrose's heuristic: write Φ as a function of z and z̄. If u, v were independent real variables, "Ψ independent of v" would read ∂Ψ/∂v = 0. By analogy, holomorphicity is ∂Φ/∂z̄ = 0, which is correct though the analogy is not a proof (note 10.4 warns the statement is local: on a kidney-shaped region avoiding the positive u-axis, ∂Φ/∂v = 0 does not force Φ to be a single function of u). Via the chain rule,
∂/∂z̄ = ½(∂/∂x + i ∂/∂y), so ∂Φ/∂x + i ∂Φ/∂y = 0.
Writing Φ = α + iβ with α, β real gives the Cauchy–Riemann equations:
∂α/∂x = ∂β/∂y, ∂α/∂y = −∂β/∂x.
The same equations hold between the coordinate pairs (x, y) and (X, Y) on every overlap; if they do, the patches assemble into a Riemann surface. This is the analytic condition Penrose "skated over" in §7.1.
Penrose's note 10.6 records that Jean le Rond d'Alembert found these equations in 1752, long before Cauchy or Riemann. The name is a historical accident of the kind Stigler's law predicts.
Laplace's equation, soap films and the hyperfunction claim
Differentiating the Cauchy–Riemann pair shows that α and β are each harmonic: ∇²α = 0, ∇²β = 0, with the 2-dimensional Laplacian ∇² = ∂²/∂x² + ∂²/∂y². Laplace's equation governs a soap film that deviates only slightly from horizontal on a wire loop (the exact minimal-surface equation has a general solution in free holomorphic functions found by Weierstrass in 1866), and in three dimensions it governs Newtonian gravitational and electrostatic potentials in free space.
Conversely, given harmonic α, setting β = ∫ (∂α/∂x) dy satisfies both Cauchy–Riemann equations. Penrose uses this to justify the claim at the end of Chapter 9 that any continuous function f on the unit circle is a hyperfunction:
- Extend f inside the circle as a harmonic function (the Dirichlet problem for a disc; the soap film on a wire bent by a scaled-down ϵf makes it plausible, and compactness of the circle makes f bounded so the scaling works).
- Supply the harmonic conjugate g, so f + ig is holomorphic inside; its boundary value is of negative frequency.
- Repeat outside the circle on the Riemann sphere, giving f − ig, of positive frequency.
- Adding the two pieces recovers f: Penrose writes f = (f + ig) + (f − ig), which literally sums to 2f, so a factor of ½ is understood on each piece.
Short check that holomorphic functions satisfy Cauchy–Riemann and have harmonic real parts, while z z̄ fails:
import sympy as sp
x, y = sp.symbols('x y', real=True)
for name, F in [("z^2", (x+sp.I*y)**2),
("z*conj(z)", (x+sp.I*y)*(x-sp.I*y)),
("exp(z)", sp.exp(x+sp.I*y))]:
a = sp.re(sp.expand_complex(F)); b = sp.im(sp.expand_complex(F))
cr = sp.simplify(sp.diff(a,x)-sp.diff(b,y))==0 and \
sp.simplify(sp.diff(a,y)+sp.diff(b,x))==0
print(name, "CR:", cr, " Laplacian of Re:",
sp.simplify(sp.diff(a,x,2)+sp.diff(a,y,2)))
z^2 CR: True Laplacian of Re: 0
z*conj(z) CR: False Laplacian of Re: 4
exp(z) CR: True Laplacian of Re: 0
Why Cauchy–Riemann means "conformal"
The Cauchy–Riemann equations have a one-line geometric reading that ties this chapter to §8.2. The Jacobian matrix of the map (x, y) ↦ (α, β) is
[∂α/∂x ∂α/∂y; ∂β/∂x ∂β/∂y] = [a −b; b a] with a = ∂α/∂x, b = ∂β/∂x,
which is exactly a rotation combined with a uniform scaling by √(a² + b²). So a holomorphic map, wherever its derivative is non-zero, preserves angles and orientation on the infinitesimal scale: it is conformal. Complex conjugation, by contrast, has Jacobian diag(1, −1), a reflection, which is why it reverses orientation and lies outside the holomorphic world.
Penrose openly uses plausibility arguments: the soap film for the Dirichlet problem, the "independence of z̄" analogy for Cauchy–Riemann. He flags both (notes 10.5 and 10.8) and points to rigorous treatments (Strauss; Brown and Churchill). Readers should treat them as intuition pumps, not proofs; the Dirichlet problem on a disc is solved rigorously by the Poisson integral, and Penrose's hyperfunction claim needs the boundary-value theory of Sato, which he does not develop. Note 10.2 adds a historical aside: Leibniz's dx notation behaves algebraically, but his d²x for second derivatives does not; writing the second derivative as (d²y − d²x dy/dx)/dx² would have made it consistent, at the cost of clumsiness.
Terms to know
| Term | Meaning |
|---|---|
| Complex curve | A space with one complex dimension, such as a Riemann surface viewed holomorphically |
| Smooth (Ck, C∞) | Partial derivatives up to order k exist and are continuous in all variables jointly |
| Coordinate patch | An open piece of the manifold with coordinates (x, y); patches glue by smooth transition functions |
| Scalar field Φ | A smooth function on the manifold itself, written f(x, y) only inside a patch |
| Vector field ξ | An operator a∂/∂x + b∂/∂y: a field of arrows giving directional rates of change |
| 1-form dΦ | The gradient as a geometric object: a field of contour systems, paired with vectors by dΦ • ξ = ξ(Φ) |
| Components | The coordinate-dependent labels (a, b) of ξ or (u, v) of dΦ |
| Cauchy–Riemann equations | ∂α/∂x = ∂β/∂y, ∂α/∂y = −∂β/∂x: the condition for α + iβ to be holomorphic |
| Harmonic function | A solution of Laplace's equation ∇²α = 0 |
| Harmonic conjugate | The β that makes α + iβ holomorphic, β = ∫(∂α/∂x)dy |
Penrose's best image for a 1-form is a paper hiking map. The height function is Φ; the contour lines are where Φ is constant; your direction of walking is a vector ξ. Walking along a contour, you neither climb nor descend (dΦ • ξ = 0). Walking across crowded contours, you climb fast. Now redraw the same terrain on a different map projection: every coordinate and every component changes, but the steepness you feel in your legs does not. That invariance is exactly what makes dΦ, rather than its components, the real object, and it is why Penrose insists on distinguishing Φ (on the land) from f (on the map).
For an AI architect the chapter's moral is the separation of a quantity from its representation. A feature vector, an embedding or a risk score lives in some coordinate system chosen for convenience; invariant meaning lives in relations like dΦ • ξ, which survive a change of basis. Penrose's "second fundamental confusion" (∂/∂x depends on what is held fixed) is the calculus version of a familiar modelling error: a partial effect depends on which other variables the model holds constant.
What the exercises ask
| Exercise | Task |
|---|---|
| 10.1 | Build subtraction and division from addition, multiplication and limits |
| 10.2 | Derive x and y from z and z̄; show z z̄ = ∣z∣² |
| 10.3 | The three N-cases of xy(x² + y²)−N: unbounded, discontinuous, non-smooth |
| 10.4–10.5 | Mixed partials agree for polynomials; a counterexample at the origin |
| 10.6–10.9 | Coordinate changes, components of ξ, the second confusion, ξ(Φ) = au + bv |
| 10.10–10.14 | Why holomorphic of holomorphic is holomorphic; derive Cauchy–Riemann; harmonic conjugates |
| 10.15 | The kidney-shaped region where ∂Φ/∂v = 0 but Φ is not a function of u |
Penrose's soap-film plausibility arguments are now routine numerical tools: harmonic extension and conformal maps are computed by fast Laplace solvers, and discrete Cauchy–Riemann equations underpin discrete complex analysis, used by Stanislav Smirnov in the work on conformal invariance of lattice models that earned him the 2010 Fields Medal. The coordinate-free calculus of this chapter is also the basis of discrete exterior calculus, used in computer graphics and geometry processing.
Hypercomplex numbers
Before the modern machinery of n-manifolds, Penrose tours the nineteenth-century attempts to push complex numbers into higher dimensions: Hamilton's quaternions, octonions, Clifford algebras and Grassmann algebras. The tour pays off twice. It explains why the quaternions disappointed as a "calculus of space", and it smuggles in the most important idea of the chapter, the spinor, an object that turns into its negative under a full 2π rotation and returns to itself only after 4π, without which ordinary solid matter could not exist.
11.1 The algebra of quaternions
The success of complex analysis, above all the way holomorphic functions solve the 2-dimensional Laplace equation, sent nineteenth-century mathematicians hunting for "generalised complex numbers" for 3-dimensional space. William Rowan Hamilton (1805–1865) found the answer on 16 October 1843, walking with his wife along the Royal Canal in Dublin, and carved it on Brougham Bridge:
i² = j² = k² = ijk = −1.
A general quaternion is q = t + ui + vj + wk with t, u, v, w real. The great novelty is the loss of commutativity: ij = −ji = k, jk = −kj = i, ki = −ik = j (each follows from the bridge equations plus associativity, exercise [11.1]).
- Ring. Addition commutative and associative, multiplication associative, both distributive laws; Penrose finds the term "totally non-intuitive".
- Ring with identity. Also has 0 and 1 with a + 0 = a and 1a = a1 = a.
- Vector space over ℝ. Elements add (commutatively, associatively) and are scaled by reals with (f + g)ξ = fξ + gξ, f(ξ + η) = fξ + fη, f(gξ) = (fg)ξ, 1ξ = ξ. Quaternions form a 4-dimensional one with basis 1, i, j, k.
- Algebra over ℝ. A vector space with a compatible multiplication.
- Division ring. Every non-zero element has an inverse with q⁻¹q = qq⁻¹ = 1.
The inverse comes from the quaternionic conjugate q̄ = t − ui − vj − wk: since q q̄ = t² + u² + v² + w² is a positive real unless q = 0, we have q⁻¹ = q̄ (q q̄)⁻¹. Quaternions are therefore a non-commutative division ring. Penrose's note 11.1 records the claim (by Eduard and Klein, 1898) that Gauss had the multiplication law around 1820 but never published, a claim disputed by Tait and Knott.
11.2 Why quaternions under-delivered
Hamilton spent his last 22 years trying to build a quaternionic calculus for physical space. Penrose judges the effort a relative failure, while granting that quaternions have real roles and that their generalisations have been enormously influential. He gives two reasons, which double as a lesson for anyone seeking "the right mathematics" for physics.
- Wrong dimension and wrong signature. The analogy goes from 2 to 4 dimensions, not 3, because one dimension is the real axis t. It is tempting to read t as time and get a 4-dimensional spacetime, but the natural quadratic form t² + u² + v² + w² has the wrong signature for relativity, which needs t² − u² − v² − w².
- No holomorphic theory. Complex holomorphic functions are those "independent of z̄". But for quaternions the conjugate is algebraic in q: q̄ = −½(q + iqi + jqj + kqk). If "quaternionic-holomorphic" means built from q by addition, multiplication and limits, then q̄ qualifies, which "rather spoils the whole idea". Quaternions are poor magicians compared with complex numbers.
The division property is rare and precious. Hurwitz (1898): the identity "norm = sum of squares" works only in dimensions 1, 2, 4, 8. A deep topological theorem (Adams and Atiyah, met again in §15.4) shows the only division algebras over the reals are ℝ, ℂ, ℍ and 𝕆. Every route to useful higher-dimensional algebra (Clifford, Grassmann) must give division up.
Octonions
About two months after Hamilton's letter announcing quaternions, John Graves (1843) found octonions, rediscovered by Arthur Cayley in 1845. They form an 8-dimensional non-associative division algebra with seven imaginary units. Associativity fails, but a remnant survives as the alternative laws a(ab) = a²b and (ab)b = ab², and inverses still work: a⁻¹(ab) = b = (ba)a⁻¹. Their multiplication table is deferred to §16.2 and the Fano-plane picture of Fig. 16.3.
Penrose's verdict on quaternions is aesthetic and historical rather than a theorem. Quaternions remain the standard representation of 3D rotations in aerospace attitude control, robotics, computer graphics and game engines, because they avoid gimbal lock and interpolate smoothly. And octonions, which Penrose treats briefly, are argued by John Baez and Cohl Furey to organise the exceptional Lie groups and possibly Standard Model fermion structure; that programme is speculative and not mainstream.
11.3 Geometry of quaternions and the spinor
Take i, j, k as three perpendicular right-handed axes. The complex i means "rotate through a right angle"; by analogy the quaternion i might be a right-angle rotation about the i-axis. That fails: Penrose's book experiment (lay a book flat, k up, i to the right, j away from you; turn a right angle about i, then about j) leaves the book spine-up, a position no single rotation about k can produce.
What works is rotation through π. But then two π-turns about the same axis give 2π, which seems to restore the object and so give i² = +1, not −1. The way out is the spinor: an object that becomes its negative after a 2π rotation.
Penrose's construction of a "spinorial object": an ordinary object plus an imaginary flexible attachment to a fixed external structure, two configurations counting as the same only if the attachments can be continuously deformed into each other. Every ordinary configuration corresponds to exactly two spinorial ones, and we call one the negative of the other. The belt tracks the parity of the number of 2π rotations, whatever axes are used.
With the belt between the pages, a π-turn about i followed by one about j equals a π-turn about k. Taking every rotation right-handed actually gives ij = −k; Penrose fixes this by adopting the usual operator convention that pq means "q first, then p" (operators act on what stands to their right, so applying P then Q to Φ gives QPΦ). With that convention all of i² = j² = k² = ijk = −1 hold for the spinorial book. Penrose credits John Conway, who demonstrated quaternion multiplication this way at the 1978 International Congress of Mathematicians in Helsinki.
Spinors are physics, not a curiosity. Electrons, protons and neutrons are spinorial; §23.7 will show that the Pauli exclusion principle, and so the stability of ordinary matter, depends on it. Penrose's note: pronounce it "spinnor", not "spynor".
11.4 How to compose rotations
Translations compose by the triangle law. Hamilton found a rotation analogue: represent a rotation by a great-circle arc on the unit sphere, the rotation axis perpendicular to the arc's plane, and the rotation angle equal to twice the arc length. Then two rotations compose by a spherical triangle law. The proof: reflect the spherical triangle in each of its three vertices; the first rotation carries external triangle 1 to 2, the second carries 2 to 3, and the composite carries 1 to 3, each through twice the arc.
For the quaternions, each π-rotation is drawn as an arc of length π/2, and i² = −1 appears as an arc of length π joining a point to its antipode, which is genuinely different from an arc of length 0 or 2π although all three represent rotations that restore the sphere. The half-angle is the spinor signature. Hamilton's own version used the dual triangle whose vertices are the rotation axes (exercise [11.5]); a relativistic variant returns in §18.4.
Unit quaternions rotate vectors by v ↦ q v q̄, and the half-angle shows up directly: a 2π rotation gives q = −1, only 4π gives +1.
import numpy as np
def qmul(a, b):
t1,u1,v1,w1 = a; t2,u2,v2,w2 = b
return np.array([t1*t2-u1*u2-v1*v2-w1*w2, t1*u2+u1*t2+v1*w2-w1*v2,
t1*v2-u1*w2+v1*t2+w1*u2, t1*w2+u1*v2-v1*u2+w1*t2])
i, j, k = np.eye(4)[1], np.eye(4)[2], np.eye(4)[3]
print("ij =", qmul(i,j), " ji =", qmul(j,i), " ijk =", qmul(qmul(i,j),k))
rot = lambda ax, a: np.r_[np.cos(a/2), np.sin(a/2)*np.array(ax)]
q = rot([0,0,1], np.pi/2); v = np.r_[0,1,0,0]
print("q v q* =", np.round(qmul(qmul(q,v), q*np.r_[1,-1,-1,-1]), 6))
print("2pi:", np.round(rot([0,0,1], 2*np.pi), 6))
print("4pi:", np.round(rot([0,0,1], 4*np.pi), 6))
ij = [0. 0. 0. 1.] ji = [ 0. 0. 0. -1.] ijk = [-1. 0. 0. 0.]
q v q* = [0. 0. 1. 0.]
2pi: [-1. 0. 0. 0.]
4pi: [ 1. -0. -0. -0.]
11.5 Clifford algebras
In n dimensions the elementary rotation has an (n − 2)-dimensional axis. The new ingredient above 3 dimensions: compositions of such rotations need not be rotations about an (n − 2)-dimensional axis; the space left fixed can have various dimensions. So William Kingdon Clifford (1845–1879), in 1878, built a hierarchy, starting from something more primitive than a π-rotation: a reflection in a hyperplane. Two reflections in perpendicular hyperplanes give a π-rotation.
- Generators. Reflections γ₁, …, γₙ, γᵣ reversing the r-th axis.
- Squares. For spinorial objects, reflecting twice gives the negative: γᵣ² = −1.
- Anticommutation. γₚγ_q = −γ_qγₚ for p ≠ q.
- Quaternions inside. For n = 3, i = γ₂γ₃, j = γ₃γ₁, k = γ₁γ₂ satisfy Hamilton's equations.
- Basis. 1, the n single γ's, the C(n,2) products of pairs, C(n,3) triples, …, and the single γ₁γ₂…γₙ: in all (1 + 1)ⁿ = 2ⁿ elements.
- Status. A 2ⁿ-dimensional real algebra and a ring with identity, but not a division ring.
Spinors are what Clifford algebras act on. They entered physics with Dirac's 1928 equation, the electron's state being a spinor (Chapter 24). Some prefer a purely algebraic treatment; Penrose insists on keeping the geometry in view.
| Dimension n | Full spin-space dimension | Half-spinor spaces |
|---|---|---|
| Even n | 2n/2 | Two spaces of 2(n−2)/2 each, opposite chirality |
| Odd n | 2(n−1)/2 | No splitting |
| n = 4 (spacetime) | 4 | Two 2-dimensional spaces: left- and right-handed |
| n = 11 (M-theory) | 32 | None |
When n is even, a reflection swaps the two half-spinor spaces, which have opposite chirality. In 4-dimensional spacetime Nature treats the left- and right-handed 2-spinors differently, which is how parity violation enters physics: predicted by Chen Ning Yang and Tsung-Dao Lee and confirmed by Chien-Shiung Wu and her group in 1957. Because spin-space grows exponentially with n, spinors are most practical in low dimension: 2 per half-space in spacetime, 32 for M-theory.
11.6 Grassmann algebras
Hermann Grassmann (1809–1877), a "little-recognised German schoolmaster", published in 1844 and 1862. His algebra is a degenerate Clifford algebra: anticommuting generators η₁, …, ηₙ with ηₚ ∧ η_q = −η_q ∧ ηₚ for all p, q, so each ηₚ² = 0 (no "p ≠ q" exception is needed, which makes it more systematic).
Clifford algebra
- Generators square to −1.
- Needs a metric: must know what "perpendicular" means to build rotations from reflections.
- Natural home of spinors.
Grassmann algebra
- Generators square to 0.
- Needs no metric, only linear structure; axes may be oblique.
- Natural home of plane elements, differential forms, and the anticommuting variables of supersymmetry.
The wedge product a ∧ b of two vectors represents the oriented, scaled plane element they span, and a ∧ b = −b ∧ a. With the convention of splitting coefficients equally between η₁∧η₂ and η₂∧η₁, its components are the antisymmetrised products a[pbq] = ½(aₚb_q − a_qbₚ). Triple products represent 3-elements, with a∧b∧c = b∧c∧a = c∧a∧b = −b∧a∧c = −a∧c∧b = −c∧b∧a, and components a[pbqcr], the average over all six orderings with signs.
- Grading. The number r of factors is the grade (0 ≤ r ≤ n). A general grade-r element is a sum of simple wedge products and need not describe any single geometric r-element; such "non-geometrical" elements reappear in §12.7.
- Product rule. For grades p and q, P ∧ Q = (−1)pq Q ∧ P, so P ∧ P = 0 when p is odd (exercise [11.14]).
- Invariance. a ∧ b ∧ … is unchanged if a is replaced by a plus any multiple of the other factors (exercise [11.12]), the algebraic form of "shearing a parallelogram does not change its area".
Two 2026 notes. Geometric algebra, the Clifford-algebra reformulation of physics championed by David Hestenes and the Cambridge group (Lasenby, Doran, Gull) that Penrose cites, now has a lively engineering community and is used in robotics and graphics libraries. Separately, Grassmann variables remain the working language of fermions in path integrals and of supersymmetry, though the LHC has found no superpartners through Run 3, which weakens the physical case Penrose mentions for supersymmetry without affecting the mathematics.
Wedge products and the cross product
In three dimensions the Grassmann bivector a ∧ b has three independent components, (a²b³ − a³b², a³b¹ − a¹b³, a¹b² − a²b¹) up to the factor ½, which are the components of the familiar cross product a × b. The cross product is really a bivector disguised as a vector by a choice of volume form and orientation (the duality of §12.7). That is why it flips sign under reflection ("pseudovector") and why it has no analogue in four dimensions, where a bivector has six components, not four. Clifford's algebra combines both products in one: for vectors, ab = a·b + a ∧ b (with Penrose's γ² = −1 convention the dot term carries a minus sign).
| n | Clifford dimension 2ⁿ | Spinor dimension | Penrose's physical example |
|---|---|---|---|
| 2 | 4 | 2 | Complex numbers as even part |
| 3 | 8 | 2 | Quaternions = even part; electron spin |
| 4 | 16 | 4 = 2 + 2 | Dirac spinors; left and right chirality |
| 10 | 1024 | 32 = 16 + 16 | Superstring theory |
| 11 | 2048 | 32 | M-theory |
Terms to know
| Term | Meaning |
|---|---|
| Quaternion | q = t + ui + vj + wk with i² = j² = k² = ijk = −1; a non-commutative division algebra |
| Conjugate and norm | q̄ = t − ui − vj − wk; q q̄ = t² + u² + v² + w² |
| Division algebra | Every non-zero element has an inverse; over ℝ only ℝ, ℂ, ℍ, 𝕆 exist |
| Octonions | 8-dimensional, non-associative but alternative division algebra (Graves, Cayley) |
| Spinor | An object that changes sign under a 2π rotation and returns after 4π |
| Clifford algebra | Generated by γ's with γr² = −1 and anticommutation; dimension 2ⁿ; needs a metric |
| Grassmann algebra | Generated by anticommuting η's with η² = 0; no metric; the algebra of plane elements |
| Wedge product a ∧ b | Oriented, scaled plane element; antisymmetric |
| Grade | The number of vectors wedged together |
| Chirality | Handedness of the two half-spinor spaces in even dimensions |
The belt trick has a bodily version, the "plate trick" (or Balinese candle dance): hold a plate flat on your palm and rotate it a full turn while keeping it level. Your arm ends up twisted. Keep going for a second full turn in the same direction and, surprisingly, your arm untwists. The plate's orientation is an ordinary rotation; the arm-plus-plate configuration is a spinorial object. Penrose's point is that this doubled bookkeeping, which looks like a quirk of attachments, is exactly how electrons transform, and that without it the exclusion principle, and hence the stability of matter, would fail.
Quaternions are the working tool for 3D orientation in robotics, drones, spacecraft attitude control and game engines because composing unit quaternions is cheap and numerically stable and interpolating between them ("slerp") avoids gimbal lock. Penrose's half-angle observation is the reason: a rotation by θ is the quaternion cos(θ/2) + sin(θ/2)n, and the double cover (q and −q give the same rotation) is the practical form of the spinor sign.
What the exercises ask
- [11.1–11.4] Derive ij = −ji etc. From the bridge equations; write general sums and products; check q⁻¹; verify the formula expressing q̄ algebraically in q.
- [11.5] Rebuild Hamilton's dual-triangle construction for composing rotations.
- [11.6–11.8] Two reflections in non-perpendicular planes give a rotation through twice the angle between them; check that γ₂γ₃, γ₃γ₁, γ₁γ₂ obey Hamilton's laws; count the 2ⁿ Clifford basis elements via (1 + 1)ⁿ.
- [11.9–11.14] Derive a ∧ b = −b ∧ a; write a ∧ b for n = 2; expand a four-fold wedge; prove shear invariance; prove P ∧ Q = (−1)pq Q ∧ P and P ∧ P = 0 for odd grade.
Manifolds of n dimensions
This is the chapter that turns the surface toolkit into the language of modern physics. An n-manifold is glued from patches of ℝⁿ; on it live scalars, vectors, covectors, p-vectors and p-forms; Cartan's exterior derivative obeys d² = 0, and one formula, ∫R dφ = ∮∂R φ, contains the fundamental theorem of calculus together with the theorems of Gauss, Green, Kelvin and Stokes. Penrose closes with tensors in abstract-index and diagrammatic notation and with complex manifolds.
12.1 Why study higher-dimensional manifolds?
Many modern theories (string theory among them) put spacetime in more than 4 dimensions, but Penrose's stronger reason is that ordinary physics already needs high-dimensional, topologically non-trivial spaces.
- Configuration space of a rigid body. The space C of positions of a rigid body in Euclidean 3-space is a non-Euclidean 6-manifold: 3 dimensions for the centre of gravity, 3 for orientation. Even its topology differs from Euclidean 6-space.
- Rotation space R. The 3-dimensional orientation part. A 2π rotation of the (unopened) book traces a closed loop in R that cannot be shrunk to a point, because the belt twist cannot be undone; so R and C are multiply-connected.
- Topological torsion. Traverse that loop twice (a 4π rotation) and it does shrink away, something no loop on a torus does.
- Gas configuration space K. For N point particles, 3N dimensions; each point is a full configuration.
- Phase space P. Add the momentum (velocity × mass, 3 components each) of every particle: 6N dimensions. A thimbleful of air with about 10¹⁹ molecules has a phase space of about 6 × 10¹⁹ dimensions.
- Simply-connected. Every closed loop can be continuously shrunk to a point: the plane, the sphere.
- Multiply-connected. Some loop cannot: the torus and surfaces of higher genus, and R and C.
- Homotopy, not homology. Shrinking is in the sense of homotopy; oppositely oriented loop segments may not "cancel".
- Penrose's model of R (exercise [12.17]): a solid ball of radius π, each rotation drawn as a vector along its axis with length equal to its angle, with antipodal boundary points identified. This is real projective 3-space ℝP³ ≅ SO(3).
12.2 Manifolds and coordinate patches
Coordinates are written x¹, x², …, xⁿ with upper indices. Penrose apologises: they are not powers, the convention is historical, he finds it "genuinely irritating", and it nonetheless works well in tensor analysis. A manifold M is glued from patches that are open regions of ℝⁿ, with transition functions on overlaps that must be consistent on every triple overlap.
- Hausdorff condition. Any two distinct points have non-intersecting open neighbourhoods. Without it a manifold can branch (like a line that splits into two), as in Fig. 12.5b.
- Further technical conditions (note 12.4): the topology is specified by its open sets (closed under finite intersection and arbitrary union); manifolds are usually required to be paracompact; Penrose settles for a locally finite patchwork. Connectedness is not insisted on.
- The manifold forgets its patches. Coordinates are auxiliaries; the manifold "stands on its own". A striking alternative (note 12.5): reconstruct M from the commutative algebra of its scalar fields; making that algebra non-commutative leads to Alain Connes's non-commutative geometry, a candidate quantum spacetime geometry.
12.3 Scalars, vectors and covectors
A scalar field Φ is a C∞ function on M. A vector field ξ is defined algebraically as a derivation on scalars, and a theorem says these properties characterise vector fields:
- ξ(Φ + Ψ) = ξ(Φ) + ξ(Ψ)
- ξ(ΦΨ) = Φ ξ(Ψ) + Ψ ξ(Φ) (Leibniz rule)
- ξ(k) = 0 for constant k.
A covector field (1-form) α is a map from vector fields to scalars, linear in the strong sense α • (ξ + η) = α • ξ + α • η and α • (Φξ) = Φ(α • ξ). The relation is symmetric, so the dual of the dual is the original: a "co-covector" is a vector.
At a point o the vectors form the tangent space T₀, an n-dimensional vector space with basis ∂/∂x¹, …, ∂/∂xⁿ; its dual is the cotangent space. The gradient dΦ has components ∂Φ/∂xʳ and satisfies dΦ • ξ = ξ(Φ). At a single point every covector is a gradient; as a field, not every one is.
What a covector looks like
A non-zero covector α at a point determines an (n − 1)-plane element: the vectors with α • ξ = 0. For α = dΦ these planes are tangent to the level surfaces Φ = const, generalising contour lines. In general the planes twist and fit no family of surfaces; the precise condition (note 12.7) is the Frobenius condition α ∧ dα = 0, which makes α = λ dΦ for some scalars λ, Φ.
- Components. ξ = ξ¹ ∂/∂x¹ + … + ξⁿ ∂/∂xⁿ and α = α₁dx¹ + … + αₙdxⁿ; each dxʳ is the (n − 1)-plane spanned by all coordinate axes except the xʳ-axis.
- Scalar product. α • ξ = α₁ξ¹ + α₂ξ² + … + αₙξⁿ.
- Note 12.8's puzzle. Classically dxʳ looks like an infinitesimal displacement, a vector; here it is a covector. Both readings are consistent: with r as an abstract index and d as gradient, dxʳ is just the Kronecker delta.
12.4 Grassmann products: multivectors and forms
- Bivectors. A 2-plane element spanned by ξ, η is the simple bivector ξ ∧ η, components ξ[rηs]. A general bivector is a sum of simple ones, with components ψrs = −ψsr.
- Trivectors and p-vectors. ξ ∧ η ∧ ζ for 3-planes, with totally antisymmetric components; the pattern continues up to n.
- p-forms. Wedging p covectors, α ∧ β ∧ … ∧ δ, gives a simple p-form with components α[rβs…δu]. It determines an (n − p)-plane element, the intersection of the (n − 1)-planes of its factors. A general p-form φrs…u is antisymmetric and is simple only automatically when p = 0, 1, n − 1, n.
- Products. φ ∧ χ has components φ[r…tχu…w], antisymmetrised across all indices.
An (n − 1)-plane element can be described two ways: by a 1-form or by an (n − 1)-vector (the wedge of n − 1 spanning vectors). The difference is subtle: a p-form is a density, the kind of thing that can be integrated over a p-dimensional region, while a multivector is not. The two are interchanged only by choosing a volume element.
12.5 Integrals of forms
Density is "mass per unit volume", the thing written after an integral sign; mass per unit area is a different kind of density. A p-form is what one integrates over a p-dimensional region. The 1-form f(x) dx along a curve is exactly what Leibniz's 17th-century notation suggested, now reread by Élie Cartan (1869–1951) in his exterior calculus, where dx is no longer an infinitesimal but a density.
- Change of variable is automatic. Replace x by X and ∫α is unchanged though its formula changes; this works patch by patch in any ambient manifold.
- Higher dimensions. Integrate f(x, y) dx ∧ dy over 2-regions, 3-forms over 3-regions, and so on. The antisymmetry of dx ∧ dy handles orientation, and the wedge plus d removes any need to mention Jacobians.
- Exercise [12.10] uses this to compute ∫e−x²dx = √π by squaring the integral and passing to polar coordinates.
12.6 The exterior derivative and the fundamental theorem
Cartan's exterior derivative d takes p-forms to (p + 1)-forms and is fixed uniquely by:
- d(α + β) = dα + dβ;
- d(α ∧ γ) = dα ∧ γ + (−1)p α ∧ dγ for a p-form α (the sign arises because d must be "pushed through" p antisymmetric indices);
- d(dα) = 0, written d² = 0;
- on scalars, dΦ is the gradient.
In components, (dα)qr…t ∝ ∂[qαr…t], antisymmetrised across all p + 1 indices including the derivative. Exercise [12.11] gives the most familiar case: d(A dx + B dy) = (∂B/∂x − ∂A/∂y) dx ∧ dy. Penrose keeps the redundant p! Repetitions in sums over indices rather than ordering indices, because the notation "works much better".
- Closed implies exact, locally. If dβ = 0 for a p-form β, then near any point β = dγ for some (p − 1)-form γ.
- Gradients are closed. α = dΦ forces dα = 0, by d² = 0.
- Globally it can fail. On multiply-connected regions a closed form need not be exact: this gap is the subject of de Rham cohomology, and the source of the kidney-shaped counterexample of Chapter 10. (Flanders's book calls this direction the converse of the Poincaré lemma.)
∫R dφ = ∮∂R φ
The fundamental theorem of exterior calculus (name suggested by N. M. J. Woodhouse)Here R is a compact oriented (p + 1)-dimensional region and ∂R its oriented p-dimensional boundary. For a segment from a to b, ∂R is the pair of endpoints (b positive, a negative), and the theorem collapses to ∫f′(x)dx = f(b) − f(a). Penrose declines the usual name Stokes's theorem, since Stokes's only contribution was to set it as a Cambridge examination question he apparently got from William Thomson (Lord Kelvin); the special cases carry the names Ostrogradski, Gauss, Green, Kelvin, Stokes.
Compactness, orientation and boundaries
| Notion | Penrose's working definition | Examples |
|---|---|---|
| Compact | Every infinite sequence in R accumulates at a point of R (general form: every open cover has a finite subcover) | Sphere, torus, closed unit disc |
| Not compact | Some sequence escapes or accumulates at a missing point | Infinite plane, open disc, closed disc minus its centre |
| Oriented | Consistent handedness everywhere: signs on points, arrows on curves, circulation arrows on surfaces, right-handed triads in 3D | Sphere, cylinder |
| Non-orientable | No consistent handedness | Möbius strip |
| Boundary ∂R | Points of R not in its interior; compact, oriented, possibly empty | ∂(disc) = circle; ∂(sphere) = ∅; ∂(cylinder) = two oppositely oriented circles |
The boundary of a boundary is empty, ∂² = 0, the geometric twin of d² = 0. The fundamental theorem makes the two dual to each other.
Check d² = 0 on a sample scalar and the fundamental theorem on the unit disc, where d(x dy) = dx ∧ dy:
import sympy as sp
x, y, t = sp.symbols('x y t', real=True)
Phi = sp.exp(x)*sp.sin(y) + x**3*y
A, B = sp.diff(Phi, x), sp.diff(Phi, y) # dPhi = A dx + B dy
print("d(dPhi) coefficient:", sp.simplify(sp.diff(B,x) - sp.diff(A,y)))
loop = sp.integrate(sp.cos(t)*sp.diff(sp.sin(t), t), (t, 0, 2*sp.pi))
r, th = sp.symbols('r theta', positive=True)
disc = sp.integrate(r, (r, 0, 1), (th, 0, 2*sp.pi))
print("loop of x dy =", loop, "; disc of dx^dy =", disc)
d(dPhi) coefficient: 0
loop of x dy = pi ; disc of dx^dy = pi
12.7 Volume element and the summation convention
An n-form ε on an n-manifold carries no direction, only an n-density; a nowhere-zero one is a volume element. With it, (n − p)-vectors and p-forms convert into each other by contraction (also called transvection): upper indices of ψ are glued to lower indices of ε and summed. Where a manifold comes equipped with a volume element, the distinction between p-forms and (n − p)-vectors disappears. This "duality" is closely related to the Hodge dual of electromagnetism (§19.2), one more case where mathematical terminology overloads a word.
Einstein's summation convention: a repeated index, once up and once down, is summed over 1, …, n without writing Σ, so the scalar product is β • ξ = βrξr. Penrose also uses round brackets for symmetrisation (all plus signs) alongside square brackets for antisymmetrisation, writes ∝ to suppress factorials, and gives the simplicity condition for a p-form: α[r…tαu]v = 0 (all indices of one factor skewed with one index of the other). Since the dual of a simple p-form is a simple (n − p)-vector, the same condition can be written with one contracted index.
12.8 Tensors: abstract indices and diagrams
Mathematicians write β • ξ, coordinate-free; physicists write βrξr, which is flexible but seems to depend on coordinates and on the "objectionable" summation convention. Penrose calls the conflict largely artificial and dissolves it with his abstract-index notation: indices are markers of type and slot, not numbers 1…n, so ξa is the vector, not its components.
- Tensor. Qf…ha…c with p upper and q lower indices has valence [p q]; algebraically it is a multilinear function of q vectors and p covectors. (Note 12.18: "rank" for p + q is avoided because of the clash with matrix rank.)
- Diagrammatic notation. A tensor is a blob with p arms up and q legs down; contraction joins an arm to a leg; a thick bar across lines antisymmetrises and a wiggly bar symmetrises (with factorial denominators dropped). Penrose has used it in handwritten work for over 50 years.
Penrose's graphical notation is now everyday infrastructure under another name: tensor network diagrams. Since the 2000s they have become the standard language of quantum many-body physics (MPS, PEPS, MERA), of the holographic codes used to model AdS/CFT, and of quantum-circuit simulation, and they are increasingly used to explain the tensor contractions inside neural networks. The tensor-network literature routinely credits "Penrose graphical notation" (1971) as the origin.
12.9 Complex manifolds
Glue patches of ℂⁿ with holomorphic transition functions and one gets a complex n-manifold, carrying holomorphic vectors, forms and tensors exactly as above. The other standpoint splits zʲ = xʲ + iyʲ and sees a real 2n-manifold with a complex structure.
- Complex structure J. Write a complex vector field as ζ = ξ + iη. Multiplying by i gives iζ = −η + iξ, so the real operation J(ξ) = −η, J(η) = ξ encodes "multiply by i".
- Almost complex structure. J² = −1 alone.
- Integrability. A genuine complex structure needs a further differential condition, the vanishing of the Nijenhuis tensor built from J.
- Newlander–Nirenberg theorem (1957). That condition is also sufficient: an integrable J makes the real 2n-manifold a complex n-manifold, so the two philosophical standpoints are interchangeable.
The classical theorems as special cases
| p | R and ∂R | ∫Rdφ = ∮∂Rφ becomes | Name |
|---|---|---|---|
| 0 | Curve and its two endpoints | ∫ₐᵇ f′(x)dx = f(b) − f(a) | Fundamental theorem of calculus (Newton, Leibniz) |
| 0 | Curve in space | ∫ ∇f · dr = f(end) − f(start) | Gradient theorem |
| 1 | Plane region and boundary curve | ∬(∂B/∂x − ∂A/∂y)dxdy = ∮(A dx + B dy) | Green's theorem |
| 1 | Surface in 3-space and its rim | ∬(∇ × F) · dS = ∮F · dr | Kelvin–Stokes theorem |
| 2 | Solid region and closed surface | ∭∇ · F dV = ∯F · dS | Gauss–Ostrogradski divergence theorem |
Each row is the same statement for a different p. The vector-calculus operators grad, curl, div are the three faces of the single operator d acting on 0-, 1- and 2-forms in three dimensions, and the identities curl grad = 0 and div curl = 0 are both d² = 0.
Penrose's choices are deliberate but idiosyncratic. He keeps redundant p! Repetitions in sums over form components, suppresses factorials with ∝, uses his own index-ordering and sign conventions, and recommends abstract indices and diagrams that most textbooks do not use. The payoff is calculational fluency; the cost is that formulas in this chapter often differ by constant factors and signs from those in standard references (Flanders, Frankel, Nakahara). Readers cross-checking should expect normalisation mismatches rather than errors.
Terms to know
| Term | Meaning |
|---|---|
| n-manifold | A Hausdorff space glued from open patches of ℝⁿ with smooth transition functions |
| Configuration / phase space | Spaces of positions (3N-dim) or positions and momenta (6N-dim) |
| Multiply-connected | Some closed loop cannot be shrunk to a point |
| Tangent space Tp | The n-dimensional vector space of vectors at p; M "infinitely magnified" |
| Cotangent space | Its dual: covectors at p |
| p-form | Antisymmetric covariant tensor; the thing integrated over p-dimensional regions |
| Exterior derivative d | Takes p-forms to (p + 1)-forms with d² = 0 |
| Poincaré lemma | dβ = 0 implies β = dγ locally |
| Compact | Every sequence accumulates within the space (every open cover has a finite subcover) |
| Orientation | A consistent handedness; fails for the Möbius strip |
| Abstract index | An index marking slot and type, not a coordinate number |
| Valence [p q] | p upper and q lower indices |
| Almost complex structure J | J² = −1 on tangent vectors; integrable if the Nijenhuis tensor vanishes |
A thimble holds about 10¹⁹ air molecules. Treat each as a point; the whole gas is then one point in a phase space of about 6 × 10¹⁹ dimensions, and its entire history is one curve in that space. Every statement of statistical mechanics, including the entropy arguments of Chapter 27, is a statement about volumes of regions in this space. Penrose's lesson: high-dimensional manifolds are not exotic speculation; they are the ordinary setting for a teaspoon of gas, and the integration theory of this chapter (p-forms, volume elements) is what lets us measure them.
Two habits carry directly into enterprise data and AI work. First, coordinates are auxiliaries: a manifold "forgets" its patches, as a well-designed domain model should outlive any particular schema or encoding. Second, Penrose's diagrammatic tensor notation is the ancestor of the tensor-network diagrams now used to reason about contractions in large neural models; drawing which indices join is often clearer than writing them.
What the exercises ask
- [12.1–12.2] Count the 6 dimensions of C; show the doubled loop shrinks using the ball-of-radius-π model.
- [12.3–12.6] dΦ is linear as a covector; level surfaces; dx² has components (0, 1, 0, 0); consistency of α • ξ with dΦ • ξ = ξ(Φ).
- [12.7–12.9] Wedge components; associativity of wedging; change of variable in ∫f(x)dx with limits.
- [12.10–12.15] Gaussian integral √π via polar coordinates; d(A dx + B dy); gradients are closed; Poincaré lemma for p = 1; check the axioms and coordinate independence of the component formula for d.
- [12.16–12.17] Equivalence of the simplicity conditions; the solid-ball picture of rotation space and why a 2π loop cannot shrink.
Symmetry groups
Penrose's longest mathematical chapter is a compact course in group theory and linear algebra, motivated by one striking fact: although no physical square is exactly square, every fundamental interaction in modern physics, gravity included, rests on a gauge connection that needs a symmetry which is exact. The chapter builds the vocabulary for that claim: groups, subgroups, normal subgroups and simple groups, the Killing–Cartan classification, matrices, determinants, traces, eigenvalues, representations and Lie algebras, and the three families of classical groups: orthogonal, unitary and symplectic.
13.1 Groups of transformations
Exact symmetry looks like a Platonic idealisation; any real square is only approximately square. Yet according to the successful theories of the 20th century, all physical interactions work through a gauge connection (Chapter 15), a notion of "twisted" differentiation that needs certain structures to have exactly symmetric fibres. Symmetry groups are the prerequisite, and they also run through chemistry, crystallography and much of mathematics.
The square
Put the square's vertices at 1, i, −1, −i in the complex plane. Its non-reflective symmetries are multiplication by i⁰ = 1, i, i² = −1, i³ = −i; i⁴ = 1 closes the list. The group axioms:
- Associativity: a(bc) = (ab)c;
- Identity: 1a = a1 = a;
- Inverses: a⁻¹a = aa⁻¹ = 1.
Penrose keeps the Chapter 11 convention: in ab, b acts first. This group is Abelian (ab = ba), named after Niels Henrik Abel (1802–1829, dead of tuberculosis at 26); any group faithfully represented by complex multiplication must be Abelian, as are the cyclic groups ℤₙ of Chapter 5. Non-Abelian group theory came from Évariste Galois (1811–1832), killed in a duel before 21 after a night spent writing down Galois theory.
Adding reflections brings in complex conjugation C, which flips the square over. Then Ci = −iC, C(−1) = (−1)C, C(−i) = iC, CC = 1, and the whole group follows from i⁴ = 1, C² = 1, Ci = i³C. This group is non-Abelian with order 8 (it is the dihedral group of the square).
The sphere
Rotations of a sphere form an infinite, continuous group: any angle about any axis. As a space it is the 3-manifold R of Chapter 12, officially SO(3) ("special orthogonal": S for unit determinant, i.e. Orientation-preserving; O because right angles between axes are preserved). Adding reflections gives O(3), a disconnected 3-manifold of two pieces, the identity component SO(3) and the reflective component. The two examples show the two great categories, finite groups and continuous (Lie) groups.
Penrose's note 13.4: every continuous group is automatically smooth and even analytic (C⁰ implies Cω). This answer to Hilbert's 5th problem came from Gleason, Montgomery, Zippin and Yamabe in 1953, and it is what licenses the power-series manipulations of Lie theory.
13.2 Subgroups, normal subgroups and simple groups
A subgroup is a subset that is a group under the same operations. Physics cares because symmetry breaking is described as a putative fundamental symmetry broken down to a manifest subgroup (§§25.5–8, §26.11, §28.1).
- Square subgroups. {1, i, −1, −i}, {1, −1, C, −C}, {1, −1}, plus the trivial {1} and the whole group.
- Normal subgroup. S is normal in G when Sg = gS for every g in G (left and right cosets coincide as unordered sets). All the square subgroups just listed are normal; for example {1, −1, C, −C}i = {i, −i, Ci, −Ci} equals i{1, −1, C, −C} = {i, −i, iC, −iC} because Ci = −iC.
- Non-normal examples. {1, C}: {1, C}i = {i, Ci} but i{1, C} = {i, −Ci}. It is the symmetry group left after marking the square with a horizontal arrow; a diagonal arrow leaves {1, Ci}. Marking a sphere with one point leaves rotations about that axis, an O(2) subgroup; marking the vertices of a regular polyhedron leaves a finite subgroup.
- Factor group. For normal S the cosets Sg form a group with (Sg)(Sh) = S(gh), written G/S; for non-normal S, G/S is only a space of cosets. For finite groups, |G/S| = |G|/|S| (exercise [13.9]).
- Simple group. No non-trivial normal subgroups. Simple groups are the building blocks; SO(3) is simple.
- Product group G × H. Pairs (g, h) with (g₁, h₁)(g₂, h₂) = (g₁g₂, h₁h₂); many particle-physics groups are products of simple groups or small modifications.
Penrose states that SO(3) is the only non-trivial normal subgroup of O(3). That is not quite right. The two-element group {I, −I}, where −I is the central inversion x ↦ −x (a reflection-type element of O(3)), commutes with everything and so is normal. In fact O(3) = SO(3) × {I, −I}, and its non-trivial proper normal subgroups are SO(3) and {±I}. The slip does not affect anything later in the book.
The classification of simple groups
| Family | Group | Dimension |
|---|---|---|
| Am | SU(m + 1) | m(m + 2) |
| Bm | SO(2m + 1) | m(2m + 1) |
| Cm | Sp(m) | m(2m + 1) |
| Dm | SO(2m) | m(2m − 1) |
| Exceptional | G₂, F₄, E₆, E₇, E₈ | 14, 52, 78, 133, 248 |
The continuous case was begun by Wilhelm Killing (1847–1923) in papers of 1888–1890 and essentially completed by Élie Cartan in 1894, in what Penrose calls one of the most important mathematical papers ever written. The finite simple groups took most of the 20th century and many mathematicians (computers helped late on); Penrose dates completion to 1982. There are systematic families plus 26 sporadic groups, the largest being the Monster of order
808 017 424 794 512 875 886 459 904 961 710 757 005 754 368 000 000 000 = 2⁴⁶·3²⁰·5⁹·7⁶·11²·13³·17·19·23·29·31·41·47·59·71 ≈ 8 × 10⁵³.
E₈ features in string theory (§31.14), and some hope the Monster will appear in physics.
The finite simple group classification was announced in the early 1980s, but a gap (the "quasithin" case) was closed only by Aschbacher and Smith in 2004, and the second-generation proof by Gorenstein, Lyons, Solomon and successors is still being published in volumes. On the Monster: Borcherds's 1992 proof of "monstrous moonshine" (Fields Medal 1998) linked it to a vertex algebra that is a string theory on a special lattice, and Witten's 2007 proposal tied it to 3D gravity; so Penrose's note that some hope the Monster will feature in physics has gained traction, though no physical theory uses it.
13.3 Linear transformations and matrices
Vector spaces are the most important objects with symmetry. A linear transformation preserves addition (the parallelogram law) and scalar multiplication; geometrically it keeps lines straight, parallels parallel and the origin fixed but may squash or stretch a sphere into an ellipsoid. Penrose flags §§13.3–7 as a rapid tutorial in matrices, essential for quantum theory and skippable for those who know it.
In index notation xᵃ ↦ Tᵃ_b xᵇ (summed), or x ↦ Tx; the components Tᵃ_b form an n × n matrix. A product R = ST (T first) has Rᵃ_c = Sᵃ_b Tᵇ_c, the usual row-by-column rule. The identity has components δᵃ_b (the Kronecker delta), drawn diagrammatically as a bare line so that TI = T = IT is automatic.
- Singular T maps V onto a lower-dimensional subspace; equivalently Tυ = 0 for some υ ≠ 0. The dimension of the image is the rank.
- Non-singular T has an inverse T⁻¹ with TT⁻¹ = I = T⁻¹T, written explicitly with the Levi-Civita symbols εa…c and εa…c (normalised by εa…cεa…c = n!).
- Matrix algebra, initiated by Arthur Cayley (lawyer and mathematician) in 1858, satisfies all the usual laws except commutativity (AB ≠ BA in general) and universal invertibility. Rectangular m × n matrices multiply when inner sizes match; a column vector is n × 1.
- GL(n), the general linear group of non-singular n × n matrices (real GL(n, ℝ) or complex GL(n, ℂ)), is the symmetry group of an n-dimensional vector space. Its normal subgroup SL(n) has determinant 1.
13.4 Determinants and traces
The determinant is a single number that vanishes exactly when T is singular: det T = (1/n!) εa…c εd…f Tᵈ_a … Tᶠ_c (Penrose's diagram is the cleanest version). For 2 × 2, det = ad − bc. Its key property, provable in one diagrammatic step, is det(AB) = det A · det B.
The trace is trace T = Tᵃ_a = T¹₁ + … + Tⁿₙ, additive (trace(A + B) = trace A + trace B) but with no product rule. The two are linked through infinitesimal transformations:
- det(I + εA) = 1 + ε trace A to first order in ε;
- hence elements of SL(n) near the identity have trace-free A;
- and globally det eA = etrace A, with eA = I + A + A²/2! + A³/3! + ….
13.5 Eigenvalues and eigenvectors
An eigenvector of T is a non-zero (complex) υ with Tυ = λυ; λ is the eigenvalue. The line of multiples of υ is left invariant. Eigenvalues solve det(T − λI) = 0, a degree-n polynomial which the fundamental theorem of algebra factors as (λ₁ − λ)(λ₂ − λ)…(λₙ − λ), so there are exactly n eigenvalues counted with multiplicity, with det T = λ₁λ₂…λₙ and trace T = λ₁ + … + λₙ.
- Multiplicity r and eigenspace dimension d satisfy 1 ≤ d ≤ r. For unitary, Hermitian and normal matrices, the ones quantum mechanics uses, d = r always. Quantum physicists call multiplicities degeneracies.
- Bases. A basis is an ordered set of linearly independent vectors spanning V; any non-singular T maps bases to bases, and any two bases are related by a unique T.
- Canonical (diagonal) form. When d = r for every eigenvalue, there is a basis of eigenvectors in which T = diag(λ₁, …, λₙ).
- Jordan normal form (note 13.12) handles d < r with 1s just above the diagonal; Weierstrass had it in 1868, two years before Jordan.
13.6 Representation theory and Lie algebras
A representation of a group G assigns to each g a matrix T(g) in GL(n) with T(g)T(h) = T(gh); it is faithful if distinct elements get distinct matrices. Every finite group of order n has a faithful representation in GL(n, ℝ) (the regular representation, exercise [13.32]). Continuous groups always have local representations, but not always faithful global ones: the double cover of SL(n, ℝ) for n ≥ 3 cannot be faithfully represented in any GL(m) (note 13.13). Quantum field theory often needs infinite-dimensional representations.
Sophus Lie (1842–1899) studied infinitesimal elements I + εA. To first order, (I + εA)(I + εB) = I + ε(A + B): sums capture only the dimension. The group commutator aba⁻¹b⁻¹ computed to second order gives I + ε²(AB − BA), so non-commutativity lives in the Lie bracket
[A, B] = AB − BA.
- Vector space: closed under +, − and multiplication by real (or complex) numbers.
- Bilinear bracket: [A + B, C] = [A, C] + [B, C], [λA, B] = λ[A, B].
- Antisymmetry: [A, B] = −[B, A].
- Jacobi identity: [A, [B, C]] + [B, [C, A]] + [C, [A, B]] = 0.
- Structure constants: in a basis E₁…E_N, [E_α, E_β] = γαβχ E_χ; antisymmetry and Jacobi constrain the N³ constants.
The structure constants fix the group locally (in a neighbourhood of the identity in the group manifold) but not globally; finite elements come from exponentiation, eA. Physicists love this because Lie-algebra conditions are linear where group conditions are non-linear, and because Lie-algebra elements are often physical quantities: for the rotation group they are angular momentum (§22.8).
Check the so(3) bracket, the determinant-trace identity, and the spinor sign: a 2π "rotation" in SU(2) is −I, in SO(3) it is I.
import numpy as np
from scipy.linalg import expm
L = [np.array(m, float) for m in ([[0,0,0],[0,0,-1],[0,1,0]],
[[0,0,1],[0,0,0],[-1,0,0]], [[0,-1,0],[1,0,0],[0,0,0]])]
br = lambda A, B: A@B - B@A
print("[Lx,Ly] == Lz :", np.allclose(br(L[0], L[1]), L[2]))
A = np.random.default_rng(1).normal(size=(4, 4))
print("det(e^A) = %.6f e^(trace A) = %.6f"
% (np.linalg.det(expm(A)), np.exp(np.trace(A))))
print("SO(3) 2pi:", np.allclose(expm(2*np.pi*L[2]), np.eye(3)))
sz = np.array([[1j, 0], [0, -1j]])/2
print("SU(2) 2pi:", np.round(expm(2*np.pi*sz).real, 6).tolist())
[Lx,Ly] == Lz : True
det(e^A) = 4.133925 e^(trace A) = 4.133925
SO(3) 2pi: True
SU(2) 2pi: [[-1.0, 0.0], [0.0, -1.0]]
13.7 Tensor representation spaces and reducibility
If G acts on a representation space V by x ↦ Tx, it acts on everything built from V:
- Dual space V*. Covectors (row vectors y) must transform by y ↦ yT⁻¹ to keep yx invariant; with transposes, yᵀ ↦ (T⁻¹)ᵀyᵀ. Both transpose and inverse reverse order, (AB)ᵀ = BᵀAᵀ and (AB)⁻¹ = B⁻¹A⁻¹, so together they restore the right order.
- Tensors of valence [p q] live in the tensor product of q copies of V* and p copies of V, of dimension np+q; each upper index transforms by T and each lower index by T⁻¹.
- Reducibility. A [0 2] tensor splits as Qab = Q(ab) + Q[ab], symmetric part of dimension n(n + 1)/2 and antisymmetric part n(n − 1)/2, each preserved by the group. In an adapted basis all representing matrices are block-diagonal: the representation is a direct sum.
- General reducibility allows an upper-right block C: matrices of the form [A C; 0 B]. Irreducible means no such form exists; completely reducible means it is always a direct sum of irreducibles.
Semi-simple groups (including the simple ones) are those whose Killing form καβ = γαχδ γβδχ is non-singular. Compact semi-simple groups have only completely reducible representations, every irreducible one finite-dimensional; non-compact ones need not. Penrose's naming aside (note 13.16): the "Killing form" is actually due to Cartan and Weyl, while many things named after Cartan were Killing's; the Killing vector of §30.6 really is Killing's.
Real forms. One complex Lie algebra (same structure constants, complex coefficients) can come from several different real groups, its real forms. A real form is compact when −κ is positive definite, and every complex semi-simple Lie group has exactly one compact real form. The contrast between the compact rotation group of 4D Euclidean space and the non-compact Lorentz group (§18.2) is the physical case that matters.
13.8 Orthogonal groups
The sphere gₐ_b xᵃxᵇ = 1 (with g = δ in Cartesian coordinates) is preserved by O(n). Penrose introduces separate symbols gab and its inverse gab (drawn as a "hoop") because, unlike δᵃ_b, their components change under a change of basis.
- Active vs passive. An active transformation moves V over itself; a passive one leaves V fixed and changes the basis/coordinates. Tensor components then transform with T and T⁻¹ by index position, and δᵃ_b is unchanged while gab generally is not. This matters for general relativity, where Cartesian coordinates are unavailable.
- Signature (p, q). Any non-singular real symmetric g can be brought by a real change of basis to diagonal form with p entries +1 and q entries −1, and (p, q) is invariant (Sylvester's law of inertia, not named by Penrose). Singular g adds 0s.
- Positive-definite: q = 0; equivalently xᵀAx > 0 for all x ≠ 0; non-negative-definite allows ≥.
- Lorentzian: one sign differs from the rest, as in relativity; named for H. A. Lorentz (1853–1928).
- Metric: ds² = gabdxᵃdxᵇ gives distance along curves (a pseudometric if g is indefinite); the length of a vector is √(gabυᵃυᵇ). In the Lorentzian case "distance" is time (§17.8).
The orthogonal group O(n) preserves a positive-definite g: gabTᵃ_cTᵇ_d = gcd, which for g = δ means T⁻¹ = Tᵀ; SO(n) adds det T = 1 (equivalently, preserving the volume form). Indefinite g gives O(p, q) and SO(p, q); O(1, 3) is the Lorentz group, which (ignoring time reflections) is also the symmetry group of hyperbolic 3-space and (ignoring space reflections) of the Riemann sphere under Möbius maps, facts central to twistor theory (§33.2).
All O(p, q) with p + q = n have dimension n(n − 1)/2 and are real forms of O(n, ℂ). Over ℂ signature disappears (a complex change of basis turns −1 into +1); only the rank survives.
Physicists, Penrose says, are often cavalier about real forms, carrying results from compact groups (finite-dimensional representations only) to non-compact ones (which need infinite-dimensional representations), or Wick-rotating signatures freely. Sometimes the cavalier move is illuminating (Lambert got the area of a hyperbolic triangle by giving a sphere an imaginary radius), sometimes not. Since quantum mechanics routinely violates the inequalities (like det T > 0) that separate real forms, Penrose reserves judgement and returns to this in §28.9, §31.13 and §32.3, where it bears on Euclidean quantum gravity and string theory. Many working physicists regard Wick rotation as well justified by the Osterwalder–Schrader theorems in flat space; Penrose's worry is strongest for curved spacetimes, where no such theorem exists.
13.9 Unitary groups
Instead of preserving a symmetric bilinear form, preserve a Hermitian form (after Charles Hermite, 1822–1901):
- Hermitian symmetry: h(x, y) = conj h(y, x);
- linear in y: h(x, y + w) = h(x, y) + h(x, w), h(x, λy) = λh(x, y);
- hence antilinear in x: h(λx, y) = λ̄ h(x, y).
A bilinear g identifies V with V* (lowering an index, υb = υᵃgab, raising with gab). A Hermitian h does the same antilinearly, so it identifies the complex-conjugate space with V*. Penrose tracks conjugate vectors with primed indices a′, b′ that never contract with unprimed ones, and ha′b converts between them. The result is Hermitian conjugation * (physicists' †), which Penrose writes with an asterisk because it swaps V and V*: upper indices become lower and vice versa, on scalars it is ordinary conjugation, and (LM)* = M*L*. Diagrammatically it is reflection in a horizontal line.
- Hermitian matrix: equal to its conjugate transpose; Hermitian operators are the observables of quantum theory.
- Hermitian scalar product: ⟨υ|w⟩ = υ* • w, with ⟨w|υ⟩ = conj⟨υ|w⟩; the norm is ⟨υ|υ⟩.
- Signature of * is defined via pseudo-orthonormal bases (diagonal ±1); positive-definite means every non-zero vector has positive norm.
- Unitary: T⁻¹ = T*. The groups U(n), U(p, q), and with unit determinant SU(n), SU(p, q). U(p, q) and GL(n, ℝ) are all real forms of GL(n, ℂ).
13.10 Symplectic groups
Now preserve an antisymmetric non-singular bilinear form s(x, y) = −s(y, x), sab = −sba. A non-singular antisymmetric matrix exists only in even dimension, and it can be put in block form with 2 × 2 blocks [0 1; −1 0] down the diagonal (never diagonal, since the only antisymmetric diagonal matrix is 0). The transformations preserving it form a symplectic group, essential to classical mechanics (§20.4) and to infinite-dimensional quantum field theory (§26.3).
- Real forms. The real transformations preserving s give the non-compact split-signature form, the one used in Hamiltonian mechanics. The compact form, usually called Sp(n), is the intersection of Sp(n, ℂ) with a unitary group. Penrose concocts the notation Sp(p, q) = Sp(n, ℂ) ∩ U(p, q) for the general real forms (note 13.24).
- Determinant automatic. Every symplectic transformation has det = 1, because the volume form is expressible through s (the Pfaffian), so no "SSp" is needed.
- Lie algebra. Solutions of XᵀS + SX = 0, i.e. SX symmetric: X is S⁻¹ times a symmetric matrix, automatically trace-free, so the group has dimension n(n + 1)/2 when V has dimension n (n = 2m even).
Penrose's labels shift: the classical list uses Sp(m) with m the quaternionic dimension (so Sp(1) ≅ SU(2) acts on a 2-dimensional complex space), while the Lie-algebra count uses n = dim V. And the extracted text's dimension formulas lose their "½". The standard results: dim O(n) = n(n − 1)/2, dim U(n) = n², dim SU(n) = n² − 1, dim of the symplectic group on a 2m-dimensional space = m(2m + 1).
Accidental isomorphisms
| Coincidence | Why it matters |
|---|---|
| SO(2) = U(1): unit complex numbers eiθ | Phase symmetry; electromagnetism's gauge group |
| SU(2) = Sp(1), locally SO(3) (double cover) | The quaternion/spinor picture of rotation; quantum spin (§22.8) |
| SL(2, ℂ) = Sp(1, ℂ), locally the proper Lorentz group (double cover) | 2-spinors in relativity |
| SU(1, 1) = Sp(1, 1) ≅ locally SO(2, 1) | Hyperbolic plane symmetries |
| SU(2, 2) locally the proper part of O(2, 4) | The conformal group of spacetime; basis of twistor theory (§33.3) |
The Lie algebras of the classical groups are simple linear conditions: antisymmetric matrices for orthogonal groups (dimension n(n − 1)/2), i × Hermitian matrices for unitary groups (dimension n², or n² − 1 for SU(n) after imposing trace X = 0), and S⁻¹ × symmetric for symplectic groups. With these, Am, Bm, Cm, Dm = SU(m + 1), SO(2m + 1), Sp(m), SO(2m) have dimensions m(m + 2), m(2m + 1), m(2m + 1), m(2m − 1), completing the reader's glimpse of all the classical simple groups.
The eight symmetries of the square
| Element | Effect on the vertices 1, i, −1, −i | Order | In which subgroups |
|---|---|---|---|
| 1 | identity | 1 | all |
| i | rotate 90° | 4 | {1, i, −1, −i} |
| −1 | rotate 180° | 2 | {1, −1}, {1, i, −1, −i}, {1, −1, C, −C}, {1, −1, Ci, −Ci} |
| −i | rotate 270° | 4 | {1, i, −1, −i} |
| C | flip in the real axis | 2 | {1, C}, |
| −C | flip in the imaginary axis | 2 | {1, −C}, |
| Ci | flip in a diagonal | 2 | {1, Ci}, |
| −Ci | flip in the other diagonal | 2 | {1, −Ci}, |
The centre {1, −1} and the three order-4 subgroups are normal; the four two-element reflection subgroups are not, which is the content of exercise [13.6] (Penrose names {1, C} and {1, Ci} and asks for the other two, {1, −C} and {1, −Ci}).
Terms to know
| Term | Meaning |
|---|---|
| Group | Set with associative product, identity and inverses |
| Abelian | Commutative group |
| Order | Number of elements |
| Normal subgroup | Sg = gS for every g; its cosets form the factor group G/S |
| Simple group | No non-trivial normal subgroups; the building blocks |
| Lie group | A continuous group; automatically analytic (Hilbert's 5th problem) |
| Representation | A homomorphism g ↦ T(g) into matrices; faithful if 1–1 |
| Lie algebra | Infinitesimal generators with bracket [A, B] = AB − BA |
| Structure constants | γαβχ with [Eα, Eβ] = γαβχEχ |
| Irreducible / completely reducible | No invariant subspace / a direct sum of irreducibles |
| Killing form | καβ built from structure constants; non-singular for semi-simple groups |
| Real form | A real group whose complexification is a given complex group |
| Signature (p, q) | Numbers of +1 and −1 in the diagonalised metric |
| Hermitian conjugate * | Conjugate transpose; swaps V and V*; (LM)* = M*L* |
Start with a perfect sphere: its symmetry group is all of O(3). Paint one dot on it and the symmetry drops to rotations about the dot's axis, an O(2). Paint the twenty vertices of a dodecahedron and only a finite group of 120 elements survives. Paint a random smudge and nothing survives but the identity. This is Penrose's picture of symmetry breaking: physics is imagined to start with a large exact group, and the world we see corresponds to a "marked" configuration whose residual symmetry is a subgroup. Which subgroups are possible is a purely group-theoretic question, which is why particle physicists need the classification.
In quantitative finance and risk, the eigenvalue machinery of §13.5 is daily practice: principal components of yield curves, covariance matrices that must be positive semi-definite (the xᵀAx ≥ 0 condition of §13.8), and stress scenarios built from eigenvectors. Penrose's warning about degenerate eigenvalues (eigenspace dimension d < multiplicity r) has a practical counterpart: near-degenerate covariance matrices make factor models unstable and must be regularised.
What the exercises ask
- [13.1–13.4] Minimal group axioms (left identity and left inverse suffice; right versions do not); vector spaces as additive Abelian groups; derive the square's multiplication laws.
- [13.5–13.10] Identify the square's subgroups and which are normal; the normal subgroups of O(3); cosets and factor groups; |G/S| = |G|/|S|; product groups.
- [13.11–13.25] Matrix algebra in components; singularity criteria (zero column, repeated rows); diagrammatic inverse and det(ST) = det S det T; 2 × 2 and 3 × 3 determinants; det(I + εA) and det eA = etrace A.
- [13.26–13.31] Characteristic polynomial coefficients; det and trace from eigenvalues; bases and change-of-basis matrices; independence of eigenvectors with distinct eigenvalues.
- [13.32–13.44] The regular representation of a finite group; the order-ε² commutator; Jacobi and structure-constant identities; tensor transformation laws and reducibility (trace and trace-free parts); symmetry of the Killing form.
- [13.45–13.62] Passive transformations and dual bases; orthogonal matrices; det = 1 as volume preservation; loss of signature over ℂ; Hermitian index gymnastics; Sp(1) and Sp(1, 1) explicitly; why SO(2) = U(1); the Lie algebras and dimensions of all classical groups.
Calculus on manifolds
A bare smooth manifold has only one coordinate-free derivative, Cartan's d on forms. To differentiate vectors and tensors one needs extra structure, a connection ∇, which Penrose motivates through parallel transport on a sphere. Parallelism on a curved space depends on the path, and that path dependence, measured by curvature, is the idea behind general relativity and every modern theory of particle interactions. The chapter builds torsion, curvature, geodesics, geodesic deviation, the Lie derivative, the Levi-Civita connection a metric provides, Killing vectors, and the "floppy" geometry of symplectic manifolds.
14.1 Differentiation on a manifold?
Vector spaces carry structure (a metric for O(n), a Hermitian form for U(n)), but physics needs more general spaces. Even Euclidean space is not a vector space: it has no preferred origin. It is an affine space, a vector space that has "forgotten" its origin, in which there is a consistent notion of parallelogram (exercise [14.1] axiomatises this with a relation [a, b; c, d]). Einstein's spacetime is a 4-manifold whose tangent spaces carry a Lorentzian metric; phase spaces carry a symplectic structure; Riemann surfaces carry a conformal one. In each case the structure lives in the tangent space Tₚ.
On a bare smooth manifold, coordinate derivatives ∂/∂xᵃ give coordinate-dependent garbage that does not match across patches. The exterior derivative is coordinate-free but limited to p-forms and says little about how they vary. Something new is required.
14.2 Parallel transport
A good derivative of a vector field ξ should vanish when ξ is constant, and "constant" means all its arrows are parallel. But parallelism is not part of a smooth manifold's structure (Euclid's fifth postulate again; hyperbolic space has no global parallel fields), and Euclidean parallelism on two glued patches disagrees on the overlap.
Penrose's model is the sphere S². Take the north pole p and a tangent vector υ along the Greenwich meridian. The ambient 3-space notion of "parallel" fails because the parallel copy is generally not tangent to the sphere elsewhere. The remedy: move υ along a path γ in many tiny steps p₀p₁, p₁p₂, …, at each step translating in 3-space and then projecting back into the tangent plane. In the limit of small steps the answer is well defined: parallel transport along γ.
The result depends on the path. Two routes from p to q (a direct great circle, and two great-circle arcs via r) can deliver vectors differing by a right angle. Transport preserves length here, so the discrepancy is a pure rotation. Around a closed loop on the unit sphere the rotation angle in radians equals the enclosed area (negatively circulated regions count negatively), which follows from Harriot's 1603 spherical-triangle area formula (exercise [14.3]).
Note 14.1 adds a topological fact: no continuous field of "parallel" tangent vectors exists on S² at all (the hairy ball theorem, "combing a spherical dog"), whereas S³ admits one, via the Clifford parallels of §15.4.
Numerical check of the area rule: transport a vector around circles of latitude by repeated "translate and project".
import numpy as np
for th0 in (np.pi/6, np.pi/3, np.pi/2):
N = 200000; phis = np.linspace(0, 2*np.pi, N+1)
pos = lambda p: np.array([np.sin(th0)*np.cos(p),
np.sin(th0)*np.sin(p), np.cos(th0)])
v = np.array([np.cos(th0), 0, -np.sin(th0)])
for b in phis[1:]:
n = pos(b); v = v - np.dot(v, n)*n; v /= np.linalg.norm(v)
e_th = np.array([np.cos(th0), 0, -np.sin(th0)])
ang = np.arctan2(v[1], np.dot(v, e_th)) % (2*np.pi)
print(f"{np.degrees(th0):3.0f} deg: rotation {ang:.4f}, "
f"area {2*np.pi*(1-np.cos(th0)):.4f}")
30 deg: rotation 0.8418, area 0.8418
60 deg: rotation 3.1416, area 3.1416
90 deg: rotation 6.2832, area 6.2832
At the equator the hemisphere's area is 2π, a full turn: the vector comes back unchanged, as it should along a geodesic.
14.3 Covariant derivative
Compare how a field ξ actually changes in a direction w with how parallel transport would carry it; the difference, in the limit, is the covariant derivative ∇wξ, and the operator ∇ is called a connection. Its rules:
- Linear in the direction: ∇w+u = ∇w + ∇u, ∇λw = λ∇w. In index form ∇w = wᵃ∇ₐ, so ∇ₐ carries a lower (covector) index and ∇ξ is a [1 1]-tensor ∇ₐξᵇ.
- Additive: ∇(ξ + η) = ∇ξ + ∇η.
- Leibniz: ∇(λξ) = λ∇ξ + ξ∇λ.
- On scalars: ∇Φ = dΦ.
- Extension to all tensors is unique given additivity and the tensor Leibniz law ∇(T•U) = (∇T)•U + T•(∇U) with matching contractions. Penrose's diagram notation draws ∇ as a ring around the differentiated quantity.
Any coordinate patch defines a coordinate connection ∂/∂xᵃ, in which all coordinate lines count as parallel; it is uninteresting and inconsistent across patches but useful, because the difference of two connections is algebraic: a tensor Γᵃ_bc. So every ∇ can be written as coordinate derivatives plus Γ-terms (the classical comma/semicolon notation of note 14.2 marks ∂ and ∇ respectively).
14.4 Curvature and torsion
Coordinate derivatives commute (∂²f/∂x∂y = ∂²f/∂y∂x), which is why the coordinate connection is path-independent. For a general ∇ the antisymmetric part ∇[a∇b] need not vanish, and it yields two tensors:
- Torsion τ, valence [1 2], antisymmetric in ab: present when ∇[a∇b] fails to vanish on scalars: (∇ₐ∇_b − ∇_b∇ₐ)Φ = τabc∇cΦ. Usually set to zero; non-zero in supergravity and the Einstein–Cartan–Sciama–Kibble spin-torsion theories.
- Curvature R, valence [1 3], defined (torsion-free) by the Ricci identity: (∇ₐ∇_b − ∇_b∇ₐ)ξᵈ = Rabcdξᶜ.
- Antisymmetry: Rabcd = −Rbacd, inherited from ∇ₐ∇_b − ∇_b∇ₐ.
- Bianchi symmetry (often "first Bianchi identity"): R[abc]d = 0, i.e. Rabcd + Rbcad + Rcabd = 0.
- Bianchi identity (the "second"): ∇[aRbc]de = 0, "the linchpin of the Einstein field equation" (§19.6).
- Penrose's warning: conventions on index order and sign vary across the literature; he uses his own.
14.5 Geodesics, parallelograms and curvature
A geodesic is a curve that goes on "parallel to itself": its tangent t satisfies t^a∇ₐtᵇ ∝ tᵇ (direction preserved), or the stronger t^a∇ₐtᵇ = 0 (tangent vector itself transported). On S² geodesics are great circles; on a surface in Euclidean space they are the taut-string curves of minimal length; in general relativity they are the worldlines of free fall (§17.9).
- Affine parameter. Any parameter u along a curve defines tangent vectors t with t(u) = 1 (t means d/du). On a geodesic, u is affine when t is parallel-transported; affine parameters are "evenly spaced", and two of them are related by υ = Au + B (exercise [14.13]). Where there is a distance, it is an affine parameter, but affine parameters also exist on light rays, where distance is zero.
- Order notation. O(ε), O(ε²), O(ε³) mean "components bounded by a constant times ε, ε², ε³" in some (hence any) coordinates; the notion is coordinate-independent.
Building a parallelogram
From p, run geodesics λ and µ with tangent vectors L, M an affine distance ε to q and r. Transport M along λ to q and go ε along the new geodesic to s; transport L along µ to r and go ε to s′. In Euclidean space s = s′. In general:
- Torsion-free ⇔ the gap ss′ is O(ε³): parallelograms "close" to second order. Non-zero torsion shows up as an O(ε²) gap.
- Curvature: transport a third vector N from p to s via q and via r; the two results differ by ε² Lᵃ Mb Nc Rabcd, equivalently the change of N after going round the whole loop.
- Only the plane element L ∧ M matters (antisymmetry in ab). On a 2-surface there is one independent component, the Gaussian curvature that distinguishes sphere, plane and hyperbolic plane (§2.6).
Set N = L. Then two sides of the parallelogram are segments of neighbouring geodesics γ and γ′, joined at p by the connecting vector M. The O(ε²) quantity ε² LᵃMbLcRabcd is their relative acceleration (the Jacobi equation). Positive curvature makes initially parallel geodesics converge; negative curvature makes them diverge. In general relativity this is tidal gravity (§17.5, §19.6).
14.6 The Lie derivative
Penrose notes how notation drives mathematics: the index-free mathematician's route to curvature goes through the Lie bracket and Lie derivative, which need no connection at all, only a chosen vector field ξ. The Lie derivative £ξQ measures how Q changes compared with being "dragged along" by ξ.
For vector fields, regarded as derivations, the commutator [ξ, η](Φ) = ξ(η(Φ)) − η(ξ(Φ)) again obeys the three derivation rules, so it is a vector field: the Lie bracket, satisfying antisymmetry, linearity and the Jacobi identity. Geometrically, alternating O(ε) steps along ξ and η leave an O(ε²) gap ε²[ξ, η].
- Link to Lie groups. On a group manifold G, left-multiplication by infinitesimal elements gives vector fields; to first order products add (tangent space at I), and the group structure appears at O(ε²) through the bracket. The group's own notion of "parallel" is a connection with torsion but no curvature (exercise [14.17]).
- Exponentiation. A finite element is eξ = I + ξ + ξ²/2! + ξ³/3! + …, a form of Taylor's theorem (ea d/dyf(y) = f(y + a)); on an analytic manifold etξ(Φ) gives Φ at parameter distance t along the integral curve of ξ. eξeη differs from eξ+η by Lie-algebra terms: the Baker–Campbell–Hausdorff formula eξeη = eξ+η+½[ξ,η]+….
- Lie derivative of a vector: £ξη = [ξ, η] = ξᵃ∇ₐηᵇ − ηᵃ∇ₐξᵇ for any torsion-free ∇. For a covector, £ξαb = ξᵃ∇ₐαb + αa∇bξᵃ; general tensors follow by Leibniz. The result is independent of the connection chosen (coordinate ∂ works too).
- Exterior derivative is likewise connection-independent: (dα)ab…d = ∇[aαb…d] for any torsion-free ∇, and d² = 0 drops out at once.
In mathematician's notation the curvature is R(L, M)N = ∇L∇MN − ∇M∇LN − ∇[L,M]N. The bracket term looks like clutter, but it handles torsion automatically and lets the loop be any small curvilinear quadrilateral rather than a near-parallelogram.
14.7 What a metric can do for you
A Riemannian manifold carries a smooth metric g (pseudo-Riemannian if indefinite; Penrose prefers "pseudo" to O'Neill's "semi"). Riemann generalised Gauss's curved 2-surfaces to n dimensions. Length is ℓ = ∫ ds with ds² = gabdxᵃdxᵇ, Pythagoras surviving only at the infinitesimal level; ds is not a 1-form but can be integrated along curves. In relativity, signature (+ − − −) makes this the time on an ideal clock (§17.7), and |υ|² = gabυᵃυᵇ can be of either sign.
A non-singular g fixes a unique torsion-free connection with ∇g = 0 (parallel transport preserves lengths): the Levi-Civita (or Christoffel, or Riemannian) connection, after Riemann (1826–66), Christoffel (1829–1900) and Levi-Civita (1873–1941). Its geodesics are the curves that make ∫ds stationary (minimal for positive-definite g), and arc length is their affine parameter.
- Raising and lowering with gab and gab: υa = gabυᵇ, αᵃ = gabαb; the same kernel letter, index position telling the type.
- Riemann (Riemann–Christoffel) tensor Rabcd, with extra symmetries Rabcd = −Rabdc = Rcdab. Out of n⁴ components only n²(n² − 1)/12 are independent: 20 in four dimensions (exercise [14.30]).
- Killing vector κ: £κg = 0, i.e. ∇(aκb) = 0; it generates a (possibly only local) continuous symmetry, and the bracket of two Killing vectors is another. Central to conserved quantities in relativity (§19.5, §§30.4–7).
14.8 Symplectic manifolds
Few tensor structures fix a unique connection; a metric is lucky. A symplectic manifold carries a non-singular antisymmetric Sab with dS = 0 (equivalently ∇ₐSbc + ∇bSca + ∇cSab = 0). It is the structure of classical phase space, locally governed by the split-signature symplectic group. Its inverse defines the Poisson bracket (after Siméon Denis Poisson, 1781–1840), {Φ, Ψ} ∝ Sab∇ₐΦ∇bΨ, with
{Φ, Ψ} = −{Ψ, Φ}, and the Jacobi identity {Θ, {Φ, Ψ}} + {Φ, {Ψ, Θ}} + {Ψ, {Θ, Φ}} = 0,
which will encode Hamilton's equations (§20.4) and lead to quantum mechanics.
Rigid structures
- Metric / connection: curvature and its derivatives give local invariants; two Riemannian manifolds generally differ locally.
- Two general vector fields on a manifold: rigid.
Floppy structures
- Symplectic: no local invariants; any two of the same dimension are locally identical (Darboux's theorem, not named by Penrose).
- Complex structure; holomorphic symplectic structure; a single nowhere-vanishing vector field.
- Floppiness matters for twistor theory (§33.11).
| Structure on M | What it supplies | Derivative it allows | Physics home |
|---|---|---|---|
| Smooth only | Scalars, vectors, forms | d on forms, £ξ given ξ | Any configuration space |
| Connection ∇ | Parallel transport | Covariant derivative; torsion, curvature, geodesics | Gauge theory (Ch. 15) |
| Metric g | Lengths, angles | Unique Levi-Civita ∇; Riemann tensor; Killing vectors | General relativity |
| Symplectic S, dS = 0 | Areas of 2-surfaces | Poisson bracket; no curvature | Hamiltonian mechanics |
| Complex J (integrable) | Holomorphic functions | ∂/∂z̄ conditions | Twistor theory |
Two currents since 2004 run straight through this chapter. Gravitational-wave astronomy (LIGO's first detection, September 2015) measures geodesic deviation directly: the interferometer arms are a connecting vector between free-falling mirrors, and the strain of order 10⁻²¹ is the Riemann tensor at work. And discrete differential geometry (discrete connections, discrete exterior calculus, holonomy on meshes) now powers geometry processing and, through "geometric deep learning" (Bronstein, Bruna, Cohen, Veličković, 2021), the design of gauge-equivariant neural networks that parallel-transport features along meshes.
The connection in coordinates
The exercises ask the reader to derive the classical formulas Penrose leaves implicit. For reference, with ∇ the Levi-Civita connection:
- Christoffel symbols: Γᵃbc = ½ gad(∂bgdc + ∂cgdb − ∂dgbc), symmetric in bc exactly when torsion vanishes.
- Covariant derivative of a vector: ∇ₐξᵇ = ∂ₐξᵇ + Γᵇacξᶜ; of a covector, ∇ₐαb = ∂ₐαb − Γᶜabαc.
- Geodesic equation in an affine parameter u: d²xᵃ/du² + Γᵃbc(dxᵇ/du)(dxᶜ/du) = 0.
- Curvature from Γ: R is built from ∂Γ − ∂Γ + ΓΓ − ΓΓ (signs and index order follow Penrose's convention, exercise [14.27]).
- Contractions previewing Chapter 19: the Ricci tensor Rab and scalar curvature R come from contracting the Riemann tensor; on a 2-surface everything reduces to the single Gaussian curvature K.
Penrose's claim that index notation is generally clearer is a matter of taste: the mathematician's R(L, M)N = ∇L∇MN − ∇M∇LN − ∇[L,M]N handles torsion without extra terms, as he concedes. Curvature sign conventions differ between standard texts (Misner–Thorne–Wheeler, Wald, Penrose–Rindler), so the sign of "R" in any formula should be checked against the source being compared. His statement that the Riemann tensor has n²(n² − 1)/12 independent components (20 in four dimensions) is standard.
Terms to know
| Term | Meaning |
|---|---|
| Affine space | A vector space without a preferred origin; parallelograms make sense |
| Parallel transport | Carrying a vector along a curve "as constant as possible" |
| Connection ∇ | Covariant derivative; equivalent to a rule of parallel transport |
| Christoffel symbols Γ | Components of the difference between ∇ and coordinate derivatives |
| Torsion τ | Failure of infinitesimal parallelograms to close at order ε² |
| Curvature R | Rotation of a vector carried round an infinitesimal loop, at order ε² |
| Geodesic | A curve whose tangent is parallel-transported along itself |
| Affine parameter | Evenly spaced parameter on a geodesic |
| Geodesic deviation | Relative acceleration of neighbouring geodesics; tidal effect |
| Lie derivative £ξ | Change of a quantity relative to being dragged along ξ; needs no connection |
| Levi-Civita connection | The unique torsion-free connection with ∇g = 0 |
| Killing vector | A vector field generating a symmetry of the metric: £κg = 0 |
| Poisson bracket | {Φ, Ψ} built from a symplectic form; antisymmetric with Jacobi identity |
Stand at the North Pole holding a spear pointing down the Greenwich meridian. Walk south to the equator without turning the spear relative to your path, walk a quarter of the way round the equator keeping the spear's direction "unchanged", then walk back north. Back at the pole the spear points 90° away from where it started, though at no step did you rotate it. The triangle you walked covers one eighth of the sphere, area π/2 on a unit sphere, which is exactly the 90° rotation. Penrose's whole theory of curvature is in this walk: no local twist, yet a global turn, measured by enclosed area.
Geodesics and connections now appear in machine learning as information geometry (the Fisher metric and natural-gradient methods treat a model family as a Riemannian manifold) and in optimisation on matrix manifolds (orthogonality or positive-definiteness constraints). In both, the Levi-Civita connection of §14.7 tells an optimiser how to "move straight" on a curved parameter space rather than in the misleading straight lines of raw coordinates.
What the exercises ask
- [14.1–14.3] Axioms for parallelograms give an additive Abelian group once an origin is chosen (and a non-Abelian generalisation); holonomy equals area for spherical triangles via Harriot's formula.
- [14.4–14.11] Uniqueness of ∇ on tensors; the difference of two connections is a tensor Γ; coordinate expressions; torsion components; commutators on covectors and general tensors; derive the Bianchi symmetry and identity.
- [14.12–14.14] Equivalent forms of the geodesic and parameter conditions; affine parameters are related by υ = Au + B; the O(ε²) torsion term.
- [14.15–14.25] Lie bracket is a derivation and obeys Jacobi; group manifolds have torsion but no curvature; Taylor's theorem as ea d/dy; formulas and uniqueness for £; torsion corrections; equivalence of the two curvature notations.
- [14.26–14.36] Christoffel symbols and the classical curvature formula; the extra Riemann symmetries and the count of 20 in four dimensions; Killing's equation and brackets; dS = 0 in index form; Poisson-bracket identities; why some structures are floppy and others not.
Fibre bundles and gauge connections
Chapter 14's connection moved tangent vectors around a manifold. The forces of particle physics need the same idea for quantities that live in internal spaces, fibres attached to each spacetime point but pointing in no spacetime direction. This chapter builds the geometry: bundles, cross-sections, the Möbius, Clifford–Hopf and complex line bundles, tangent and cotangent bundles, projective spaces, and finally bundle connections and their curvature. The payoff is the modern view that physical force fields are the curvature of connections on bundles whose fibres have an exact symmetry.
15.1 Physical motivations
General relativity and classical phase space need only Chapters 12 and 14. The gauge theories of the strong, weak and electromagnetic interactions need gauge connections: "parallel transport" of quantities that live not in the tangent space at p but in some other space located at p. Tensors and (in Penrose's view) spinors are nothing new once the tangent space is given; the gauge-theory spaces are new, an extra kind of "internal" dimension that moving along does not take one away from the spacetime point.
The bundle notion existed in pure mathematics long before physicists realised they had been using it; Andrzej Trautman (around 1967) was among the first physicists to see that a gauge theory is a connection on a bundle.
Kaluza–Klein extra dimensions
- Kaluza and Klein (around 1919–1926) extend spacetime from 4 to 5 dimensions, the fifth curled into a tiny loop, and recover Maxwell's theory geometrically.
- Supergravity and string theory push this to 26, 11 or 10 total dimensions.
- The extra dimensions are put on a par with space and time.
Bundle (internal) dimensions
- Standard gauge theory treats the internal space as a fibre over ordinary 4D spacetime, not extra spacetime.
- The fibre carries an exact symmetry group that makes "twisting" possible.
- Penrose: whether internal dimensions ultimately come from a Kaluza–Klein spacetime is speculation (§31.4); even in string theory the Calabi–Yau spaces are not themselves the fibres (note 15.2).
15.2 The mathematical idea of a bundle
A bundle B is built from a base space M (usually spacetime) and a fibre V (the internal space): "an M's worth of Vs". The fibres are disjoint and fill B; M is not inside B but is the factor space of B by its fibres, reached by the canonical projection that collapses each fibre to its base point.
- Trivial bundle: the product space M × V of pairs (a, b).
- Twisted bundle: locally identical to M × V over small open sets of M, but globally different, often topologically different. Dim B = dim M + dim V always.
- Group of the bundle: the symmetry group G of V that supplies the freedom to twist; B is a G-bundle over M. When V is a vector space B is a vector bundle, with G inside a general linear group.
The canonical example: M = S¹, V a 1-dimensional real vector space (modelled on ℝ but with only 0 marked). The trivial bundle is the cylinder; the twisted one is the Möbius strip. Cover S¹ by two arcs S¹ − p and S¹ − q, each with a trivial bundle above it, and glue: matching directly gives the cylinder, matching with the flip υ ↦ −υ on one overlap gives the Möbius strip.
The twist exists only because the flip is a symmetry of V. Penrose stresses that ℝ itself has no symmetries at all (x ↦ −x does not preserve multiplication, and 1 ≠ −1), which is why the fibre must be a 1-dimensional vector space "modelled on" ℝ rather than ℝ. Fibre symmetry is what makes non-trivial bundles, and hence gauge fields, possible.
15.3 Cross-sections
A cross-section (section) is a continuous lift of M into B meeting each fibre once; composing with the projection gives the identity on M. On a trivial bundle a section is just a function M → V, the familiar graph; on a twisted bundle it is a "twisted function".
- Cylinder: the fibres can be consistently coordinatised; the zero section marks the zeros; there are many sections that never meet the zero section (for instance a constant non-zero function).
- Möbius bundle: the coordinate must flip sign once round the circle, so a section is a function that changes sign on circumnavigation, and every section meets the zero section (exercise [15.3]). That alone proves B is not the cylinder.
- Some bundles have no sections at all.
15.4 The Clifford–Hopf bundle
The serious example: S³ fibred by circles over S², Hopf's 1931 fibration, built explicitly on William Clifford's earlier "Clifford parallels"; Penrose names it the Clifford–Hopf bundle.
- Work in ℂ² with coordinates (w, z); the bundle space is the unit 3-sphere |w|² + |z|² = 1 (u² + υ² + x² + y² = 1 in real terms).
- Each complex line through the origin, Aw + Bz = 0, is a copy of the complex plane and meets S³ in a circle: these are the fibres.
- Distinct lines meet only at 0, so the circles are disjoint and fill S³.
- Lines are labelled by the ratio A : B, so the base is the Riemann sphere S² = ℂℙ¹.
Sphere-over-sphere bundles of this kind exist only in three cases: S³ → S² with fibre S¹ (complex numbers), S⁷ → S⁴ with fibre S³ (quaternions) and S¹⁵ → S⁸ with fibre S⁷ (octonions), by the theorem of Adams and Atiyah (1966); the division algebras of Chapter 11 reappear.
- Clifford parallels: the fibres are great circles that twist around each other, every pair linked, staying at a constant distance apart. In flat space skew lines diverge; on the positively curved S³ geodesic deviation pulls geodesics together; for Clifford parallels the two effects cancel exactly. Stereographic projection to ℝ³ turns them into a family of linked circles (Fig. 33.15), the configuration that seeded twistor theory.
- No cross-sections. Each point of S³ is a unit spinorial tangent vector to S² (exercise [15.5]). A section would be a continuous field of such vectors on S², but even ordinary unit tangent fields on S² do not exist (the hairy-ball theorem), and making them spinorial does not help.
- Unit tangent bundle B′. Identify antipodal points of S³ (each ordinary vector has two spinorial versions): the result is the bundle of unit tangent vectors to S², whose circles are each double-covered by those of B. B′ is the rotation space R ≅ SO(3) of Chapter 12 (mark a sphere with one arrow and you fix its orientation), and S³ is its universal (double) cover, i.e. SU(2).
The fibres of the Hopf map are circles of phase multiples (w, z) ↦ (eiθw, eiθz), and two fibres keep a constant distance:
import numpy as np
rng = np.random.default_rng(0)
def rand_s3():
v = rng.normal(size=4); v /= np.linalg.norm(v)
return v[0]+1j*v[1], v[2]+1j*v[3]
def hopf(w, z):
return np.array([2*(w*np.conj(z)).real, 2*(w*np.conj(z)).imag,
abs(w)**2 - abs(z)**2])
t = np.linspace(0, 2*np.pi, 400)
(w1, z1), (w2, z2) = rand_s3(), rand_s3()
F1 = [(np.exp(1j*s)*w1, np.exp(1j*s)*z1) for s in t]
F2 = [(np.exp(1j*s)*w2, np.exp(1j*s)*z2) for s in t]
imgs = np.array([hopf(*p) for p in F1])
print("fibre maps to one point of S2:", np.allclose(imgs, imgs[0]))
dist = [min(np.sqrt(abs(a-c)**2 + abs(b-d)**2) for c, d in F2)
for a, b in F1[::40]]
print("distance fibre 1 to fibre 2:", np.round(dist, 4))
fibre maps to one point of S2: True
distance fibre 1 to fibre 2: [0.6382 0.6382 0.6382 0.6382 0.6382 0.6382 0.6382 0.6382 0.6382 0.6382]
15.5 Complex vector bundles and (co)tangent bundles
Take the whole complex line Aw + Bz = 0 as the fibre: a 1-dimensional complex vector space over the Riemann sphere. All these lines share the origin, so ℂ² must be modified by blowing up the origin: replacing the single point (0, 0) by a whole ℂℙ¹ of zeros, one per fibre, which becomes the zero section. The result, Bℂ, is a complex line bundle, a holomorphic object.
- Sections exist now that zero is allowed; they are the spinor fields on S², the spinors at a point forming a 2-complex-dimensional space (each spinor field must vanish somewhere, exercise [15.6]).
- Holomorphic sections ("twisted holomorphic functions") are tightly controlled and central to twistor theory (§33.8); for Bℂ the only global holomorphic section is zero.
- B′ℂ, the square of Bℂ, identifies (w, z) with (−w, −z) and scales by λ1/2; as a real bundle it is the tangent bundle T(S²).
- Tangent bundle T(M): points are (point of M, tangent vector there); sections are vector fields. Cotangent bundle T*(M): sections are covector fields, and every cotangent bundle is automatically a symplectic manifold, the root of classical mechanics' phase space (§20.2). Tensor fields are sections of tensor bundles.
15.6 Projective spaces
Projective geometry grew from perspective drawing: parallel road edges meet at a vanishing point on the horizon, so projective geometry adds points at infinity where parallels meet. Theorems of Pappos (late 3rd century AD; Penrose keeps the Greek spelling) and Desargues (1636) are properly projective: each says that if all but one of the marked points are triple intersections of the drawn lines (9 lines and points for Pappos, 10 for Desargues), so is the last, provided parallel triples count as meeting at infinity.
- Definition. ℙⁿ is the space of lines through the origin of an (n + 1)-dimensional vector space; projective lines come from 2-planes through the origin, and ℙʳ ⊂ ℙⁿ from (r + 1)-dimensional subspaces.
- The artist's eye sits at the origin of ℝ³; each light ray through it is one "point" of the visual field ℝℙ². Any flat canvas covers only part of ℝℙ²; three canvases suffice (exercise [15.9]), four for the doubly-covering sphere of directed rays (note 15.13).
- Homogeneous coordinates z⁰ : z¹ : … : zⁿ, not all zero, giving n independent ratios; real for ℝℙⁿ, complex for ℂℙⁿ. The Riemann sphere is ℂℙ¹.
- As a bundle: ℝⁿ⁺¹ − O or ℂⁿ⁺¹ − O fibres over ℙⁿ with fibre ℝ − 0 or ℂ*; restoring zeros means blowing up the origin into a copy of ℙⁿ.
- Quantum geometry. The unit sphere S²ⁿ⁺¹ ⊂ ℂⁿ⁺¹ is an S¹-bundle over ℂℙⁿ. For an (n + 1)-state quantum system, physically distinct states form ℂℙⁿ, and the overall phase is really a "twisted" unit complex number, an element of the S¹ fibre, the geometric source of the Berry phase (Berry 1984; Simon 1983; Aharonov–Anandan 1987).
15.7 Non-triviality in a bundle connection
A bundle can be non-trivial without any topological twist. Over S¹ with a 1-dimensional real fibre, glue with a stretch υ ↦ 2υ instead of a flip. Topologically this is just the cylinder S¹ × ℝ, but it carries a "strain" visible only through a connection.
- Connection as horizontality. In the tangent bundle, parallel transport of υ along γ is a curve γυ in T(M); "parallel" means "horizontal" in the bundle. For bundles not tied to T(M), one speaks of constancy rather than parallelism, and a bundle connection is a local notion of horizontal.
- Freedom. Extending a tangent connection to covectors and tensors is forced; on a general bundle the connection is independent data.
- The strained bundle: horizontal means ordinarily horizontal in each patch, but one gluing stretches by 2. A non-zero locally horizontal section comes back doubled, so no non-zero horizontal cross-section exists, and transport from a to b depends on the route. Since the base is 1-dimensional there is no local curvature: this is global path dependence without local path dependence.
15.8 Bundle curvature
To get local path dependence the base needs at least 2 dimensions. Take Mℂ = ℂ (the old S¹ is the unit circle) with real-line fibres and the connection
∇ = ∂/∂z − A, A a smooth complex function multiplying the fibre value.
- Horizontal sections solve ∇Φ = 0. If A is holomorphic, Φ = eB + B̄ with B = ∫A dz works.
- If A is not holomorphic, the commutator [∇, ∇̄] multiplies Φ by a number proportional to Im(∂A/∂z̄), which obstructs solutions: this is the bundle curvature, the local strain.
- Choosing A so the curvature is constant, the logarithm of the stretch acquired round a loop is proportional to the enclosed area; tuned suitably it reproduces the factor-2 strain over the unit circle (exercise [15.14] asks for the constant).
- General form. In coordinates ∇ₐ = ∂/∂xᵃ − Aₐ, where Aₐ carries suppressed bundle indices (Aₐµλ, Greek for fibre directions); curvature is Fab from ∇[a∇b], antisymmetric in the base indices with fibre indices λ, µ attached, and there is an analogue of the Bianchi identity. Torsion is irrelevant for bundles unrelated to T(M).
Widen the fibre to a complex line and replace the stretch by multiplication by a unit complex phase eiθ: a rotation, as in the Clifford–Hopf bundle. The group is U(1), and U(1) bundle connections describe electromagnetism, with the electromagnetic field as their curvature (§19.4). A circle fibre suffices (a principal bundle, whose fibre is the group itself with its identity "forgotten", an affine version of G); a complex-plane fibre gives a vector bundle.
| Bundle | Base | Fibre | Group | Notable feature |
|---|---|---|---|---|
| Cylinder | S¹ | 1-dim real vector space | trivial | Sections avoiding zero exist |
| Möbius strip | S¹ | 1-dim real vector space | {±1} | Every section hits zero |
| Strained bundle | S¹ | 1-dim real vector space | stretches ℝ⁺ | Topologically trivial; global holonomy factor 2 |
| Clifford–Hopf S³ | S² | circle S¹ | U(1) | No sections; fibres are linked Clifford parallels |
| Unit tangent bundle ≅ SO(3) | S² | circle | U(1) | Double-covered by S³ = SU(2) |
| Complex line bundle Bℂ | S² = ℂℙ¹ | ℂ | ℂ* | Sections are spinor fields; no global holomorphic ones |
| T*(M) | Any M | Covectors | GL(n) | Always symplectic: classical phase space |
| S²ⁿ⁺¹ over ℂℙⁿ | ℂℙⁿ | circle | U(1) | Quantum state space and phase; Berry phase |
Penrose insists that gauge theory depends on fibres having an exact symmetry, and asks where such symmetries come from (Chapters 28, 31, 34). Mainstream physics largely takes the gauge groups SU(3) × SU(2) × U(1) as given or derived from unification schemes; Penrose's question is a genuine open one, but his implied doubt that the internal spaces can be ordinary extra dimensions is a minority stance among string theorists, for whom gauge symmetry routinely emerges from compactification geometry or brane configurations.
The Yang–Mills existence and mass gap problem, the rigorous version of the quantum theory built on the bundle curvature of this chapter, remains one of the Clay Millennium Prize Problems, still unsolved in 2026. Meanwhile bundle geometry has spread: Berry phases and Chern numbers of Bloch bundles classify topological insulators (2016 Nobel Prize to Thouless, Haldane and Kosterlitz for topological phases), and the Hopf fibration is used to describe qubit states (the Bloch sphere as ℂℙ¹) and knotted light fields.
Penrose's "strained" bundle, path dependence with no local curvature on the path itself, has a celebrated physical counterpart he takes up later (§19.4): the Aharonov–Bohm effect (1959). Electrons passing either side of a shielded solenoid travel only where the electromagnetic field (the curvature) is zero, yet their interference pattern shifts by a phase equal to the magnetic flux enclosed, the holonomy of the U(1) connection round the loop. It was confirmed decisively by Tonomura and colleagues in 1986 using superconducting shielding. Dirac's monopole (1931) is the matching topological story: a monopole's field is a U(1) connection on the Hopf-type bundle over a sphere surrounding it, and consistency forces charge quantisation.
Counting twists: the Chern number
How twisted is a U(1) bundle over a sphere? Integrate its curvature 2-form F over the sphere: (1/2π)∫F is always an integer, the first Chern number, which no smooth deformation can change. The trivial bundle has Chern number 0; the Clifford–Hopf bundle has Chern number ±1 (sign by convention), and its tensor powers have the other integers. The same integer appears as the Hopf invariant of the map S³ → S² (any two fibres link exactly once) and, physically, as the magnetic charge of a Dirac monopole and as the quantised Hall conductance of a topological insulator. It is the cleanest example of Penrose's theme that bundle curvature, a local quantity, can encode global topology.
Terms to know
| Term | Meaning |
|---|---|
| Fibre bundle B | Total space locally like M × V; "an M's worth of Vs" |
| Base space M | The space being "decorated", usually spacetime |
| Fibre V | The internal space attached at each point |
| Structure group G | Symmetries of V used to glue local pieces |
| Canonical projection | B → M collapsing each fibre to its point |
| Cross-section | A continuous choice of one fibre point over each base point |
| Vector / line bundle | Fibre is a vector space / a 1-dimensional one |
| Principal bundle | Fibre is the group G itself with its identity forgotten |
| Hopf fibration | S³ → S² with circle fibres (Clifford parallels) |
| Blowing up | Replacing a point by the projective space of directions through it |
| ℂℙⁿ | Lines through the origin of ℂⁿ⁺¹; the space of pure states of an (n + 1)-level system |
| Bundle connection | Notion of horizontal (constant) transport in the bundle |
| Bundle curvature F | Commutator of covariant derivatives; physically the gauge field strength |
Imagine each country (a point of the base) has its own currency line (the fibre). There is no global answer to "how many euros is one rupee", only exchange rates along routes between neighbours. Carry money round a triangle of exchanges (rupees to dollars to euros to rupees) and you may come back with more or less than you started: that discrepancy is a curvature, and an arbitrage loop is a non-zero holonomy. The analogy is due to physicists such as Malaney and Weinstein ("economic gauge theory") rather than Penrose, but it captures his strained-bundle example exactly: a topologically trivial bundle whose connection still records path-dependent stretching.
For a banking architect the currency picture is more than an analogy. Triangular arbitrage detection is literally the search for loops with non-trivial holonomy in a graph of exchange rates (log-rates summed round a cycle, as in Bellman–Ford negative-cycle detection). Penrose's "local consistency, global discrepancy" is also the shape of many reconciliation failures in distributed ledgers: each pairwise link reconciles, yet the loop does not close.
What the exercises ask
- [15.1–15.3] dim(M × V) = dim M + dim V; ℝ has no symmetries; every Möbius section meets zero.
- [15.4–15.5] The quaternionic and octonionic Hopf bundles S⁷ → S⁴ and S¹⁵ → S⁸; S³ as unit spinorial tangent vectors of S² using the vector u∂/∂υ − υ∂/∂u + x∂/∂y − y∂/∂x.
- [15.6–15.8] Spinor fields on S² vanish somewhere; Bℂ is holomorphic; B′ℂ is T(S²).
- [15.9–15.11] Three canvases cover ℝℙ²; n + 1 affine patches cover ℙⁿ; ℝⁿ⁺¹ − O over ℝℙⁿ factors through Sⁿ.
- [15.12–15.14] Horizontal sections for holomorphic A; the curvature commutator; the constant giving a stretch factor of 2 round the unit circle.
The ladder of infinity
Physics as practised leans on the infinite: the continuum, infinite-dimensional Hilbert spaces, function spaces. Penrose first examines the finite alternative (finite fields, finite projective planes, the Fano plane that encodes the octonions) and finds it elegant but physically unconvincing. He then climbs Cantor's ladder: 1–1 correspondence, ℵ₀, the diagonal slash proving α < 2α, the continuum hypothesis, Russell's paradox, Turing machines and Gödel's theorem. The same diagonal argument that shows there are more reals than integers also shows there is no algorithm to decide whether a computation halts, and that no trustworthy formal system captures all mathematical truth.
16.1 Finite fields
Some prefer a universe finite in extent and only finitely divisible, and a school associated with Y. Ahmavaara (1965) proposed that ℝ approximates a finite physical number system. The simplest candidates come from arithmetic mod a prime p: a ≡ b (mod p) iff a − b = kp, giving p equivalence classes, the elements of the finite field 𝔽ₚ.
- "Field" here is the algebraist's sense: a commutative division ring, not a vector or physical field.
- Characteristic p: adding p copies of any element gives 0; p itself counts as zero. Exercise [16.1] asks why p must be prime (otherwise zero divisors appear).
- Irony: each element is defined as an infinite set (the class "3" in 𝔽₅ is {…, −7, −2, 3, 8, 13, …}), so the infinite is used to define the finite, the same equivalence-class trick that defines fractions.
- 𝔽₅: inverses 1⁻¹ = 1, 2⁻¹ = 3, 3⁻¹ = 2, 4⁻¹ = 4.
- 𝔽q for q = pᵐ: e.g. 𝔽₄ = {0, 1, ω, ω²} with ω³ = 1, x + x = 0 and 1 + ω + ω² = 0, extending the cube roots of unity of §5.4 (the "quarkiness" of §5.5).
16.2 A finite or infinite geometry for physics?
For 𝔽q to replace ℝ, p would have to be enormous, and Penrose judges a theory that rests on an absurdly large prime more complicated and less probable than one resting on a simple notion of infinity. Still, much geometry survives over 𝔽q.
- Finite projective spaces. ℙⁿ(𝔽q) has 1 + q + q² + … + qⁿ = (qⁿ⁺¹ − 1)/(q − 1) points.
- Magic discs. For the plane ℙ²(𝔽q), mark 1 + q + q² points round a circle and put 1 + q pointers on a rotating disc so that every pair of marked points is hit by exactly one disc setting; equivalently the gaps a₀, …, aq represent each distance 1, …, q + 1 uniquely as cyclic sums (a perfect difference set). Penrose's gaps: q = 2: 1, 2, 4; q = 3: 1, 2, 6, 4; q = 4: 1, 3, 10, 2, 5; q = 5: 1, 2, 7, 4, 12, 5, plus discs for q = 7, 8, 9, 11, 13, 16. They exist for every prime power q, and readers can check Pappos and Desargues on them.
The Fano plane and the octonions
The case q = 2 is the Fano plane: 7 points, 7 lines, the circle counting as a line. It is the multiplication table of the octonions. Label the points by the units i₀, …, i₆ (each ir² = −1); the product of two units is, up to sign, the third point on their line, with sign + if the cyclic order agrees with the disc's orientation and − otherwise: i₀i₁ = i₃ = −i₁i₀, i₀i₂ = i₆, i₁i₆ = −i₅, i₄i₂ = −i₁. Exercise [16.6] shows the associator a(bc) − (ab)c is antisymmetric, which yields the alternative law a(ab) = a²b.
Penrose is openly sceptical: finite geometries and octonions are beautiful, but "the case has yet to be convincingly made" that physics uses them, and mathematical elegance alone is far from enough. Note 16.3 surveys octonionic and quaternionic quantum mechanics (Adler: serious obstacles) and p-adic numbers (5-adics like …24033200411.3104, infinite to the left). The warning cuts both ways: it is also Penrose's implicit rebuke to elegance-driven programmes such as string theory, and supporters of octonionic physics (Dixon, Furey, Manogue–Dray) would dispute his verdict.
Infinite mathematics need not mean infinite physics: Penrose's own spin networks (§32.6) build space combinatorially from the discreteness of spin (multiples of ½ħ), and loop quantum gravity (Ashtekar, Rovelli, Smolin, Jacobson) uses knots and spin networks, yet both still lean on the continuum. The early hope that quantum theory would make spacetime discrete was not realised; small-scale discreteness remains "unconventional".
16.3 Different sizes of infinity
Georg Cantor, from 1874 to 1895, showed infinities come in sizes. Two sets have the same cardinality if there is a 1–1 correspondence between them.
- Galileo (1638) noticed that an infinite set can match a proper subset: n ↔ n² pairs ℕ with the squares, a vanishing fraction of ℕ.
- ℕ = {0, 1, 2, …} matches ℕ − 0 (r ↦ r + 1), the integers ℤ (order them 0, 1, −1, 2, −2, …), and the rationals.
- Cardinal numbers. Frege (1884) tried to define a cardinal as the class of all equinumerous sets, but "all sets" breeds contradictions; Penrose treats cardinals as Platonic abstractions from 1–1 equivalence. Natural numbers are the finite cardinals, closer to intuition than the ordinal construction of §3.4.
- Ordering. α ≤ β if a set of size α matches a subset of one of size β. α ≤ β and β ≤ α imply α = β (the Schröder–Bernstein theorem; exercise [16.10] outlines the proof). Comparability of all cardinals follows from the axiom of choice.
- Arithmetic of infinities. If β ≤ α with α infinite, both A ∪ B and A × B have cardinality α.
- ℵ₀ (aleph-nought) is the smallest infinite cardinal. The rationals: each is a/b in lowest terms, giving ρ ≤ |ℕ × ℕ| = ℵ₀, and ℤ ⊂ ℚ gives ℵ₀ ≤ ρ, so ρ = ℵ₀. Exercise [16.8] supplies the explicit pairing (a, b) ↦ ½[(a + b)² + 3a + b].
The axiom of choice says that for any set of non-empty sets there is a set containing exactly one element from each. It looks obvious, but it asserts existence without construction, and it implies the Banach–Tarski theorem: a unit ball can be cut into five pieces (non-measurable point sets) and reassembled by rigid motions into two unit balls. Penrose says he is "cautious" about it. Most working mathematicians accept choice freely (ZFC is the standard foundation), and Gödel showed it consistent with the other axioms, so his caution is a philosophical rather than technical position.
16.4 Cantor's diagonal slash
Notation: Bᴬ is the set of all maps from A to B, with cardinality βᵅ (for finite sets the count really is bᵃ). With B = {in, out}, a map is a subset of A, so 2ᵅ is the number of subsets of a set of size α.
- Suppose a 1–1 correspondence a ↦ S(a) between A and its subsets.
- Define Q = {a : a ∉ S(a)}. Then Q = S(q) for some q.
- Ask whether q ∈ Q. If not, q qualifies for Q, so q ∈ Q; if so, q fails the condition, so q ∉ Q. Contradiction either way.
- And α ≤ 2α via a ↦ {a}. Hence α < 2α: no largest infinity.
- The continuum. The cardinality of ℝ is C = 2ℵ₀. For 2ℵ₀ ≤ C, read a 0–1 sequence as a real; to dodge the ambiguity of binary expansions ending in all 0s or all 1s, interleave the digit 3 (100110… becomes .313030313130…) and read it in decimal. For C ≤ 2ℵ₀, use binary expansions of (0, 1) and any bijection of (0, 1) onto ℝ. So C > ℵ₀: there are more reals than fractions.
- Cantor's original listed all reals in (0, 1) and built a new one differing from the n-th in the n-th digit: the "diagonal slash" (told in The Emperor's New Mind, Chapter 3).
Three of the chapter's claims checked by machine: field inverses in 𝔽₅, Penrose's pairing function, and the diagonal slash.
print("inverses mod 5:", {a: pow(a, -1, 5) for a in range(1, 5)})
pair = lambda a, b: ((a + b)**2 + 3*a + b)//2
vals = sorted(pair(a, b) for a in range(60) for b in range(60) if a+b < 60)
print("first 1830 codes are 0..1829:", vals == list(range(len(vals))))
listing = [[(n*k + n//3) % 2 for k in range(10)] for n in range(10)]
diag = [1 - listing[n][n] for n in range(10)]
print("diagonal differs from every row:",
all(diag[n] != listing[n][n] for n in range(10)))
inverses mod 5: {1: 1, 2: 3, 3: 2, 4: 4}
first 1830 codes are 0..1829: True
diagonal differs from every row: True
16.5 Puzzles in the foundations of mathematics
Cantor wanted C = ℵ₁, the next cardinal after ℵ₀: the continuum hypothesis (CH). Gödel (1940) and Paul Cohen (1963) showed CH (and the axiom of choice) cannot be decided from standard set theory. Penrose stresses that, given Gödel's theorem, independence does not settle whether CH is true: stronger methods might decide it, or its truth might depend on one's mathematical standpoint (note 16.11 points to Woodin's new approach).
Hugh Woodin has since moved between programmes: first arguing (around 2001, the approach Penrose cites) for axioms implying 2ℵ₀ = ℵ₂, later developing "Ultimate L", which would favour CH. In 2021 the Annals of Mathematics published Asperó and Schindler's proof that the forcing axiom Martin's Maximum⁺⁺ implies Woodin's axiom (*), uniting two leading routes to 2ℵ₀ = ℵ₂. Set theorists remain divided; the question Penrose leaves open is still open.
Russell's paradox and sets versus classes
Since 2Ω > Ω, there is no greatest cardinal. Bertrand Russell, who had believed the "class of all classes" was largest, applied Cantor's argument to it around 1902 and found his paradox: let R = the set of all sets that are not members of themselves; R ∈ R implies R ∉ R and vice versa. The lesson: there is no set of all sets. Cantor knew this years earlier (note 16.10).
- The standard fix: distinguish sets from classes. Any collection of sets is a class; some classes are "respectable enough" to be sets; classes cannot be collected into bigger entities. The class of all sets, Ω, is allowed (Cantor gave it an almost deistic status), but 2Ω is not.
- Penrose's dissatisfaction: "a class is a set iff it can be a member of a class" looks circular. The more liberal the membership rules, the more powerful the proofs; open the door too wide and contradiction collapses everything. Drawing the line is "one of the most delicate and difficult procedures in mathematics".
- Constructivism is no escape: as the next section shows, the diagonal slash defeats extreme conservatives too.
16.6 Turing machines and Gödel's theorem
Computability was developed by Church, Curry, Kleene, Gödel and Post and put on clear footing by Alan Turing in 1936. A Turing machine is an idealised computer: unlimited time and memory, no errors. Each T computes T(n) = m on natural numbers.
- Faulty vs effective. A machine is faulty if it fails to halt on some n (or its code is invalid), effective if it always halts. Example: "find the least number not a sum of n squares" gives T(0) = 1, T(1) = 2, T(2) = 3, T(3) = 7, but T(4) runs forever by Lagrange's four-square theorem.
- Coding. Every machine's instruction table is a natural number t, giving Tt.
- Universal machine. U(t, n) = Tt(n); U is itself some Tu; modern computers are essentially universal Turing machines.
- Recursive sets have a halting membership test (output 0 or 1); recursively enumerable (r.e.) sets are listed by an effective machine; S is recursive iff S and ℕ − S are both r.e. There are only ℵ₀ computations but C subsets of ℕ, so most sets are not recursive.
Run Cantor's argument over the recursive subsets of ℕ: the set of codes t for which Tt is effective is not recursive, not even r.e. So there is no algorithm that decides, for an arbitrary Turing machine, whether it will halt. Even deciding whether two effective machines define the same recursive set is uncomputable (exercise [16.17]).
Gödel's incompleteness theorem
Formal systems were meant to tame the paradoxes by fixing clear-cut rules of proof, checkable by computation. Gödel showed this cannot capture everything: for any formal system F we are prepared to trust (and that is not too weak) there is a definite statement G(F) that we must then accept as true but that F cannot prove.
- Derivation from Turing: the theorems of F form an r.e. set. Many famous statements are Π₁-sentences, of the form "this computation never halts": Lagrange's four-square theorem, Fermat's Last Theorem (proved by Andrew Wiles), the open Goldbach conjecture. True Π₁-sentences are not r.e., so some escape F; refining the argument yields the specific G(F).
- The common misreading: Gödel does not show that parts of Plato's world are inaccessible. It shows that trusting a set of rules gives us new access to truths those rules cannot reach: "Gödel shows us how to transcend any F that we are prepared to trust".
Penrose's reading
- Believing F sound lets us see G(F) is true; human insight therefore outruns any fixed algorithm.
- This underwrites his argument (The Emperor's New Mind, Shadows of the Mind) that mathematical understanding is non-computable, and his hope that computability will matter for physics.
The mainstream reading
- We usually cannot know that a complex F is sound; humans are also fallible (critiques by Putnam, Feferman, Chalmers, among many).
- G(F) is provable in the stronger system F + Con(F); nothing forces a non-algorithmic mind.
- Most logicians accept Penrose's statement of the theorem and reject the inference to non-computable minds.
Machine-checked mathematics has advanced on exactly the ground Penrose surveys. BB(5) = 47,176,870, the fifth Busy Beaver value (a pure halting-problem quantity), was settled in July 2024 by the bbchallenge collaboration with a proof checked in Coq. Google DeepMind's AlphaProof reached IMO silver-medal standard in 2024 by producing proofs in the Lean system (published in Nature in 2025), and Gemini Deep Think achieved gold-medal level at IMO 2025 in natural language. None of this touches Gödel's theorem, which constrains these systems as much as any, but it sharpens the empirical side of Penrose's claim that understanding is not algorithmic.
16.7 Sizes of infinity in physics
Despite the closeness of mathematics and physics, transfinite set theory and computability have so far barely touched physical theory. Penrose expects computability will eventually matter (Penrose 1989, 1994, 1997; precedents by Komar 1964 and Geroch and Hartle on the non-computability of certain quantum-gravity sums).
- Physics rarely exceeds C. ℂ = ℝ × ℝ has cardinality C; manifolds glued from countably many patches of ℝⁿ or ℂⁿ have C points.
- All functions ℝ → ℝ number Cᶜ = 2ᶜ > C, but continuous functions are fixed by their values on the countable set of rational points, so there are only Cℵ₀ = (2ℵ₀)ℵ₀ = 2ℵ₀·ℵ₀ = C of them. Hyperfunctions, separable Hilbert spaces and even the wild paths of path integrals all stay at C.
- Cardinality is too coarse. Spacetime and a 6 × 10¹⁹-dimensional phase space both have C points. A better measure is dimension: ∞ⁿ points for an n-dimensional space, ∞∞ for infinite-dimensional Hilbert space (dimension ℵ₀, e.g. Sequences (z₁, z₂, …) with Σ|zi|² convergent).
- Free fields with k components on an n-dimensional space: freedom ∞k∞ⁿ, from the formal rule (Aᴮ)ᶜ = AB×C (exercise [16.19]).
- Fields fixed by initial data: if free data of r components live on a q-dimensional surface, freedom ∞r∞q.
- Invariance: q is unambiguous; r needs care (Cartan 1945; modern jet-bundle treatment by Bryant et al. 1991).
- Refinement (Penrose 2003): polynomial exponents such as ∞2∞²+3∞+5 for "2 functions of 2 variables, 3 of 1, and 5 constants".
- Use later: comparing theories by how much freedom their fields carry (§23.2, §§31.10–17), Penrose's main argument against extra dimensions in string theory.
| Infinite structure | Cardinality | Role in physics |
|---|---|---|
| ℕ, ℤ, ℚ | ℵ₀ | Counting, quantum numbers, lattices |
| ℝ, ℂ, ℝⁿ, manifolds | C = 2ℵ₀ | The continuum of space and time |
| Continuous / smooth fields, hyperfunctions | C | Classical and quantum fields |
| Separable Hilbert space | C points, dimension ℵ₀ | Quantum states |
| All functions ℝ → ℝ | 2ᶜ | Essentially unused |
| Class of all sets Ω | Not a set | Foundations only |
How G(F) is built, in outline
- Arithmetise. Code every formula and every proof of F as a natural number (a Gödel numbering), so "x is the code of a proof in F of the formula with code y" is a computable relation.
- Enumerate. Because checking proofs is mechanical, the theorems of F are recursively enumerable: a machine can list them all.
- Diagonalise. Construct a sentence that, through its own code, says in effect "no proof of me appears in F's list". This is Cantor's slash applied to the list of provable sentences.
- Conclude. If F is sound, G(F) cannot be provable (it would then be false), so G(F) is unprovable and therefore true. Written out, G(F) is a Π₁-sentence: a particular computation never halts.
- Second theorem. F cannot prove its own consistency either; adding Con(F) as an axiom gives a stronger system with its own new Gödel sentence, an unending ladder that mirrors Cantor's ladder of infinities.
Ordinals, briefly
Penrose mentions ordinals only in passing (the construction 0 = {}, 1 = {0}, 2 = {0, {0}}, … of §3.4 and the generalised continuum hypothesis 2ℵα = ℵα+1 in note 16.8). Cardinals measure how many; ordinals measure position in a well-ordered sequence, and they continue past ω (the first infinite ordinal) through ω + 1, ω·2, ω², ωω, … all of which are still countable. The cardinals ℵ₀, ℵ₁, ℵ₂, … are indexed by ordinals. This distinction matters later for Penrose's discussion of Goodstein's theorem, where termination is proved by descending ordinals below ε₀, a fact unprovable in Peano arithmetic.
Two personal positions colour this chapter. Penrose treats cardinals and sets as inhabitants of a Platonic world, preferring that to formalist definitions; many logicians are formalists or structuralists instead. And his reading of Gödel feeds the claim, developed at length in The Emperor's New Mind and Shadows of the Mind and revisited in §34.7, that human mathematical understanding is non-computable and that new physics (gravitational state reduction) is needed to explain it. The mathematics of this chapter is uncontroversial; the inference to minds and physics is a minority view that most logicians and cognitive scientists reject, while granting that no one has refuted its premises to everyone's satisfaction.
Terms to know
| Term | Meaning |
|---|---|
| 𝔽q | The finite field with q = pᵐ elements |
| Perfect difference set | Penrose's "magic disc": gaps whose cyclic sums hit each distance once |
| Fano plane | ℙ²(𝔽₂): 7 points, 7 lines; the octonion multiplication table |
| Cardinality | Size measured by 1–1 correspondence |
| ℵ₀ | Cardinality of ℕ; smallest infinity |
| C = 2ℵ₀ | Cardinality of the continuum |
| Continuum hypothesis | No cardinal strictly between ℵ₀ and C; undecidable in ZFC |
| Axiom of choice | Every family of non-empty sets has a choice set; implies Banach–Tarski |
| Class vs set | Collections too large to be members are classes |
| Turing machine | Idealised computer; U is universal |
| Recursive / r.e. | Decidable membership / computably listable |
| Π₁-sentence | "This computation never halts" |
| G(F) | Gödel sentence: true if F is sound, unprovable in F |
| ∞r∞q | Wheeler–Penrose measure of functional freedom |
A hotel with rooms 0, 1, 2, … is full, yet a new guest fits: everyone moves from room r to r + 1 (Galileo's insight in modern dress). A countably infinite coach of guests fits too: move everyone to room 2r and use the odd rooms. Even countably many coaches fit, via Penrose's pairing function. But suppose the guests are all infinite 0–1 strings. Any assignment to rooms misses the string that differs from room n's string in its n-th digit. Cantor's diagonal is the night manager's impossible task, and the same argument, applied to programs, says no inspector can certify in advance which programs will halt.
The halting theorem is the hard ceiling on automated assurance. No tool can decide in general whether arbitrary code terminates, whether two programs are equivalent, or whether a model's behaviour satisfies a rich specification; practical verification therefore restricts the language (total functions, bounded loops), accepts incompleteness (tests, sampling), or uses proof assistants where humans supply the hard steps. For AI governance in regulated banking this is the formal reason that model validation can never be fully mechanical and that human accountability (in the SM&CR sense) cannot be engineered away.
What the exercises ask
- [16.1–16.6] Why 𝔽ₚ needs prime p; the tables of 𝔽₄; the point count of ℙⁿ(𝔽q); making new magic discs by multiplying gaps; an 𝔽₈ identity on the Fano disc; the octonion associator.
- [16.7–16.10] Explicit enumerations of fractions; the pairing function; transitivity of ≤; the Schröder–Bernstein proof.
- [16.11–16.14] Ambiguous binary expansions; a bijection (0, 1) → ℝ; Cantor's original list argument as the case α = ℵ₀; Russell's paradox as Cantor applied to the set of all sets.
- [16.15–16.19] Values of the four-squares machine; recursive = r.e. Plus co-r.e.; why equality of recursive sets is undecidable; the construction of G(F); (Aᴮ)ᶜ = AB×C.
Spacetime
The physics half of the book opens by asking what arena physical events occupy. Penrose climbs a ladder of four spacetimes: Aristotelian 𝔼¹ × 𝔼³, Galilean (a fibre bundle with no absolute space), Newton–Cartan (gravity folded into a curved connection) and finally Minkowski and Einstein spacetimes, where absolute time also goes and the null cones carry the causal structure. Each step removes a structure that physics cannot detect, and gravity ends up as nothing but spacetime curvature, read off physically as tidal distortion.
17.1 Aristotelian spacetime: the cinema screen
Penrose begins by noting a historical irony: spacetime was not Einstein's idea, and Einstein was not keen on it when he first met it (it came from Minkowski in 1908). With hindsight, Galileo and Newton could themselves have profited from a spacetime view. To see why, he builds the spacetime appropriate to an idealized Aristotelian dynamics, in which the state of rest is dynamically preferred.
If rest is preferred, a point of space keeps its identity from moment to moment: a particle at rest stays "at the same place". Reality is like a cinema screen, where a marked point on the screen remains the same point whatever is projected on it. Time is modelled as the 1-dimensional Euclidean space 𝔼¹ rather than the real line ℝ, because ℝ has a preferred origin 0; with no preferred origin the dynamical laws cannot change with time. Space is 𝔼³, uniform in every direction, again with no origin.
Aristotelian (and Galilean, and Newtonian) physics carries an absolute simultaneity: it is meaningful to say that a typing finger in Oxford and a supernova in Andromeda happen "at the same time", just as two images in the same projected frame are simultaneous. So the right spacetime is the product
A = 𝔼¹ × 𝔼³, the space of pairs (t, x).
Between two events (t, x) and (t′, x′) there is a well-defined spatial distance |x − x′| and a well-defined time difference. We know absolutely whether two events happen at the same place and whether they happen at the same time.
17.2 Galilean spacetime: a bundle, not a product
Galileo's 1638 principle of relativity, given through his famous ship's-cabin passage (flies, butterflies and a dripping bottle behave identically whether the ship is at rest or moving uniformly), says the laws of dynamics are the same in any uniformly moving frame. This was the essential support for his Copernicanism: the Earth can move without our noticing.
The consequence is drastic and, Penrose complains, under-appreciated: there is no dynamical meaning to saying a point of space now is "the same point" as one a minute ago. He makes it concrete. Pick the exclamation-mark key on his laptop. In one minute Earth's rotation carries Oxford about 10 miles (to near Witney); Earth's orbit carries it about a hundred times farther in the opposite direction, well outside the atmosphere; then add the Sun's motion round the galaxy, the galaxy's motion in the Local Group, the Local Group's fall towards Virgo, Virgo's motion relative to Coma, and Coma's towards the Great Attractor. Which of these is "the" same point? None.
So Galilean spacetime G is not a product but a fibre bundle (Chapter 15) with base 𝔼¹ and fibre 𝔼³. The canonical projection G → 𝔼¹ assigns every event its time (absolute time survives), but there is no pointwise identification of fibres (absolute space is gone). The mathematics of Chapter 15 is exactly what the physics needed: a space that "evaporates" at each moment and reappears, yet still fits together into a connected whole.
17.3 Newtonian dynamics in spacetime language
Newton was at first as much a Galilean relativist as Galileo. His 1684 manuscript De motu corporum in mediis regulariter cedentibus listed five (or six) laws, of which law 4 was the Galilean principle; he later found three sufficient for Principia. Lacking anything like a bundle, Penrose argues, Newton had little choice but to introduce absolute space to make the laws precise.
What structure must G carry? Not a bundle connection (that would be too strong, re-identifying fibres). What is needed is the content of Newton's first law: a body under no forces moves uniformly in a straight line, an inertial motion. In spacetime every particle history is a world line (always a cross-section of the bundle), and "uniform and straight" becomes simply straight. Penrose gives three equivalent ways to encode straightness:
- Affine space. G is an affine 4-space whose affine structure restricts on each 𝔼³ fibre to the ordinary Euclidean one.
- Borrowed lines. Take the ∞⁶ family of straight lines of 𝔼¹ × 𝔼³ (the Aristotelian uniform motions), transfer them to G, and forget the product structure.
- Flat connection. Give G, as a manifold, a connection ∇ with zero curvature and zero torsion. Its geodesics are the inertial motions. This is the version that generalizes to gravity.
With a connection, a non-geodesic world line has a curvature, which is the particle's acceleration. Newton's second law reads a = f ÷ m, so the curvature of a world line directly measures the total force on the particle. In standard Newtonian mechanics the total force is the vector sum of contributions from all other particles, each acting instantaneously along the line joining them within one 𝔼³. Newton's third law makes the paired forces equal and opposite. Each force type has a force law; for gravity
F = G m M / r²,
attractive, with Newton's constant G. From these few ingredients comes a theory of enormous power. Penrose's figures: Newton's gravity is now confirmed to about one part in 10⁷ in the solar system, whereas the data Newton himself had were good to only about one part in 10³, a ten-thousandfold improvement on the evidence that inspired it.
17.4 The principle of equivalence
Einstein's deeper perspective changes none of Newton's observable predictions on its own. What it changes is the concept of inertial motion, and the change pays off only when combined with the finite speed of light. The key is the principle of equivalence, whose roots go back to Galileo (late 16th century), with precursors Simon Stevin (1586) and Ioannes Philiponos (5th or 6th century). Two rocks dropped from the Leaning Tower of Pisa, large and small, fall at the same rate if air resistance is ignored.
This is special to gravity. The gravitational force on a body is proportional to its gravitational mass; its resistance to acceleration is its inertial mass; and these are equal (more carefully, proportional). Penrose also distinguishes passive gravitational mass (the m feeling the force in GmM/r²) from active (the source), but Newton's third law forces them equal. Electricity shows how special this is: two equal-mass pith balls of opposite charge in a downward electric field accelerate in opposite directions, because charge has no tie to inertial mass and can even change sign.
A uniform gravitational field is indistinguishable from an acceleration. An insect clinging to one of Galileo's falling rocks sees the other rock hover, as if gravity were absent; an orbiting astronaut sees the space station hover beside him. Falling freely cancels gravity locally.
Taken seriously, this forces a new definition. Before, inertial meant zero total force. Now, because there is no local way to tell gravity from acceleration, Einstein declares a motion inertial when the non-gravitational forces sum to zero, that is, when the body is in free fall. The insect and the astronaut are therefore inertial; a person standing on the ground is not (the ground's push and gravity balance but neither is zero). Newton would have said exactly the opposite in both cases. Penrose's note adds that parabolic-flight "tourist opportunities" in Russia now sell the insect's experience to humans.
17.5 Cartan's "Newtonian spacetime"
To ease into Einstein, Penrose reformulates Newton's own gravity in Einstein's spirit, following Élie Cartan, who did it about six years after Einstein's 1915 theory. The result, Newton–Cartan spacetime N, is still a bundle over 𝔼¹ with fibre 𝔼³ (absolute time kept), but its "straight" world lines are now the free-fall motions. The whole Newtonian gravitational field is encoded in the structure of N.
N carries a torsion-free connection whose geodesics are the free-fall world lines, and this connection generally has curvature. The curvature is what makes a real gravitational field essentially different from no field. The exception proves the rule: a field uniform over all space (though varying in time) can be removed entirely by a freely falling global frame, and then N is equivalent to G: slide the 𝔼³ fibres sideways until all free-fall lines are straight.
What curvature means physically: tides
Penrose's astronaut Albert (A) falls freely above the atmosphere, surrounded by a sphere of particles initially at rest relative to him. Relative to A, particles displaced horizontally accelerate slightly inward (their pull points to the Earth's centre E from a slightly different angle), while those displaced vertically accelerate slightly outward (gravity weakens with height). The sphere distorts into a prolate ellipsoid of revolution along the line AE, and, remarkably, its volume is initially unchanged. This volume preservation is a signature of the inverse-square law in empty space. (The rotational symmetry of the ellipsoid is incidental; volume preservation is general, for particles starting at rest relative to A in vacuum.)
Swap roles: put the Earth at A and the Moon or Sun at E, and the sphere of particles becomes the oceans. That distortion is the tide, which is why "tidal effect" is the right name for this direct physical manifestation of spacetime curvature. In the spacetime picture the distortion is geodesic deviation (§14.5) of free-fall world lines neighbouring A's, which is a direct measure of the curvature R of ∇.
Now let the sphere surround the Earth just above the atmosphere. Every particle falls inward: instead of a shape change at fixed volume we get a volume reduction, at an initial rate (as an inward acceleration of volume)
4πGM,
where M is the total mass enclosed, and the result holds whatever the size or shape of the shell and however the mass is arranged inside. In general both effects coexist: in empty space only distortion; around matter, distortion plus volume reduction proportional to the enclosed mass.
Distortion at fixed volume
Present in vacuum; ellipsoidal squeeze and stretch; caused by distant masses. In Einstein's theory this becomes the Weyl curvature (§19.7).
Volume reduction
Present only where matter is; inward acceleration 4πGM; set by local density ρ. In Einstein's theory this becomes the Ricci curvature, tied to matter by the field equations.
Cartan showed that Newton's theory can be stated entirely as conditions on the curvature of ∇, relating the mass density ρ to the volume-reducing part of R. Penrose skips the details because Einstein's version is in a sense simpler, but flags that the idea returns in §30.11, where Newton–Cartan structure underpins his proposal for gravitationally induced quantum state reduction.
17.6 The fixed, finite speed of light
The third ingredient also traces to Galileo, who in 1638 proposed timing lantern flashes between distant hills, far too crude for light's actual speed. Both Galileo and Newton suspected a deep link between light and the forces that hold matter together; the 20th century vindicated them, since chemical and atomic binding is electromagnetic, and electromagnetism is the theory of light. James Clerk Maxwell's equations of 1865 (inspired by Michael Faraday's experiments over 30 years earlier) require a definite light speed c ≈ 3 × 10⁸ m/s.
Here is the conundrum. Common sense says a fast-moving observer should measure light going faster or slower. The relativity principle says the observer's laws, including the value of c, must be identical. A particle theory of light (Newton's preference) would dodge the clash, since particle speed depends on the source, but double-star observations (de Sitter, 1913) showed light's speed is independent of the source's motion. Meanwhile Maxwell's theory was strengthened by Heinrich Hertz's 1888 experiments and by its own elegance, unifying electricity, magnetism and light as waves with a fixed speed. Lorentz, more completely Poincaré, and Einstein found a viewpoint in which the contradiction disappears.
17.7 Light cones
The spacetime route makes the resolution transparent. Start from a featureless real 4-manifold. At each event p consider all photon histories through p in every direction (treating a photon as a tiny high-frequency packet of Maxwell field, or as a quantum photon; the distinction does not matter here). They sweep out the light cone at p. To make light speed fundamental is to make the light cones fundamental.
Penrose prefers the term null cone for the tangent-space structure at p (velocities live in the tangent space) and keeps "light cone" for the locus actually swept by light rays. Each cone has a past half (a flash imploding on p) and a future half (a flash exploding from p). Requiring light speed to be the same in all directions means the cone is "spherical", which is to say given by a quadratic equation in Tp:
gab va vb = 0,
where g is a non-singular symmetric tensor of Lorentzian signature. "Null" means the vector v has zero length, |v|² = 0, in this pseudo-metric. Note 17.10 adds a subtlety: recalibrating distances can make any ellipsoid look like a sphere, but no smooth recalibration makes a non-ellipsoidal ovoid look spherical; such ovoids would give a Finsler space, lacking the local symmetry of relativity. For later chapters the key fact is that multiplying g by any non-zero number gives the same cones: the cones fix g only up to scale (the conformal structure, central to §27.12 and twistor theory in §33.3). Constant light speed is expressed by making the cones at all events parallel: this is Minkowski space 𝕄, flat, with uniformly arranged cones.
17.8 The abandonment of absolute time
Could we keep the absolute time of G as well? That would add an 𝔼³ slice through every event, hence a 3-plane in each Tp. But g defines orthogonality, and the g-orthogonal complement of that 3-plane is a preferred time direction, that is, a preferred state of rest. The relativity principle would be lost. This is the common-sense clash restated precisely, and it shows where the culprit lies: the conflict arises only if absolute time is retained. So absolute time must go, along with the bundle structure of G and N. Having already abandoned absolute space for Galilean reasons, Penrose argues, abandoning absolute time should not feel like such a revolution.
We cling to absolute time only because c is so large. In everyday units the cones are almost flat; the exact value is
c = 299 792 458 m/s,
exact because since 1983 the metre is defined from the second and c (time can be measured far more accurately than length). Relativists set c = 1: a second of time pairs with a light-second of distance (299 792 458 m), a year with a light-year (about 9.46 × 10¹⁵ m), a metre with about 3 nanoseconds.
Henceforth space by itself, and time by itself, are doomed to fade away into mere shadows, and only a kind of union of the two will preserve an independent reality.
Hermann Minkowski, Cologne, 21 September 1908Penrose's judgement is firm: despite Einstein's insights and the contributions of Lorentz and Poincaré, special relativity was incomplete until Minkowski (1864–1909), one of Einstein's teachers at the ETH Zurich, supplied the spacetime viewpoint.
Fixing the scale: proper time
To finish 𝕄, the scale of g is fixed so that it measures time along world lines. A timelike curve, with tangents inside the cones, is a possible history of a massive particle, and an ideal clock carried along it between events A and B registers the proper time
τ = ∫AB ds, ds² = gab dxa dxb.
Penrose uses signature (+ − − −) (others prefer + + + −) so that ds² is positive on timelike curves. Photons travel on null world lines, along the cones, and for them τ = 0: a photon, if it could experience anything, would experience no time.
Cones before metric: causality
Penrose deliberately ranks the null cones above the metric, because the cones fix causality. Massive particles stay inside the cones, light runs along them, and nothing physical has a spacelike world line (note 17.13 dismisses hypothetical tachyons as hard to make consistent). So the future of p (all events on or within p's future cone) is exactly the set of events p can signal, and the past of p is the set that can signal p. Fields, and even quantum effects, respect this, with the puzzling exception of quantum entanglement ("quanglement", §23.10). And the relativity principle survives: 𝕄 has as large a symmetry group as G, with every event and every timelike direction on an equal footing (§18.2).
17.9 The spacetime of general relativity
Einstein's spacetime ℰ is to Minkowski's 𝕄 what Cartan's N is to Galileo's G. The cones are no longer uniformly arranged but tilt and vary from event to event; there is still a Lorentzian (+ − − −) metric g giving clock time by the same formula, but without 𝕄's uniformity. Locally ℰ looks like 𝕄; globally its causal structure can be strange.
The extreme case is causality violation: closed timelike curves, along which a signal could reach its own past. Penrose would rule these out for any classically acceptable spacetime; some physicists (he cites Novikov 2001 and Davies 2003) are relaxed enough to entertain time travel (§30.6). Less extreme but still exotic causal structures occur in black holes (§27.8).
The decisive mathematical point comes from §14.7: a non-degenerate (pseudo)metric g determines a unique torsion-free connection ∇ with ∇g = 0 (the Levi-Civita connection). So in Einstein's theory inertial motion is fixed entirely by the metric, unlike Newton–Cartan, where ∇ had to be supplied in addition to the (degenerate) metric notions. The timelike geodesics are the curves that locally maximize proper time, the opposite of the "stretched string" that minimizes length in a Riemannian surface. That maximization is the clock paradox of §18.3 in disguise.
What locally distinguishes special from general relativity is a single tensor: R = 0 for 𝕄, R ≠ 0 for ℰ. The curvature's physical meaning is the same tidal meaning found in Cartan's N, and Einstein's field equations (Chapter 19) are the natural encoding of the volume-reducing rate 4πGM into ℰ.
Worked example: tides from the Moon and Sun
Tidal acceleration across Earth's radius R⊕ from a body of mass m at distance r scales as 2Gm R⊕ / r³ (Exercise 17.7 asks you to show the m r−3 law). For the Moon: m = 7.34 × 10²² kg, r = 3.84 × 10⁸ m. For the Sun: m = 1.99 × 10³⁰ kg, r = 1.50 × 10¹¹ m. The Sun is 27 million times more massive, but 390 times farther, and 390³ ≈ 5.9 × 10⁷. Result: the Moon's tidal effect is about 2.2 times the Sun's. Since both discs have nearly the same angular size, m/r³ ∝ density, so the Moon must be about twice as dense as the Sun (3.34 versus 1.41 g/cm³).
import numpy as np
G = 6.674e-11
moon, sun = (7.342e22, 3.844e8), (1.989e30, 1.496e11)
tid = lambda m, r: 2*G*m*6.371e6/r**3
print("ratio %.2f" % (tid(*moon)/tid(*sun)))
print("densities %.2f %.2f" % (moon[0]/(4/3*np.pi*1.7374e6**3)/1000,
sun[0]/(4/3*np.pi*6.957e8**3)/1000))
M, r = 5.972e24, 6.771e6 # Earth, at the ISS altitude
T = -(G*M/r**3)*np.diag([1, 1, -2]) # tidal tensor, z toward Earth
print("trace", np.trace(T))
Output: ratio 2.18, densities 3.34 1.41, trace 0.0. The zero trace is the volume-preservation property of §17.5: the tidal tensor in vacuum is trace-free, squeezing two directions as much as it stretches the third.
A slip in Exercise 17.7. Penrose says the Moon's tidal distortion of the oceans is "about five times" the Sun's. The standard figure, and the calculation above, give about 2.2: spring tides are roughly (1 + 0.46) and neap tides (1 − 0.46) of the lunar tide. The density conclusion he wants (the Moon is denser) still follows. Two historical simplifications are also worth flagging: Cartan's geometric Newtonian gravity dates to 1923–24, and the Pisa experiment is, as Penrose himself says, "alleged"; the documented equal-fall demonstrations are Stevin and de Groot's 1586 Delft drop and Galileo's inclined planes.
Seal yourself in a windowless lab. Drop a hammer and a feather: they hit the floor together. Are you resting on Earth, or in a rocket accelerating at 9.8 m/s²? With one small lab, no experiment can tell (equivalence). Now make the lab 10,000 km tall. Two balls released at floor and ceiling separate on Earth (the lower one falls faster), while in the rocket they keep their spacing. Size reveals tides, and tides reveal curvature. That is exactly why curvature, not "force", is the invariant content of gravity.
What the exercises ask
Exercises 17.1–17.4 ask why a bundle connection would over-structure G, why world lines must be cross-sections, why the three definitions of straightness agree, and how to express world-line curvature through ∇ (and what normalization of tangent vectors is needed). 17.5 asks for the explicit change of frame x ↦ x − ½∫∫F that removes a spatially uniform but time-varying field. 17.6–17.9 derive the prolate, volume-preserving tidal ellipsoid to stated order, the m r−3 tidal law with the Moon–Sun density inference, and the 4πGM volume-reduction rate, first for a central mass and then for any shell and any mass distribution (Gauss's theorem in disguise). 17.10 asks why the cones fix g only up to a factor.
Terms to know
| Term | Meaning in Penrose's usage |
|---|---|
| Aristotelian spacetime A | Product 𝔼¹ × 𝔼³: absolute space and absolute time |
| Galilean spacetime G | Bundle over 𝔼¹ with fibre 𝔼³: absolute time, no absolute space; flat torsion-free connection |
| World line | A particle's history as a curve in spacetime |
| Inertial motion (Einstein) | Free fall: zero non-gravitational force |
| Newton–Cartan spacetime N | Bundle like G, but connection curved by gravity; free fall is geodesic |
| Tidal effect | Relative acceleration of nearby free particles; geodesic deviation, i.e. Curvature |
| Null (light) cone | gabvavb = 0 in Tp; directions of light rays |
| Timelike / null / spacelike | Inside / on / outside the cones |
| Proper time τ | ∫ds along a timelike world line; what an ideal clock reads |
| Closed timelike curve | A world line returning to its own past; causality violation |
Test yourself
- Q. Why is Galilean spacetime a bundle and not a product? Because relativity of uniform motion means there is no way to identify a spatial point at one time with one at another, while time remains absolute.
- Q. Why does keeping absolute time destroy relativity once light cones exist? The 𝔼³ slice and g together pick out an orthogonal time direction, a preferred rest frame.
- Q. What distinguishes Einstein's spacetime from Newton–Cartan's? In ℰ the metric is non-degenerate, so it determines the connection uniquely; in N the connection is extra structure.
Every pillar of this chapter has been tested far beyond 2004. The MICROSCOPE satellite's final result (2022) confirmed the equivalence of inertial and gravitational mass to about 1 part in 10¹⁵ (Eötvös parameter around 10⁻¹⁵). In 2023 CERN's ALPHA-g experiment showed that antihydrogen falls down with an acceleration consistent with ordinary matter's, closing the old speculation about "antigravity". Optical atomic clocks at JILA measured gravitational time dilation across a single millimetre of height in 2022. Gravity Probe B (final results 2011) confirmed geodetic precession to 0.3% and frame dragging to about 19%. And the causal cone structure itself was confirmed by the near-simultaneous arrival of gravitational waves and light from the neutron-star merger GW170817, which pinned the speed of gravity to light's speed within about one part in 10¹⁵.
Chapter 18 develops 𝕄's geometry (Lorentz and Poincaré groups, the clock paradox); Chapter 19 gives Maxwell's and Einstein's field equations, turning 4πGM into G = 8πGT; the conformal structure fixed by the null cones returns in §27.12 (conformal diagrams) and Chapter 33 (twistors); Newton–Cartan structure returns in §30.11 for gravity's role in quantum state reduction.
The chapter is a lesson in removing unobservable structure: absolute space, then absolute time, then the gravitational "force" itself. In system design the same discipline pays: model only the invariants that downstream behaviour depends on, and represent conventions (reference frames, time zones, booking dates) as explicit, swappable structure rather than baking them into the core.
Minkowskian Geometry
Minkowski space differs from Euclidean 4-space only in signs, yet the sign flip changes everything: directions can be orthogonal to themselves, the triangle inequality reverses (the twin "paradox"), the "sphere" of unit timelike vectors becomes hyperbolic space, which is relativistic velocity space, and the celestial sphere is a Riemann sphere on which the Lorentz group acts by Möbius maps. Energy, momentum and mass fuse into one conserved 4-vector, and E = mc² falls out as its time component.
18.1 Euclidean and Minkowskian 4-space
Euclidean 4-space 𝔼⁴ is easy algebraically: add a fourth Cartesian coordinate w, and the Pythagorean distance becomes s² = (w − w′)² + (x − x′)² + (y − y′)² + (z − z′)², infinitesimally ds² = dw² + dx² + dy² + dz², with curve length ∫ds. Visual intuition fails in four dimensions, though some beautiful 4-dimensional configurations, such as the Clifford parallels on S³, can be glimpsed through stereographic projection (Fig. 33.15); Penrose's note credits Tom Banchoff (Brown University) for interactive tools that build 4-dimensional intuition.
Minkowski space 𝕄 differs only by signs. Many workers prefer the (+ + + −) form dℓ² = −dt² + dx² + dy² + dz², positive for spacelike displacements and convenient for spatial geometry. Penrose prefers the (+ − − −) form
ds² = dt² − dx² − dy² − dz² = gab dxa dxb,
because it is positive along timelike world lines and ∫ds is physical clock time. Along a photon world line ∫ds = 0, so distinct points can be "zero distance" apart, which the non-positive-definite (Lorentzian) metric permits.
The old trick: imaginary time
Early relativists set t = iw so that the dℓ² form looks Euclidean. The cost is a hidden reality condition (time imaginary, space real) that gets tangled in a moving frame. The modern descendant is Euclidean quantum field theory; Penrose accepts it as an honest calculational trick but distrusts it as a foundation (§28.9).
Penrose's way: complexify everything
Let all four coordinates be complex: ℂ𝔼⁴ with holomorphic metric ds² = dω² + dξ² + dη² + dζ². Then 𝔼⁴ (all real), 𝕄 (ω real; ξ, η, ζ imaginary) and the (+ + + −) version (ω imaginary; rest real) are just different real slices, each picked out by an involutory complex conjugation C (C² = 1) that fixes it pointwise.
18.2 The symmetry groups of Minkowski space
The Euclidean motions of 𝔼⁴ form a 10-dimensional group: the 6-dimensional rotation group O(4) fixing the origin (n(n − 1)/2 = 6 for n = 4) plus 4 dimensions of translations. Complexified, it becomes a 10-complex-dimensional group, and every continuous motion of ℂ𝔼⁴ preserving ℂg is of this kind. Restricting to the Lorentzian real slice keeps the count at 10 real dimensions: 4 translations (so the group is transitive on 𝕄) and the 6-dimensional Lorentz group O(1,3) (or O(3,1)), as one can check through its Lie algebra with sign changes.
The full 10-dimensional group is the Poincaré group, named for Henri Poincaré (1854–1912), who built the mathematical structure of special relativity between 1898 and 1905, independently of Einstein's 1905 input. It matters enormously later: in quantum theory particles are representations of the Poincaré group, labelled by mass and spin (§22.12).
The relativity principle for 𝕄 is the statement that the Poincaré group acts transitively on the bundle of future-timelike directions: every event, every spatial orientation (3 dimensions) and every velocity below c (3 more dimensions) is on an equal footing. Keeping Galilean simultaneity slices would shrink the symmetry at a point to O(3), with no freedom to change velocity.
The dimension count makes this concrete: 4 (translations) + 3 (rotations) + 3 (boosts) = 10. Penrose's note adds that the group also contains time-reversing elements, which swap future-timelike and past-timelike directions.
18.3 Lorentzian orthogonality and the "clock paradox"
Orthogonality carries over from 𝔼⁴ to ℂ𝔼⁴ by complexification (Penrose stresses this is the holomorphic notion, not the Hermitian one of quantum mechanics), and something new appears: a direction can be orthogonal to itself. On the real slice 𝕄 these self-orthogonal real directions are exactly the null directions, along light rays.
For an r-plane element η at p, the orthogonal complement η⊥ is the (4 − r)-plane element of directions orthogonal to all of η, with (η⊥)⊥ = η. Complements of lines are 3-planes, of 2-planes are 2-planes, of 3-planes are lines; algebraically, raising or lowering indices on the simple r-vector or form representing η passes to η⊥. Read physically: for an inertial observer with timelike direction τ at p, τ⊥ is the 3-space of events the observer calls simultaneous with p. Because τ⊥ tilts when τ tilts, simultaneity depends on velocity. The only difference from Euclidean geometry is that the complement tilts the opposite way, so that as τ approaches the cone, τ⊥ swings to meet it, and for a null direction the complement contains the direction.
The deepest change concerns inequalities. Following Hermann Bondi, Penrose treats clock time as arc length along a world line, so that a traveller's time depending on the route is no stranger than distance depending on the route. In Euclidean geometry the triangle inequality reads AB + BC ≥ AC, with equality only for collinear points. In Lorentzian geometry, for future-timelike sides, it reverses:
AB + BC ≤ AC, equality only when A, B, C lie on one inertial world line.
That is the clock (twin) paradox: the traveller's broken path ABC registers less time than the stay-at-home's straight AC. Critics complain that the traveller's acceleration is unaccounted for; Penrose answers by smoothing the corners (finite accelerations), which changes the times very little. He calls the old claim that general relativity is needed to handle acceleration "completely wrong": both theories compute clock time by ∫ds, and the only question is which metric: flat 𝕄 when gravity is negligible, curved g when it is not.
A traveller flies to a star 4 light-years away at 0.8c and returns at once. Earth time: 2 × 4 / 0.8 = 10 years. Traveller's time: 10 × √(1 − 0.64) = 6 years. The γ factor is 1/0.6 = 5/3. The asymmetry is geometric: the traveller's world line has a corner; the Earth's does not.
18.4 Hyperbolic geometry inside Minkowski space
In 𝔼⁴ the locus at fixed distance a from O is a 3-sphere. In 𝕄 (with + − − −), real a > 0 gives two sheets: the bowl H⁺ inside the future cone and the hill H⁻ inside the past cone; imaginary a gives a one-sheeted hyperboloid spacelike to O. Directions along H⁺ are spacelike, so the dℓ² metric measures it, and its intrinsic geometry is a "sphere with a sign flip": a model of 3-dimensional hyperbolic geometry. Drop a spatial dimension and you get the hyperbolic plane, with geodesics = intersections of H⁺ with 2-planes through O.
This vindicates Johann Lambert, who in 1786 speculated that a sphere of imaginary radius would give a geometry violating Euclid's fifth postulate. Penrose makes it vivid by slicing the null cone t² − x² − y² − z² = 0 with the 3-planes z + t + λ(t − z) = 2, all through the 2-plane t = 1 = z. For λ > 0 the section has the metric of a sphere of radius 1/√λ; for λ = 0 a flat Euclidean plane (even though it looks like a paraboloid); for λ < 0 a hyperbolic plane, Lambert's imaginary-radius sphere. One cone, three geometries.
The hyperboloid unifies Beltrami's two models from Chapter 2. With H⁺ given by t² − x² − y² = 1 in 3-dimensional 𝕄³: projecting from the origin to the plane t = 1 gives the projective (Klein) disc, where hyperbolic lines are straight chords; projecting from (−1, 0, 0) to t = 0 gives the conformal (Poincaré) disc, where lines are circles meeting the boundary at right angles (Escher's Circle Limit).
Velocity space and rapidity
The points of H⁺ (with a = 1) are the future-timelike unit vectors, the possible velocities of a massive particle. So H⁺ is relativistic velocity space, answering the puzzle left at the end of §2.7. Velocities do not add naively: a ship moving at ¾c that fires a missile forward at ¾c relative to itself sees the missile move at only (24/25)c relative to Earth, not 1½c. In H⁺ this is just adding hyperbolic lengths. The hyperbolic length is the rapidity ρ:
ρ = ½ log[(1 + v)/(1 − v)], v = tanh ρ (c = 1).
For small v, ρ ≈ v; as v → c, ρ → ∞, so the light speed is the boundary at infinity of hyperbolic space, the rim of Escher's disc. Collinear velocities add their rapidities, giving the addition law (u + v)/(1 + uv); velocities in different directions compose by a hyperbolic triangle law with sides equal to half the rapidities, the signature-flipped version of the half-angle rule for composing rotations (§11.4, the quaternion/spinor rule).
import math
add = lambda u, v: (u + v)/(1 + u*v)
print(add(0.75, 0.75)) # 0.96
r = math.atanh(0.75)
print(round(r, 4), math.tanh(2*r)) # 0.973, 0.96
Output: 0.96 both ways. Doubling the rapidity of 0.75c (ρ = 0.9730) gives exactly the relativistic sum, which is the whole content of "velocity space is hyperbolic".
18.5 The celestial sphere as a Riemann sphere
Look at a clear night sky and you are looking at your own past light cone: the family S of light rays through the event O at your eye. With a full view from space, S is a whole 2-sphere. Does it have structure? Not a metric: slicing the cone by t = −1 gives a unit sphere, but that depends on the observer's t; another observer passing through O at high speed draws a distorted map. That distortion is real, it is stellar aberration, found by James Bradley in 1725: Earth's changing orbital velocity shifts star positions by about 20 arc seconds seasonally, like rain that seems to come from ahead when you drive fast.
What survives every change of observer is a conformal structure: angles, small shapes, and circles, but not sizes. The celestial sphere is naturally a Riemann sphere, and the Lorentz group acts on it as the Möbius transformations. So a circular pattern of stars seen by one observer is circular for every observer, and a natural label for each star is a complex number ζ = eiφ cot(θ/2) (the stereographic coordinate, with ∞ allowed). Penrose notes that astronomers have not adopted this, though relativists routinely do. The 6 real dimensions of the Möbius group (three complex parameters) match the 6 dimensions of the Lorentz group, the independent check promised in §18.2.
This seems to contradict the FitzGerald–Lorentz contraction, by which a sphere moving at speed v is flattened along its motion by √(1 − v²/c²). Would an observer not see a flattened planet sweep overhead? No. Light from the apparent rear of the sphere travels a longer path than light from the front (the rear moves out of the light's way, the front into it), so the image is stretched to compensate exactly. For small angular size the net visual effect is a rotation, not a flattening (the Terrell–Penrose effect, found independently by James Terrell and Penrose in 1959). Exercise 18.10 sketches John L. Synge's calculation-free proof: intersect the past cone C of O with a timelike 3-plane P through O; the intersection Σ is seen from O as a circle in every frame.
18.6 Newtonian energy, momentum and angular momentum
Before the relativistic versions, Penrose introduces the Newtonian conserved quantities, whose significance is that, for a system free of external forces, their totals are constant in time.
- Energy. Kinetic ½mv² per particle (called heat when the motion is random, §27.3) plus potential energy stored in the forces. Neither part is conserved separately; the total is, as Galileo's pendulum first hinted (height traded for speed and back).
- Momentum. p = mv, a vector; the vector total is conserved.
- Angular momentum. M = 2x ∧ p about an origin O (components xipj − xjpi; the "2" is an artefact of Penrose's definition of ∧). Why skaters spin faster with arms pulled in.
- Mass-centre motion. N = tp − mx, conserved; it says the mass centre moves uniformly in a straight line with velocity p/m.
- Mass. Separately conserved in Newtonian physics.
Under a Galilean change of frame by velocity u, every velocity v becomes v − u, and neither energy nor momentum is invariant. Conservation in one frame still implies conservation in the other, provided mass is also conserved and Newton's third law holds. A classic consequence (Exercise 18.14): when a moving billiard ball elastically strikes an equal stationary one, they leave at right angles.
18.7 Relativistic energy and angular momentum
Just as t joins x to make the position 4-vector (x⁰, x¹, x², x³) = (t, x), energy and momentum unite into the energy–momentum 4-vector. Its time component is
p⁰ = E = mc²,
which fuses the separate Newtonian laws of energy conservation and mass conservation into one. Penrose keeps c explicit with metric components gab = diag(1, −c⁻², −c⁻², −c⁻²), so the spatial components of pa are c²p. He argues it is more natural (§20.2, §21.2) to treat 4-momentum as a covector pa = (E, −p). In any collision, decay or capture, the sum of 4-momenta before equals the sum after: energy, momentum and mass conservation become one law, and the components transform among themselves correctly under change of frame.
Mass m (= E/c²) is conserved additively but frame-dependent: a moving body has m = γµ, with γ = (1 − v²/c²)−1/2. Rest mass µ is frame-independent, (c²µ)² = papa = E² − c²p², but not conserved. For a massive particle pa = µva, with 4-velocity va = γ(c², v) of length c.
Massless particles (µ = 0), like the photon, have null 4-momentum. Since rest mass is not conserved, a massive particle can turn into massless ones: the neutral pion π⁰ decays into two photons in about 10⁻¹⁶ s. In the pion's rest frame each photon carries half its 134.98 MeV, about 67.5 MeV; the two photons' rest masses are zero, but the system's total mass–energy is unchanged.
Expanding the energy in powers of momentum (Exercise 18.20) shows how Newton sits inside Einstein:
E = c²µ + p²/2µ − p⁴/8c²µ³ + p⁶/16c⁴µ⁵ − …
The first term is the rest energy (E = mc²), the second is Newtonian kinetic energy, and the rest are relativistic corrections. (A sympy series expansion reproduces exactly these four terms.)
Relativistic angular momentum is an antisymmetric tensor Mab = −Mba, for a point particle Mab = xapb − xbpa, the same at every point of an inertial world line. Its six components split into M²³, M³¹, M¹² (ordinary angular momentum M, times c²) and M⁰¹, M⁰², M⁰³ (the mass-centre quantity N, times c²). So Newton's oddly neglected N is the boost partner of angular momentum.
The diagram is the chapter's punchline and a forward reference. Noether's theorem (§20.6) explains why: the 4 translational symmetries give conservation of pa, the 6 Lorentz rotations give conservation of Mab, and the same pattern governs quantum theory (§§21.1–5, §22.8).
Terms to know
| Term | Meaning |
|---|---|
| Signature (+ − − −) | Penrose's choice: ds² positive on timelike curves, ∫ds = clock time |
| Real slice | 𝔼⁴, 𝕄 as different real sections of complex ℂ𝔼⁴ fixed by a conjugation C |
| Poincaré group | 10-dimensional symmetry group of 𝕄: 4 translations + 6 Lorentz |
| Lorentz group O(1,3) | 6-dimensional symmetries fixing an origin: 3 rotations + 3 boosts |
| Orthogonal complement η⊥ | The (4 − r)-plane orthogonal to an r-plane; for an observer, τ⊥ = simultaneity |
| Reversed triangle inequality | AB + BC ≤ AC for future-timelike sides: the twin effect |
| H⁺ | Unit future hyperboloid; hyperbolic 3-space; relativistic velocity space |
| Rapidity ρ | Hyperbolic distance in H⁺; v = tanh ρ; collinear rapidities add |
| Celestial sphere | Light rays through O; a Riemann sphere on which Lorentz = Möbius |
| Rest mass µ | (papa)1/2/c²; invariant but not conserved |
| Mab | Antisymmetric angular-momentum tensor: spatial part M, boost part N |
Test yourself
- Q. Why does the twin who travels age less? Clock time is Minkowski arc length, and for future-timelike paths the triangle inequality reverses (AB + BC ≤ AC): the straight, inertial world line is the longest.
- Q. What is the geometry of relativistic velocity space? The unit hyperboloid H⁺, a model of hyperbolic 3-space; rapidity is hyperbolic distance and light speed lies at infinity.
- Q. Why does a fast-moving sphere still look circular? Lorentz transformations act on the celestial sphere as Möbius maps, which send circles to circles; light-travel-time differences exactly undo the contraction (it looks rotated).
- Q. Which quantity is conserved: rest mass or mass? Mass–energy E = p⁰ is conserved but frame-dependent; rest mass is invariant but not conserved (π⁰ → 2γ).
What the exercises ask
18.1 asks for the explicit conjugations C selecting each real slice. 18.2–18.4 ask why the Lorentz group is 6-dimensional (via 4 × 4 Lie-algebra matrices) and how the Poincaré group acts on timelike directions. 18.5 asks when a 3-plane in 𝕄 contains its own normal (when it is a null hyperplane) and introduces the self-dual and anti-self-dual 2-planes of ℂ𝔼⁴, which do not survive in 𝕄 but return in §32.2 (Ashtekar variables) and §33.11 (twistors). 18.6–18.9 verify the sphere/plane/hyperbolic sections of the cone, the straight-line and orthogonal-circle forms of geodesics in the Klein and Poincaré discs, and the velocity-addition law via a signature-flip of the tangent addition formula. 18.10–18.13 reconstruct Synge's argument, the stereographic formula and the exact compensation of FitzGerald–Lorentz flattening (an apparent rotation). 18.14–18.22 cover billiard balls at right angles, spinning skaters, mass-centre motion, the γ factor, the Taylor expansion of E above, and the invariance of Mab along an inertial world line.
Credit and history. Penrose's claim that special relativity was incomplete until Minkowski (1908) is his own judgement, shared by some historians (Stachel) and resisted by others who see Einstein's 1905 kinematics as complete. The "invisibility of the Lorentz contraction" is usually credited to Terrell (1959), with Penrose's paper of the same year (on the circle-preserving property) less widely known; earlier hints go back to Anton Lampa (1924). One textual note: the extracted text of the stereographic coordinate reads "ζ = eiφ cot θ"; the standard form is cot(θ/2).
Fly through the galaxy at 0.99c (rapidity 2.65). Aberration crowds the stars toward the direction of travel; a star field that filled the whole sky now squeezes into a cone ahead. Yet every circle of stars is still a circle, every small constellation keeps its shape, only rescaled. The Lorentz boost acts on your sky as a Möbius transformation that pushes points toward one fixed point (forward) and away from its antipode, exactly the "loxodromic/hyperbolic" Möbius maps of §8.3.
Special relativity has passed every test since 2004. Time dilation has been measured with optical clocks at walking speeds (NIST, 2010) and γ factors of tens at particle accelerators; Lorentz invariance is now constrained by the Standard-Model Extension programme to parts in 10²⁰ and beyond in some sectors (photon, neutrino and gravity data, including gamma-ray bursts seen by Fermi). The neutral-pion lifetime is measured at about 8.4 × 10⁻¹⁷ s (PrimEx-II, 2020). Hyperbolic velocity space has also become a working tool beyond physics: hyperbolic embeddings of tree-like data (Poincaré embeddings, 2017 onward) use exactly Beltrami's discs.
The Poincaré group's representations become particles labelled by mass and spin (§22.12); 4-momentum as a covector returns in §20.2 and §21.2; Noether's theorem in §20.6; the celestial Riemann sphere and the self-dual 2-planes in twistor theory (Chapter 33); the conformal structure of the null cones in the conformal diagrams of §27.12; Euclideanization critiqued in §28.9.
Penrose's move of complexifying first and slicing later is a good architecture habit: design the general model (here ℂ𝔼⁴) and obtain each concrete case (Euclidean, Lorentzian) as a constrained view of it, rather than maintaining three hand-built variants that drift apart.
The Classical Fields of Maxwell and Einstein
Between Newton and Einstein the deepest shift was the arrival of the field: a disembodied physical entity, carrying energy, living alongside particles. Penrose writes Maxwell's theory in its natural modern dress (dF = 0, dF = 4πJ), shows that the potential A is a gauge connection whose curvature is F, and then derives Einstein's field equation from nothing more than Newton's 4πGM volume-reduction law plus energy conservation. Gravity's own energy refuses to be localized: it slips in "through the cracks" between the local law ∇aTab = 0 and any global conservation law.
19.1 Evolution away from Newtonian dynamics
Between Principia (1687) and special relativity (1905) the main change in our picture of reality was the realization, through Michael Faraday (experiments around 1833) and James Clerk Maxwell (equations of 1864), that a field permeating space must coexist with Newton's particles and instantaneous forces. The classical fields are Maxwell's electromagnetic field and, after 1915, Einstein's gravitational field. Penrose notes two other strands of the period that he treats elsewhere: the mathematical reformulations of Newtonian mechanics (Lagrangian and Hamiltonian, Chapter 20), which are indispensable for quantum theory, and thermodynamics and statistical mechanics (Carnot, Clausius, Maxwell, Boltzmann, Gibbs, Einstein; Chapter 27). And Planck's 1900 hint of quanta already signalled the end of classical physics, though the quantum treatment of gravity remains "enigmatic and controversial".
Penrose stresses a two-way traffic between physics and mathematics. Maxwell's equations now look like the inevitable output of the calculus on manifolds, but historically they drove that mathematics: their form led Lorentz, Poincaré and Einstein to the transformations of special relativity, hence to Minkowski's spacetime, hence to Cartan's differential forms, and their conservation laws to the fundamental theorem of exterior calculus (generalized Stokes). He tempers this by crediting precursors (Laplace, d'Alembert, Gauss, Green, Ostrogradski, Coulomb, Ampère). His note adds that Newton himself was less dogmatically particle-based than the "Newtonian" view championed in the 18th century by R. G. Boscovich.
19.2 Maxwell's electromagnetic theory
Maxwell's equations are partial differential equations for the time evolution of the electric field E = (E₁, E₂, E₃) and magnetic field B = (B₁, B₂, B₃), given the charge density ρ and current density j. For fundamental physics Penrose ignores the ambient-medium terms (a medium is itself made of charged constituents), uses Gaussian units, Minkowski coordinates and c = 1. Following Minkowski, the six field components assemble into the antisymmetric Maxwell field tensor Fab = −Fba (a 2-form), and the sources into the charge-current vector Ja = (ρ, j).
- Forms: dF = 0 and dF = 4πJ, with F and J the Hodge duals (a 2-form and a 3-form).
- Index form: ∇[aFbc] = 0 and ∇aFab = 4πJb.
- Complex (self-dual) form: with ⁺F = ½(F − iF)** and its conjugate ⁻F, satisfying (±F) = ±i ±F, both equations combine into a single complex equation d⁺F = −2πiJ*.
- Charge conservation follows: apply d to dF = 4πJ and use d² = 0: d*J = 0, i.e. ∇aJa = 0.
The duals use the Levi-Civita tensor εabcd with ε₀₁₂₃ = 1, so Fab = ½εabcdFcd* and Jabc = εabcdJd; raising all indices flips the sign, ε0123 = −1, a Lorentzian quirk. Geometrically, dualizing a bivector into a 2-form barely changes it (same 2-plane, now a density), but index raising passes to the orthogonal complement (§18.3); since the Hodge dual involves raising, F ↦ F swaps a 2-plane for its orthogonal complement, and in components it simply interchanges E and B (with a sign). Dualizing twice gives minus** the original, again because of the Lorentzian signature.
The self-dual and anti-self-dual parts matter far beyond this chapter: in quantum theory they describe right-handed and left-handed photons (§22.7), and they are central to Ashtekar variables (§32.2) and twistor theory (§§33.6–11). Maxwell's own supreme result was that his equations have wave solutions moving at light speed with all the polarization properties of light; he proposed that light is electromagnetic, and Heinrich Hertz confirmed it in 1888, almost a quarter-century later. Everything carries over to curved spacetime by reading the components in a local Minkowskian frame and letting the index notation do the rest.
19.3 Conservation and flux laws
Integrate dJ = 0 over a compact 4-region R and apply the fundamental theorem of exterior calculus: ∮∂R J = 0 for any closed 3-surface Q = ∂R. Since *J is the flux of charge across Q, the charge flowing in equals the charge flowing out: electric charge is conserved**, in a fully spacetime-covariant form.
The second Maxwell equation integrated over a 3-region A with spacelike boundary S gives the Gauss law: the total charge χ threaded through S equals (1/4π)∮S *F, the electric flux across S, and S need not lie in a constant-time slice. The first equation dF = 0 gives the companion law ∮S F = 0 for every closed 2-surface: the total magnetic flux through any closed surface vanishes. That is the statement that there are no magnetic monopoles. Nothing in Maxwell's equations forbids adding a source to dF = 0, so the absence of monopoles is an empirical fact, not a theorem; their existence would matter for particle physics and grand unification (§28.2), but none has been found.
19.4 The Maxwell field as gauge curvature
By the Poincaré lemma, dF = 0 means locally (globally in a region of Euclidean topology) F = 2dA for a 1-form A, the electromagnetic potential; in index form Fab = ∇aAb − ∇bAa. A is fixed only up to the gauge freedom
A ↦ A + dΘ,
so no experiment can measure A at a point. Yet A is the key to how the field couples to charged matter. It defines a gauge (bundle) connection
∇a = ∂/∂xa − ieAa,
acting on a field Ψ of charge e (typically a charged particle's quantum wavefunction), viewed as a cross-section of a U(1) bundle whose fibre at each point is the set of possible Ψ values up to phase. Physics must be insensitive to the gauge transformation Ψ ↦ eiθΨ with θ a real function on spacetime (gauge invariance). The curvature of this connection is the Maxwell field F.
Hermann Weyl (1885–1955), in Penrose's opinion the most influential mathematician to work entirely in the 20th century, proposed in 1918 that length itself is path-dependent. The null cones stay fundamental, but the metric is fixed only up to conformal rescaling g ↦ λg; each choice is a "gauge" for measuring time. A connection (without the i) tells how the scale changes along a path, and its curvature is Maxwell's F. A space traveller would return to find Earth clocks both showing different times and ticking at different rates. Einstein objected: atomic spectral frequencies do not depend on an atom's history. Worse (in later quantum terms), a particle of mass m has a natural frequency mc²/h, so masses would depend on history and two protons would not be identical, violating the exact identity of like particles (§23.7).
The rescue came about a decade later (Weyl 1928–29, independently W. Gordon, Pauli and Heisenberg): keep the structure but make the "gauge" a unit complex number eiθ rather than a real scale λ. The rotation now happens in a complex plane unrelated to space or time, the phase of the quantum state. Weyl's discarded geometry of path-dependent clocks survives, twisted into a U(1) phase, as the basis of the modern account of how electromagnetism interacts with matter. The name "gauge" is a fossil of the original scale-changing idea, and it passed on to the Yang–Mills theories of the weak and strong forces. Penrose stresses that the idea strictly requires an exact, unobservable symmetry, and warns that the issue becomes "distinctly muddied" in some modern uses of "gauge" (Chapter 28, symmetry breaking).
The Aharonov–Bohm effect
The path dependence of the gauge connection shows up directly in a quantum experiment. Split an electron beam to pass on either side of a long solenoid, then recombine it on a screen. The electrons travel only through regions where F = 0, yet the fringes shift with the magnetic flux inside the solenoid. The reason: the field-free region is not simply connected, and no gauge makes A vanish throughout it. What matters is not any local value of A (unobservable) but the loop integral ∮A around the solenoid, which is unchanged by deforming the loop within the region (since dA = 0 there) and equals the enclosed flux. The effect depends on topology. Penrose's note gives the history: predicted by Ehrenberg and Siday (1949), rediscovered by Aharonov and Bohm (1959), tested by Chambers and conclusively by Tonomura et al. (1982, 1986).
19.5 The energy–momentum tensor
E = mc² makes energy a source of gravity, so we need the energy density of fields. Einstein's answer is the symmetric energy–momentum tensor Tab = Tba obeying the local conservation equation
∇aTab = 0,
with an extra index compared with ∇aJa = 0 because what is conserved is the 4-(co)vector pa, not a scalar. In a Minkowski frame, T0b is the density of 4-momentum and T1b, T2b, T3b its fluxes in the three spatial directions; T₀₀ is the energy density and T₁₁, T₂₂, T₃₃ the pressures along the axes. The electromagnetic field has its own T, whose 00 component reproduces Maxwell's energy density (E² + B²)/8π; all fields' contributions add.
In flat spacetime each of the four vectors Ta₀, …, Ta₃ is separately divergence-free, giving integral conservation of total energy and momentum exactly like charge. With gravity this fails. In curved spacetime ∇ contains Γ terms, and because of its extra index Tab is not the dual of a 3-form, so there is no coordinate-independent integral law. "We seem to have lost those most cherished conservation laws of physics."
If spacetime has a continuous symmetry, a Killing vector κ with ∇(aκb) = 0, then La = Tabκb satisfies ∇aLa = 0, and there is an integral law ∮*L = 0. Minkowski space has 10 Killing vectors: time translation gives energy, 3 space translations give momentum, 3 rotations give angular momentum, 3 boosts give mass-centre motion. But this works only when the background geometry is symmetric and passive, decoupled from the fields; it says nothing once gravity is an active player.
Since the early days, the loss of a local gravitational energy has been a source of objections to general relativity. Einstein's resolution: T includes the energy–momentum of every non-gravitational field and particle, and nothing of gravity's own. The equivalence principle makes this plausible: a free-falling observer in a windowless ship sees no gravity and expects ∇aTab = 0 with no gravitational term. Corrections appear only at the order where tidal effects enter. So T and its local law remain unaffected by curvature, and gravity's contributions "slip in through the cracks" that separate the local equation from any integral law of total energy–momentum.
19.6 Einstein's field equation
Spacetime curvature in four dimensions is complicated: the Riemann tensor Rabcd has 20 independent components, 10 of them in empty space. But the deeper reason for tensors is the equivalence principle itself. Gravity is not a force but curvature, and this works only if there are no preferred coordinates: preferred coordinates would define preferred observers relative to whom a "gravitational force" could be reintroduced. Penrose calls this general covariance essential to Einstein's spirit, and adds a stronger reading that returns in §30.11: between two different spacetimes (two different gravitational fields) there is no preferred pointwise identification. (His note concedes "no preferred coordinates" is vague; the real requirement is that special coordinates play no physical role.)
Deriving the equation
Two requirements fix the equation: (i) the source is T with ∇aTab = 0; (ii) the Newtonian limit is recovered. From §17.5, a small ball of free particles around an observer with unit tangent ta has volume acceleration D²(δV) = −4πG δM. Geometrically, that volume acceleration is measured by the Ricci tensor Rab = Racbc:
D²(δV) = Rabtatb δV,
with D the rate of change in proper time. The observer measures mass density Tabtatb, so δM = TabtatbδV. Equating for all observers (so the t's can be stripped off, using symmetry) gives Einstein's first proposal
Rab = −4πG Tab.
It fails. The contracted Bianchi identity gives ∇a(Rab − ½R gab) = 0 (with R = Raa the Ricci scalar). Combined with ∇aTab = 0, the first proposal forces the trace T = Taa to be constant throughout spacetime, "blatantly inconsistent" with ordinary physics. So in 1915 Einstein equated the two divergence-free tensors:
Rab − ½R gab = −8πG Tab (Penrose's sign conventions).
The coefficient doubles from 4πG to 8πG because the trace term must be accounted for. In vacuum (Tab = 0, including no electromagnetic field) this reduces to the Ricci-flat condition
Rab = 0.
19.7 The cosmological constant and the Weyl tensor
In 1917 Einstein added the cosmological constant Λ, consistent with conservation because Λ is constant and ∇g = 0:
Rab − ½R gab + Λgab = −8πG Tab.
He wanted a static, spatially closed universe (topology S³ × 𝔼¹). After Hubble's 1929 discovery of expansion he dropped it, reportedly calling it his "greatest mistake" (perhaps because he could otherwise have predicted the expansion). Λ is tiny, at most about 10⁻⁵⁵ cm⁻², irrelevant below cosmological scales, but distant-supernova data led most theorists to reintroduce it, or a "dark energy" like it. Penrose, like most relativists, had been reluctant to believe Nature uses Λ, but concedes the evidence points that way (§28.10).
Active gravitational mass
Rewriting the equation the other way round and taking the 00 component in an observer's frame, the inward volume acceleration is 4πG(ρ + P₁ + P₂ + P₃) − Λ. So the density of active gravitational mass is
ρG = ρ + P₁ + P₂ + P₃ − Λ/4πG,
not simply ρ. Pressure gravitates. Normally the pressure terms are tiny (constituents move slowly compared with light), but near collapse they matter: in a very massive star, extra pressure meant to hold the star up adds active mass and hastens collapse.
Maxwell versus Einstein, term by term
| Electromagnetism | Gravitation | Role |
|---|---|---|
| Ja (charge-current) | Tab (energy–momentum) | Source |
| ∇aJa = 0 | ∇aTab = 0 | Local conservation |
| Aa (potential) | gab (metric) | Potential |
| Fab (field) | Cabcd (Weyl tensor) | Free field degrees of freedom |
| Gauss law ∮*F = 4πχ | Bondi–Sachs mass at null infinity | Charge / mass at infinity |
| Local energy (E² + B²)/8π | No local energy density | Field energy |
The natural analogue of F is not the full Riemann tensor but the Weyl (conformal) tensor Cabcd: the Riemann tensor with its Ricci part removed, all its traces vanishing. Since Ricci is tied to the source by Einstein's equation, Weyl is what remains for the gravitational field's own degrees of freedom: tides from distant masses, gravitational waves. In vacuum (with Λ = 0) Weyl equals Riemann; C = 0 is the condition for conformal flatness. Weyl curvature will carry the weight of Penrose's argument about the special initial state of the universe (§28.8).
19.8 Gravitational field energy
Gravitational energy is real even though T has no room for it. Two planets momentarily at rest: close together, the system has more negative potential energy, so less total mass, than far apart, though the integrated T is virtually identical. Set them orbiting and Einstein's equation predicts gravitational waves carrying positive energy away through empty space where T = 0. Gravitational energy is genuinely non-local.
The Hulse–Taylor binary PSR 1913+16 (Nobel Prize for Joseph Taylor and Russell Hulse, 1993) contains a pulsar beeping about 17 times a second. A neutron star is so dense that a tennis ball of its matter would weigh about as much as Mars's moon Deimos. Tracked for some 25 years, its orbit decays in exact accord with gravitational-wave emission, a consistency Penrose quotes as one part in 10¹⁴ in overall timing (his note warns this includes Newton's theory and measures overall consistency, not an improvement over Newton).
1915 Mercury's anomalous perihelion advance, 43″ per century (one extra turn in about 3 million years), explained. 1919 Eddington's eclipse expedition to Príncipe sees starlight bending. 1925 W. S. Adams's tentative gravitational redshift in Sirius B. 1960 Pound–Rebka measure redshift in Earth's field (a weak test, Penrose notes, since it follows from energy and quantum considerations). 1964 Shapiro proposes radar time delay; 1968–71 confirmed, to 0.1% with Viking transponders (Reasenberg and Shapiro). 1969 quasar radio observations open precision tests. 1991 VLBI confirms light bending to 10⁻⁴ (Robinson et al.). 1974–2000s Hulse–Taylor orbital decay.
For isolated (asymptotically flat) systems there is a complete account. Hermann Bondi and collaborators (assuming axial symmetry, 1960–62), generalized by Rayner Sachs, and anticipated in part by Andrzej Trautman (1958), defined the mass and the mass carried off by gravitational waves at null infinity (§27.12): the Bondi–Sachs mass-loss law. It is non-local and exact only in the limit of complete isolation, yet "something a little miraculous" fits together, including the later positive-mass theorems (Schoen and Yau 1979–82, Witten 1981 and others) proving the total mass, gravitational binding included, cannot be negative.
Worked example: how much power does the Solar System radiate?
For two bodies in circular orbit the quadrupole formula gives P = (32/5)(G⁴/c⁵)(m₁m₂)²(m₁ + m₂)/r⁵.
G, c = 6.674e-11, 2.998e8
P = lambda m1, m2, r: 32/5*G**4/c**5*(m1*m2)**2*(m1+m2)/r**5
print("Jupiter-Sun %.0f W" % P(1.989e30, 1.898e27, 7.785e11))
print("Earth-Sun %.0f W" % P(1.989e30, 5.972e24, 1.496e11))
Output: Jupiter–Sun 5202 W, Earth–Sun 196 W. A few kilowatts from the largest planet: utterly negligible against the Sun's 3.8 × 10²⁶ W of light, which is why the effect had to be sought in compact, fast binaries.
Numbers and conventions to check. (1) Penrose puts the Jupiter–Sun gravitational-wave output at "about a 40-watt light bulb"; the standard quadrupole estimate above gives about 5 kW, more than a hundred times larger (still negligible). (2) The extracted text drops the ½ in several formulas; the correct forms are Rab − ½Rgab and F = ½ε F*. (3) His minus sign in −8πG comes from his curvature and signature conventions; most textbooks write Gab + Λgab = 8πG Tab. (4) The "greatest blunder" quotation rests on George Gamow's** recollection and is doubted by historians. (5) The Eddington 1919 data were marginal by modern standards.
Heat a brick. Its energy rises, so by E = mc² its mass rises (by about 10⁻¹⁴ of its mass per 100 K). Now squeeze a gas so its pressure rises at fixed energy density: Einstein says its active gravitational mass rises too, because ρG = ρ + 3P. For a brick the effect is invisible; for the core of a collapsing massive star, or for the radiation era of the early universe (P = ρ/3, so ρG = 2ρ), it changes the outcome. And for dark energy, P = −ρ gives ρG = −2ρ: negative active mass, which is why Λ accelerates the expansion.
Terms to know
| Term | Meaning |
|---|---|
| Fab | Maxwell field tensor (2-form) built from E and B |
| **Hodge dual *** | Uses εabcd; takes a 2-plane to its orthogonal complement; swaps E and B |
| Self-dual ⁺F | ½(F − i*F); right-handed photons; key to twistors and Ashtekar variables |
| Potential A | F = 2dA; gauge freedom A ↦ A + dΘ; a U(1) connection |
| Gauge invariance | Physics unchanged by Ψ ↦ eiθΨ |
| Aharonov–Bohm effect | Fringe shift from ∮A in a field-free, non-simply-connected region |
| Tab | Energy–momentum tensor: densities and fluxes of energy and momentum |
| Killing vector | ∇(aκb) = 0; a spacetime symmetry; yields a conserved current Tabκb |
| Ricci tensor Rab | Trace of Riemann; measures volume-reducing (focusing) curvature |
| Weyl tensor Cabcd | Trace-free part of Riemann; free gravitational field; tidal distortion |
| Active mass density | ρG = ρ + P₁ + P₂ + P₃ − Λ/4πG |
| Bondi–Sachs mass | Mass of an isolated system at null infinity; decreases by radiation |
Test yourself
- Q. Why does charge conservation follow from Maxwell's equations? Apply d to dF = 4πJ and use d² = 0: d*J = 0.
- Q. What saved Weyl's gauge idea after Einstein's objection? Replacing the real scale factor λ by a unit complex phase eiθ acting on the quantum state, giving a U(1) connection.
- Q. Why did Einstein abandon Rab = −4πG Tab? With the contracted Bianchi identity it would force the trace of T to be constant everywhere.
- Q. Where is gravitational energy? Not in Tab: it is non-local, accounted for exactly only at null infinity (Bondi–Sachs mass) for isolated systems.
What the exercises ask
19.1–19.4 check the duality normalizations, write Maxwell's equations out in E and B to show they evolve the fields in time, and prove the equivalence of the form and index versions and of the two divergence statements. 19.5–19.8 show that dualizing twice gives minus the original (and tie the sign to Lorentzian signature), extend the equations to curvilinear coordinates, work charge conservation on a spacetime cylinder (contrasting flux through spacelike top and bottom with timelike sides), and identify the Gauss integral with electric flux. 19.9–19.11 justify gauge freedom, show F is the curvature of ∇ (via §15.8), and explain the deformation invariance of ∮A. 19.12–19.14 relate Tab to Tab, derive the Maxwell T and its energy density (E² + B²)/8π, and find a particle analogue of the Killing conservation law (paκa constant between collisions). 19.15–19.23 prove Rab symmetric, the volume-acceleration formula via the Ricci identity, the stripping of t's, the contracted Bianchi identity, the constancy of T under the first proposal, the 8πG coefficient, the Ricci-flat vacuum form, the reversed form of the equation, and that all traces of C vanish.
Gravitational energy has now been detected directly. On 14 September 2015 LIGO recorded GW150914, two black holes of about 36 and 29 solar masses merging about 1.3 billion light-years away, radiating roughly 3 solar masses of energy as gravitational waves in a fraction of a second (Nobel Prize 2017, Weiss, Barish, Thorne). Penrose's 2004 hope of detection at 15 Mpc was overtaken by events: detections now come from hundreds of megaparsecs to gigaparsecs. The LIGO–Virgo–KAGRA O4 run (May 2023 to November 2025) (ended 18 November 2025, the richest run so far) added hundreds of new candidates, including GW250114, loud enough to test Hawking's area theorem. The Event Horizon Telescope imaged the shadows of M87 (2019) and Sgr A (2022). In 2025 the DESI collaboration's baryon-acoustic data hinted (at roughly 3 to 4σ, depending on the supernova sample) that dark energy may weaken over time, which would make Λ an approximation rather than a constant; the question is open. Magnetic monopoles remain undetected, though MoEDAL** at the LHC has set leading collider limits and analogue "monopoles" have been made in spin ice and Bose–Einstein condensates.
Lagrangians and Noether's theorem (Chapter 20) supply general conservation laws; the U(1) gauge connection becomes the template for Yang–Mills (§§25.3–8); self-dual fields reappear in §32.2 and Chapter 33; the Weyl tensor drives the Weyl curvature hypothesis (§28.8); null infinity and Bondi mass in §27.12; Λ in §28.10; general covariance and the lack of pointwise identification in Penrose's gravitational state reduction (§30.11).
The energy–momentum story is a warning for any architecture that assumes a single global ledger. When the "background" itself is dynamic, conservation holds locally and at well-defined boundaries (Bondi–Sachs at infinity), not as a sum over an arbitrary interior. In distributed systems the analogue is reconciling at clearly defined edges (settlement boundaries, event logs) rather than pretending a global instantaneous balance exists.
Lagrangians and Hamiltonians
The great reformulations of Newton by Euler, Lagrange, Hamilton, Jacobi and others compress an entire mechanical system into one function: the Lagrangian on the tangent bundle of configuration space, or the Hamiltonian on the cotangent bundle (phase space). Phase space carries a natural symplectic form S = dpa ∧ dqa, dynamics is the flow generated by H, phase volume is conserved (Liouville), small vibrations split into normal modes, and every continuous symmetry yields a conservation law (Noether). Penrose admires the machinery and distrusts it: Lagrangians are so general and so non-unique that they give little guidance toward the right fundamental theory.
20.1 The magical Lagrangian formalism
After Newton, Euler, Laplace, Lagrange, Legendre, Gauss, Liouville, Ostrogradski, Poisson, Jacobi and Hamilton built a unifying overview whose very existence, Penrose says, tells us something deep: "not many suggested laws for a physical universe could lead to mathematical structures of such imposing splendour." It comes in two forms. (Names mislead as usual: both pictures were known to Lagrange well before Hamilton, and the Lagrangian one was partly anticipated by Euler.)
Take a Newtonian system of particles and rigid bodies. Its configuration space C has some large dimension N; each point is a complete spatial arrangement, and the system's history is a curve traced by one point Q in C. The law of motion comes from a single function:
- Lagrangian picture. L is a function on the tangent bundle T(C) (a point plus a velocity).
- Hamiltonian picture. H is a function on the cotangent bundle T*(C), the phase space (a point plus a covector).
Both bundles are 2N-dimensional. Coordinates are generalized coordinates q¹, …, qN (positions, angles, anything adequate, perhaps only patchwise) and generalized velocities q̇r = dqr/dt. The beauty is that any coordinates will do; the choice is governed only by convenience. L(q¹, …, qN, q̇¹, …, q̇N) treats each q̇r as an independent variable, initially baffling, "but it works". Usually L = K − V, kinetic minus potential energy. The equations of motion are the Euler–Lagrange equations:
d/dt (∂L/∂q̇r) = ∂L/∂qr, r = 1, …, N.
These equations express Hamilton's principle (stationary action): the motion of Q from a to b makes the action ∫L dt stationary under variations of the path with ends fixed. "Stationary" rather than "minimum", as in ordinary calculus where df/dx = 0 can mark a minimum, a maximum, an inflexion or (in more dimensions) a saddle. The trajectory is a kind of geodesic in C, echoing the minimum-length (Riemannian) and maximum-proper-time (Lorentzian) characterizations of §14.7 and §17.9.
Example. A particle of mass m in Earth's surface gravity: L = ½m(ẋ² + ẏ² + ż²) − mgz. The z equation gives d(mż)/dt = −mg: Galileo's constant downward acceleration, and parabolic flight.
Penrose's notes add two technicalities. He assumes holonomic systems; a hoop rolling without slipping is non-holonomic (two coordinates locate the contact point but only one velocity is available), though allowing a little slipping restores holonomy, and fundamental systems are presumably holonomic. Time-dependent forces can be included by adjoining q⁰ = t as an extra coordinate.
20.2 The more symmetrical Hamiltonian picture
Hamilton's form swaps velocities for generalized momenta
pr = ∂L/∂q̇r,
which for a free particle is mass times velocity but in general need not be. The p's coordinatize the cotangent spaces, so padqa is a natural 1-form on phase space, and its exterior derivative
S = dpa ∧ dqa (with dS = 0)
is the symplectic 2-form. This structure belongs to phase space itself, independent of which Hamiltonian governs the dynamics, and much of the Hamiltonian picture's strength flows from it. The Hamiltonian (for time-independent systems, the total energy) is obtained by
H = paq̇a − L,
rewritten by eliminating every velocity in favour of momenta ("not an easy task, in general!"). The evolution equations are beautifully symmetrical:
dqr/dt = ∂H/∂pr, dpr/dt = −∂H/∂qr.
They define a vector field on T(C), written {H, }, whose flow is the Newtonian behaviour of the system. For the falling particle, H = (px² + py² + pz²)/2m + mgz*.
Penrose "comes clean" about a notational clash. With his (+ − − −) signature the covariant spatial momenta p₁, p₂, p₃ are minus the ordinary momentum components (§18.7), so when written with xa and pa his Hamilton equations appear with the opposite sign. His advice: readers not concerned with full detail should ignore the issue, "as most experts would do, until the moment comes when they have to write articles or books on the topic".
20.3 Small oscillations and normal modes
Vibrations about equilibrium matter everywhere and, through the quantum harmonic oscillator, become central to quantum field theory (§22.13). The prototype is the pendulum: for small swings the bob executes simple harmonic motion, a sine wave, with period independent of amplitude, observed by Galileo in 1583. With displacement q,
d²q/dt² = −ω²q, general solution q = a cos ωt + b sin ωt, frequency ω/2π,
and for a pendulum of length h, ω² = g/h (for larger q the equation picks up corrections).
Now take a general Hamiltonian system in stable equilibrium at qa = 0. Stability means a local minimum of potential energy; adding motion only raises kinetic energy, so H has a minimum at q = 0 = p, and its power series has no linear terms:
H = ½Qabqaqb + ½Pabpapb + (higher order),
with Q and P positive-definite symmetric matrices. Dropping higher orders, Hamilton's equations give d²q/dt² = −Wq, where W = PQ. Each eigenvector Wq = ω²q has ω² > 0 (because P and Q are positive-definite) and oscillates in simple harmonic motion at frequency ω/2π.
- Normal modes. Every small vibration of an N-degree-of-freedom system about stable equilibrium is a superposition of N independent normal modes, each a collective simple-harmonic motion of all coordinates at one normal frequency.
- Degeneracy. Frequencies may coincide; counting multiplicity there are still N modes.
- Orthogonality. Modes of different frequency are orthogonal in the "metric" Q: rTQq = 0.
- Dissipation is ignored; in a molecule, where every constituent is included, there is none.
- Unstable equilibrium. If Q is not positive-definite, W can have negative eigenvalues, and disturbances grow exponentially.
The theory extends to N = ∞. A string fixed at its ends (or bent into a circle) has infinitely many modes, the Fourier sine waves of Chapter 9, with frequencies all integer multiples of the fundamental, which is what instrument makers strive for. Drums and bells have normal frequencies not so simply related, hence their timbre. Infinite-dimensional mechanics leads to field theory (§20.5), and to string theory, in which particles are the normal modes of vibrating loops (§§31.5–14).
Try it in Python: two coupled masses, and Liouville's theorem
import numpy as np
Q = np.array([[2, -1], [-1, 2]]); P = np.eye(2) # k = m = 1
w2, modes = np.linalg.eig(P @ Q)
print(np.round(w2, 3)); print(np.round(modes, 3))
def flow(q, p, T=5.0, n=5000): # pendulum, leapfrog
dt = T/n
for _ in range(n):
p -= 0.5*dt*np.sin(q); q += dt*p; p -= 0.5*dt*np.sin(q)
return q, p
eps, q0, p0 = 1e-6, 1.0, 0.3
a = np.subtract(flow(q0+eps, p0), flow(q0, p0))
b = np.subtract(flow(q0, p0+eps), flow(q0, p0))
print("area ratio %.6f" % ((a[0]*b[1] - a[1]*b[0])/eps**2))
Output: ω² = 3 and 1, with modes (0.707, −0.707) (masses moving oppositely, the faster mode, ω = √3) and (0.707, 0.707) (moving together, ω = 1). The pendulum flow carries a tiny phase-space square to a sheared parallelogram of area ratio 1.000000: Liouville's theorem, which the symplectic leapfrog integrator respects exactly.
20.4 Hamiltonian dynamics as symplectic geometry
Every symplectic manifold has a Poisson bracket {Φ, Ψ} turning two scalar fields into a third; in canonical coordinates
{Φ, Ψ} = ∂Φ/∂pr · ∂Ψ/∂qr − ∂Φ/∂qr · ∂Ψ/∂pr
(in Penrose's ordering, matching §14.8). Leave one slot empty and {Φ, } is a vector field. Put Φ = H and {H, } is exactly the time evolution. The whole dynamics of a system is geometrically encoded in one scalar function on a symplectic manifold.
Liouville's theorem. The phase-space volume element is Σ = S ∧ S ∧ … ∧ S (N factors). The Lie derivative of S along {H, } vanishes, so S, and hence Σ, is preserved by the evolution: phase-space volume is conserved, though the shape of a region of initial states may become grossly distorted (a fact that returns in the Second Law discussion of Chapter 27). Since {H, H} = 0, H is constant along trajectories (energy conservation), so each trajectory lies on a (2N − 1)-dimensional energy surface. The space of trajectories at fixed energy is (2N − 2)-dimensional, and remarkably it is again symplectic: symplectic reduction, with many elegant applications.
"Nature has had a habit, in the past, of first tempting us to a euphoric complacency by the power and elegance of the mathematical structures that she appears to force us to accept as guiding her world, but then jolting us, from time to time, out of our conceptual torpor." The Hamiltonian picture is his example: contradicted by quantum facts, yet the lead into quantum mechanics, its Hamiltonians the core of the non-relativistic formalism. For relativistic quantum theory the Lagrangian is the usual "leaping-off point", into "the deep quagmire of quantum field theory".
20.5 Lagrangian treatment of fields
A field cannot be specified by finitely many numbers, so the configuration space (say of free Maxwell fields in a region) is infinite-dimensional. The formalism survives with one novelty, the functional derivative (written δ). L becomes a function of fields Φ, …, Ψ (possibly carrying tensor or spinor indices) and their derivatives ∇aΦ, … (usually first derivatives). Time loses its special status (no "dots"), bringing the formalism into line with relativity. The field Euler–Lagrange equations read
∂L/∂Φ − ∇a(∂L/∂(∇aΦ)) = 0, and similarly for each field.
Rigorous justification can be subtle; physicists customarily follow the formal rules with "mathematical common sense".
The end-points a, b of Hamilton's principle become field configurations on two 3-surfaces A and B spanning the same 2-surface S (perhaps at infinity), forming a "blister" around a 4-region D; joined with opposite orientations they form ∂D. L is a density: the invariant object is the 4-form Lε, with ε = √(−det g) dx⁰ ∧ dx¹ ∧ dx² ∧ dx³ (fixed up to sign by εabcdεabcd = −24). The action
𝒮 = ∫D L ε
must be stationary, δ𝒮 = 0, under variations of every field with boundary data fixed. This same 𝒮 is the heart of the path-integral approach to quantum field theory (§26.6).
20.6 How Lagrangians drive modern theory
Noether's theorem. If a Lagrangian has a continuous symmetry, there is a conservation law. Time-independence gives energy; invariance under spatial translation gives momentum; under rotation about an axis, angular momentum about that axis. In coordinates where L does not depend on some qr, the conserved quantity is simply the conjugate momentum pr = ∂L/∂q̇r, constant by the Euler–Lagrange equation. For fields, a gauge invariance Ψ ↦ eiθΨ gives a conserved charge (electric charge).
Gravity is where Noether falters. The apparent analogue of gauge symmetry is invariance under general coordinate transformations, but there Noether's theorem yields only something like "0 = 0". Energy–momentum conservation in general relativity needs different insights (§19.8), and Penrose notes that angular momentum in general relativity still carries a "significant question mark" even for asymptotically flat spacetimes (his own 1982 quasi-local work and others').
Hilbert's action and Mie's forgotten theory
David Hilbert (1915) first derived Einstein's equations from an action: the scalar curvature R divided by −16πG, made into a density with ε and added to the matter Lagrangian,
𝒮 = ∫ (L − R/16πG) ε.
Hilbert stated it only for the matter Lagrangian of Gustav Mie's theory of matter, then fashionable, and apparently believed he had a theory of everything. "That was in 1915. Who remembers Mie's theory today?" The standard Maxwell Lagrangian, proportional to FabFab, was known long before, but works only when written in terms of the potential Aa, and with charged fields needs interaction terms and a check of gauge invariance; with gravity, coordinate invariance is the "gauge invariance" to respect.
Why everyone uses Lagrangians
- Better odds (not certainty) of consistency and invariance.
- A built-in Newton's third law: interactions are mutual.
- Modularity: a new field adds its terms plus interaction terms.
- A direct route to quantization via path integrals (§26.6).
Why Penrose is uneasy
- Too general: little guidance toward the correct theory.
- Non-unique, often contrived, sometimes of "undisguised complication".
- Remote from physical meaning: FabFab = 2(B² − E²) has no obvious significance, and works only via the unobservable A.
- Einstein's free Lagrangian R vanishes on solutions (vacuum gives R = 0) and works only through non-invariant metric components.
His verdict: Lagrangians for fields are "undoubtedly extremely useful as mathematical devices", letting us write down endless candidate theories, but he remains uneasy about relying on them in the search for better fundamental theories, an unease that resurfaces with path integrals in §26.6.
Terms to know
| Term | Meaning |
|---|---|
| Configuration space C | N-manifold of all spatial arrangements |
| Lagrangian L = K − V | Function on T(C); its action ∫L dt is stationary on motions |
| Generalized momentum | pr = ∂L/∂q̇r |
| Hamiltonian H | paq̇a − L in terms of q, p; total energy; lives on T*(C) |
| Symplectic form S | dpa ∧ dqa; closed, independent of H |
| Poisson bracket | {Φ, Ψ}; {H, } generates time evolution |
| Liouville's theorem | Hamiltonian flow preserves phase-space volume Σ = S∧N |
| Symplectic reduction | Trajectories at fixed energy form a (2N − 2)-dim symplectic space |
| Normal mode | Collective simple-harmonic vibration; eigenvector of W = PQ |
| Functional derivative | δ/δΦ, calculus on infinite-dimensional field spaces |
| Noether's theorem | Continuous symmetry ⇒ conserved quantity |
| Hilbert action | ∫(L − R/16πG)ε, giving Einstein's equations |
Test yourself
- Q. On which spaces do L and H live? L on the tangent bundle T(C), H on the cotangent bundle T*(C) (phase space); both are 2N-dimensional.
- Q. What does Liouville's theorem say, and why is it true? Hamiltonian flow preserves phase-space volume, because it preserves the symplectic form S, and volume is S∧…∧S.
- Q. When is an equilibrium unstable in the normal-mode analysis? When Q is not positive-definite, so W = PQ has negative eigenvalues and disturbances grow exponentially.
- Q. Why does Noether's theorem fail for general covariance? A local (gauge-like) symmetry gives an identity (the Bianchi identity), "0 = 0", not a new conserved charge.
What the exercises ask
20.1–20.4 complete Galileo's parabola from the Lagrangian, check that dS = 0, explain the vector-field form of Hamilton's equations and redo free fall in Hamiltonian form. 20.5–20.13 confirm simple harmonic motion, derive the full pendulum equation three ways (Lagrange, Hamilton, Newton; the potential is mg(h − (h² − q²)1/2)) to see that the formalism gains nothing in simple cases, explain why linear terms vanish at stable equilibrium, prove ω² > 0 via the positivity of inverses of positive-definite matrices, redo the analysis in Lagrangian form, describe degenerate eigenvectors, prove Q-orthogonality of modes, and describe exponential divergence from unstable equilibrium. 20.14–20.16 match the Poisson bracket with §14.8, prove the Lie derivative of S vanishes, and show {H, H} = 0. 20.17–20.19 prove the Noether shortcut, show FabFab = 2(B² − E²), and check the normalization of ε.
Strike a bell. Its millions of metal atoms form a system with N ≈ 10²⁵ degrees of freedom, yet what you hear is a handful of normal modes, the "hum", "prime" and "tierce" that bell founders tune. In phase space, the strike puts the system on one energy surface, and the flow winds round a high-dimensional torus, one circle per mode. Slowly, couplings ignored by the quadratic approximation (and air) leak energy into random atomic motion: the pure tone becomes heat, and the phase-space blob of Fig. 20.7 frays into fingers too fine to see. That fraying is where Chapter 27's entropy will come from.
Historical and conceptual caveats. The Galileo 1583 pendulum story (timing a cathedral lamp by his pulse) comes from his disciple Viviani and is probably embellished. The Hilbert–Einstein priority question is subtler than "Hilbert first": Hilbert's November 1915 paper's printed version was revised after Einstein's; historians (Corry, Renn, Stachel, 1997) argue that the published equations followed Einstein's. And Emmy Noether, whose 1918 theorems this chapter uses, deserves explicit credit: her second theorem is exactly what explains the "0 = 0" Penrose finds for general covariance (local symmetries give identities, the Bianchi identities, rather than new conserved charges).
Symplectic structure now runs the world's simulations and AI. Symplectic integrators (leapfrog, as above) are standard in molecular dynamics, celestial mechanics and the Hamiltonian Monte Carlo samplers used in Bayesian statistics (Stan). Since 2019, Hamiltonian and Lagrangian neural networks (Greydanus et al.; Cranmer et al.) learn H or L from data and inherit energy conservation, an instance of Noether-style inductive bias in machine learning. On the mathematical side, symplectic topology made headlines when Greene and Lobb (2020) used it to settle the rectangular peg problem for smooth closed curves.
Hamiltonians become quantum operators (§21.1–2), Poisson brackets become commutators, the harmonic oscillator becomes the ladder of §22.13 and the particle content of quantum field theory (§26.3); the action 𝒮 drives Feynman's path integral (§26.6); Liouville's theorem and phase-space volume underpin entropy (§27.3); normal modes of strings in §31.5.
The Lagrangian lesson for architects: a single, composable objective with built-in invariants (here, symmetries giving conservation laws) is powerful precisely because modules can be added term by term. Penrose's caution applies too: when a framework can express anything, it stops telling you what is right. Constrain the design space with the invariants you actually need.
The Quantum Particle
Quantum mechanics keeps the whole Hamiltonian machinery of Chapter 20 but makes one "crazy-looking" substitution: momentum becomes the differential operator iħ∂/∂xa and energy becomes iħ∂/∂t. From this follow the canonical commutation rules, the Schrödinger equation, plane-wave momentum states, delta-function position states, Fourier duality between them and the Heisenberg uncertainty relation. Penrose's own stance is set here: the wavefunction is not a mere "probability wave" but the best candidate for quantum reality, holistic and non-local, and its sudden "quantum jumps" on measurement are the deepest puzzle in physics.
21.1 Non-commuting variables
Most physicists rank quantum mechanics as more revolutionary than curved spacetime; its picture of reality is so far from classical that many abandon quantum-level "pictures" and rely on the formalism alone. Yet the Lagrangian–Hamiltonian machinery of Chapter 20 provides "the essential background", as if Newton's formalism "was already waiting for quantum mechanics to come, with parts of its machinery of just the right shape and size".
The bridge is an observation by Oliver Heaviside (1850–1925): differential operators can often be treated like numbers. Write D = d/dx. The equation y + d²y/dx² = x⁵ becomes (1 + D²)y = x⁵, so formally
y = (1 + D²)⁻¹x⁵ = (1 − D² + D⁴ − D⁶ + …)x⁵ = x⁵ − 20x³ + 120x,
which is a correct particular solution (the series terminates since D⁶x⁵ = 0). Heaviside met fierce opposition, but with care the method can be made rigorous. Exercises 21.2–21.3 ask why it misses the general solution (adding a cos x + b sin x): the series is not a true two-sided inverse of 1 + D², because (1 − D² + D⁴ − …)(1 + D²) cos x = 0 while cos x ≠ 0.
The catch is ordering. Acting on an "invisible" function ψ on the right, x multiplies and D differentiates, so by Leibniz's rule D(xψ) − xD(ψ) = ψ:
Dx − xD = 1.
In N variables with Da = ∂/∂xa: Daxb − xbDa = δab, the D's generating infinitesimal translations of flat 𝔼N.
Noether ties a translation symmetry to a conserved momentum, an elegant and comprehensible fact. Quantum mechanics goes further, in a way that "seems to be mathematically completely crazy": it identifies the momentum with the very differential operator that generates the translation.
21.2 Quantum Hamiltonians
With Dirac's ħ = h/2π and a factor i, the quantum momentum is
pa = iħ ∂/∂xa,
giving the canonical commutation rule paxb − xbpa = iħδab (with Penrose's (+ − − −) convention, p1,2,3 are minus the ordinary momenta, so the familiar form is px = −iħ∂/∂x). Canonical quantization slots this operator into the classical Hamiltonian H(p; x) exactly where the classical momentum stood. For a particle in a potential V(x, y, z):
H = −(ħ²/2m)∇² + V, with ∇² = ∂²/∂x² + ∂²/∂y² + ∂²/∂z² (the Laplacian).
Factor-ordering problem
A classical term like px could become px, xp, ½(px + xp) or infinitely many other operators, because p and x do not commute. Often symmetry, invariance or aesthetics picks an "obvious" choice, or the options turn out equivalent. But quantizing a classical theory can involve real choices.
Coordinate problem
Classically any generalized coordinates qa are allowed. Quantum mechanically, quantizing every conjugate momentum as −iħ∂/∂qa is not coordinate-free. This leads into geometric quantization and bites hard in quantum gravity and quantum fields on curved backgrounds (§30.4). Angular coordinates (with angular momenta) are safe with care (§22.8).
The procedure as it stands is non-relativistic: with many particles, space and time are treated very differently, even though for a single particle there is an evident symmetry between x⁰ and x¹, x², x³ that the next section exploits.
21.3 Schrödinger's equation
The invisible function on the right now steps forward as the wavefunction ψ(x¹, …, xN; t), the quantum state of the system. It depends on positions and time but not on momenta, which are now operations, not variables. Relativity suggests extending pa = iħ∂/∂xa to a = 0, so energy becomes iħ∂/∂t. Since H is the total energy, the Schrödinger equation is exactly the statement of that role:
iħ ∂ψ/∂t = Hψ, e.g. iħ ∂ψ/∂t = −(ħ²/2m)∇²ψ + Vψ.
Penrose anticipates the sceptic: what has this "mathematical mumbo-jumbo" to do with "the momentum imparted by a boxer's fist or by a golfer's swing"? According to quantum mechanics, everything. Momentum's essence is conservation: a blow is the inevitable transfer of something that cannot disappear. And classical mechanics already conserves momentum, so the case for the operator identification must come from experiment, which reveals a universal link between frequency and energy and between wave number and momentum.
Put a particle in uniform gravity, V = mgz, and change to the freely falling frame Z = z + ½gt². The Schrödinger equation transforms into the free equation, with the wavefunction picking up a position- and time-dependent phase factor. So Einstein's equivalence principle holds for quantum systems, but only up to a phase, a subtle point Penrose exploits in §30.11 for his gravitational collapse proposal.
21.4 Quantum theory's experimental background
1887 Hertz observes the photoelectric effect. 1900 Max Planck fits the black-body spectrum by assuming emission and absorption in packets E = hν, with "crazy" statistics foreshadowing Bose–Einstein. 1902 Philipp Lenard shows electron energies independent of light intensity. 1905 Einstein explains it with light particles (photons), the work that earned the 1921 Nobel Prize, not relativity. To 1916 Robert Millikan, initially sceptical, confirms Einstein's predictions. 1923 Arthur Compton: photons scatter off electrons as massless relativistic particles. 1923 Louis de Broglie proposes matter waves λ = h/p. 1927 Davisson and Germer diffract electrons off a crystal.
Davisson–Germer. Electrons of suitable 3-momentum fired at a crystal deflect only through special angles set by the lattice spacing and the momenta: a particle of momentum p behaves as a wave of de Broglie wavelength
λ = h/p = 2πħ/p,
and, as relativity demands, a frequency ν with E = hν = 2πħν. In its rest frame a particle of rest mass µ therefore has an intrinsic frequency µc²/h (Exercise 21.8 asks how relativity lets Planck's relation be deduced from de Broglie's).
Black-body radiation. For radiation in equilibrium with a "black" cavity at temperature T (black meaning perfectly absorbing; the walls may glow), Planck's intensity is
I = 2hν³ / (ehν/kT − 1) (c = 1, k Boltzmann's constant).
The classical-wave Rayleigh–Jeans law I = 2kTν² fits at low ν but diverges at high ν; Wien's law I = 2hν³e−hν/kT, justified by treating radiation as classical particles, fits at high ν only. Planck's new constant is h ≈ 6.62 × 10⁻³⁴ J s. Waves had become particles, just as Davisson–Germer would show particles becoming waves; in both directions the period is set by 2πħ: ν⁻¹ = 2πħ/E, λ = 2πħ/p.
The two-slit experiment. Particles emitted one at a time land as individual dots. With one slit open the dots pile up in a smooth band; with the other open, likewise. With both open, interference fringes appear, including regions that are never reached, though particles reached them happily with either single slit. Between source and screen the particle "feels out both slits" like a wave, and the fringe spacing gives exactly λ = 2πħ/p.
21.5 Understanding wave–particle duality
"We should not turn down a miracle when it is presented to us!" The miracle: these mutually absurd facts fit a single beautiful formalism. The plane wave
ψ = e−iPaxa/ħ
is periodic with time period 2πħ/P₀ and spatial period 2πħ/P₁ (and similarly), exactly as experiment demands, and it is an eigenfunction of the momentum operator: paψ = Paψ. On this state the mysterious operator acts as the plain classical number Pa, the eigenvalue. Such a ψ is a momentum state, a state with a definite momentum, and only eigenfunctions have definite values.
The language generalizes. Operators like momentum, position and angular momentum are dynamical variables (observables); ψ, sitting in the vector space W of possible wavefunctions (infinite-dimensional: plane waves for different P are linearly independent, with "linear dependence" allowing integrals), is the state or state vector. Eigenstates of a dynamical variable are the states in which it has a definite value, the eigenvalue. The plane wave written with Pa = (E, −P) and xa = (t, x) is at once a momentum eigenstate with 3-momentum P and a solution of Schrödinger's equation with energy E; but since Schrödinger's scheme treats time apart, Penrose now reverts to non-relativistic descriptions.
21.6 What is quantum "reality"?
Many physicists take a "positivist" line, refusing to ask what is real and demanding only correct answers to experimental questions. Penrose rejects this. If quantum theory applies to everything, then denying quantum reality denies reality at every level, and "our objective universe, and thence the whole of science, simply evaporates before our contemplative gaze". If anything in the formalism is real, he argues, it must be the wavefunction (state vector) (alternatives in Chapter 29).
Why the reluctance? A momentum state is not localized at all: |eiP·x/ħ| = 1 everywhere in the universe. It is an idealization; real particles are approximated by wave packets, a momentum state times a Gaussian e−B(x−C)² peaked at x = C with spread about B−1/2; letting C be complex packs the momentum and position into one formula. The wave is complex, and its "waviness" lies in its phase (argument), which twists round and round: drawn with the complex plane perpendicular to the direction of motion, a momentum state is a right-handed corkscrew (for positive momentum), a wave packet a corkscrew that tails off at both ends. In three dimensions the planes of constant phase are perpendicular to the momentum, spaced 2πħ/p apart. The two-slit fringes are simply two such plane waves at a slight angle reinforcing where phases agree and cancelling where they oppose.
21.7 The holistic nature of a wavefunction
Could a dot simply appear with some probability wherever the local intensity is high? No. Then sometimes two dots would appear from one emitted particle, at two well-separated bright places; for electrons that would violate charge conservation, for neutrons baryon-number conservation, contradicting vast evidence. (Exercise 21.12 shows such double hits would be appreciable whatever the rule.) The wave must be treated as one entire thing: "If it causes a spot to appear at one place, then it has done its job". Wavefunctions are not local disturbances; they are completely holistic entities.
A single photon meets a half-silvered mirror in interstellar space; its wavefunction splits into reflected and transmitted packets. After a year, two colleagues more than 1.4 light-years apart each focus their part onto a detector. Exactly one detects the photon, never both, though no signal could pass between them. Fine, says the sceptic: the photon simply chose its path at the mirror. But suppose instead the colleagues reflect their parts to a second beam splitter, with equal path lengths. Then the photon always reaches detector A and never B: constructive interference at A, destructive at B. If it had chosen a path, either detector would be possible. Both routes must be "felt out" simultaneously, and the photon cannot "know" in advance which experiment awaits it.
Ground versions (Mach–Zehnder interferometers, arm lengths of metres) have been run many times and quantum mechanics has never been contradicted. Quantum theory resolves the "foresight" puzzle not by giving the particle foresight but by accepting the non-local holism of ψ: the state splits at the first beam splitter, and the particle aspect appears only at detection. Penrose's note adds the de Broglie–Bohm alternative, in which a real particle takes one path while a guiding wave explores both (assessed in §§29.2, 29.9).
21.8 The mysterious quantum jumps
What counts as a measurement, and why does it switch us from a spreading wave to a localized particle by an "awkward discontinuous (and non-local) change", a quantum jump, not described by Schrödinger's equation? This jump is why many physicists doubt that ψ describes reality. Schrödinger himself told Bohr: "If all this damned quantum jumping were really here to stay then I should be sorry I ever got involved with quantum theory."
- Evolve: between measurements, ψ evolves deterministically by Schrödinger's equation, usually spreading (sometimes refocusing).
- Jump: on measurement, ψ collapses at once to something localized and specific, however spread out it was.
- Repeat: from that new state, Schrödinger evolution resumes until the next measurement.
Roughly, the particle aspect shows in measurements and the wave aspect between them, but the split is not that clean. Some physicists (Penrose cites Goldstein and Bell) hold that all measurements are ultimately of position; he finds this "much too narrow", since momentum or angular-momentum measurements are equally legitimate.
21.9 Probability distribution in a wavefunction
The Born rule: |ψ|² = ψψ̄ is the probability density for finding the particle under a position measurement. Total probability 1 requires ‖ψ‖ = ∫|ψ|² d³x = 1 (Penrose's ‖ψ‖ is many authors' ‖ψ‖²), a normalized wavefunction. This rules out exact momentum states, whose integral diverges: they are unrealizable idealizations, along with (later) hyperfunctional states. Only normalizable states can be physical.
Multiplying ψ by any non-zero complex constant κ changes nothing physical: ψ ≡ κψ. So the true space of physical states is the projective space ℙW (§15.6), and probability density for an unnormalized ψ is |ψ|²/‖ψ‖ (Penrose's note points to fully projective formulations by Brody and Hughston, Ashtekar and Schilling).
- ψ is complex, so it cannot be a probability.
- Its phase, varying from place to place, drives Schrödinger evolution; a momentum state has constant |ψ|, so |ψ| carries no information about direction of motion: the phase alone makes the wave wavy.
- Probabilities never cancel, but destructive interference (the dark fringes) is quantum mechanics' signature.
- Gauge freedom ψ ↦ eiθ(x)ψ is allowed only with the compensating change ∂/∂xa ↦ ∂/∂xa − ieAa (Aa = ∇aθ, e = 1): the phase information is not lost but mixed into the connection ∇.
21.10 Position states
A position measurement destroys the phase-distribution information and restarts the evolution from a state sharply peaked "here", which then spreads. An ideal measurement of x¹ yields an eigenstate of multiplication by x¹: x¹ψ = X¹ψ, solved by the Dirac delta function
ψ = δ(x¹ − X¹), since xδ(x) = 0,
a hyperfunction (§9.7), infinitely peaked. The other coordinates remain free, ψ = φ(x², x³)δ(x¹ − X¹). Because x¹, x², x³ commute, they have simultaneous eigenstates (a general theorem for commuting observables), giving the position state ψ = δ³(x − X) (products of deltas in different variables are legitimate). Position states are idealizations opposite to momentum states: infinitely concentrated rather than infinitely spread, and equally non-normalizable (a delta function cannot be squared).
21.11 Momentum-space description
Writing ψ(x) means expanding the state in position eigenstates, ψ(x) = ∫ψ(X)δ(x − X)d³X. Expanding instead in momentum states gives the Fourier transform
ψ(x) = (2π)−3/2 ∫ ψ̃(p) eip·x/ħ d³p,
and ψ̃(p) is an equally good representation. Now x becomes a derivative in p: xa = −iħ∂/∂pa (note the sign change), with the same commutation relations. Momentum states become δ(p − P); position states become plane waves e−ip·X/ħ; and the inverse transform differs only by the sign in the exponent, which is why the symmetric factor (2π)−3/2 is used.
Heisenberg's uncertainty relation bounds the spreads:
Δx Δp ≥ ½ħ.
A pure momentum state has Δp = 0, Δx = ∞; a position state the reverse. This illustrates the incompatibility of non-commuting measurements: measure momentum, then position, then momentum again, and the intermediate position measurement has completely ruined the original momentum state, leaving every momentum equally likely.
Try it in Python: Heaviside's trick and the uncertainty bound
import sympy as sp, numpy as np
x = sp.symbols('x'); y = x**5 - 20*x**3 + 120*x
print(sp.simplify(y + sp.diff(y, x, 2))) # x**5
X = np.linspace(-40, 40, 2**14); dx = X[1]-X[0]; s, k0 = 1.7, 3.0
psi = np.exp(-X**2/(4*s**2))*np.exp(1j*k0*X)
psi /= np.sqrt(np.sum(abs(psi)**2)*dx)
P = 2*np.pi*np.fft.fftfreq(X.size, d=dx); w = abs(np.fft.fft(psi))**2; w /= w.sum()
sx = np.sqrt(np.sum(X**2*abs(psi)**2)*dx)
mp = np.sum(P*w); sp_ = np.sqrt(np.sum((P-mp)**2*w))
print(round(sx, 4), round(sp_, 4), round(sx*sp_, 4), round(mp, 3))
Output: x⁵ (Heaviside's solution checks), then Δx = 1.7000, Δp = 0.2941, product 0.5000, mean p = 3.000 (with ħ = 1). A Gaussian packet sits exactly on the Heisenberg bound ħ/2, and multiplying by eik₀x shifts its momentum to k₀ without changing either spread.
Energy and time
Relativity suggests ΔE Δt ≥ ½ħ too, but its status differs: time is an external parameter, not a dynamical variable. The usual reading: an energy measurement lasting Δt has uncertainty ΔE. For an unstable particle or nucleus, its lifetime limits how long its energy can be ascertained, giving a mass uncertainty. For uranium-238 (lifetime ~10⁹ years in Penrose's round figure), ΔE ~ 10⁻⁵¹ J and Δm ~ 10⁻⁶⁸ kg (computed: 3.3 × 10⁻⁵¹ J and 3.7 × 10⁻⁶⁸ kg). Particle physicists encode decay with a complex energy whose imaginary part relates to the half-life. Penrose flags that this energy–time relation will be central to his collapse-time estimate in §30.11.
Terms to know
| Term | Meaning |
|---|---|
| Canonical quantization | Replace pa by iħ∂/∂xa (and E by iħ∂/∂t) in H |
| Commutation rule | paxb − xbpa = iħδab |
| Factor-ordering problem | Ambiguity in quantizing products like px |
| Wavefunction ψ | The quantum state; a function of positions and time, not momenta |
| Schrödinger equation | iħ∂ψ/∂t = Hψ |
| de Broglie / Planck | λ = h/p; E = hν |
| Eigenstate / eigenvalue | State with a definite value of an observable / that value |
| Momentum state | Plane wave e−iP·x/ħ; non-normalizable idealization |
| Position state | δ³(x − X); non-normalizable idealization |
| Born rule | |
| Projective state space ℙW | ψ and κψ represent the same physical state |
| Quantum jump | Discontinuous, non-local state change on measurement |
| Heisenberg relation | Δx Δp ≥ ħ/2; ΔE Δt ≥ ħ/2 (different status) |
Test yourself
- Q. What is the quantum momentum operator, and its commutator with position? pa = iħ∂/∂xa, with paxb − xbpa = iħδab.
- Q. Why can't the two-slit dots be explained by a local probability rule? It would sometimes produce two dots from one particle, violating charge or baryon conservation.
- Q. Why does Penrose reject the "probability wave"? ψ is complex, its phase governs the dynamics, and probabilities cannot cancel as amplitudes do.
- Q. What are momentum and position states, and why are neither physical? Plane waves and delta functions; neither is normalizable. Real particles are wave packets obeying Δx Δp ≥ ħ/2.
What the exercises ask
21.1–21.4 check (1 + D²) kills cos x and sin x, find the general solution of (1 + D²)y = x⁵, diagnose why the formal series misses solutions (it is not a two-sided inverse), and justify commutation of xa with Db for a ≠ b. 21.5–21.6 solve Schrödinger's equation in uniform gravity (Airy functions) and transform to the falling frame to test the equivalence principle quantum mechanically. 21.7 shows that translation invariance of H makes p commute with time evolution, hence conserved. 21.8 derives E = hν from p = h/λ via relativity. 21.9–21.11 prove plane waves are linearly independent (allowing integrals), justify splitting the two-slit wave into two plane waves, and find the frequency and peak of a packet with complex centre C + iD. 21.12 shows a local probability rule would give appreciable double hits. 21.13–21.16 check xδ(x) = 0, show how x and p swap roles under Fourier transform, compute the transform of a Gaussian packet, and justify the −ħ log 2 factor linking complex energy to half-life.
Points to read critically. (1) Penrose's rejection of the "probability wave" and his claim that ψ is the best candidate for reality are interpretive positions; Copenhagen, QBism and many-worlds readers would describe the same mathematics differently (Chapter 29 is his full treatment). (2) The uranium-238 lifetime is rounded: the half-life is 4.47 × 10⁹ years (mean life 6.4 × 10⁹), shrinking ΔE by a further factor of six. (3) In Fig. 21.3's caption the printed Planck formula carries a stray exponent −1; the correct form is 2hν³/(ehν/kT − 1). (4) "Particles reach the screen one at a time" was first shown cleanly for electrons by Merli, Missiroli and Pozzi (1974) and Tonomura (1989), and for single photons by Grangier, Roger and Aspect (1986).
A 160 g cricket ball bowled at 40 m/s has p = 6.4 kg m/s and de Broglie wavelength λ = h/p ≈ 10⁻³⁴ m, about 10¹⁹ times smaller than a proton. No slit could resolve it; no fringes could ever be seen. An electron at 100 eV has λ ≈ 0.12 nm, the spacing of atoms in a crystal, which is exactly why Davisson and Germer saw it. The formalism is the same for both; only the scale of 2πħ/p decides whether the wave nature is visible. Whether something else (Penrose will argue: gravity) also stops a cricket ball's superpositions is the question of Chapter 30.
Wave–particle duality has been pushed far toward the everyday scale. In 2019 the Vienna group (Fein, Arndt and colleagues) showed interference of molecules of about 2,000 atoms and over 25,000 atomic mass units. The 2022 Nobel Prize (Aspect, Clauser, Zeilinger) honoured the entanglement experiments that make wavefunction holism undeniable (Chapter 23), and the 2025 Nobel Prize went to John Clarke, Michel Devoret and John Martinis for macroscopic quantum tunnelling and energy quantization in superconducting circuits, the physics behind today's superconducting quantum processors. Delayed-choice versions of Penrose's beam-splitter story have been realized, including Wheeler's delayed-choice experiment over 3,500 km via satellite (Vedovato et al., 2017, using a geodetic satellite link). None has contradicted the formalism; the meaning of the "jump" remains as contested as when Penrose wrote.
Hilbert-space structure, spin and the formal U (unitary evolution) and R (reduction) processes come in Chapter 22; many particles and entanglement in Chapter 23; the relativistic wave equation in Chapter 24 (Dirac); the quantized harmonic oscillator and fields in §22.13 and Chapter 26, where Feynman's path integral sums ei𝒮/ħ over histories (§26.6); interpretations in Chapter 29; gravitational collapse and the energy–time relation in Chapter 30.
The operator view of momentum is a powerful design idea: a quantity is defined by what it does to the state (its generator role), not by a stored number. Event-sourced systems behave similarly: the "value" is recovered by applying operations, and the order of non-commuting operations matters, which is why idempotency and commutativity have to be designed in rather than assumed.
Quantum Algebra, Geometry, and Spin
Quantum mechanics runs on two incompatible procedures: smooth, deterministic, linear unitary evolution U and abrupt, probabilistic state reduction R. Penrose builds the Hilbert-space machinery that lets them dovetail (scalar products preserved by U, probabilities computed from them by R), then shows that spin turns the abstract complex amplitudes into honest geometry: every spin-½ state is spin "up" about some real direction, and a spin-j state is a constellation of 2j points on the Riemann sphere.
22.1 Two procedures, one theory
Between measurements a quantum state ψ evolves by the Schrödinger equation iħ ∂ψ/∂t = Hψ. When a measurement corresponding to an operator Q is made, the state jumps into one of Q's eigenstates, which one being a matter of pure chance with precisely computable probabilities. Penrose names the first process U (unitary evolution) and the second R (reduction, or "collapse of the wavefunction"). The textbook picture is an alternation: U, then R, then U again, an arrangement he calls "a distinctly odd type of way for a universe to behave".
Most physicists, he notes, regard U as the underlying truth and R as an approximation, illusion or bookkeeping convenience, and they keep the formalism unchanged because nothing in experiment contradicts it. Penrose's own view, previewed here and argued in Chapters 29 and 30, is that U and R are both approximations to a single, as yet unknown, coherent evolution law, and that finding it belongs to 21st-century physics. Either way, any new theory must reproduce the present one to very high accuracy, so it has to be understood thoroughly first.
A footnote adds a linguistic barb: the colloquial "quantum leap" means a huge change, but real quantum jumps are extraordinarily tiny, barely detectable and possibly unreal events.
22.2 Linearity of U, and why it fights R
Three facts follow from the form of the Schrödinger equation alone, whatever the Hamiltonian H:
- Deterministic. Given ψ at one time, U fixes it at all times. "Quantum uncertainty" lives entirely in R, never in U.
- Complex. The explicit i makes it a complex equation.
- Linear. If ψ and ϕ are solutions then so is wψ + zϕ for any complex constants w, z. After any finite time T, the evolution map on the state space W is a linear transformation: if ψ ⇝ ψT and ϕ ⇝ ϕT, then wψ + zϕ ⇝ wψT + zϕT.
The Hamiltonian acts as a vector field on W (an infinitesimal linear transformation); the finite evolution is obtained by "exponentiating" it, exactly as a Lie group element comes from a Lie algebra element (§14.6), though harder in the infinite-dimensional case. Exercise 22.1 makes a subtle point: U is linear even when H is a wildly non-linear function of the ps and xs, because linearity refers to the state, not to the dynamical variables.
Linearity is what defeats the "convenience" reading of R. Take the space thought experiment of §21.7, with a photon wave packet split between two detectors. The state before detection is a sum of the two packet parts, so by linearity the Schrödinger-evolved detector responses must also be a sum: detector 1 fires plus detector 2 fires. What always happens is detector 1 or detector 2. Penrose's verdict: it is "untenable to maintain that U tells the whole story". Bohr's Copenhagen interpretation does not try to; it treats detectors as classical. The only way to keep "U at all levels" is a many-worlds view, and even that needs an extra theory of why conscious perception registers only one outcome.
Linearity alone makes U incompatible with R. U turns "A + B" into "response to A plus response to B"; experience delivers "response to A or response to B". No amount of complexity in the measuring apparatus changes this, because complexity does not break linearity.
22.3 Hilbert space and Dirac's notation
Unitarity concerns the norm. For a spinless particle, ‖ψ‖ = ∫|ψ(x)|² d³x (Penrose writes ‖ψ‖ for what many books call ‖ψ‖²), and normalisation ‖ψ‖ = 1 makes |ψ(x)|² a probability density. The norm is the special case of a Hermitian scalar product, written ⟨ϕ|ψ⟩, with ‖ψ‖ = ⟨ψ|ψ⟩; for one particle ⟨ϕ|ψ⟩ = ∫ ϕ̄(x) ψ(x) d³x.
A Hilbert space ℋ is a complex vector space with a scalar product ⟨·|·⟩ satisfying:
- Hermitian symmetry. ⟨ϕ|ψ⟩ is the complex conjugate of ⟨ψ|ϕ⟩.
- Linearity in the second slot. ⟨ϕ|ψ + χ⟩ = ⟨ϕ|ψ⟩ + ⟨ϕ|χ⟩ and ⟨ϕ|aψ⟩ = a⟨ϕ|ψ⟩.
- Antilinearity in the first. ⟨aϕ|ψ⟩ = ā⟨ϕ|ψ⟩ (a consequence).
- Positive definiteness. ⟨ψ|ψ⟩ > 0 unless ψ = 0.
- Completeness. Basic continuity (Cauchy sequences converge).
The normalisable wavefunctions form ℋ, a subspace of the larger space W. Because the scalar product can be recovered from the norm (Exercise 22.6: compute the norms of ϕ + ψ and ϕ + iψ, the polarisation identity), any linear map preserving norms also preserves scalar products.
Paul Dirac's notation: a ket |ψ⟩ is a state in ℋ with a memorable label inside; its bra ⟨ψ| is the Hermitian conjugate, an element of the dual space ℋ∗. Bra and ket meet in a bracket ⟨ψ|ϕ⟩. States are orthogonal when ⟨ϕ|ψ⟩ = 0. An operator acts as L|ψ⟩, and ⟨ϕ|L|ψ⟩ is both ⟨ϕ| paired with L|ψ⟩ and the bra "⟨ϕ|L" paired with |ψ⟩; that bra is the conjugate of L∗|ϕ⟩, where L∗ is the adjoint (physicists usually write L†). Complex conjugating ⟨ϕ|L|ψ⟩ gives ⟨ψ|L∗|ϕ⟩.
22.4 Unitary evolution: Schrödinger and Heisenberg pictures
To show U is unitary we need only that it preserves ⟨ϕ|ψ⟩, i.e. d⟨ϕ|ψ⟩/dt = 0. Two minimal conditions on H suffice: it keeps states in ℋ, and it is Hermitian (H∗ = H, which also guarantees real energy eigenvalues). Using the Leibniz rule, iħ d⟨ϕ|ψ⟩/dt = ⟨ϕ|Hψ⟩ − ⟨Hϕ|ψ⟩ = 0. Positive-definiteness of H (all energies positive) is usual but not needed for unitarity. The same argument makes translations and rotations unitary, since their generators are Hermitian too.
So evolution from t = 0 to T is a single operator UT with |ψT⟩ = UT|ψ⟩ for every state, and UT−1 = UT∗, i.e. UT∗UT = I.
Schrödinger picture
- State |ψ⟩ evolves: |ψT⟩ = UT|ψ⟩.
- Operators Q fixed in time.
- Gives "some glimpse of what quantum reality might be like" (Penrose's preference).
Heisenberg picture
- State frozen: |ψ⟩H = UT−1|ψT⟩.
- Operators evolve: QH = UT−1QUT, with iħ dQH/dt = QHH − HQH (Heisenberg's equations).
- QH = H gives energy conservation at once.
Eigenvalues and scalar products agree in both pictures, so they are physically equivalent. The quantum jumps do not disappear in the Heisenberg picture; one may only choose whether the state or the dynamical variables "jump" at R. Penrose finds the jumping "simply made more obscure" there, because Heisenberg operators describe questions one can ask ("what is your position?") rather than any specific physical system.
- 1913: Bohr atom, quantised circular orbits.
- July 1925: Heisenberg's matrix mechanics.
- January 1926: Schrödinger's wave equation; he soon proves the two equivalent.
- June 1926: Max Born interprets |ψ|² as probability (Schrödinger resisted, preferring a classical-field reading).
- 1930: Dirac's Principles of Quantum Mechanics codifies the operator framework built by Heisenberg, Born and Pascual Jordan.
Neither picture is relativistically invariant; quantum field theory often uses a hybrid interaction picture, and Dirac argued the Schrödinger picture does not even exist in relativistic QFT. Penrose expects that a future modification of quantum theory may break the equivalence between the pictures.
22.5 Observables, eigenstates and the Born rule
A measurable quantity is an observable: a linear operator Q on ℋ. A state has a definite value q for Q exactly when it is an eigenstate, Q|ψ⟩ = q|ψ⟩. Convention requires Hermitian observables (Q∗ = Q) so eigenvalues are real.
Penrose calls the Hermitian requirement "unreasonably strong". Complex quantities are routine in classical physics (the Riemann-sphere celestial sphere, oscillator amplitudes), so he demands only that Q be normal: Q∗Q = QQ∗. That is exactly what guarantees the essential property, eigenvectors for distinct eigenvalues are orthogonal, while allowing complex measurement outcomes. Standard texts do not follow him; a complex "observable" is usually split into two commuting Hermitian ones (real and imaginary parts), which comes to the same thing for normal operators.
In infinite dimensions one must also assume the eigenvectors span ℋ (automatic in finite dimensions); a Hermitian operator with this property is self-adjoint. Orthogonality is what makes repeated measurement consistent: the probability of jumping to an orthogonal state is zero, so measuring Q twice gives the same q twice.
The probability rule depends only on the states before and after, not on Q or its eigenvalue:
- Born rule (normalised). Probability of |ψ⟩ jumping to eigenstate |ϕ⟩ is |⟨ψ|ϕ⟩|².
- Unnormalised form. ⟨ψ|ϕ⟩⟨ϕ|ψ⟩ / (⟨ψ|ψ⟩⟨ϕ|ϕ⟩), always between 0 and 1, equal to 1 only for proportional states.
- Amplitudes. In wψ + zϕ with ψ, ϕ orthonormal, the probability amplitudes w and z give probabilities |w|² and |z|².
This is where U and R "dovetail": U preserves exactly the scalar products from which R computes its probabilities. They are inconsistent with each other, yet fitted together with great precision.
A normal Q (with spanning eigenvectors) supplies an orthonormal basis e1, e2, … with ⟨ei|ej⟩ = δij, so every ψ = z1e1 + z2e2 + …, the z's being complex Cartesian coordinates. Switching between position and momentum representations is just a change of basis in ℋ, though strictly neither position nor momentum eigenstates are normalisable, so neither belongs to ℋ. Penrose's comment on the dilemma: be sloppy, or risk "rigour mortis"; he tries to steer between them without being sure which way progress lies.
22.6 YES/NO questions and projectors
Continuous observables give probability zero for any exact value, so it is better to ask questions like "is the particle in this region?". Such a YES/NO measurement is a projector E: E² = E = E∗, eigenvalue 1 for YES, 0 for NO. Exercise 22.13 shows any polynomial equation satisfied by Q is satisfied by each eigenvalue, hence E's eigenvalues obey λ² = λ.
In more than two dimensions projectors are highly degenerate (a whole eigenspace shares the eigenvalue 1), so knowing the result does not fix the state. The projection postulate resolves it: on result YES, |ψ⟩ jumps to E|ψ⟩; on NO, to (I − E)|ψ⟩. Since |ψ⟩ = E|ψ⟩ + (I − E)|ψ⟩ with the two parts orthogonal, the measurement just decides between two orthogonal components. Normalised, the jump is to E|ψ⟩⟨ψ|E|ψ⟩−1/2; Penrose prefers unnormalised states because then the probability of each outcome is simply the factor by which the squared length ‖ψ‖ shrinks under the projection, a geometric fact hidden by normalising.
22.7 Null measurements and helicity
Critics call the projection postulate unnecessary or unobservable, since entanglement with the apparatus can hide what the state "became". Null (interaction-free) measurements show it in action. Send one photon at a beam splitter: the state is |ψ⟩ = |τ⟩ + |ρ⟩ (transmitted plus reflected). Put a 100%-efficient detector in the transmitted beam and a source that logs every emission. If a photon is emitted but not detected, its state has jumped to |ρ⟩ although it never touched the detector.
Put the beam splitter inside a Mach–Zehnder interferometer with equal arms, so without obstruction every photon reaches detector A, never B. A bomb whose trigger is detector C may or may not sit in one arm. If B ever clicks without an explosion, C must be in place: C's non-detection collapsed the photon into the other arm, destroying the interference, so A and B each get probability ½. You have verified a bomb's presence with a photon that never went near it. The idea of interaction-free measurement goes back to Robert Dicke (1981).
To exhibit degeneracy, Penrose adds photon polarisation. A massless particle can spin only about its direction of motion; the signed spin is its helicity s, an integer or half-integer multiple of ħ, with |s| = j fixed for the particle type.
| Massless particle | Spin j | Helicities |
|---|---|---|
| Photon | 1 | ±1 (right/left circular polarisation) |
| Graviton | 2 | ±2 |
| Neutrino (if massless) | ½ | −½ (antineutrino +½) |
Other polarisations (plane, elliptical) are superpositions of the two helicity states. The fact needed: under near-perpendicular reflection a circular polarisation is reversed, while transmission keeps it. A right-handed photon at the splitter becomes |ψ+⟩ = |τ+⟩ + |ρ−⟩. A polarisation-blind detector in the transmitted beam that fails to fire tells us only that the state lies in the NO eigenspace, spanned by |ρ+⟩ and |ρ−⟩. Only the full projection postulate, in Lüders' (1951) refinement, says the state goes to |ρ−⟩ rather than to |ρ+⟩ or some mixture. In projective Hilbert space ℙℋ3 this target, the Lüders point, is where the unique transversal from the initial point meets the NO line. Note 22.20 offers a slicker version: aim unpolarised light at the Brewster angle of a refracting surface, and reflected and transmitted beams emerge with opposite linear polarisations.
22.8 Spin and spinors
For a massive particle, spin is angular momentum about its centre of mass. As momentum is iħ times the generator of translations, angular momentum is iħ times the generator of rotations. The generators ℓ1, ℓ2, ℓ3 of the Lie algebra of SO(3) satisfy ℓ1ℓ2 − ℓ2ℓ1 = ℓ3 (and cyclic permutations), and with Li = iħℓi:
L1L2 − L2L1 = iħL3, L2L3 − L3L2 = iħL1, L3L1 − L1L3 = iħL2.
Any quantum system with angular momentum is thus a representation of the Lie algebra of SO(3) on ℋ. The simplest non-trivial one uses the Pauli matrices: Li = (ħ/2)σi with σ1 = (0 1; 1 0), σ2 = (0 −i; i 0), σ3 = (1 0; 0 −1), acting on a two-component wavefunction ψA = {ψ0, ψ1}. That object is a 2-spinor: exponentiating a Pauli generator through a full 2π rotation gives −I, sending ψA to −ψA (the spinorial sign of §11.3). Exercises 22.18 and 22.19 tie these rules back to quaternions.
Try it in Python: Pauli algebra and the 2π sign flip
import numpy as np
from scipy.linalg import expm
sx=np.array([[0,1],[1,0]]); sy=np.array([[0,-1j],[1j,0]]); sz=np.diag([1,-1])
L=[s/2 for s in (sx,sy,sz)] # hbar = 1
print(np.allclose(L[0]@L[1]-L[1]@L[0], 1j*L[2])) # True
print(np.round(expm(-1j*2*np.pi*L[2]).real,6)) # [[-1,0],[0,-1]]
th=np.pi/3; up=np.array([1,0]); n=np.array([np.cos(th/2),np.sin(th/2)])
print(round(abs(up@n)**2,4), round((1+np.cos(th))/2,4)) # 0.75 0.75
The last line checks the ½(1 + cos θ) rule of §22.9 for two spin directions 60° apart.
Higher spin (Penrose sets ħ = 1 from here to §22.11; reinstate it by dimensional analysis) uses symmetric spin-tensors. Spin values run 0, ½, 1, 3/2, 2, …; spin n/2 is carried by an n-index object ψAB…F = ψ(AB…F), totally symmetric, with n + 1 independent components. These are the irreducible representations of SO(3), and every representation (including the two-valued spinorial ones) is a direct sum of them. The spin-tensor is spinorial only for odd n (half-odd-integer spin).
| Spin | Indices | Examples |
|---|---|---|
| 0 (scalar) | 0 | π meson (Chapter 21's spinless particle) |
| ½ | 1 | electron, muon, neutrino, proton, neutron, quarks |
| 1 | 2 | deuteron, W boson |
| high | many | heavier nuclei, whole atoms treated as one particle |
Total spin J² = L1² + L2² + L3² has eigenvalue j(j + 1) and commutes with every Li although they do not commute among themselves: it is the Casimir operator of SO(3). States are labelled by j and m, the eigenvalue of L3, with −j ≤ m ≤ j in integer steps, giving 2j + 1 = n + 1 states. A warning from Penrose: two particles are not described by two separate spin-tensors; multi-particle states are subtler (Chapter 23). He also notes that the 2-spinor calculus, including primed indices A′ for complex conjugates, could supplement or even replace tensor calculus and is undervalued in QFT, general relativity and twistor theory.
22.9 The Riemann sphere of a two-state system
Take a spin-½ particle at rest, so its state is just a pair of complex numbers {w, z} = w|↑⟩ + z|↓⟩, with ⟨↑|↓⟩ = 0, ⟨↑|↑⟩ = ⟨↓|↓⟩ = 1, and scalar product ⟨{a, b}|{w, z}⟩ = āw + b̄z.
Every spin-½ state is pure spin "up" about some actual direction in space: w|↑⟩ + z|↓⟩ = |↗⟩. The space of physically distinct states, ℙℋ2, labelled by the ratio u = z/w, is the Riemann sphere of Chapter 8, and its points are the directions of space. Complex amplitudes are not abstract bookkeeping; they are geometry.
The projector E↗ asks "is the spin along ↗?"; YES projects to |↗⟩, NO to |↙⟩, the antipodal point. Note that Hilbert-space orthogonal means spatially opposite, not at right angles. For a state prepared along one direction and measured along another at angle θ:
P(YES) = ½(1 + cos θ) = cos²(θ/2), P(NO) = ½(1 − cos θ).
Geometrically, on a sphere of diameter 1, project the initial point B orthogonally onto the measurement axis A′A at C; then P(YES) = A′C and P(NO) = CA.
This sphere is a metric sphere (antipodes matter) rather than a merely conformal one, so its symmetries are rotations only. The construction works for any two-state system: the Riemann sphere always provides the "quantum spread" of a pair of classical alternatives. Overall phase is unobservable, but relative phases are physical, which is why the complex projective geometry of ℙℋ is meaningful and has inspired geometric formulations of quantum theory.
Photon polarisation gets its own sphere. With |+⟩ at the north pole and |−⟩ at the south (photon moving north), the state w|+⟩ + z|−⟩ is marked not at z/w but at q = (z/w)1/2. Draw the great circle perpendicular to the radius to q (the Stokes vector), orient it right-handedly, and project it onto the equatorial plane: the result is the polarisation ellipse, with the right sense of rotation. Plane polarisation corresponds to points on the equator (degenerate ellipses), circular polarisation to the poles.
22.10 Higher spin: the Majorana picture
For spin j = n/2, every symmetric spin-tensor factorises uniquely (up to scale and order) into a symmetrised product of single spinors: ψAB…F = α(AβB…φF) (Exercise 22.30 derives it from the fundamental theorem of algebra applied to a degree-n polynomial). Since each α, β, … is a point on the Riemann sphere, a general spin-j state is an unordered set of 2j points on the sphere, the Majorana description, found in 1932 by Ettore Majorana, who vanished from a ship in the Bay of Naples at 31.
- Standard basis. All points at the poles: |↑↑…↑⟩, |↓↑…↑⟩, …, |↓↓…↓⟩, the n + 1 eigenstates of L3 with m = j, j − 1, …, −j.
- Measuring m. A Stern–Gerlach apparatus sends atoms with a magnetic moment through a strongly inhomogeneous field, deflecting each m-value differently.
- Orthogonality. A state containing direction ↗ is orthogonal to |↙↙…↙⟩. If ↗ appears with multiplicity r, the state is orthogonal to any state containing ↙ with multiplicity at least n − r + 1.
- Physical meaning. The Majorana directions are exactly those for which a Stern–Gerlach measurement has zero probability of finding the spin entirely opposite; for multiplicity r, m values from −j to −j + r − 1 along that axis are forbidden.
Most physicists, Penrose notes, never meet this picture and use harmonic analysis instead.
22.11 Spherical harmonics
Normal modes of a vibrating sphere (a soap bubble, a balloon) are spherical harmonics, eigenfunctions of the Laplacian on S² with metric ds² = dθ² + sin²θ dϕ². The eigenvalues of ∇² are −j(j + 1) for j = 0, 1, 2, …, and simultaneous eigenfunctions of ∂/∂ϕ have eigenvalue im with −j ≤ m ≤ j. Examples: Φ = 1 (j = m = 0); cos θ (j = 1, m = 0); e±iϕ sin θ (j = 1, m = ±1); 3cos²θ − 1 (j = 2, m = 0).
The match is no coincidence: J² ↔ −∇² and L3 ↔ −i∂/∂ϕ for the angular dependence of a wavefunction of integral spin. Half-integral spins need spin-weighted spherical harmonics, functions that also depend on a spinorial unit tangent vector at each point, i.e. Functions on the S³ Clifford bundle of §15.4, with an eisχ dependence on the vector's angle χ.
Penrose's spinor route to harmonics: take a spinor ξA pointing to the sphere point (θ, ϕ) and ηA pointing to its antipode, and form components of ψAB…F with j + s copies of ξ and j − s of η. Equal numbers give ordinary harmonics; the zeros of the harmonic with only ξs are the Majorana points, which is how Majorana found them.
Pick a quantum state of very large j at random. Its Majorana description is 2j points peppered randomly over the sphere, nothing like a classical spinning top, whose points would cluster around one axis. And a quantum j = 0 state must be spherically symmetric, while a classical non-spinning object can be any shape. Large quantum numbers do not by themselves make a state classical; almost all "large" states are wildly non-classical, the same puzzle as Schrödinger's cat (§29.7).
Applications extend far beyond spin: the cosmic microwave background is analysed in harmonics up to ℓ of 200 and more (§§27–28). A warning for non-compact spaces: the naive "flip the signs" transfer of harmonic analysis from the sphere to hyperbolic space captures a vanishingly small proportion of the relevant functions.
22.12 Relativistic quantum angular momentum
Relativity merges energy and momentum into pa and angular momentum with mass-centre motion into the antisymmetric 6-tensor Mab (§18.7). Quantum mechanically these are the generators of the Poincaré group: p0 = E = iħ∂/∂x0 generates time translation, the spatial p's generate displacements, the purely spatial M's give ordinary angular momentum (c−2M23 = L1, etc.), and c−2M01, M02, M03 generate boosts and describe mass-centre motion. Their commutators define the Lie algebra of the Poincaré group, neater in Penrose's diagrammatic notation.
We want a complete commuting set of operators: if AB = BA there are joint eigenstates labelled by eigenvalue pairs, and a complete set labels a full basis. The starting point is the Casimir operators, which commute with everything.
- Pauli–Lubanski vector. Sa = ½εabcdMbcpd (in forms, S = ⋆(M ∧ p)). Always paSa = 0 and [Sa, pb] = 0, so S is origin-independent. A structureless particle (Mab = xapb − xbpa) has S = 0.
- Casimir 1. papa = c⁴μ² (rest mass μ).
- Casimir 2. SaSa = −μ²J², giving spin j via J² = j(j + 1).
- Complete set. Add p1, p2, p3 and one spin component S3: six commuting operators for μ ≠ 0.
- Massless case. J² = −c⁴(papa)−1SaSa fails at μ = 0. Instead Sa = s pa, defining the helicity s; the commuting set is s, p1, p2, p3, four in all. (Exercise 22.39: S can be both orthogonal and proportional to p because p is null.)
Penrose adds that the neatest treatment of massless particles is twistor theory, where the four twistor components Z0…Z3 themselves serve as commuting operators (§33.6). Wigner's classification of particles by mass and spin, which this section reconstructs, is the bridge from symmetry to particle physics.
22.13 The general isolated quantum object
An isolated atom or molecule splits into external data (4-momentum, 6-angular momentum: pa, Mab) and internal data (relative coordinates qr: distances, angles). Internal variables are unchanged by every Poincaré motion. If a symmetry S acts by |ψ⟩ ↦ S|ψ⟩, an operator transforms as Q ↦ SQS−1, so invariance means SQ = QS: internal variables commute with pa and Mab, and the wavefunction separates. Choose the rest frame (zero 3-momentum) and the angular momentum reduces to the non-relativistic theory.
For small oscillations with Hamiltonian ½Pabpapb + ½Qabqaqb, each eigenvalue ω² of W = PQ gives a normal mode. Classical intuition plus Planck's E = ħω would suggest energies 0, ħω, 2ħω, …; the truth adds a zero-point energy:
E = ½ħω, (3/2)ħω, (5/2)ħω, … (from H = (m²ω²q² + p²)/2m).
Remarkably, free bosonic quantum fields (photons included) behave exactly like collections of such oscillators, the bridge to Chapter 26. Note 22.48 identifies (2mħω)−1/2(p + imq) as the creation operator.
The electron's orbit is a superposition of many classical orbits, stationary solutions with spherical-harmonic angular dependence; the proton is about 1836 times heavier and nearly fixed. Bohr (1913) had quantised Kepler ellipses by demanding orbital angular momentum be an integer multiple of ħ, which explained the Balmer formula ν = R(N−2 − M−2). Classical physics predicted electrons spiralling into the nucleus almost instantly. Quantum mechanics removed the catastrophe and explained the spectral lines, now a tool from forensics to cosmology: "one of the supreme triumphs of 20th-century physics".
In the non-relativistic, spinless treatment, hydrogen's energy fixes j only "fortuitously" not the other way round (the accidental degeneracy); more exact theories lift it. Atoms in excited states decay to the ground state by photon emission, with frequency fixed by the energy difference; selection rules forbid some transitions.
Penrose's closing remark: discreteness, the feature that gave quantum theory its name, comes from compactness of some space (the sphere of directions for angular momentum, periodicity for oscillators). Without compactness, ∇²Φ = −kΦ allows any k. The "quantum" in quantum mechanics is a topological gift.
Worked example: measurement disturbs, and the order matters
Prepare a spin-½ particle along +x, i.e. The Riemann-sphere point on the equator: |→⟩ = |↑⟩ + |↓⟩ (unnormalised).
- Measure along z. The angle between +x and +z is 90°, so P(↑) = ½(1 + cos 90°) = ½. Suppose YES: the state is now |↑⟩.
- Measure along x again. Now the angle between +z and +x is 90°, so P(→) = ½, not 1. The first z measurement erased the certainty the particle had about x.
- Without the middle step, a repeated x measurement gives → with probability 1 (orthogonality of eigenstates, §22.5).
- Projector view. E↑|→⟩ = |↑⟩ has squared length 1, while |→⟩ has squared length 2: the shrink factor ½ is the probability, exactly Penrose's unnormalised rule.
A second example: a spin-1 state with Majorana points north and south is |↑↓⟩ + |↓↑⟩ (symmetrised), the m = 0 state. Its Stern–Gerlach probabilities along z are m = +1: 0, m = 0: 1, m = −1: 0, and indeed a state containing ↑ is orthogonal to |↓↓⟩ and one containing ↓ is orthogonal to |↑↑⟩, as the orthogonality rule of §22.10 predicts.
Test yourself
- Why can a photon not have spin 0 along its motion if its helicity is ±1? Because a massless particle's spin magnitude |s| is fixed by its type; the photon's is 1, so only s = ±1 occur (s = 0 would be a different particle).
- What makes U and R "dovetail"? U preserves ⟨ϕ|ψ⟩; R's probabilities are built from ⟨ϕ|ψ⟩.
- Why are atomic energy levels discrete? Compactness of the relevant space (the sphere of directions, or a confining potential), not quantum theory alone.
- Paul Dirac: bra-ket notation, the operator framework, Principles of Quantum Mechanics (1930).
- Werner Heisenberg: matrix mechanics (1925) and the Heisenberg picture.
- Erwin Schrödinger: the wave equation (1926), equivalence of the pictures.
- Max Born: probability interpretation of |ψ|² (June 1926).
- John von Neumann: the projection postulate and Hilbert-space rigour.
- Gerhart Lüders: the refined projection rule for degenerate eigenvalues (1951).
- Avshalom Elitzur, Lev Vaidman: the bomb-testing thought experiment (1993).
- Ettore Majorana: the constellation picture of spin (1932).
- Otto Stern, Walther Gerlach: the spin-measuring apparatus.
Terms to know
| Term | Meaning |
|---|---|
| U | Unitary (Schrödinger) evolution: linear, deterministic, norm-preserving |
| R | State reduction: probabilistic jump to an eigenstate of the measured observable |
| Hilbert space ℋ | Complete complex vector space with positive-definite Hermitian scalar product |
| Adjoint Q∗ (Q†) | Operator with ⟨ϕ∣Qψ⟩ = ⟨Q∗ϕ∣ψ⟩ |
| Hermitian / normal | Q∗ = Q / Q∗Q = QQ∗ (Penrose's weaker requirement) |
| Projector E | E² = E = E∗; a YES/NO question |
| Lüders point | Where the projection postulate sends a state in a degenerate eigenspace |
| Helicity s | Spin of a massless particle along its motion; Sa = s pa |
| Casimir operator | Operator commuting with the whole symmetry algebra (J²; papa, SaSa) |
| Majorana description | Spin j state as 2j unordered points on the sphere |
| Zero-point energy | The ½ħω floor of a quantum oscillator |
Run the bomb test with a perfectly sensitive bomb and simple 50/50 splitters. Half the photons hit C and detonate it, a quarter reach A (inconclusive) and a quarter reach B, certifying an intact bomb: one success for every two explosions. Add many weak beam splitters and the quantum Zeno effect pushes the success rate toward 100%, as Kwiat and Zeilinger's group showed experimentally in 1995. Information is gained through what did not happen, which only makes sense if the unrealised alternative was physically present as an amplitude.
- "Quantum mechanics is indeterministic all the way down." U is fully deterministic; chance enters only with R.
- "Orthogonal spin states point at right angles." On the Riemann sphere, orthogonal means antipodal: up and down, not up and sideways.
- "Big quantum numbers mean classical behaviour." Almost all large-j states are wildly non-classical; classicality needs the Majorana points to cluster.
2004 versus 2026
| Topic | In the book (2004) | By 2026 |
|---|---|---|
| Qubits as Riemann-sphere points | Geometric curiosity of spin ½ | The Bloch sphere is the working picture in every quantum-computing lab |
| Interaction-free measurement | Thought experiment plus 1995 demo | Basis of quantum Zeno imaging and counterfactual communication proposals |
| Complex amplitudes | Argued to be geometric and real | Experimentally required (2021–22 tests rule out real-number QM) |
| U versus R | Penrose's minority view that both are approximate | Still open; collapse models tightly constrained but not excluded |
Penrose's exercises for Chapter 22
The 40 exercises ask the reader to: prove U is linear even for non-linear H (22.1); prove convergence of ⟨ϕ|ψ⟩ by a Cauchy–Schwarz argument and that normalisable functions form a vector space (22.2–22.5); recover the scalar product from the norm (22.6); spell out unitarity via the Leibniz rule and the Heisenberg equations (22.7–22.9); prove Hermitian eigenvalues are real and normal eigenvectors orthogonal (22.10–22.12); handle projectors and polynomial identities (22.13–22.14); explain circular-polarisation reversal on reflection and the Lüders projection (22.15–22.17); check the angular-momentum algebra with quaternions and Pauli matrices and exponentiate to −I (22.18–22.21); use the ladder operators L± to prove j is a half-integer (22.23); derive the ½(1 + cos θ) rule and the polarisation-ellipse construction (22.26–22.29); prove the Majorana factorisation from the fundamental theorem of algebra (22.30–22.31); derive the spherical Laplacian and harmonics for j = 1, 2, 3 (22.32–22.34); and verify the Poincaré commutators and Casimirs (22.35–22.40).
Extraction caution and contested points. (1) This edition's source text drops many ½ factors (spin "", probability "(1 + cos θ)"); the correct forms are spin ½ and ½(1 ± cos θ), restored here. (2) Penrose's preference for normal rather than Hermitian observables is his own, not textbook practice. (3) His claim that U and R must both be approximations is a minority view; decoherence-based and many-worlds accounts reject it, though none has solved the "why one outcome" problem to general agreement.
Complex numbers proved necessary. Penrose insists the complex amplitudes are physically real geometry. In 2021 Renou and colleagues (Nature) showed that real-number quantum theory makes different predictions from standard theory in network Bell tests, and experiments in 2022 (Chen et al. And Li et al., Physical Review Letters) ruled the real version out. Interaction-free imaging and the quantum Zeno effect are now laboratory tools, and spin Majorana constellations are used to design optimal states for quantum metrology and to classify symmetric multi-qubit entanglement.
For engineers building quantum-safe or quantum-computing roadmaps, this chapter is the specification: a qubit is a point on the Riemann (Bloch) sphere, gates are unitaries U, readout is a projector obeying the Born rule. Measurement is not a passive read; it changes the state, the principle behind quantum key distribution's eavesdropper detection.
Chapter 23 shows that many-particle states are entangled rather than lists of one-particle states; §24 makes spin relativistic via the Dirac equation; §26 reuses the oscillator as creation/annihilation operators; Chapters 29–30 return to the U/R conflict and Penrose's gravitational reduction proposal; §33 revisits helicity through twistors.
The Entangled Quantum World
With more than one particle, quantum theory stops describing "things" and starts describing one indivisible state on configuration space, overwhelmingly entangled. Penrose shows how vast that state space is, proves with Stapp's and Hardy's arguments that no picture of independent separated particles can reproduce the predictions, separates two mysteries of entanglement (what it is, and why we never notice it), treats bosons and fermions as built-in entanglement, and uses quantum teleportation to motivate his own concept, quanglement, which can zig-zag backwards in time without carrying signals.
23.1 One wavefunction, many particles, one time
For n particles there is not one wavefunction per particle but one wavefunction Ψ for the whole system, a function of all particles' position coordinates (a function on configuration space, §12.1), plus discrete indices for spins, plus time. The reason is mechanical: every particle's momentum becomes a derivative with respect to its own position, and all these operators must act on the same object.
Penrose flags an asymmetry he thinks "hides something deep": each particle gets its own space coordinates but they all share one time. In relativity space and time should be treated alike, so a relativistic theory ought to give each particle its own time. Multi-time formulations were tried from the late 1920s (Eddington, Mott, Dirac 1932) but never became a full theory, partly because each particle then wanders off into its own time dimension. The path-integral approach (§26.6) sidesteps the problem but introduces others.
23.2 The hugeness of many-particle state space
Penrose counts functional freedom with the notation ∞a∞b (a real components on b dimensions). A complex scalar wavefunction on 3-space has freedom ∞2∞³. (A source-free Maxwell field has 6 components but 2 constraints, div E = div B = 0, giving ∞4∞³.) n separate wavefunctions would give ∞2n∞³; the true n-particle wavefunction is one complex function of 3n variables, freedom ∞2∞3n, "stupendously larger".
- One particle. 10 complex amplitudes z0…z9: ℋ10. Physical analogue: an electron in a row of quantum dots.
- Two distinguishable particles A, B. 100 amplitudes z00…z99; |z38|² is the probability A is at 3 and B at 8: ℋ100 (versus ℋ20 for two separate wavefunctions).
- Three. ℋ1000 versus ℋ30; four, ℋ10000 versus ℋ40.
- n particles. ℋ10ⁿ versus ℋ10n.
- Eight particles. 200,000,000 real dimensions instead of 160.
Almost all the "information" in a many-particle wavefunction describes entanglement relations between the particles. This is the resource quantum computing tries to exploit, and Penrose takes it as a hint about where the quantum formalism itself should go next.
23.3 Tensor products and Bell inequalities
Entanglement was named by Schrödinger (1935), the year of the Einstein–Podolsky–Rosen (EPR) paper. Independent subsystems combine by the tensor product: |ψ⟩|ϕ⟩ (or |ψ⟩ ⊗ |ϕ⟩), bilinear in each factor; if |ψ⟩ ∈ ℋp and |ϕ⟩ ∈ ℋq, the product lies in ℋp ⊗ ℋq = ℋpq.
- Unentangled states. Those of product form |ψ⟩|ϕ⟩, a very small part of ℋpq when p, q > 1.
- Entangled states. Everything else: sums of products that cannot be refactored.
- Splitting matters. Entanglement is defined relative to a factorisation; ℋn with composite n can be split as a tensor product in many ways. Physics usually picks the obvious one, typically widely separated particles.
- Index notation. Ket ψα, bra ψ̄α, bracket ψ̄αϕα, product ψαϕβ; a general two-part state is just ϕαβ, which need not split.
John S. Bell (Northern Irish, 1964) derived inequalities on joint probabilities of separated measurements that any model of independent, non-communicating particles must satisfy and quantum mechanics violates. The most quoted is the CHSH form (Clauser et al. 1969): |E(A,B) − E(A,D)| + |E(C,B) + E(C,D)| ≤ 2, E being the agreement expectation. Gleason (1957) and Kochen–Specker (1967) give related no-go results, and "Bell inequalities without probabilities" use only "never" and "always". Penrose's own contributions here (with Zimba) include the "magic dodecahedra" Kochen–Specker-style examples, cited in his notes.
23.4 Bohm's EPR experiment and Stapp's argument
David Bohm (1951) recast EPR with two spin-½ particles born in a spin-0 state, flying to distant detectors L and R whose measurement directions are chosen after the particles separate. The spin-0 state is
|Ω⟩ = |↑⟩|↓⟩ − |↓⟩|↑⟩ (left factor = left particle; tensor products do not commute, so no L/R labels are needed),
and by rotational invariance |Ω⟩ ∝ |↙⟩|↗⟩ − |↗⟩|↙⟩ for any pair of opposite directions. Measure "up" on the left: YES projects to |↑⟩|↓⟩, NO to |↓⟩|↑⟩, so the right-hand result in the same direction is always opposite. For directions at angle θ: agree with probability ½(1 − cos θ), disagree with ½(1 + cos θ).
Henry Stapp (1971, 1979). My settings: ↑ or →. My colleague's: ↗ (45° to both) or ↖ (45° to ↑, 135° to →). Put the colleague on Titan and the source midway: about 45 minutes of light travel to choose settings after emission.
- Quantum predictions. At 45°, agreement ½(1 − cos 45°) ≈ 14.6%. At 135°, ≈ 85.4%.
- Local bookkeeping. For a pair to agree at (→, ↖) it cannot disagree at all three 45° pairs (→, ↗), (↑, ↗), (↑, ↖), since three disagreements chain to a disagreement. So it must agree in at least one of them.
- Contradiction. Each happens under 15% of the time, so agreement at (→, ↖) is at most 15 + 15 + 15 = 45%. Quantum mechanics says 85%.
The argument is sometimes faulted for relying on counterfactuals (measurements that "might have happened"). Penrose replies that the only assumption is that independently travelling particles must be prepared to answer any setting correctly; the only way to reproduce the quantum statistics is for the particles to stay "connected" until one is measured, and that connection is entanglement. Experiments (mostly with photon polarisation) consistently vindicate quantum mechanics; by 2004 Bell violations had been shown over more than 15 km (Tittel et al. 1998).
Try it in Python: Stapp's numbers and a teleportation check
import numpy as np
for th in (45,135): print(th, round((1-np.cos(np.radians(th)))/2,4))
# 45 0.1464 135 0.8536
The teleportation check of §23.9 (simulated below) confirms Penrose's correction table.
23.5 Hardy's example: almost without probabilities
Lucien Hardy (1992, 1993) lets both observers choose between ↑ and →, and prepares the pair in a particular spin-1 state with Majorana description |←↗⟩ = |←⟩|↗⟩ + |↗⟩|←⟩, where ↗ lies in the quarter-plane between ↑ and → at a specific slope. The state is not orthogonal to |↓⟩|↓⟩ but is orthogonal to |↓⟩|←⟩, |←⟩|↓⟩ and |→⟩|→⟩. Those facts translate into four YES/NO statements:
- Sometimes both observers get NO for ↑ (both ↑ measurements give "down").
- If I get NO for ↑, my colleague must get YES for →.
- If my colleague gets NO for ↑, I must get YES for →.
- We never both get YES for →.
A local model must prepare some pairs to give NO, NO at (↑, ↑) (property 0). To honour (1) and (2), those same pairs must be pre-set to answer YES to → on each side. But then if both observers switch to →, they get YES, YES, forbidden by (3). The contradiction rests on certainties plus a single non-zero probability: in Penrose's set-up P(NO, NO) = 1/12 ≈ 8.33%, and Hardy's optimal arrangement gives about 9.017% (exactly (5√5 − 11)/2).
23.6 Two mysteries of entanglement
Mystery 1: the phenomenon
How can separated particles be holistically linked, so that measurement on one constrains the other instantly? This is the mystery everyone discusses.
Mystery 2: its invisibility
Since the stupendous majority of states are entangled and U spreads entanglement, why is the everyday world not an entangled mess? Penrose thinks this second mystery "has not received nearly the attention that it deserves".
U only makes things worse: starting near the "rock" of unentangled states, Schrödinger evolution plunges the system into a "seaweed-strewn ocean" of entanglement with no route back. So the answer must involve R. In the EPR case, my measurement cuts my colleague's particle free; thereafter it has its own state. Measurements slash through entanglements, and preparing any clean quantum experiment implicitly requires something measurement-like to strip off unwanted entanglements.
Penrose's controversial position: Nature herself continually enacts R, with no experimenter or conscious observer required (developed in §§30.9–13). The conventional practice of assuming environmental entanglements "average out" has, in his view, no convincing justification. He links the problem to Tony Leggett's term, the measurement paradox (rather than "problem"): why, when and how does R replace U?
23.7 Bosons and fermions
Identical particles are entangled in a way that even measurements do not cut. Quantum mechanics recognises two kinds, linked to spin by the spin-statistics theorem of QFT (§26.2):
| Kind | Spin | Wavefunction | Examples |
|---|---|---|---|
| Bosons | 0, 1, 2, … | Symmetric: zij = zji | photons, mesons (π, K), W, Z, gluons, α particles, deuterons |
| Fermions | ½, 3/2, … | Antisymmetric: zij = −zji | electrons, protons, neutrons, quarks, neutrinos, muons |
Fermion wavefunctions are spinorial (§11.3); boson wavefunctions are not. In the 10-point toy universe:
- Two bosons. ½(10 × 11) = 55 amplitudes (ℋ55 instead of ℋ100); both may sit on one point (z33).
- Three bosons. (10 × 11 × 12)/6 = 220. n bosons: (9 + n)!/(9! N!).
- Two fermions. ½(10 × 9) = 45; three: (10 × 9 × 8)/6 = 120; n fermions: 10!/(n!(10 − n)!).
- Exclusion. Antisymmetry forces z33 = 0, z474 = 0. Counts fall after n = 5; at n = 10 there is exactly one state, and an 11th fermion is impossible.
That is the Pauli exclusion principle: no two identical fermions in the same state. Solid matter does not collapse because its electrons, protons and neutrons must "keep out of each other's way". Bosons show the opposite statistical tendency to bunch: at low temperature, Bose–Einstein condensation puts most particles in one state, behind superfluids, lasers, and superconductors (where electrons form Cooper pairs that act as bosons).
23.8 The quantum states of identical particles
In real space the wavefunction depends on positions u, v, … and discrete spin labels; bosons require ψ(u; v) = ψ(v; u), fermions ψ(u; v) = −ψ(v; u), with the spin label carried along in each swap. So two electrons can share an orbital if their spins are opposite, the rule behind chemistry's shell structure (§24.8).
In abstract-index form: distinguishable particles give ψαϕβ; identical bosons ψ(αϕβ) (symmetrised); identical fermions ψ[αϕβ] (antisymmetrised), and likewise for n particles. A ket version would use a wedge product |ψ⟩ ∧ |ϕ⟩ ∧ … with graded commutation. These states are technically entangled, but mildly: the superposed terms are physically indistinguishable, and they are the nearest thing to unentangled; general n-boson or n-fermion states Ψ(αβ…κ), Φ[αβ…κ] do not factorise at all.
Photons arriving at Earth from opposite sides of a star are boson-entangled, and their intensity correlations were used to measure stellar diameters. Distinguished physicists objected that "photons can only interfere with themselves"; they had missed that the "other" photons were part of a boson-entangled whole. The HBT effect is now a standard tool from astronomy to heavy-ion collisions.
23.9 Quantum teleportation
The no-cloning theorem (Wootters and Zurek 1982) forbids copying an unknown state. Penrose's proof sketch: if you could copy |↗⟩ once you could copy it repeatedly, building |↗↗…↗⟩, a large-spin state whose direction can be read classically, so you would have measured the state. But R only allows YES/NO questions ("is the spin along ↘?"), which return one bit and do not reveal the direction. Cloning would give more than R permits. It also means a Star Trek transporter that sends a true quantum state could never duplicate a person.
Classical signals alone cannot carry a quantum state, because classical signals can be copied. The trick is to "prepare the ground" first:
- Share an EPR pair. Five years ago my colleague and I each took one half of a spin-0 pair; mine stays on Earth, theirs goes to Titan, both shielded.
- Receive the unknown state. A friend hands me a spin-½ particle in unknown state |↙⟩.
- Bell measurement. I measure my friend's particle and my EPR particle jointly in the basis (0) |↑⟩|↓⟩ − |↓⟩|↑⟩, (1) |↑⟩|↑⟩ − |↓⟩|↓⟩, (2) |↑⟩|↑⟩ + |↓⟩|↓⟩, (3) |↑⟩|↓⟩ + |↓⟩|↑⟩, each outcome with probability ¼.
- Send 2 classical bits (00, 01, 10, 11) by radio.
- Correct. My colleague (0) leaves the particle alone, (1) rotates 180° about x, (2) 180° about y, (3) 180° about z. The particle is now in state |↙⟩; my friend's original no longer carries it.
Try it in Python: teleportation with Penrose's table
import numpy as np
u,d=np.array([1,0]),np.array([0,1]); k=np.kron
X=np.array([[0,1],[1,0]]);Y=np.array([[0,-1j],[1j,0]]);Z=np.diag([1,-1]);I=np.eye(2)
rng=np.random.default_rng(1); chi=rng.normal(size=2)+1j*rng.normal(size=2)
chi/=np.linalg.norm(chi)
state=k(chi,(k(u,d)-k(d,u))/np.sqrt(2)) # friend's, mine, Titan's
bell=[k(u,d)-k(d,u),k(u,u)-k(d,d),k(u,u)+k(d,d),k(u,d)+k(d,u)]
for n,(b,R) in enumerate(zip(bell,[I,X,Y,Z])):
titan=np.tensordot(b.conj()/np.sqrt(2),state.reshape(4,2),axes=(0,0))
p=np.linalg.norm(titan)**2; out=R@titan/np.sqrt(p)
print(n, round(p,3), round(abs(np.vdot(chi,out)),6))
# 0 0.25 1.0 / 1 0.25 1.0 / 2 0.25 1.0 / 3 0.25 1.0
Every outcome occurs a quarter of the time and every corrected state has fidelity 1 with the friend's.
The puzzle Penrose presses: 2 bits have conveyed a point on the whole Riemann sphere, which classically needs a continuum's worth of information, ℵ0 bits for perfect accuracy. Some say quantum states are "not real", but the spin direction is objective: a measurement along it on Titan gives YES with certainty, and whoever prepared it knows this. The only link wide enough is the path from my friend to me, back five years to the EPR source, then forward to Titan. Teleportation had been demonstrated over metres (Jennewein et al. 2002) when the book was written, and underpins quantum cryptography and much of quantum computation.
23.10 Quanglement
To keep "information" from implying signals, Penrose coins QUANGLEMENT for what others call quantum information.
Quanglement is not information. It cannot send a signal on its own, since its channels run into the past as readily as into the future; if it carried messages, it could message the past. It is constrained by light cones like ordinary links, but can zig-zag forward and backward in time to produce effective spacelike correlation. Combined with ordinary channels, it lets them do what classical signalling alone cannot: teleportation, quantum cryptography, quantum computing.
Parametric down-conversion: a laser photon in a non-linear crystal C splits into an entangled pair A, B whose momenta sum to the original's and whose polarisations are EPR-correlated. Photon A passes a shaped hole to detector DA; photon B passes a lens to a movable detector DB. Counting B only when A also fires, DB gradually builds an image of the hole that B never met (Shih et al. 1995, "ghost imaging"). The lens position is exactly where it would be if C were a mirror reflecting in time as well as space. A version built on the Elitzur–Vaidman interferometer makes it unambiguously quantum, since a classical pair source cannot fake it.
Relativity and R. In the Sun's frame, Titan's measurement comes first and reduces the state on Earth; for a fast observer O moving from Titan toward Earth, Earth measured first. The joint probabilities agree but the "story" of who reduced whose state does not, a conflict with relativity if R is a real process. The same fact proves no faster-than-light signalling: some frame always has the "receiver" go first, finding the entanglement already destroyed.
Penrose's quanglement view treats the two measurements symmetrically, linked by a correlation that is indifferent to time order and only constrains joint probabilities. He admits it says nothing about when R happens; he sees more promise in a connection with twistor theory (§33.2) and his gravitational-reduction ideas (§30.12).
Worked example: Bell's bound and Tsirelson's maximum
Use the CHSH form with the singlet, whose correlation for analyser angles a, b is E(a, b) = −cos(a − b). Choose a = 0°, c = 90° on the left and b = 45°, d = 135° on the right:
- E(a, b) = −cos 45° = −0.7071; E(a, d) = −cos 135° = +0.7071.
- E(c, b) = −cos 45° = −0.7071; E(c, d) = −cos 45° = −0.7071.
- CHSH = |E(a,b) − E(a,d)| + |E(c,b) + E(c,d)| = 1.4142 + 1.4142 = 2√2 ≈ 2.828.
Any local model is capped at 2; quantum mechanics reaches 2√2, Tsirelson's bound, and no physical theory obeying no-signalling has been found to exceed it in experiment. The Stapp numbers are the same physics: agreement 14.6% at 45° but 85.4% at 135°, against a local cap of 3 × 14.6% ≈ 44%.
A second calculation shows Penrose's "hugeness" concretely: 40 qubits need 240 ≈ 1.1 × 1012 complex amplitudes (about 17.6 terabytes at 16 bytes each), while 40 separate qubit states need only 80. Simulating 50 entangled qubits exactly already strains the largest supercomputers.
Test yourself
- Does teleportation move the particle? No; it moves the state, consuming one EPR pair and two classical bits; the original's state is destroyed by the Bell measurement, consistent with no-cloning.
- Why can entanglement not signal? Some frame always has the "receiver" measure first; the local statistics on either side are independent of the other side's setting.
- Why are identical-particle "entanglements" mild? The superposed terms are physically indistinguishable; they restrict states rather than enlarging them.
- Albert Einstein, Boris Podolsky, Nathan Rosen: the 1935 paradox.
- Erwin Schrödinger: named entanglement (1935).
- David Bohm: the spin version of EPR (1951).
- John S. Bell: the inequalities (1964).
- Henry Stapp: the probability argument used here (1971, 1979).
- Lucien Hardy: the nearly probability-free proof (1992–93).
- William Wootters, Wojciech Zurek: no-cloning (1982).
- Robert Hanbury Brown, Richard Twiss: photon correlations and star sizes.
- Yanhua Shih: down-conversion "ghost" imaging (1995).
- Tony Leggett: coined the "measurement paradox" framing Penrose adopts.
Penrose's magic dodecahedra
Penrose's notes point to his own Bell-type puzzle with Jason Zimba (1993), built on the Majorana picture: a pair of spin-3/2 particles in a particular entangled state, with each observer choosing among measurement directions given by the vertices of a dodecahedron. Certain outcomes are never obtained and others always, yet no assignment of pre-set answers to the dodecahedron's directions can respect all the "never" and "always" constraints: a Kochen–Specker style contradiction dressed as two "magic dodecahedra" that seem to know what the other was asked. It belongs to the family of "Bell inequalities without probabilities", alongside the GHZ (Greenberger–Horne–Zeilinger, 1989) three-particle argument, which Penrose does not discuss but which achieves an outright contradiction with local realism from a single run's perfect correlations.
Terms to know
| Term | Meaning |
|---|---|
| Tensor product ⊗ | Way independent systems combine; dimensions multiply |
| Entangled state | Element of ℋp ⊗ ℋq not of product form |
| Bell inequality | Constraint on joint statistics obeyed by any local, separable model |
| CHSH | ∣E(A,B) − E(A,D)∣ + ∣E(C,B) + E(C,D)∣ ≤ 2; quantum max 2√2 |
| Singlet ∣Ω⟩ | ∣↑⟩∣↓⟩ − ∣↓⟩∣↑⟩, spin 0, same form in every direction |
| Bell basis | Four maximally entangled two-qubit states |
| No-cloning | No process copies an unknown quantum state |
| Pauli exclusion | Two identical fermions cannot occupy the same state |
| Bose–Einstein condensate | Many bosons in a single state at low temperature |
| Quanglement | Penrose's term for quantum information: correlations, not signals |
Suppose a machine copied any unknown spin state. Make a million copies of |↗⟩ and you have a macroscopic gyroscope pointing along ↗: you could read the direction off with a protractor. Now apply this to one half of an EPR pair: my choice of measurement on Earth would decide which direction Titan's copies point, and reading them would be a faster-than-light signal. No-cloning is what keeps quantum theory and relativity on speaking terms.
- "Entanglement lets you send messages faster than light." It cannot; local statistics never depend on the distant setting.
- "Bell's theorem proves non-locality, full stop." It rules out local hidden variables; one may instead give up realism, measurement independence or single outcomes (many-worlds), each with costs.
- "Teleportation copies the object." The original state is destroyed; matter is not moved; two classical bits must travel at or below light speed.
2004 versus 2026
| Topic | In the book (2004) | By 2026 |
|---|---|---|
| Bell tests | Violations over 15 km; loopholes open | Loophole-free tests (2015); Nobel 2022 |
| Teleportation | Metres in the lab | Ground-to-satellite (Micius, 2017), metropolitan quantum networks |
| Exploiting ℋ2ⁿ | Quantum computing a hope | Below-threshold error correction (Willow, 2024); logical-qubit roadmaps |
| Quanglement | Penrose's new word | Unadopted; the field says quantum information |
Penrose's exercises for Chapter 23
The 11 exercises ask the reader to: derive the two Maxwell constraints (23.1); normalise |Ω⟩ and show it has spin 0 by antisymmetry in a 2-dimensional spin space (23.2–23.3); show the singlet cannot be written as a product of localised states, and find a factorisation if the states are not localised (23.4); verify |Ω⟩ ∝ |↙⟩|↗⟩ − |↗⟩|↙⟩ (23.5); derive Hardy's state, its orthogonality relations and the 1/12 probability (23.6–23.8); explain the boson and fermion counting formulas (23.9); confirm the teleportation rotations (23.10); and explain the ghost-imaging lens position (23.11).
Corrections and contested points. (1) The extracted text prints the singlet as "|↑⟩|↓⟩ − |↑⟩|↓⟩", which is zero; the correct form is |↑⟩|↓⟩ − |↓⟩|↑⟩. (2) The ghost-imaging experiment was done at the University of Maryland, Baltimore County (Shih's group), not "the University of Baltimore". (3) Quanglement never caught on; the field says quantum information, and most physicists read teleportation in terms of correlations plus classical communication without any backward-in-time channel. Retrocausal readings (Cramer's transactional interpretation, Aharonov's two-state vector formalism, Price) remain a respected minority. (4) Penrose's claim that Nature performs R objectively is his own view; decoherence theory offers the mainstream answer to "mystery 2", though it does not by itself select a single outcome.
Entanglement became engineering. 2015: three loophole-free Bell tests (Delft, Hensen et al.; Vienna, Giustina et al.; NIST, Shalm et al.). 2017: China's Micius satellite distributed entanglement over 1,203 km and teleported photon states from ground to orbit over up to 1,400 km. 2022 Nobel Prize in Physics: Aspect, Clauser and Zeilinger for entangled-photon experiments. 2024: Google's Willow chip showed surface-code error correction below threshold (logical error falling as the code grows), a milestone for exploiting the ℋ2ⁿ state space; Penrose's "hugeness" argument is now an engineering budget. Ghost imaging has become a field of its own.
For quantum-safe security planning, two facts from this chapter carry the weight: no-cloning makes eavesdropping on quantum keys detectable (QKD), and the exponential state space is why a large fault-tolerant quantum computer would break RSA and elliptic-curve cryptography. Banks' post-quantum migration (NIST's 2024 ML-KEM and ML-DSA standards) is the defensive response to the second.
Chapter 24 brings relativity in through Dirac's equation; Chapter 26 gives the field-theoretic origin of spin-statistics; Chapter 29 surveys interpretations of the measurement paradox; Chapter 30 presents Penrose's gravitational OR as the physical R; §33.2 links quanglement to twistors.
Dirac's Electron and Antiparticles
Joining quantum theory to special relativity forces two revolutions. Because E = mc² lets energy become matter, particle number cannot be fixed, so the theory must become a theory of fields. And the relativistic energy √(μ² + p²) threatens negative energies. Dirac's 1928 equation removes the square root by factorising the wave operator with Clifford algebra, and in doing so explains the electron's spin, predicts its magnetic moment, and, through the "Dirac sea", predicts the positron, found by Anderson in 1932.
24.1 The tension between quantum theory and relativity
Chapters 21–23 were frankly non-relativistic: one external time, many spatial coordinates. Combining quantum theory with special relativity (general relativity is a further, unsolved step) yields quantum field theory, whose successes culminate in the standard model (Chapter 25). Yet the tension "has never been fully resolved": most non-trivial QFTs are, strictly, mathematically inconsistent, and "tricks" are needed to extract finite answers. Whether those tricks are stop-gaps or "profound truths" about Nature is, for Penrose, a delicate judgement; much modern research treats them as fundamental, and he suspects Nature may be "a good deal less in sympathy" with some of these schemes.
24.2 Why antiparticles imply quantum fields
Take antiparticles as given for now. A particle and its antiparticle can annihilate, their mass converting into energy; conversely concentrated energy can create a pair. Mass-energy alone would not allow creating a single charged particle from energy, because charge (and baryon number, and other additive quantum numbers) is conserved. Creating a particle-antiparticle pair, with every additive quantum number reversed in the antiparticle, conserves them all.
- Rest mass is non-additive and identical for particle and antiparticle.
- Threshold: at least 2μc² of energy to create or released by annihilating a pair (more if they move).
- Additive quantum numbers (charge, baryon number, lepton number): sign-reversed in the antiparticle.
- Consequence: particle number is not conserved, so the theory must allow an unlimited number of particles.
In quantum theory, anything that can happen contributes to the state, so the mere possibility of pair creation is already present in the description. Hence a field theory, where particles are field excitations; but Penrose notes the Feynman-graph approach keeps a strongly particle-like picture with unlimited creation and destruction.
24.3 Energy positivity and positive frequency
For an energy eigenstate Hψ = Eψ, Schrödinger's equation gives ψ = C e−iEt/ħ. E must be positive: negative-energy states invite catastrophic instability (strictly, energy must be bounded below, after which a constant can be added; Exercise 24.2 notes such a shift is harmless except for gravity, which feels absolute energy). Positive E makes the exponent a negative multiple of i, which is what mathematicians call positive frequency.
Here a piece of pure mathematics from §9.3 turns physical. Wrap the real time line round the equator of the Riemann sphere: positive-frequency functions are those that extend holomorphically into the southern hemisphere. "Any self-respecting wavefunction" must be positive-frequency, so a geometric property of complex functions encodes the physical demand that energies be positive, which Penrose calls a wonderful instance of the mysterious fit between mathematics and nature.
For a free non-relativistic particle, H = p²/2μ is positive-definite (a sum of squares; quantum mechanically the eigenvalues of −∇² are non-negative, Exercise 24.3 via Green's theorem), so positive frequency comes for free.
24.4 The trouble with the relativistic energy
Relativistically E² − c²p² = (c²μ)², so the Hamiltonian should be H = √((c²μ)² + c²p²), which expands as c²μ + p²/2μ + …: the rest energy E = mc² plus the Newtonian kinetic term (the series diverges for p > μc). Setting c = 1, H = √(μ² + p²). Two difficulties:
- Square root of an operator. p² is really −ħ²∇², so H = √(μ² − ħ²∇²) is the square root of a partial differential operator; try giving a meaning to √(1 − d²/dx²) (Exercise 24.4 suggests Fourier transforms, series or contour integrals).
- The sign ambiguity. Complex square roots do not split globally into "positive" and "negative" (§5.4), and in quantum theory both roots are possibilities that contribute. Once negative energy is possible, transitions to it are possible, and instability threatens.
For free particles one can keep to positive-energy plane waves, but with interactions, even a single charged particle in a fixed electromagnetic field cannot keep its wavefunction positive-frequency. That is the first concrete face of the quantum-relativity tension.
24.5 Why ∂/∂t is not invariant, and the Klein–Gordon equation
Schrödinger's equation uses ∂/∂t, but in relativity time is not invariant; via E → iħ∂/∂t and p → −iħ∇ the non-invariance of ∂/∂t mirrors that of energy. The relativistic mass m (energy) is frame-dependent; the rest mass μ is invariant but non-additive and not conserved in particle transformations, so a poor Hamiltonian, and anyway μ = √(m² − p²), another square root.
Quantising μ² = m² − p² instead avoids the root and gives the wave operator (d'Alembertian)
□ = ∂²/∂t² − ∂²/∂x² − ∂²/∂y² − ∂²/∂z² (signature + − − −, c = 1),
and the invariant Klein–Gordon equation (□ + M²)ψ = 0, with M = μ/ħ. Schrödinger had written it down before his famous equation. In modern QFT it describes spinless mesons (pions, kaons). Dirac rejected it in 1928 because it is second order in time: he wanted a first-order equation so that the wavefunction could yield a positive-definite probability density, a requirement complementary to energy positivity (both feed into the CPT theorem, §25.4).
24.6 The Clifford–Dirac square root of the wave operator
Dirac's move: take the square root of □ itself, invariantly, by admitting non-commuting coefficients, acceptable in quantum mechanics because they act as operators on the wavefunction. He had rediscovered Clifford algebras (§11.5), apparently unaware that Clifford (1877) and before him Hamilton (c.1840s) had used them to factorise Laplacians. Hamilton's version: with quaternions i, j, k,
−(i∂/∂x + j∂/∂y + k∂/∂z)² = ∂²/∂x² + ∂²/∂y² + ∂²/∂z² (the 3-D Laplacian).
- Generators γ0, γ1, γ2, γ3 with γ0² = 1, γ1² = γ2² = γ3² = −1.
- Anticommutation: γiγj = −γjγi (i ≠ j); compactly γaγb + γbγa = 2gab.
- The square root: □ = (γ0∂/∂t + γ1∂/∂x + γ2∂/∂y + γ3∂/∂z)².
- Feynman slash: ∇̸ = γa∇a, so □ = ∇̸²; in general A̸ = γaAa.
- Size: no 2 × 2 matrices satisfy all the relations; 4 × 4 is the minimum (Exercise 24.9).
Note 24.10 flags a sign-convention clash: physicists' γs follow a convention opposite to the usual mathematicians' (and Penrose–Rindler's) for + − − − signature.
Try it in Python: checking Dirac's square root
import numpy as np
I2=np.eye(2); Z2=np.zeros((2,2))
s=[np.array([[0,1],[1,0]]),np.array([[0,-1j],[1j,0]]),np.diag([1,-1])]
g=[np.block([[I2,Z2],[Z2,-I2]])]+[np.block([[Z2,si],[-si,Z2]]) for si in s]
eta=np.diag([1,-1,-1,-1])
print(all(np.allclose(g[a]@g[b]+g[b]@g[a],2*eta[a,b]*np.eye(4))
for a in range(4) for b in range(4))) # True
E,p=5.0,np.array([3.0,0,0]); ps=E*g[0]-sum(p[i]*g[i+1] for i in range(3))
print(np.allclose(ps@ps,(E**2-p@p)*np.eye(4)), E**2-p@p) # True 16.0
For a plane wave the slashed momentum squares to E² − p² = μ² times the identity: the square root of the mass-shell condition, with no ± ambiguity in sight.
24.7 The Dirac equation
Factorise □ + M² = (∇̸ − iM)(∇̸ + iM). The Dirac equation is
∇̸ψ = −iMψ, i.e. iħγa∂aψ = μψ (with c = 1, sign conventions as Penrose's).
Any solution automatically satisfies the Klein–Gordon equation for rest mass ħM. (The "anti-Dirac" equation ∇̸ψ = +iMψ also does, but describes negative mass −ħM.) It is first order in ∂/∂t and can be cast as a Schrödinger equation with Hamiltonian iħγ0γ·∇ + γ0μ; singling out ∂/∂t is frame-dependent, but the full equation is Lorentz invariant, through a careful interplay of the γs with Lorentz transformations. Physicists were shocked: relativistically invariant objects exist outside the vector/tensor calculus; Dirac had launched spinor calculus (the word "spinor" came from Ehrenfest, in a letter to van der Waerden).
The γs need new degrees of freedom to act on; those degrees of freedom are the electron's spin. Since "a spinor is an object on which Clifford elements act", ψ is a spinor. The bargain grows:
- Spin ½, built in rather than bolted on.
- Electromagnetic coupling: adding the minimal gauge term (∇̸ → ∇̸ − ieA̸) gives the correct charged-particle behaviour, including subtle relativistic terms.
- Magnetic moment: the electron behaves as a magnet of strength eħ/2μc (the Bohr magneton, g = 2), within about one part in a thousand of experiment.
- The residue explained: the measured value exceeds Dirac's by the factor 1.0011596521…, a discrepancy accounted for by QED corrections, Dirac's equation being one of QED's ingredients.
The best modern determination differs from Dirac's original value by the multiplicative factor 1.001 159 652 1…, and even this small discrepancy is now explained.
Penrose, on the electron's magnetic moment24.8 Dirac's route to the positron
The puzzle: Dirac's ψ has four components, but a spin-½ particle has two spin states. History: Uhlenbeck and Goudsmit (1925) proposed electron spin; Pauli (1927) represented it by 2 × 2 Pauli matrices (quaternions times i, i.e. The 3-D rotation Clifford algebra) acting on 2-component spinors ψA = (ψ0, ψ1).
The need for exactly two spin states is chemistry's foundation: by the exclusion principle each orbital holds at most two electrons, with opposite spins, and covalent bonds are shared opposite-spin pairs. Dirac's 4 × 4 γs need 4-component ψ, yet there are still only two spin states: a first-order equation has half as many solutions as the second-order wave equation (which also admits the anti-Dirac, negative-mass solutions). The extra freedom hides the antiparticle, though Penrose warns it is misleading to say two components are "electron" and two are "positron" (§25.2 gives the subtler truth).
The negative-energy problem has not gone away: interactions still mix negative-frequency parts into an initially positive-frequency wave. Dirac's response was audacious.
- Danger. If unoccupied negative-energy states exist, electrons cascade into ever deeper ones, radiating without limit.
- Pauli to the rescue. Electrons obey exclusion; an occupied state cannot take another.
- The "crazy idea". All negative-energy states are already full: the Dirac sea. Nothing can fall in.
- Holes. An occasional empty negative-energy state behaves as a particle with positive energy and opposite charge.
- Annihilation. An electron dropping into a hole emits energy (photons): electron and hole annihilate.
- Creation. Enough energy kicks an electron out of the sea, leaving a hole: pair creation.
- 1928: Dirac publishes his equation.
- 1929: he cautiously suggests holes are protons, the only known positive massive particle.
- 1930–31: Igor Tamm, Hermann Weyl and J. Robert Oppenheimer show a hole must have the electron's mass, not the proton's (1836 times larger).
- 1931: Dirac predicts the antielectron.
- 1932: Carl Anderson finds the positron in cosmic-ray cloud-chamber tracks: the first antiparticle, predicted from the mathematics of a square root.
Worked example: numbers from Dirac's electron
- Pair-creation threshold. Creating an electron-positron pair needs at least 2mec² = 1.022 MeV, so gamma rays above this energy, passing near a nucleus (which absorbs the recoil momentum), can convert into pairs; a lone photon in empty space cannot, since energy and momentum could not both be conserved.
- Annihilation. An electron and positron at rest give two 511 keV photons, back to back: the signal used in every PET scanner.
- Zitterbewegung frequency. The zig-zag "trembling" has angular frequency 2mec²/ħ ≈ 1.55 × 1021 s−1 (about 2.5 × 1020 Hz) and amplitude of order the reduced Compton wavelength ħ/mec ≈ 3.9 × 10−13 m, far too fast and small to see directly, though it has been simulated with trapped ions (2010).
- Klein–Gordon check. A plane wave e−i(Et − p·x)/ħ satisfies (□ + M²)ψ = 0 exactly when E² = p²c² + μ²c⁴, with both signs of E allowed: the negative-energy problem in one line.
Test yourself
- Why does Dirac's ψ need four components but describe two spin states? A first-order equation halves the solution space; the other degrees of freedom belong to the antiparticle.
- What did Clifford algebra buy Dirac? A square root of □ without a ± ambiguity, spin ½, and the magnetic moment eħ/2μc.
- Why does gravity spoil "just add a constant to H"? Gravity responds to absolute energy, not differences.
- Paul Dirac: the equation (1928), holes (1929), the antielectron prediction (1931).
- Oskar Klein, Walter Gordon (and earlier Schrödinger): the relativistic scalar wave equation.
- William Rowan Hamilton: quaternion square root of the Laplacian (1840s).
- William Kingdon Clifford: the general algebras (1870s), unknown to Dirac.
- George Uhlenbeck, Samuel Goudsmit: electron spin (1925).
- Wolfgang Pauli: 2 × 2 spin matrices (1927), the exclusion principle.
- Igor Tamm, Hermann Weyl, J. Robert Oppenheimer: showed holes must have the electron's mass.
- Carl Anderson: discovered the positron (1932).
- Paul Ehrenfest: coined "spinor".
Terms to know
| Term | Meaning |
|---|---|
| Positive frequency | Time dependence e−iEt/ħ with E > 0; holomorphic in the lower half-plane |
| Wave operator □ | ∂t² − ∇²; the invariant Lorentzian Laplacian |
| Klein–Gordon equation | (□ + M²)ψ = 0; spinless relativistic particles |
| γ matrices | 4 × 4 Clifford generators with γaγb + γbγa = 2gab |
| Dirac operator ∇̸ | γa∇a, the square root of □ |
| Dirac spinor | 4-component wavefunction acted on by the γs |
| Bohr magneton | eħ/2μc, Dirac's predicted electron magnetic moment |
| Dirac sea | Filled negative-energy states; holes are positrons |
Imagine a staircase descending forever and a ball that emits a photon at each step down. Left alone, it falls forever, flooding the universe with radiation; that is a relativistic electron with unfilled negative-energy states. Dirac's trick is to fill every step below ground with balls, so the ball has nowhere to go. A missing ball in the filled region looks, from above, like an anti-ball of positive energy. The trick works only because electrons are fermions; for bosons there is no exclusion principle and no sea, which is one reason physics later replaced the sea with field theory.
- "Antimatter has negative mass or falls up." Its rest mass is positive, and antihydrogen falls down (ALPHA, 2023).
- "Two Dirac components are the electron, two the positron." Penrose warns this is misleading; the split is subtler and frame-dependent.
- "The Dirac sea is how physicists picture the vacuum today." It was replaced by quantum field theory's antiparticle creation operators.
2004 versus 2026
| Topic | In the book (2004) | By 2026 |
|---|---|---|
| Electron g − 2 | Agreement to about 10−11 | Measured to 0.13 ppt (2023); α measurements now disagree |
| Antimatter gravity | Untested | Antihydrogen falls down (2023) |
| Positron applications | Medical PET | PET plus positron annihilation spectroscopy for materials, routine |
| Zitterbewegung | Theoretical | Simulated with trapped ions (2010) and photonic lattices |
Penrose's exercises for Chapter 24
The 10 exercises ask the reader to: verify ψ = Ce−iEt/ħ (24.1); show adding a constant to H multiplies all solutions by a phase, harmless except for gravity (24.2); prove positivity of −∇² eigenvalues via Green's theorem derived from the fundamental theorem of exterior calculus (24.3); give a meaning to √(1 − d²/dx²) (24.4); check the Clifford factorisation of □ and the Schrödinger form of Dirac's equation (24.5–24.6); explain its Lorentz invariance (24.7); relate Pauli matrices to quaternions and Clifford elements (24.8); show 2 × 2 matrices cannot satisfy the Dirac relations and find 4 × 4 ones (24.9); and justify the gauge prescription (24.10).
Corrections and contested points. (1) The extracted text garbles the magnetic moment as "ħ2e/4µc"; the Dirac value is the Bohr magneton eħ/2μc (g = 2). (2) Calling the positron's 1932 detection "the next year after Dirac's prediction" is right, but Anderson was not looking for it and did not initially connect it to Dirac. (3) The Dirac sea is no longer the accepted picture: it fails for bosons (no exclusion principle) and implies an infinite negative charge density. Modern QFT reinterprets negative-frequency solutions as positive-energy antiparticles via creation operators (Chapter 26), which Penrose himself notes Zee treats rigorously. (4) Penrose's claim that non-trivial QFTs are "mathematically inconsistent" is strong; rigorous constructions exist in lower dimensions, though 4-D interacting theories (the Yang–Mills mass gap) remain unproved.
The electron's magnet, measured to 0.13 parts per trillion. In 2023 Gabrielse's group (Northwestern) measured the electron's anomaly ae = (g − 2)/2 = 0.00115965218059(13), the most precise property of any elementary particle. Comparing it with QED's 5-loop prediction now tests the fine-structure constant, and the two best atom-interferometry values of α (Berkeley caesium 2018, Paris rubidium 2020) disagree by about 5 standard deviations, an unresolved puzzle. Antimatter has gone from prediction to laboratory: CERN's ALPHA experiment showed in 2023 that antihydrogen falls down under gravity, as general relativity predicts.
Dirac's method is a model for design under constraints: he held two non-negotiable requirements (relativistic invariance, first order in time), refused to drop either, and accepted a new kind of object (matrices acting on extra components) to satisfy both. The extra structure then turned out to explain spin and predict antimatter. When two requirements clash in an architecture, adding the right new abstraction can beat compromising either one.
Chapter 25 rewrites Dirac's equation in 2-spinor "zig-zag" form and builds the standard model; Chapter 26 replaces the sea with quantum fields, creation operators and positive-frequency splitting, and explains spin-statistics; §33 uses positive frequency as the gateway to twistor theory.
The Standard Model of Particle Physics
Penrose tours the standard model through his own lens: the Dirac electron as a "zigzag" between two massless helicity components, the chiral weak interaction that couples only to the left-handed "zig", the C, P, T symmetries and their violations, electroweak unification under U(2) = SU(2) × U(1)/ℤ2 broken by the Higgs field, and QCD, the exact SU(3) colour gauge theory of quarks and gluons. He admires its precision but calls it plainly "not the ultimate answer": about 17 free parameters, three unexplained generations, and a gauge group (SU(2)) that is supposed to be a symmetry yet is severely broken.
25.1 Origins: from three particles to a zoo
In 1928 science knew three particles: electron, proton, photon. The photon's quantum theory came from Einstein (1905), Bose and others, made systematic by Jordan and Pauli (1927); electron and proton seemed to obey Dirac's equation; their electromagnetic interaction followed Weyl's 1918 gauge idea; and Dirac began quantum electrodynamics in 1927. Nobody sensible expected a theory of everything, because two forces were missing:
- Strong force. Without it, every nucleus except hydrogen's would fly apart under electrostatic repulsion. Chadwick's neutron (1932) replaced the proton-electron nuclear model with protons plus neutrons bound by a strong force.
- Weak force. Behind Becquerel's radioactivity (1896) and the decay of the free neutron (about 15 minutes). It produces the neutrino, proposed by Pauli around 1929–30 and detected in 1956.
- 1932: neutron (Chadwick), positron (Anderson).
- 1934: Yukawa predicts the pion; Powell finds it in cosmic-ray tracks in 1947.
- 1955–56: antiproton, then antineutron.
- 1961: Gell-Mann and Ne'eman organise hadrons by SU(3) ("eightfold way").
- 1962–64: the Ω− predicted, then found.
- 1963: Zweig and Gell-Mann propose quarks.
- 1983: W and Z bosons found at CERN.
- 2004 (writing): Higgs "still unobserved", though in some form essential; speculative extras (X-bosons, axions, photinos, squarks, gluinos, monopoles, dilatons) are not implied by accepted theory.
25.2 The zigzag picture of the electron
In 2-spinor form a Dirac spinor is a pair ψ = (αA, βA′), one unprimed and one primed 2-spinor (Weyl introduced 2-spinors in 1929). The Dirac equation becomes two coupled equations, ∇AA′αA = 2−1/2MβA′ and ∇AA′βA′ = 2−1/2MαA: each is the source of the other, with the mass as coupling constant.
Penrose's picture: a massive electron is a massless left-handed "zig" (αA, helicity −½) continually converting into a massless right-handed "zag" (βA′, helicity +½) and back, each travelling at light speed, the forward motion of one becoming the backward motion of the other. The average flipping rate is the electron's de Broglie frequency, and the jiggle is the zitterbewegung (Schrödinger 1930): the instantaneous velocity of a Dirac electron is always measured as c, though its average is slower. The spin direction stays constant in the rest frame while the velocity reverses.
The full propagator is the sum over all zigzags of every length, a 2 × 2 matrix of Feynman-graph series. Penrose stresses that a Feynman graph is one component of a vast superposition: the electron does not "really" follow one zigzag; its behaviour is the superposition of all of them, plus every interaction with photons.
Penrose's 2-spinors
- αA, the "zig" particle.
- βA′, the "zag" particle.
- Zigzag picture suggested naturally; Penrose thinks QED would be "significantly simpler" in 2-spinors.
Physicists' 4-spinors
- (1 − γ5)ψ, "left-handed part".
- (1 + γ5)ψ, "right-handed part".
- γ5 = −iγ0γ1γ2γ3, anticommuting with all γs, γ5² = 1. Standard practice.
Are zigs and zags real? Penrose: as real as the Dirac electron itself, an idealised mathematical description of a basic ingredient of the world, a question deferred to §34.6.
25.3 Electroweak interactions and mirror asymmetry
Zig and zag carry the same charge (charge is conserved through each flip), and the photon couples equally to both. The weak interaction does not: only the zig (left-handed part) of a particle couples to the W and Z bosons; for antiparticles, only the zag.
Weak processes include β decay: U-238 α-decays to thorium in billions of years (half-life about 4.5 × 109 years), and a free neutron decays to proton + electron + antineutrino in about 15 minutes. Fermi's 1933 theory treated this as a point interaction; theoretical trouble was resolved by the electroweak theory of Weinberg, Salam, Ward and Glashow, in which a massive W boson mediates the decay.
Tsung Dao Lee and Chen Ning Yang (1956) proposed that weak interactions are not mirror-symmetric. Chien-Shiung Wu and colleagues confirmed it in January 1957: electrons from polarised cobalt-60 nuclei came out preferentially opposite to the nuclear spin, a pattern whose mirror image never occurs. It was the first reflection-asymmetric basic process ever seen. In zigzag terms the mirror swaps zig and zag, and only zigs feel the weak force.
Neutrons and protons approximately obey Dirac's equation, so the zigzag picture applies to them, and more fundamentally to their three quarks each. Neutrinos: set M = 0 and the equations decouple into two Weyl equations; only the zig version takes part in weak interactions, so neutrinos are left-handed (antineutrinos right-handed). Pauli had objected vehemently to Weyl's 1929 equation because it is not mirror-invariant; Weyl died in 1955, a year before the parity proposal vindicated him.
Do neutrinos have mass? Super-Kamiokande showed neutrino oscillations (flavours νe, νμ, ντ turning into each other), impossible with zero masses, though the mass differences are tiny (around 10−7 electron masses). A slightly massive neutrino is mostly zig with occasional momentary zag flips; in its own rest frame zig and zag contribute equally.
Antiparticles are just as much particles; the Dirac-sea asymmetry is an artefact. Bosons have antiparticles too (π+ and π−), and some are their own antiparticles (photon, π0). Every known particle has an antiparticle.
25.4 C, P, T and crossing
- C (charge conjugation). Replace every particle by its antiparticle.
- P (parity). Mirror reflection; swaps zig and zag.
- T (time reversal). Run the process backwards.
- Weak interactions violate C and P separately but (ordinarily) respect CP, a mirror that also swaps particle and antiparticle (zig ↔ anti-zag).
- CPT theorem. Every QFT interaction is invariant under all three together. It is "just a piece of mathematics", valid only as far as its assumptions; Penrose will question them in §30.2.
- CP violation. Fitch and Cronin (1964): neutral K0 decays violate CP (and hence T), while respecting CPT, amid K0 ↔ K̄0 oscillation.
CPT gives a better account of antiparticles than the sea, valid for bosons too: if C = PT, an antiparticle is the particle's spacetime reflection, i.e. (ignoring P) the particle travelling backwards in time, Feynman's interpretation, suggested by Wheeler and earlier by Stückelberg (1942), "just as 'crazy' an idea as was Dirac's sea". In Feynman graphs, a particle line's arrow pointing to the past is the antiparticle. Then very different processes are one process seen from different angles: crossing symmetry relates e⁺e⁻ → 2γ annihilation to Compton scattering, by analytic continuation.
To decide whether a spin-½ entity's zig or zag feels the weak force we need a convention: leptons (e, μ, τ and their neutrinos) and quarks count as particles; their antis as antiparticles. The weak bosons are W+, W− (charges ±1, antiparticles of each other) and neutral Z0 (its own antiparticle). Their lines attach to the zig of a lepton or quark or the zag of an antilepton or antiquark. Conserved throughout: electric charge and three separate lepton numbers (electron, muon, tauon), checkable by following four kinds of arrow continuously through a diagram.
25.5 The electroweak symmetry group
Weak and electromagnetic interactions unify under SU(2) × U(1), more precisely U(2) (Note 25.12: "SU(2) × U(1)/ℤ2" is ambiguous because there is more than one ℤ2; U(2) picks the right one). The apparent asymmetries look fatal: electromagnetism is mirror-symmetric, weak forces maximally not; the photon is massless (mass below 10−20 of the electron's, so below about 5 × 10−26 of the W/Z mass) while W and Z are heavy; W's are charged but the photon carries no weak charge. The non-Abelian group allows three-boson vertices (only two types exist), which pure electromagnetism, being Abelian, lacks.
Picture a 2 × 2 Hermitian matrix: the two real diagonal entries are like Z0 and γ (each its own antiparticle, unarrowed lines), and the two complex-conjugate off-diagonal entries are like W+ and W− (antiparticles of each other). A U(2) transformation, H ↦ UHU−1, churns the entries but keeps the matrix Hermitian. The physical photon and Z are particular mixtures of the diagonal entries (with the trace), fixed by the Weinberg angle.
Which superpositions appear as free particles? Those that are eigenstates of mass, and mass breaks the symmetry. The standard story is spontaneous symmetry breaking: at temperatures above about 1016 K, before roughly 10−12 s after the Big Bang, U(2) was exact and all four bosons massless and interchangeable; on cooling, the particular W+, W−, Z0 and γ "froze out", three acquiring mass. The agent is the Higgs field. In zigzag terms, the Higgs field replaces the mass coupling constant at each zig-zag vertex; when it settles to a constant value everywhere, it sets the overall mass scale, each particle's mass being that scale times its own coupling.
- Predicted: existence of Z0 (W± already expected), masses about 80 GeV and 90 GeV.
- Observed: W and Z at CERN, 1983; Penrose quotes modern values of about 81.4 and 91.2 GeV (see Critical Lens).
- Weinberg angle: independent measurements agree closely, among the most impressive confirmations.
- Nobel: Glashow, Salam, Weinberg (1979).
- 1 GeV = 109 electron-volts; 1 eV ≈ 1.6 × 10−19 J.
25.6 Strongly interacting particles
Quantum chromodynamics (QCD) is the other half of the standard model. Hadrons ("bulky") feel the strong force; they comprise baryons ("heavy", spin-½ and 3/2 fermions: nucleons and hyperons) and mesons (bosons: pions, kaons, …). Leptons ("small") do not feel the strong force, which is roughly why they are lighter, though the tauon is almost twice the proton's mass. Since the late 1940s hundreds of hadrons, plus higher-spin Regge recurrences, were found; they fell into multiplets forming representations of SU(3)/ℤ3 (Gell-Mann, Ne'eman 1961), ℤ3 being the cube roots of unity times the identity.
The explanation: quarks (Zweig, Gell-Mann 1963), spin ½, in three flavours with fractional charges: up +2/3, down −1/3, strange −1/3. Baryons = 3 quarks, mesons = quark + antiquark. Because quarks are never seen free and their charges looked implausible, they were first regarded as bookkeeping, and the bookkeeping worked only if quarks obeyed the wrong statistics, as if they were bosons.
| Row | Quark content | Charges | Particles |
|---|---|---|---|
| No s | uuu, uud, udd, ddd | +2, +1, 0, −1 | Δ++, Δ+, Δ0, Δ− |
| One s | uus, uds, dds | +1, 0, −1 | Σ∗+, Σ∗0, Σ∗− |
| Two s | uss, dss | 0, −1 | Ξ∗0, Ξ∗− |
| Three s | sss | −1 | Ω− |
Try it in Python: the decuplet is the symmetric 3-quark states
from itertools import combinations_with_replacement as cwr
from fractions import Fraction as F
q={'u':F(2,3),'d':F(-1,3),'s':F(-1,3)}
dec=[''.join(c) for c in cwr('uds',3)]
print(len(dec), {c:str(sum(q[x] for x in c)) for c in dec})
# 10 {'uuu':'2','uud':'1','uus':'1','udd':'0','uds':'0','uss':'0','ddd':'-1','dds':'-1','dss':'-1','sss':'-1'}
Exactly 10 symmetric combinations, with the right charges. Spin 3/2 means all three quark spins aligned, so the spin part is symmetric too; states such as uuu would vanish for antisymmetric (fermionic) quarks. That is the statistics paradox. The spin-½ octet (N+ = proton, N0 = neutron, Σ±,0, Λ0, Ξ0,−) works similarly with two spins parallel and one antiparallel: two independent states for uds (Σ0 and Λ0 share the centre), none for uuu, ddd, sss (hence a hexagon, not a triangle), one for each other combination.
25.7 Coloured quarks and QCD
The fix (Han and Nambu 1965): every flavour comes in three colours, and every observable particle is totally antisymmetric in colour. Antisymmetry in colour turns the required fermionic antisymmetry into symmetry in the remaining labels. Free particles are colour-neutral; colour is never directly seen.
Penrose dislikes "red, white, blue" (white is not a colour, and it smacks of "misplaced patriotism") and uses red, yellow, blue, so that "orange, green, purple" superpositions are equally good bases: the symmetry is a full 8-dimensional SU(3), not just permutations. With six flavours (d, u, s plus charm, bottom, top) in three colours there are 18 quarks, none directly observable.
The pay-off for this apparent extravagance: because colour SU(3) is exact and unobservable, it can serve as a gauge group, just as exact U(1) underlies electromagnetism. The generalisation of electromagnetism to a non-Abelian group is Yang–Mills theory (Yang and Mills 1954; anticipated by Pauli, who rejected it because the gauge bosons must be massless, and by Ronald Shaw 1955). QCD replaces ∂/∂xa − ieAa with a 3 × 3-matrix-valued covariant derivative, a bundle connection (§15.8).
The QCD gauge bosons are gluons. Because SU(3) is non-Abelian, gluons themselves carry colour charge, so three- and four-gluon vertices exist, the root of confinement and of the strong force's behaviour. SU(3) has shifted role: from flavour symmetry (1960s–70s, approximate) to colour symmetry (exact). Flavours now form three generations of doublets, (d, u), (s, c), (b, t), matched by three lepton generations (e, μ, τ with neutrinos).
| Generation | Quarks (charge +2/3, −1/3) | Leptons (charge 0, −1) | Notes |
|---|---|---|---|
| 1 | up, down | νe, electron | Everything in ordinary matter |
| 2 | charm, strange | νμ, muon | Strange quarks behind kaons and hyperons |
| 3 | top, bottom | ντ, tauon | Top found 1995; tauon ≈ 1.9 proton masses |
| Bosons | gluons (8), W±, Z0, photon | Higgs | Gauge group SU(3) × SU(2) × U(1)/ℤ6 |
Mixing angles tie the sectors together. Penrose's example: the K0, produced as a strong-interaction eigenstate, decays weakly as a combination of KL (three pions, about 5 × 10−8 s) and KS (two pions, about 10−10 s). He associates this rotation with the Cabibbo angle (which he gives as about 0.26 rad). The Weinberg (weak mixing) angle relates weak and electromagnetic interactions and is viewed as "frozen in" at electroweak symmetry breaking, whereas the Cabibbo angle has no such status because the standard model does not unify strong and electroweak forces.
25.8 Beyond the standard model?
To put the Cabibbo angle on the same footing one needs a grand unified theory (GUT) containing SU(3) and U(2) in a larger group: SU(5), SO(10) or E8 are the main candidates, none accepted (string theory's view comes in §31.14; GUT cosmology in §28.2).
- About 17 free parameters (masses, mixing angles) taken from experiment.
- Asymmetric treatment: colour SU(3) exact, electroweak U(2) severely broken.
- Gauge-group puzzle: a gauge connection presupposes an exact symmetry on the fibres (§15.8), so how can a badly broken SU(2) be a gauge group? The conventional answer, "it was exact in the early universe", has implications he finds unpleasant (Chapter 28).
He describes with evident sympathy the Chan Hong-Mo and Tsou Sheung Tsun (2002) "dualized standard model": every non-Abelian symmetry has a dual group, the same abstract group playing the opposite role, as the dual Maxwell tensor ⋆F plays to F (non-Abelian duality needs path-dependent quantities). One member of each pair is exact (and confining), the other broken. A new exact SU(2), dual to electroweak SU(2), would confine heavy "2-coloured" constituents of leptons; the broken SU(3) dual to colour would be the puzzling SU(3) of the three generations. The scheme computes 14 of the ~17 parameters from 3. Penrose: "a definite step forwards, provided that the predictions … are borne out" (and it fits his twistor hopes, §33.13).
Worked example: three standard-model numbers
- Neutron β decay energy. mn − mp − me = 939.565 − 938.272 − 0.511 = 0.782 MeV, shared between electron and antineutrino; the electron's spread of energies (rather than a single line) is what led Pauli to propose the neutrino.
- Weinberg angle from masses. At tree level mW = mZ cos θW. With mW ≈ 80.37 GeV and mZ ≈ 91.19 GeV, cos θW ≈ 0.881, so sin²θW ≈ 0.223, agreeing with values from neutrino scattering and Z decays: the "independent determinations agree" that Penrose cites.
- Quark charges of the proton. uud: 2/3 + 2/3 − 1/3 = +1; neutron udd: 2/3 − 1/3 − 1/3 = 0. Yet the proton's mass (938 MeV) is about 100 times the sum of its up and down quark masses (≈ 9 MeV): almost all visible mass is QCD binding energy, not Higgs-given mass.
Test yourself
- Why does only the zig feel the weak force? Weak interactions are maximally parity-violating; a mirror swaps zig and zag, and nature's weak bosons couple only to left-handed particles (right-handed antiparticles).
- What problem did colour solve? The wrong statistics of quarks in states like Δ++ = uuu; colour antisymmetry restores Fermi statistics, and exact colour SU(3) became the QCD gauge group.
- What is Penrose's main complaint? About 17 (in fact 19) free parameters and a gauge SU(2) that is badly broken.
- Hideki Yukawa: meson theory of nuclear forces (1934).
- Enrico Fermi: point-interaction theory of β decay (1933).
- Tsung Dao Lee, Chen Ning Yang, Chien-Shiung Wu: parity violation (1956–57).
- James Cronin, Val Fitch: CP violation (1964).
- Murray Gell-Mann, Yuval Ne'eman, George Zweig: SU(3) and quarks (1961–63).
- Moo-Young Han, Yoichiro Nambu: colour (1965).
- Chen Ning Yang, Robert Mills (and Ronald Shaw): non-Abelian gauge theory (1954–55).
- Sheldon Glashow, Abdus Salam, Steven Weinberg, John Ward: electroweak unification.
- Peter Higgs (with Englert, Brout and others): mass via symmetry breaking.
- Chan Hong-Mo, Tsou Sheung Tsun: the dualized standard model Penrose favours.
Two notes extend the zigzag picture. A massive spin-1 particle such as the W or Z has three ingredients: a helicity +1 "zig", a helicity −1 "zag" and a non-spinning helicity-0 "zog"; Penrose suggests it is the zog that mediates the weak interaction (Note 25.11), the longitudinal mode that in standard language the W and Z "eat" from the Higgs field. And a massive neutrino could be Majorana (its own antiparticle) or Dirac; the search for neutrinoless double β decay, which only Majorana neutrinos allow, continues in 2026 with no signal yet.
Terms to know
| Term | Meaning |
|---|---|
| Zig / zag | Left- / right-handed massless 2-spinor parts of a Dirac particle |
| Chirality | Handedness; the weak force couples to left-handed particles only |
| Zitterbewegung | Rapid light-speed "trembling" of a Dirac particle |
| CPT theorem | Combined C, P, T is an exact symmetry of local relativistic QFT |
| Crossing symmetry | Processes differing by time ordering are analytic continuations of each other |
| Hadron / baryon / meson / lepton | Strongly interacting / 3-quark / quark-antiquark / non-strongly-interacting |
| Flavour / colour | Quark type (u, d, s, c, b, t) / exact SU(3) charge |
| Yang–Mills theory | Gauge theory with a non-Abelian group |
| Weinberg angle | Mixing between the neutral electroweak bosons |
| Cabibbo angle | Mixing between d and s quarks in weak interactions |
| GUT | Grand unified theory joining SU(3) with SU(2) × U(1) |
How would you tell an alien civilisation, by radio alone, which hand you call "left"? Before 1957 it was impossible: every law was mirror-symmetric. After Wu, there is a recipe: "Align cobalt-60 nuclei with a current loop and look from the side where fewer β electrons emerge; the sense in which the current then circulates defines your handedness." But if the aliens are made of antimatter, CP symmetry reverses the answer, and only CP violation in kaon decays (Fitch–Cronin) lets you settle "left" and "matter" unambiguously, a puzzle Feynman liked to pose.
- "The Higgs gives all mass." It gives the elementary masses; about 99% of the proton's mass is QCD binding energy.
- "Quarks are just bookkeeping." That was the 1960s view; deep inelastic scattering (SLAC, 1968) and jets showed point-like constituents.
- "Parity violation means nature has no symmetry." CPT survives, and CP was only discovered broken in rare kaon decays.
2004 versus 2026
| Topic | In the book (2004) | By 2026 |
|---|---|---|
| Higgs boson | "Still unobserved" | Found 2012 at 125 GeV; couplings match the SM |
| Neutrino masses | Oscillations seen; scale unknown | KATRIN < 0.45 eV (2025); ordering still open; DUNE and JUNO running or coming |
| Exotic hadrons | Mesons and baryons only | Tetraquarks and pentaquarks confirmed (LHCb, 2015 onward) |
| New physics hints | Muon g − 2 tension | Resolved by 2025 lattice results; no SUSY at the LHC |
Penrose's exercises for Chapter 25
The 9 exercises ask the reader to: use Weyl's equation to justify reading αA, βA′ as coupled massless particles (25.1); prove γ5 anticommutes with all γs and squares to 1 (25.2); find the ℤ3 normal subgroup of SU(3) via determinants (25.3); check the decuplet charges (25.4); explain decuplet and octet counting with 2-spinor and SU(3)-flavour indices, including why the octet is a hexagon with a doubled centre (25.5–25.6); use a colour index to show colour antisymmetry yields effective symmetry (25.7–25.8); and see why non-Abelian dual curvatures cannot simply be bundle curvatures (25.9).
Errors and dated claims. (1) The modern W mass is about 80.4 GeV, not "81.4 GeV" (Z: 91.19 GeV is right). (2) The KL/KS split is K0–K̄0 mixing into CP eigenstates; it is not governed by the Cabibbo angle, which describes d–s quark mixing in charged weak currents and is about 13° (0.227 rad), not 0.26. (3) Standard counts give 19 free parameters (26 or more with neutrino masses), not "about 17". (4) Electroweak symmetry breaking occurs at about 1015 K (≈ 100 GeV), at roughly 10−11 to 10−12 s. (5) The Chan–Tsou dualized model has not gained traction; its predictions have not been confirmed. (6) Penrose's "broken gauge group" worry is answered in mainstream physics by noting the gauge symmetry is never broken, only hidden by the Higgs vacuum (gauge symmetry being a redundancy of description), a reading he would contest.
The Higgs found, the model unbroken. On 4 July 2012 ATLAS and CMS announced a Higgs boson near 125 GeV; Englert and Higgs won the 2013 Nobel. Its couplings to W, Z, top, bottom, τ and (2025) evidence for muons all match the standard model so far. Neutrino oscillations won the 2015 Nobel (Kajita, McDonald); KATRIN (2025) caps the electron-neutrino mass at 0.45 eV (under 10−6 of the electron's). CDF's 2022 heavy-W anomaly (80,433 MeV) was not confirmed by ATLAS (2024) or CMS (2024: 80,360 MeV). Fermilab's final muon g − 2 result (June 2025), 127 parts per billion, agrees with the 2025 lattice-QCD-based prediction, dissolving a long-advertised hint of new physics. LHC Run 3 at 13.6 TeV has found no supersymmetric particles, and LHCb has added tetraquarks and pentaquarks to the hadron zoo.
The standard model is a superb reference architecture with documented "technical debt": 19 hand-set parameters, three copies of one generation with no stated reason, and a symmetry layer (SU(2)) that is formally present but operationally overridden. Penrose's critique is what a good architecture review does: it praises the predictive accuracy and still flags the undocumented assumptions that will block the next major version.
Chapter 26 supplies the QFT machinery (Fock space, Feynman graphs, renormalisation, the Higgs mechanism in §26.11); Chapter 28 asks what symmetry breaking in the early universe implies; Chapter 31 tests supersymmetry and strings against the model's ragged edges; §33.13 returns to Chan–Tsou in a twistor setting.
Quantum Field Theory
Quantum field theory is the framework under the standard model and almost every attempt to go deeper. Penrose builds it from creation and annihilation operators acting on a vacuum, shows that positive-frequency splitting is what makes a classical field quantum, explains antiparticles and the startling idea of inequivalent vacua, and then follows Feynman from path integrals to Feynman graphs and renormalization. His verdict is double-edged: QFT is "magnificent, profound, difficult, sometimes phenomenally accurate, and yet often tantalizingly inconsistent", and its most powerful trick, an exact symmetry hidden by an asymmetric vacuum, deserves "a critical and sceptical eye".
26.1 The fundamental status of QFT
QFT descends from Dirac, with early work by Jordan, Heisenberg and Pauli, but at first gave ∞ for almost every question. Bethe, Tomonaga, Dyson, Schwinger and above all Feynman made it workable for renormalizable theories; Ward, Weinberg, Salam, Wilson, Veltman and 't Hooft shaped the class of renormalizable theories that became the standard model. Penrose notes wryly that the consistency requirements are so tight that agreement with experiment can seem "almost incidental".
Most physicists hold that QFT is "here to stay" and blame inconsistencies (divergent integrals and sums) on the particular Lagrangian used, not on QFT itself. Many hope gravity will supply a natural short-distance cut-off; Penrose instead suspects that QFT itself may need modifying once general relativity is properly included (Chapter 30).
26.2 Creation and annihilation operators
The misnamed "second quantization" turns a one-particle wavefunction ψ into an operator Ψ that creates a particle with wavefunction ψ, acting on whatever state stands to its right, ultimately a shadowy vacuum |0⟩ with no particles. ΨΦ…Θ|0⟩ adds particles with wavefunctions θ, …, ϕ, ψ. (Standard texts write a† for creation and a for annihilation, usually in momentum states.)
- Fermions (Pauli principle). Ψ² = 0 and ΨΦ = −ΦΨ: you cannot add the same fermion twice.
- Bosons. ΘΞ = ΞΘ: creation operators commute.
- Grassmann structure. Creation operators form a graded Grassmann algebra (§11.6): fermion operators odd, boson operators even.
- Positive frequency. Only positive-frequency wavefunctions may be created (§24.3).
- Annihilation. The Hermitian conjugate Ψ∗ removes a particle; on the vacuum, Ψ∗|0⟩ = 0.
- Mixed rule. Ψ∗Φ ± ΦΨ∗ = ik⟨ψ∣ϕ⟩I (+ for fermions, − for bosons; ik a spin-dependent phase); ΨΦ ± ΦΨ = 0 and Ψ∗Φ∗ ± Φ∗Ψ∗ = 0.
An annihilation operator does not simply delete "the ψ particle"; it forms a scalar product with the relevant part of the state, so Ψ∗ΦΘ|0⟩ can be non-zero even if neither ϕ nor θ equals ψ. The spin-statistics theorem fixes which rule applies: anticommutation for half-odd-integer spin, commutation for integer spin; Penrose traces it to energy positivity for fermions and particle-number positivity for bosons, plus spinor combinatorics (with intriguing topological links between particle exchange and 2π rotation).
Try it in Python: Pauli's rule as operator algebra
import numpy as np
c=np.array([[0,0],[1,0]]); Z=np.diag([1,-1]); I=np.eye(2)
A1=np.kron(c,I); A2=np.kron(Z,c) # create a fermion in mode 1 or mode 2
anti=lambda X,Y: X@Y+Y@X
print(np.allclose(A1@A1,0), np.allclose(anti(A1,A2),0)) # True True
print(np.allclose(anti(A1.conj().T,A1),np.eye(4)), np.allclose(anti(A1.conj().T,A2),0)) # True True
A 4-dimensional Fock space of two fermion modes already shows Ψ² = 0, ΨΦ = −ΦΨ and the mixed rule Ψ∗Ψ + ΨΨ∗ = I.
26.3 Infinite-dimensional algebras and the complex structure J
For fermions the anticommutation rules are exactly those of a Clifford algebra (§11.5), but infinite-dimensional, since the space of one-particle wavefunctions is infinite-dimensional, and infinite dimensions can behave very differently. QFT also uses infinite-dimensional versions of Hermitian forms, symmetric (pseudo-orthogonal) and antisymmetric (symplectic) forms, and complex structures.
The decisive structure in passing from a classical to a quantum field is a complex structure J. Take the real vector space F of free Maxwell solutions; split each into positive- and negative-frequency parts, F = F+ + F−, and define J(F) = iF+ − iF−, so J² = −1. Its +i eigenspace is exactly the positive-frequency fields, the one-photon wavefunctions that creation operators insert. Quantizing a field is, at bottom, choosing how to make its real solution space complex. For non-linear (self-interacting) fields such as general relativity, this construction runs into profound difficulty.
A normalising scalar product exists: an integral over any spacelike 3-surface of field components times potential components.
26.4 Antiparticles in QFT
Whether a particle is its own antiparticle depends on whether complex conjugation of its classical field gives the same kind of quantity. Complex (charged) fields have distinct antiparticles; but charge is not the whole story: the neutral K0 differs from K̄0, while the neutral π0 is its own antiparticle, both being real scalar fields classically. A massive neutrino could be a Majorana spinor (its own antiparticle, the neutrino's zig being the antineutrino's zag), though the 2004 consensus was that neutrinos differ from antineutrinos.
For a negative-frequency ϕ, its conjugate ϕ̄ is a positive-frequency wavefunction of different type: an antiparticle, created by Φ̄ and annihilated by Φ̄∗. Penrose then connects to Dirac: take as "vacuum" the filled sea |Σ⟩. One positron is Φ∗|Σ⟩ (remove the negative-energy state ϕ); with the empty vacuum it is Φ̄|0⟩ (add a positron). Both insert the same Hilbert-space vector; they differ only in how it acts on the chosen vacuum, which is part of what the vacuum means.
26.5 Alternative vacua
Let 𝒜 be the algebra of all (convergent) expressions in creation and annihilation operators. Two candidate vacua |0⟩ and |Σ⟩ may be such that no element of 𝒜 turns one into the other. Then they live in different Hilbert spaces, and cross terms like ⟨Σ|A|0⟩ are infinite or meaningless: no single consistent quantum theory contains both.
The choice of vacuum is as fundamental as the choice of dynamics. For free electrons, |0⟩ and |Σ⟩ are effectively equivalent once one moves the "zero of charge", but only by renormalizing the sea's infinite negative charge (and infinite negative mass, which would gravitate) to zero. Penrose's point: both features, inequivalent vacua and infinite renormalization, are not quirks of Dirac's sea; they are ubiquitous in present-day realistic theories, and the standard model depends on both.
26.6 Interactions: Lagrangians and path integrals
Free fields are trouble-free: states with any number of particles form Fock space (after V. A. Fock), a direct sum of n-particle Hilbert spaces (for a self-conjugate boson, ℂ ⊕ ℋ ⊕ (ℋ ⊙ ℋ) ⊕ …). Coherent states, built by exponentiating a field operator, are the most classical-like field states and contain unlimited particle numbers. Field operators do not commute (e.g. The magnetic field B and potential A satisfy canonical commutation relations), so uncertainty relations apply to fields.
Interactions need the Lagrangian, which (unlike the Hamiltonian) can be fully relativistically invariant. The idea is Dirac's, carried through by Feynman: the path integral or sum over histories. Superposition is applied to entire histories: each path in configuration space from a to b gets the amplitude
amplitude ∝ eiS/ħ, S = ∫ L dt (the classical action),
and the total amplitude is the "sum" over all paths. For a particle the paths need not be smooth, need not respect light cones, and may even wander backwards in time (Exercise 26.8: read that as pair creation and annihilation).
- Far from stationary action. Neighbouring paths have very different S (in units of ħ), so their phases eiS/ħ point all around the clock and cancel.
- Near stationary action. S barely changes, phases line up and reinforce.
- Result. The classical path (Hamilton's principle, §20.1) dominates; nearly classical paths give quantum corrections, often measurable.
- Fields. The same holds with "paths" replaced by entire 4-D field configurations.
Try it in Python: stationary phase picks the classical path
import numpy as np
x=np.linspace(-3,3,200001); dx=x[1]-x[0]
for hb in (0.1,0.01):
w=np.exp(1j*x**2/hb)
print(hb, round(abs(np.sum(w)*dx),4),
round(abs(np.sum(w*(abs(x)<4*np.sqrt(hb)))*dx),4), round(np.sqrt(np.pi*hb),4))
# 0.1 0.5922 0.6039 0.5605 0.01 0.1795 0.1909 0.1772
With S = x², almost all of the total comes from a window of width ~√ħ around the stationary point x = 0, and the total approaches the stationary-phase value √(πħ); the rest cancels.
26.7 Divergent path integrals: Feynman's response
Is any of this mathematically justified? Penrose: "No; not as things stand today." Even for one particle, the path space is infinite-dimensional, the natural measure favours non-smooth paths on which the Lagrangian is undefined, and "everything diverges". The method rests on faith that divergent expressions have a deeper "Platonic" meaning, as with Euler's "nonsense" sums (§4.3). The faith is rewarded by uncanny accuracy: QED's correction to the electron's magnetic moment, 1.001 159 652 188, matches experiment to better than 10−11 (Feynman's image: the distance from Los Angeles to New York to within a hair's breadth).
The first rescue is the Feynman propagator K(p, q): instead of summing paths from p to q directly, ask what algebraic and differential properties the sum would have, including the positive-frequency condition; these fix K uniquely (it is a Green's function, after self-taught miller's son George Green, 1793–1841). For a Dirac particle in momentum space:
propagator = i(P̸ − M + iε)−1, with P̸ = γaPa,
where the tiny iε encodes positive/negative frequency. As ε → 0 it blows up when PaPa = M²: the path integral "feels out" wrong masses, but the classical mass dominates because the amplitude is huge near it.
26.8 Feynman graphs and the S-matrix
Lines are propagators; vertices contribute simple factors: a coupling constant (e.g. The charge), index-matching γs, and a δ-function enforcing 4-momentum conservation. External lines are on shell (PaPa = M², on the mass hyperboloid); internal lines need not be. In Møller scattering (two electrons exchanging one photon, the quantum root of Coulomb repulsion) momentum conservation forces the exchanged photon off shell: it is virtual and can never escape to be observed.
Higher orders (two-photon exchanges, internal pair creation) leave internal momenta free, to be integrated over, and all graph topologies consistent with the external lines must be summed. The collection of in-to-out amplitudes is the S-matrix (Heisenberg and Wheeler), the central object of QFT.
Tree graphs
- No closed loops.
- Internal momenta fixed by external ones; no integration.
- Reproduce the classical theory.
Loop graphs
- Closed loops.
- Free internal momenta, so a genuine integral, done by contour methods (ε steers the contour).
- These are the quantum corrections, and they diverge.
The gain is real: each graph is an ordinary finite-dimensional integral rather than an infinite-dimensional path integral. The cost: precisely the graphs that carry quantum information, those with loops, give divergent integrals.
26.9 Renormalization
Ultraviolet divergences come from arbitrarily large momenta (short distances, via Δp Δx ≥ ħ) and are the serious ones; infrared divergences (large distances) are usually cured by asking only physically sensible questions.
Around an electron E, virtual electron-positron pairs flicker into existence (within the energy-time uncertainty) and vanish. In E's field the virtual electron is pushed away and the positron pulled closer, so the vacuum shields E's charge. Measured from afar, we see the dressed charge, smaller than the bare charge. Direct calculation makes the ratio infinite. In natural units the dressed charge is about 0.0854 (= √α); if the bare charge were 1, the factor would be 11.7062 ≈ √137, a finite number a future theory with a short-distance cut-off might give. (Disconnected "vacuum bubble" graphs are taken to have no observable effect.)
In a renormalizable theory all divergences collect into finitely many "parcels" (charge, mass, field normalisations) absorbed by rescaling, with remaining divergences cancelling by symmetry. QED and the whole standard model are renormalizable; most QFTs are not. Many physicists make renormalizability a selection principle, turning infinities into a guide, and it did steer physics to the standard model.
- Gerard 't Hooft: proved in 1971, as a Utrecht graduate student, that theories with spontaneously broken gauge symmetry are renormalizable, rescuing electroweak theory. He told Penrose renormalizability matters in proportion to the coupling strength: for gravity (10−40 times weaker than electric attraction in hydrogen) the non-renormalizability bites only at absurd energies.
- Gross, Politzer, Wilczek (Nobel 2004): asymptotic freedom, the strong force vanishing at short distance, which makes QCD calculable at high energy.
- Freeman Dyson: QED's perturbation series, though each term is finite, does not converge; trouble appears only around order 137.
QCD's force behaves like an elastic band: zero at zero separation, growing with distance, the root of confinement. It cannot "snap": pull hard enough and quark-antiquark pairs are dragged from the vacuum, producing the jets seen at accelerators. Between nuclei the strong force is negligible because hadrons are colour singlets whose attractive and repulsive parts cancel (gravity, always attractive, accumulates instead).
26.10 Feynman graphs from Lagrangians
Feynman graphs are a perturbation expansion of the path integral in powers of the coupling constant: in QED each vertex contributes a factor e, so n-vertex graphs give the coefficient of eⁿ (in any one process only even or only odd powers appear). In Penrose's zigzag QED there are two couplings, charge e and mass M. Graphs are generated unambiguously by taking formal functional derivatives of the path integral, whose "paths" are now whole 4-D field configurations with amplitude eiS/ħ, S the integrated Lagrangian density.
Renormalization makes each coefficient f0, f1, f2, … in f0 + f1e + f2e² + … finite. It says nothing about whether the sum converges, and for QED it does not. Penrose describes the divergence as "logarithmic", like 1 + x/2 + x²/3 + … at x = 1, appearing around order 137. Most physicists follow Dyson (1952) in saying the series has zero radius of convergence (coefficients grow factorially), so it is an asymptotic series: excellent if truncated early, meaningless if summed. Either way, QED is not a finite theory.
26.11 Feynman graphs and the choice of vacuum
A symmetry of the Lagrangian (U(2) for electroweak, SU(3) for QCD) underwrites renormalizability: surviving divergences would have to break the symmetry, so they must cancel. Electroweak theory, though, does not show U(2) in the world. The resolution is the vacuum.
Compute ⟨ψout|ψin⟩ by creating incoming particles from |0⟩, writing the bra with annihilation operators, and pushing each annihilator rightward until it hits |0⟩ and dies. Each push past a creator leaves a (anti)commutator, i.e. One propagator line; what remains is ⟨0|0⟩ = 1 times a Feynman graph (vertices come from the interaction terms in 𝒜). Now replace |0⟩ by an inequivalent vacuum |Θ⟩.
The Higgs mechanism in one sentence: keep the Lagrangian, and hence the Feynman rules and renormalizability, exactly U(2)-symmetric, but put the world in a vacuum |Θ⟩ that is symmetric only under the U(1) of electromagnetism. Every proposal "beyond the standard model" leans on this device. Penrose calls it "marvellous" and "a great temptation", warning that such schemes must be judged sceptically, especially in the early universe (Chapter 28) and in supersymmetry and strings (Chapter 31).
Worked example: the electron's magnet, term by term
QED gives the anomaly ae = (g − 2)/2 as a series in α/π, each coefficient the sum of all graphs at that loop order:
| Order | Coefficient | Running total of ae |
|---|---|---|
| 1 loop (Schwinger 1948) | ½ | 0.001161409734 |
| 2 loops | −0.328478965 | 0.001159637429 |
| 3 loops | +1.181241456 | 0.001159652233 |
| 4 loops | about −1.912 | 0.001159652177 |
| 5 loops | about +6.7 | 0.001159652178 |
| Measured (2023) | 0.00115965218059 |
The remaining sliver comes from hadronic and weak contributions and from the value of α used. Each coefficient is finite only after renormalization, and the coefficients eventually grow without bound, yet the truncated series matches experiment to about one part in a trillion. Schwinger's one-loop term α/2π is engraved on his tombstone.
Test yourself
- What does iε do in the propagator? It moves the poles off the real axis so the contour integral picks out positive frequency for particles and negative for antiparticles.
- Why do tree graphs give classical physics? No loops means no free momentum integrals, so no sum over quantum alternatives.
- How can a symmetric Lagrangian describe an asymmetric world? Choose an asymmetric vacuum |Θ⟩: the dynamics stays symmetric, the ground state does not.
- Paul Dirac, Pascual Jordan, Werner Heisenberg, Wolfgang Pauli: founders of QFT (late 1920s).
- Vladimir Fock: Fock space.
- Richard Feynman: path integrals, propagators, graphs (1948–49).
- Julian Schwinger, Sin-Itiro Tomonaga, Freeman Dyson, Hans Bethe: making QED finite.
- John Wheeler, Werner Heisenberg: the S-matrix.
- Gerard 't Hooft, Martinus Veltman: renormalizability of gauge theories (1971).
- Kenneth Wilson: the renormalization group.
- David Gross, David Politzer, Frank Wilczek: asymptotic freedom (1973; Nobel 2004).
- George Green: the Green's functions behind propagators.
Coherent states: the most classical quantum fields
Penrose singles out coherent states as the field states closest to classical. Given a classical free Maxwell field F, form the field operator F̂, the sum of the creation operator for F's positive-frequency part and the annihilation operator for its negative-frequency part, and build eF̂|0⟩. Such a state contains no definite number of photons: it is a superposition of 0, 1, 2, … photon states with Poisson-distributed numbers, yet its expected field follows Maxwell's equations exactly. A well-stabilised laser beam is the textbook example. They show concretely why QFT must allow unlimited particle number and why "particle" is a derived notion in a field theory.
Terms to know
| Term | Meaning |
|---|---|
| Second quantization | Promoting wavefunctions to creation operators acting on a vacuum |
| Fock space | Direct sum of 0-, 1-, 2-, … particle Hilbert spaces |
| Complex structure J | J² = −1 on classical solutions; +i eigenspace = positive frequency |
| Inequivalent vacua | Vacua not related by any operator in the field algebra |
| Path integral | Sum of eiS/ħ over all histories |
| Propagator | Green's function for one line of a Feynman graph |
| On / off shell | PaPa = M² holds / fails (virtual particles) |
| S-matrix | Table of in-to-out amplitudes |
| UV / IR divergence | From short / long distances |
| Renormalizable | Divergences absorbed into finitely many parameters |
| Asymptotic freedom | Strong coupling weakens at high energy |
| Running coupling | Coupling strength depending on the energy scale |
Dirac's sea has infinite negative charge and infinite negative mass; we "renormalize" both to zero. Electromagnetism only cares about charge differences, so this is harmless. Gravity cares about absolute energy (Exercise 24.2). Ask what the vacuum weighs and QFT's natural estimate of vacuum energy exceeds the observed cosmological constant by about 10120, the worst prediction in physics. The renormalization that works so beautifully for QED becomes a deep puzzle the moment gravity is in the room, which is Penrose's broader point about QFT and general relativity.
- "Virtual particles are real particles popping in and out." They are internal lines of a perturbative calculation; they are off shell and never observed.
- "Renormalization hides infinities under the rug." In modern effective-field-theory language it expresses how couplings depend on scale, a physical effect (the running of α is measured).
- "The path integral is a well-defined integral." In 4-D interacting theories it is not, as Penrose stresses; it is defined through perturbation theory or a lattice.
2004 versus 2026
| Topic | In the book (2004) | By 2026 |
|---|---|---|
| Computing amplitudes | Sum Feynman graphs | On-shell methods, BCFW, amplituhedron, twistor techniques |
| Non-perturbative QCD | Hard | Lattice QCD at percent-level precision for many observables |
| Renormalizability as criterion | Widely used selection rule | Largely replaced by the effective field theory view |
| Rigorous 4-D QFT | Lacking | Still lacking (Yang–Mills mass gap open) |
Penrose's exercises for Chapter 26
The 15 exercises ask the reader to: show the operator rules give symmetric and antisymmetric states and sort out normalising factorials using index or diagram notation (26.1–26.2); identify the fermion operators as an infinite Clifford algebra (26.3); explain addition in the space of Maxwell solutions and why J's eigenspaces are the positive/negative-frequency fields (26.4–26.5); show how annihilators can remove a specific state and exhibit the |0⟩ versus |Σ⟩ difference diagrammatically (26.6–26.7); interpret a time-wandering path as pair creation (26.8); make the stationary-phase argument precise with O-notation (26.9); explain the divergence of the path measure and the propagator's pole by rationalising (P̸ − M + iε)−1 (26.10–26.11); fix the virtual photon's momentum in Møller scattering and count the freedom in two-photon exchange (26.12–26.13); explain why vacuum polarization reduces the charge (26.14); and why only even or only odd powers of e appear (26.15).
Errors and contested points. (1) The strong coupling is not "about 10": αs is about 0.12 at the Z mass and of order 1 at hadronic scales (gs ≈ 1.2 at MZ). (2) QED's divergence is factorial (Dyson), not literally logarithmic. (3) Since Kenneth Wilson's renormalization group (Nobel 1982), most physicists no longer treat renormalizability as a criterion for fundamental truth: non-renormalizable theories are respectable effective field theories valid below a cut-off, and general relativity is routinely treated as one, a view close to 't Hooft's pragmatism. (4) Penrose's "no; not as things stand" on rigour is fair for 4-D interacting theories; the Yang–Mills existence and mass gap problem (a Clay Millennium Prize) remains open in 2026.
Beyond Feynman graphs, via twistors. Witten's 2003 twistor-string paper, explicitly building on Penrose's twistors, launched the scattering-amplitudes programme: BCFW recursion (2005) computes gluon amplitudes without summing graphs, and the amplituhedron (Arkani-Hamed and Trnka, 2013) expresses some amplitudes as volumes of a geometric object in which locality and unitarity are emergent. Precision QFT has gone further: 5-loop QED (about 12,672 diagrams, Aoyama–Kinoshita) is needed for the electron's g − 2, and lattice QCD now computes hadron masses and the muon's hadronic vacuum polarization from first principles, the latter decisive in the 2025 muon g − 2 resolution.
Two lessons for systems builders. First, Penrose's "choice of vacuum" is the physics version of default state: identical rules (the Lagrangian) can produce very different observable behaviour depending on the ground state a system settles into, which is how a symmetric design can yield an asymmetric deployment. Second, renormalization is the art of making a model useful at the scale you can measure while admitting it is wrong at scales you cannot, the same stance behind effective, calibrated risk models that are trusted only inside their validated range.
Chapter 27 turns to the Big Bang and the Second Law; Chapter 28 examines spontaneous symmetry breaking in the early universe and inflation; Chapters 29–30 take up measurement and gravitational OR; Chapter 31 asks whether supersymmetry and strings cure QFT's infinities; §33 develops twistor theory, where positive frequency becomes holomorphy.
The Big Bang and Its Thermodynamic Legacy
The Second Law looks like a vague statistical rule, yet Penrose shows it hides the most precise number in physics. Dynamics is time-symmetric, so the arrow of time must come from a boundary condition: a Big Bang so special that the Creator's pin had to find one part in 1010123 of phase space. The specialness lies in gravity: matter began thermal, but the gravitational degrees of freedom were unexcited, a smooth geometry that left the whole entropy reservoir of clumping and black holes waiting to be spent.
27.1 Time symmetry in dynamical evolution
Since Galileo, almost every successful physical theory has been a dynamics: a rule saying "if the world is like this now, it will be like that later". Such theories do not say how the world is unless we tell them how it was. Kepler's 1609 ellipses looked like an exception, a statement of shape rather than of evolution, but after Newton's Principia (1687) they became consequences of an inverse-square dynamics. Penrose stresses how lucky Kepler was: hardly any other simple central force gives orbits that are elegant curves already studied by the Greeks eighteen centuries earlier. The modern expectation is that the laws are elegant and shapes are a bonus.
The equations of classical and quantum mechanics are symmetric under time reversal. Mathematically, final conditions determine a solution as well as initial ones, yet we habitually evolve only into the future. Relativity does not spoil this: data on a spacelike 3-surface determine the evolution both ways, although in general relativity the spacetime into which the data evolve is itself part of the solution (which matters for black holes).
For quantum theory, the determinism concerns U only. Under time reversal T, the operator iħ ∂/∂t becomes −iħ ∂/∂t; Schrödinger's equation goes to itself provided we also flip i ↦ −i, which is how T acts in quantum mechanics (and positive frequency is preserved under the combined swap). R, the reduction process, behaves quite differently under T, a point saved for §30.3.
27.2 Submicroscopic ingredients and the Second Law
In practice we never know every particle's position and momentum; we work with averages: mass distribution, centre of mass, temperature, pressure, elasticity. Whether such coarse knowledge suffices depends on the system. Chaotic systems, such as the magnetic-pendulum executive toy of Fig. 27.1, are deterministic yet effectively unpredictable, because a tiny change in initial state grows exponentially. Weather is the familiar case; even the Solar System is probably chaotic on timescales far beyond observation. Penrose's Note 27.1 insists this is a matter of degree, not a breach of determinism.
Retrodiction is usually far worse than prediction, and the reason is the Second Law, in its simplest form:
- Heat flows from a hotter to a colder body.
Connect a hot and a cold body and they settle to a common temperature: predictable. Run the film backwards and two equal bodies spontaneously diverge in temperature, and nobody could say which, by how much, or when. Hence physics is about prediction, and the Second Law is what makes prediction work. Note 27.3 records a paradox Penrose admits he cannot fully resolve: in daily life we "retrodict" easily by memory and archaeology, while the future is closed to us; how memory relates to the Second Law "remains somewhat obscure" to him.
Many physicists treat the Second Law as not fundamental, an "obvious" ingredient of any sensible theory, vague compared with energy conservation or the standard model. Penrose's thesis is the opposite: behind this "vague" statistical law lies an almost mind-blowing precision, and it lives in the initial state of the universe.
27.3 Entropy
The First Law says total energy is conserved in an isolated system. When Sadi Carnot proposed it in the early 1820s (unpublished), it was not obvious that heat is energy. Temperature is energy per degree of freedom, so thermodynamics is dynamics applied statistically to the constituents. The First Law is an equality; the Second Law is an inequality: a quantity called entropy never decreases.
Rudolf Clausius introduced entropy in 1865; Ludwig Boltzmann made it clear in 1877. Take the phase space P (for n featureless particles, 6n dimensions) and apply a coarse graining: divide P into boxes, each grouping states that are macroscopically indistinguishable. Then the Boltzmann entropy of a state x lying in a box of volume V is
S = k log V, with k = 1.38 × 10−23 J K−1 (natural logarithm).
Note 27.6 adds a historical aside: Boltzmann never used the constant k; the formula S = k log V was first written explicitly by Planck.
Penrose admits the definition looks subjective. Where box boundaries go depends on how closely one looks, and two neighbouring points either side of a boundary get different entropies. His position: entropy is a "convenience" in present theory, not an absolute notion, though it may become fundamental in quantum gravity (black-hole entropy hints at this). Quantum mechanics at least supplies an absolute measure for phase-space volume (units with ħ = 1). The arbitrariness rarely matters because the volume ratios are stupendous and S is a logarithm: only an absurd redrawing of boundaries would change S noticeably.
27.4 The robustness of the entropy concept
Penrose's worked example: a one-litre container of air with a bulb R of one tenth its volume. With about m = 1022 molecules (Boltzmann statistics, molecules distinguishable in principle), the fraction of phase space in which all molecules sit in R is 10−m, i.e. 10−10 000 000 000 000 000 000 000. Opening the valve raises the entropy by m k ln 10 ≈ 2.3 × 1022 k, about one third of a joule per kelvin.
Now loosen the definition so R need only hold 99.9% of the molecules, a vacuum well within technology. The entropy gain barely moves, from 2.30 × 1022k to about 2.29 × 1022k (Exercise 27.7). This is the robustness of entropy: reasonable box choices give essentially the same answers.
Try it in Python: the numbers behind Chapter 27
import math
k,G,hbar,c = 1.380649e-23, 6.674e-11, 1.0546e-34, 2.998e8
Msun, mp = 1.989e30, 1.6726e-27
m = 1e22 # molecules in the litre of air
print(f"entropy gain = {m*math.log(10):.2e} k = {m*math.log(10)*k:.3f} J/K")
SBH = lambda M: 4*math.pi*G*M**2/(hbar*c) # Schwarzschild hole, S/k
print(f"Sun-mass hole: S = {SBH(Msun):.1e} k")
gal_baryons = 1e11*Msun/mp
print(f"3e6 Msun hole, per galactic baryon: {SBH(3e6*Msun)/gal_baryons:.1e}")
print(f"all 1e80 baryons in one hole: S = 10^{math.log10(SBH(1e80*mp)):.1f}")
Output:
entropy gain = 2.30e+22 k = 0.318 J/K
Sun-mass hole: S = 1.0e+77 k
3e6 Msun hole, per galactic baryon: 7.9e+21
all 1e80 baryons in one hole: S = 10^122.9
Three of Penrose's headline numbers drop out: the ⅓ J/K gas example, the 1021 per baryon from a Milky-Way-type central black hole, and the 10123 ceiling for a 1080-baryon universe.
The logarithm also makes entropy additive: for independent systems with phase space P = P1 × P2 and product boxes, volumes multiply so entropies add, S = S1 + S2.
In a normal system one box, the thermal-equilibrium box E, has a volume practically equal to the whole of P and dwarfs all other boxes combined (Fig. 27.4). For a gas of identical balls it gives the Maxwell distribution of speeds, density A e−βv² (a Gaussian, β set by temperature). Richer systems obey equipartition: energy shared equally (with statistical spread) among all degrees of freedom. Away from equilibrium, the approach is governed by Boltzmann's equation; the whole subject is statistical mechanics.
27.5 Derivation of the Second Law, or not?
The standard argument: let x start NOW in a small box V. With no bias in its motion and box sizes differing stupendously, x will almost surely wander into bigger and bigger boxes; once out, returning to a much smaller one is absurdly unlikely on any sensible timescale. This seems independent of the dynamics, which is why many physicists find nothing puzzling here. Penrose quotes Eddington: a theory that contradicts Maxwell's equations or observation may survive, but one that contradicts the Second Law can only "collapse in deepest humiliation".
The flaw: the argument is time-symmetric but its conclusion is not. Run it into the past (Fig. 27.6b) and it says x most probably entered V from ever-larger boxes, so entropy should rise into the past, grossly contradicting experience (Fig. 27.7).
Start with all the gas in R at time t0. Forward in time, it floods the container: correct. Backwards, with no outside interference, the "most probable" history is that the gas was spread out and spontaneously concentrated into R. That is the right answer to the question as posed, which is why we never see it happen. The real way gas gets into R: an experimenter pumps in ten times the gas, closes the valve and vacuums out the rest, entropy rising throughout. But the experimenter's low entropy comes from meals and air, which come from the Sun. Enlarging the phase space to include experimenter, Sun and beyond only moves the puzzle outward; the past-directed argument still predicts falling entropy behind us.
27.6 Is the whole universe an isolated system?
Some distinguish isolated from open systems, explaining entropy decrease by outside input. Penrose rejects this as provisional: all outside influences can be folded into the system, so the system must ultimately be the whole universe U, with phase space Pᵤ. Spatial infinity is no objection (Chapter 16), and the infinite/finite question is only mildly relevant.
Technicalities: cosmology needs general relativity, and full general covariance forbids a preferred time; but the standard models have a natural cosmic time t, good enough here. Each point of Pᵤ encodes matter and fields, including the gravitational field (spatial geometry and its rate of change). Pᵤ is infinite-dimensional, so box volumes need quantum-field regularisation, which is unavailable for gravity; Penrose treats this as a technicality.
A common misconception: entropy rises because the universe expands, the small early universe having few degrees of freedom and a low "ceiling". Penrose's rebuttals:
- Collapse. In a recollapsing model the ceiling would fall and entropy would have to decrease, violating the Second Law (and failing badly with black holes).
- Phase space does not grow. The universe's size is itself a dynamical degree of freedom represented in the fixed space Pᵤ. Time is not part of Pᵤ; all dynamically accessible states are already there. There is no ceiling, only boxes x has not yet reached.
27.7 The role of the Big Bang
Throw a history curve ξ randomly into Pᵤ and it lives in the equilibrium box E: no Second Law (Fig. 27.8a). Pin it NOW in a modest box V and the future is fine but the past violates the law (Fig. 27.8c). Our universe is Fig. 27.8d: ξ has its past end in an exceedingly tiny region B. Seen backwards, x seems "purposefully guided" into smaller and smaller boxes, but that is only because B is surrounded by ever-smaller boxes. The whole puzzle of the Second Law is that one end of the universe's history lies in B.
Evidence for the Big Bang:
- Theory. Alexandr Friedmann's 1922 expanding solutions of Einstein's equation.
- Expansion. Edwin Hubble, 1929: redshift grows with distance, recession velocity proportional to distance. Note 27.11 credits Vesto Slipher (1917) with earlier redshift evidence, rarely acknowledged (he also led the team in which Clyde Tombaugh found Pluto).
- The flash. The 2.7 K microwave background, uniform to about one part in 105. Predicted by Gamow (1946) and by Alpher, Bethe and Gamow (1948), again by Dicke (1964), found by accident by Penzias and Wilson (1965), whose paper Penrose calls "possibly the most modestly named scientific paper of all time".
- Age. About 1.4 × 1010 years on the reckoning of 2004.
The Sun as a low-entropy source
We do not live on the Sun's energy: on average the Earth radiates back exactly what it receives (Note 27.14 adds radioactive heating and the greenhouse imbalance as small corrections). What matters is the form. By E = hν, sunlight arrives as relatively few high-energy (yellow) photons and leaves as many low-energy (infrared) photons. Fewer photons means fewer degrees of freedom, a smaller phase-space region, lower entropy. Plants exploit this in photosynthesis; we eat plants (or things that eat them) and breathe their oxygen.
Why is the Sun a hot spot in a cold sky? Because stars condensed gravitationally from an earlier uniform gas. The low entropy comes from the reservoir stored in that uniformity.
Ordinary gas
- Low entropy: gas concentrated in a corner.
- High entropy: uniformly spread, thermal equilibrium.
- Maximum: uniform equilibrium filling the box.
Self-gravitating matter
- Low entropy: matter uniformly spread.
- High entropy: matter clumped into stars and galaxies.
- Maximum: everything collapsed into a black hole.
27.8 Black holes
Newtonian intuition: a stone thrown upward escapes if its speed exceeds the escape velocity (2GM/R)1/2. Make a body massive and compact enough and escape velocity exceeds c. John Michell reached a "dark star" conclusion in 1784, Laplace in 1799. Penrose is unconvinced by the Newtonian version: light speed has no absolute status there, and he argues light at the surface of such a body could be faster than in free space and still escape (Exercise 27.12 hints at a particle theory of light and a mirror). In relativity, where c is the limiting speed, the argument becomes real.
Collapse and its limits
- White dwarf. About a solar mass in an Earth-sized body, held up by electron degeneracy pressure (the Pauli principle).
- Neutron star. The same mass about 10 km across, held by neutron degeneracy. A tennis ball of its material would weigh as much as Deimos.
- Chandrasekhar limit. Subrahmanyan Chandrasekhar, 1931: about 1.4 M☉ for white dwarfs; neutron stars somewhat more. No resting configuration exists for a cold object above roughly 2 M☉ (Penrose: "probably not more than 1.6 M☉").
- Collapse of a 10 M☉ star. When the core exceeds the limit it collapses; infall can trigger a supernova that briefly outshines its galaxy. If too little mass is shed, collapse continues through an event horizon.
The geometry is Karl Schwarzschild's 1916 solution, found months before he died of a disease contracted on the eastern front. The horizon sits at r = 2MG/c2, exactly Michell's radius. Exercise 27.13 works with the metric ds² = (1 − 2M/r)dt² − (1 − 2M/r)−1dr² − r²(dθ² + sin²θ dφ²) and its horizon-crossing Eddington–Finkelstein form ds² = (1 − 2M/r)dv² − 2dv dr − r²(dθ² + sin²θ dφ²).
The horizon is not a material surface. It is a hypersurface separating events that can signal to infinity from those that cannot. An infalling observer notices nothing locally on crossing it; the black hole is a gravitating region of spacetime, not a ponderable body.
Evidence (as of 2004)
- X-ray binaries. In the 1970s, double stars with one dark member too massive for a white dwarf or neutron star; X-rays from an accretion disc. Best known: Cygnus X-1, about 7 M☉.
- No surface. Material falling "straight in" produces no surface glow, direct evidence that the compact object has no surface.
- Galactic centres. Most, perhaps all, galaxies host large black holes; the Milky Way's is about 3 × 106 M☉, with stellar orbits tracked in detail.
27.9 Event horizons and spacetime singularities
In Fig. 27.11 the null cones tilt inward until tangent to the horizon H; any outward crossing would violate causality. The spherically symmetric case is Oppenheimer and Snyder (1939). Inside, tidal effects (Weyl curvature) grow without bound toward the singularity at r = 0, and the singularity theorems (Penrose 1965; Hawking and Penrose 1970) make this generic once a trapped surface forms: a compact spacelike 2-surface whose ingoing and outgoing light flashes both shrink in area (Note 27.20). The criterion needs no symmetry and is stable under perturbation.
- Stellar hole (few M☉). Tides kill a person long before the horizon.
- Galactic-centre hole (≳106 M☉). Horizon millions of km across; curvature there only about 20 times that at the Earth's surface.
- After crossing. Tides mount to infinity and destroy the observer in under a minute.
- Quasars. Rotating central holes powering output from a Solar-System-sized region that can outshine a galaxy by 102 to 103.
Penrose expects the generic singularity to be wildly quasi-oscillatory (the BKL picture) and notes that quantum gravity must take over there; black holes are therefore data for the quantum-gravity search. Cosmic censorship, the conjecture that singularities stay hidden behind horizons, is unproven (see §28.8). Powerful gamma-ray bursts probably involve black holes too.
27.10 Black-hole entropy
The no-hair theorems (Israel 1967, Carter 1971, Hawking 1972, Robinson 1975) show that a collapse, however messy, settles to the Kerr metric (Kerr 1963), described by mass m and angular momentum am (G = c = 1). Penrose quotes Chandrasekhar: black holes are "the most perfect macroscopic objects there are in the universe", built only of space and time. Huge amounts of detailed structure reduce to ten parameters (a, m, spin axis direction, centre-of-mass position and 3-velocity), plus a negligible charge. Like thermal equilibrium, an immense number of microstates gives one macroscopic description, so the coarse-graining box is stupendous.
The Bekenstein–Hawking formula assigns
SBH = (k c³ / 4Għ) A,
with A the horizon area. This is the first formula in the book combining ħ and G: a quantum-gravitational effect. For a Kerr hole the area gives (in G = c = 1 units) SBH = 2π k m (m + √(m² − a²)) / ħ, reducing to 4πkGm²/ħc for a non-rotating hole.
Planck units
Set G = c = ħ = k = 1 and all units are fixed:
| Conventional unit | In Planck units | Planck unit | In conventional units |
|---|---|---|---|
| gram | 4.7 × 104 | Planck mass | 2.1 × 10−5 g |
| metre | 6.3 × 1034 | Planck length | 1.6 × 10−35 m |
| second | 1.9 × 1043 | Planck time | 5.3 × 10−44 s |
| kelvin | 4 × 10−33 | Planck temperature | 2.5 × 1032 K (as printed) |
| proton charge e | 0.0854245 | Planck charge | 11.7 proton charges |
In these units SBH = ¼ A.
- Planck temperature. The standard value is TP = √(ħc⁵/G)/k ≈ 1.42 × 1032 K, so one kelvin is about 7 × 10−33 Planck units. Penrose's printed pair (kelvin = 4 × 10−33, TP = 2.5 × 1032 K) is self-consistent, but the temperature is about 1.8 times too large; the other Planck values in the table are correct.
- Ages. The chapter gives the universe's age as 1.4 × 1010 years in §27.7 and 1.5 × 1010 in §27.11; the modern value is 13.8 × 109.
Black holes dominate the entropy budget
In the 1960s the microwave background was thought to carry most of the universe's entropy: about 108 to 109 per baryon (roughly photons per baryon). A Milky-Way central hole of 3 × 106 M☉ already gives about 1021 per baryon (our Python run gives 7.9 × 1021), and the large holes in other galaxies dominate further. Whatever the figure now, it will grow stupendously.
27.11 Cosmology: the FLRW models
Friedmann (1922) found uniform "dust" solutions; with later contributions they are the Friedmann–Lemaître–Robertson–Walker (FLRW) models: spatially homogeneous (same at every point at each time) and isotropic (same in all directions, an O(3) symmetry), giving a 6-dimensional symmetry group (Exercise 27.15). Isotropy is confirmed directly by the CMB (COBE, BOOMERANG, WMAP: deviations of a few parts in 105); homogeneity follows unless we occupy a privileged spot, since a space isotropic about two distinct points must be homogeneous (Exercise 27.16). Irregularities such as the Great Attractor shrink proportionally with distance. The observable universe holds about 1011 galaxies and 1080 baryons.
The metric is ds² = dt² − R(t)² dΣ², with dΣ² the unit 3-sphere (K > 0), Euclidean space (K = 0) or unit hyperbolic space (K < 0), and R(t) the scale.
| Model | Spatial geometry | Fate with Λ = 0 | Stone analogy | With Λ > 0 |
|---|---|---|---|---|
| K > 0 | 3-sphere S³ (or ℝℙ³), "closed" | Recollapses to a Big Crunch (cycloid R(t)) | Thrown below escape velocity | Exponential expansion if Λ large enough |
| K = 0 | Euclidean 3-space | Expands, just avoiding collapse | Exactly escape velocity | Exponential expansion |
| K < 0 | Hyperbolic 3-space | Expansion approaches a constant rate | Above escape velocity | Exponential expansion |
Further points:
- Cosmological constant. Einstein's 1917 Λgab, which he abandoned after 1929, is now indicated positive by observation. Penrose considers one of the Λ > 0 models a fair description since decoupling, at about 3 × 105 years, roughly 1/50 000 of the present age.
- Radiation era. Before decoupling the universe was radiation-dominated; Tolman's (1934) radiation model (t ∝ R²) replaces Friedmann dust (t ∝ R3/2), shortening the time to decoupling (Exercise 27.17).
- Inflation. A proposed exponential growth by "perhaps 1060", over by 10−32 s, invisible in these pictures. Penrose excludes inflation from "the standard model of cosmology" (Note 27.34 mentions the emerging term concordance model for K = 0, Λ > 0 plus inflation).
- Topology. Lens spaces and other identifications are possible but not globally isotropic; Note 27.35 mentions Luminet's (2003) dodecahedral universe, which would vindicate the ancient Greeks.
- No centre. The balloon analogy: every point recedes from every other; the balloon's centre is not part of the universe.
27.12 Conformal diagrams
A conformal diagram compresses a whole spacetime into a finite picture with null directions at 45° and infinity as a boundary. ℐ+ ("scri plus") is future null infinity, ℐ− past; they are null 3-surfaces when Λ = 0 and spacelike when Λ > 0. Only the null cones (the conformal structure, g ∼ Ω²g) are drawn faithfully. Penrose first used them in his 1962 Warsaw lecture; Brandon Carter (1966) systematised the strict version (they are now called Penrose or Carter–Penrose diagrams).
- Interior point: a whole 2-sphere (spherical symmetry).
- Dashed line: symmetry axis, where the spheres shrink to points.
- Solid line: infinity (ℐ).
- Wiggly line: singularity.
- Open circle ○: a corner that is conformally a whole 2-sphere.
- Filled dot •: a corner that is a single point.
Lessons the diagrams make visible:
- Black-hole interior. The horizon is at 45°; once inside, every timelike curve hits the singularity, which is a spacelike future boundary, not a point at the centre.
- Big Bang. A spacelike past boundary (3-dimensional in conformal terms), again unlike the intuitive "point".
- Particle horizons. An observer p near the Big Bang sees only the part P of the initial surface inside its past light cone; particles from elsewhere lie outside p's observable universe.
- Event horizons. Arise whenever the future boundary is spacelike; with Λ > 0 a cosmological event horizon keeps part of the universe forever unseen (Exercise 27.22).
27.13 Our extraordinarily special Big Bang
Two pieces of evidence say the early universe was thermal: the CMB's near-perfect Planck black-body spectrum (error bars in Fig. 27.19 exaggerated 500 times) and the agreement of Big Bang nucleosynthesis (hydrogen/deuterium/helium ratios) with calculations that assume thermal equilibrium. After about 10−11 s the temperature was about 1015 K; after about 102 s, about 109 K.
This misled many cosmologists into seeing the Big Bang as a high-entropy random state, the paradox "solved" by the small early universe's low ceiling, which §27.6 has already refuted. Penrose's resolution: the gravitational degrees of freedom were never thermalised; the smooth FLRW geometry is exactly what made the Big Bang special.
Counting the entropy
- Assumptions. Near-FLRW, temporarily K > 0, Λ = 0, 1080 baryons.
- Now. Galactic black holes of about 106 M☉ give about 1021 per baryon, total about 10101.
- At decoupling. Radiation and matter give about 1088.
- At a messy Big Crunch. Galaxies merge, holes congeal; just before the end, SBH for all 1080 baryons is about 10123.
- Λ > 0 makes no difference. The time-reverse of the ever-expanding K > 0, Λ > 0 model is also a solution; perturbing it gives a similar congealing mess of 10123 (Fig. 27.20b).
Using S = log V in natural units:
- Total phase space Pᵤ (≈ equilibrium box E): 1010123.
- Box N (universe today): 1010101.
- Box B (Big Bang): 101088.
- B and N as fractions of E: each about one part in 1010123 (the exponents 101 and 88 vanish beside 123; Exercise 27.23).
- B as a fraction of N: one part in 1010101.
A pin that missed would land in E, giving an uninhabitable universe with no Second Law and no time direction (Fig. 27.20d). Aiming merely for sentient beings does not help; that is the anthropic question of §§28.6–7 and §34.7. If the universe is spatially infinite, apply the argument to the observable universe; applied to the whole, the Creator needs infinite precision, which resolves nothing.
Gravity just seems to have been different!
Roger Penrose, §27.13Why was gravity different? Penrose says none of the attempts in Chapter 28 comes close to answering. His own route goes through the foundations of quantum mechanics (Chapter 29) to his views in Chapter 30.
What the exercises ask
- Time reversal (27.1). Why T must accompany t ↦ −t with i ↦ −i, and why momentum behaves consistently.
- Phase-space measure (27.2, 27.3). An absolute volume when ħ = 1; how the logarithm tames stupendous ratios.
- Gas counting (27.4 to 27.9). Boltzmann vs Bose–Einstein vs Fermi–Dirac counting, the 10−m fraction, Stirling's formula to get 2.29 × 1022k, and the recurrence time for the gas to return to R.
- Relativity of light and gravity (27.10 to 27.13). Relativistic Doppler shift two ways; the height reached by a thrown stone, v²R(2gR − v²)−1; Michell's dark star; Schwarzschild vs Eddington–Finkelstein coordinates and plotting radial null geodesics.
- Cosmology (27.14 to 27.22). Why big holes dominate entropy; the 6-dimensional symmetry group; isotropy about two points implies homogeneity; Friedmann vs Tolman time to decoupling; unit 3-sphere and hyperbolic metrics; the cycloid R = C(1 − cos ξ), t = C(ξ − sin ξ); building conformal diagrams and their conformal factors; when the observable universe eventually covers everything.
| Term | Meaning |
|---|---|
| Coarse graining | Division of phase space into boxes of macroscopically indistinguishable states |
| Boltzmann entropy | S = k log V, V the volume of the state's box |
| Thermal equilibrium box E | The box with almost all of phase space; maximum entropy |
| Chaotic system | Deterministic, with exponentially growing sensitivity to initial data |
| Chandrasekhar limit | Maximum mass (about 1.4 M☉) of a white dwarf |
| Event horizon | Boundary of the region that can signal to infinity |
| Trapped surface | Closed 2-surface whose outgoing and ingoing light both converge |
| Kerr metric | The final stationary black hole, parameters m and a |
| Bekenstein–Hawking entropy | S = kc³A/4Għ, or A/4 in Planck units |
| FLRW model | Homogeneous isotropic cosmology with scale R(t) |
| Particle horizon | Limit of the observable part of the Big Bang |
| Weyl curvature | The free, tidal part of spacetime curvature (unexcited at the Big Bang) |
- Black holes imaged. The Event Horizon Telescope imaged M87* (2019) and Sgr A* (2022); the Milky Way's hole is about 4.3 × 106 M☉ (Ghez and Genzel, Nobel 2020 with Penrose himself, cited for the singularity theorem of §27.9).
- Gravitational waves. GW150914 (2015) and hundreds of mergers since; GW250114 (2025) gave the clearest test yet of Hawking's area theorem, the classical root of SBH ∝ A.
- Numbers revised. Age 13.8 Gyr, decoupling at about 380 000 years; Cygnus X-1 re-measured at about 21 M☉ (2021); neutron stars of at least 2.0 to 2.35 M☉ observed (PSR J0740+6620, J0952−0607), above Penrose's "probably not more than 1.6 M☉".
- Λ and tension. Planck 2018 confirms a flat Λ-dominated universe, but the Hubble tension (67 vs 73 km/s/Mpc) and DESI's 2024 to 2025 hints of evolving dark energy keep the "standard model" of cosmology under pressure.
- Inflation factor. "Perhaps 1060" is unusual; standard accounts need about 60 e-folds, a linear factor near 1026 (e60). Penrose may mean volume, or simply a generous figure.
- The 1010123 argument is widely quoted but contested: it treats gravitational entropy via black holes as if a coarse graining of geometry were well defined, which no one has achieved. Critics such as Robert Wald (2006) accept the low-entropy past hypothesis but question the precision of the figure; Penrose's own Note admits the definition of entropy is a convenience.
- The Michell argument. Penrose's rejection of the Newtonian dark star is idiosyncratic; most historians and physicists accept it as a valid Newtonian precursor.
For anyone building predictive systems: Penrose's point that retrodiction is harder than prediction has a practical twin. Models trained on forward-running processes (credit transitions, fraud cascades) cannot be run backwards to recover causes, because coarse-grained states lose the information. Logging the low-entropy boundary condition, the original raw event, is the only reliable route back.
§28 tests whether inflation, anthropic reasoning or Hartle–Hawking explain the special Big Bang; §30 links the Weyl curvature hypothesis to gravity's role in quantum reduction; §31.15 and §32.6 return to black-hole entropy in string theory and loop gravity.
Speculative Theories of the Early Universe
Penrose puts early-universe symmetry breaking, inflation, the anthropic principle and the Hartle–Hawking no-boundary proposal in the "speculative" camp and tests each against the one fact Chapter 27 established: the Big Bang's gravitational specialness. His verdict is severe. Thermalization and inflation use the Second Law and so cannot explain it, anthropic reasoning is 1010123 times too extravagant, and time-symmetric proposals cannot produce a time-asymmetric universe. What he offers instead is a geometric statement of the specialness: the Weyl curvature hypothesis.
28.1 Early-universe spontaneous symmetry breaking
Penrose opens with a warning: up to here the book stayed within established theory; now he deliberately classes as speculative two ideas many readers treat as fact, inflation (expansion by 1030, or even 1060) and spontaneous symmetry breaking in the early universe. He does not doubt symmetry breaking as such: it underlies renormalizable gauge theories and is real in superconductivity and ferromagnetism. His worry is that its appeal tempts physicists to use it too broadly.
Iron's atoms are little magnets that like to align. Above the Curie point, about 770 °C (1043 K), thermal agitation wins and the ball is unmagnetized, fully SO(3) symmetric. Cool it slowly and the minimum-energy state is total alignment, but no direction is preferred (a degeneracy), so the final magnetization axis is chosen at random. The SO(3)-symmetric state has become an SO(2)-symmetric one: spontaneous symmetry breaking. Note 28.1 concedes this is idealised; real iron forms randomly oriented domains unless cooled extremely slowly.
The standard picture is the Mexican-hat potential: height is energy, the peak is the symmetric unstable equilibrium, the rim a whole circle of degenerate minima. A random disturbance sends the "marble" to one rim point, and the choice is the broken symmetry. A sudden change of stable state as temperature falls is a phase transition (freezing, boiling, magnetization); symmetry reduction often, but not always, accompanies it.
In QFT a phase transition is described as tunnelling to a new vacuum. Strictly no unitary process connects different sectors (different vacua live in different Hilbert spaces), so this is an infinite-system approximation, though a good one; superconductivity is treated this way, breaking electromagnetism's U(1).
- Hat geometry. The 2-D hat breaks SO(2) to the trivial group ("SO(1)"); higher-dimensional hats break SO(p) to SO(p − 1) (Exercise 28.1).
- Electroweak. The hat E = (|w|² + |z|² − 1)² on ℂ² breaks U(2) to U(1) (Exercise 28.2, with Clifford parallels on S³). This is supposed to have happened at about 1016 K, 10−12 s after the Big Bang.
- GUTs. Earlier and hotter, SU(5) might break to a group containing SU(3) and U(2), apparently SU(3) × SU(2) × U(1)/ℤ6 (Note 28.4).
28.2 Cosmic topological defects
Breaking need not happen everywhere at once. A rapidly cooled iron ball becomes a patchwork of magnetization directions; slow cooling may even them out. Worse are topological defects, which no continuous wriggling can remove. The ferromagnetic example is a magnetic monopole: impossible with ordinary magnets and currents (Exercise 28.3), but achievable if the excess pole is "piped away" along a Dirac wire, which with magnetic sources allowed appears only as a glitch in the potential A and vanishes in the bundle picture (§15.4). Non-Abelian gauge theories have analogous monopoles.
- Monopoles: spatially 0-dimensional.
- Cosmic strings: spatially 1-dimensional. Gravitational field built by a scissors-and-paste cut of Minkowski space: remove a wedge of angle α ≈ 10−6 around the string and glue the faces.
- Domain walls: spatially 2-dimensional.
The "direction" broken is not a spatial direction but one in an internal vector bundle (e.g. The electron/neutrino mixture in electroweak theory). Which defects occur depends on the topology of the groups.
Cosmic strings were once proposed as seeds of galaxies. Penrose calls this extreme but not dismissible; one of the more plausible models instead seeds galaxies with supermassive black holes (Silk and Rees 1998), and black holes now count as conventional physics.
Most defect predictions come from GUTs without observational support. Electroweak breaking is well supported, but it yields monopoles only if gauge monopoles already existed in the unbroken phase, which would need an earlier GUT breaking.
Dirac (1931) showed that a single magnetic monopole anywhere would force all electric charges to be integer multiples of a unit inversely related to the monopole's strength. Charges are indeed quantised (in units of the anti-d-quark's ⅓ e), which some read as circumstantial evidence. But monopoles must be exceedingly rare, or they would short-circuit the cosmic magnetic fields seen across vast regions; the MACRO collaboration set stringent limits.
28.3 Problems for early-universe symmetry breaking
Penrose now takes an openly unconventional line: he questions whether electroweak breaking at 10−12 s was a real event or an artefact of how the theory is presented.
Suppose that before 10−12 s an exact U(2) symmetry held: massless quarks and leptons, "zig" electrons and neutrinos on an equal footing, W, Z and photon rotatable into each other. At the transition, a particular (W−, W+, Z0, γ) is chosen at random from the U(2)-symmetric space G of gauge-boson sets. One might define "the same" choice at different points to be whatever the breaking picked. But that contradicts gauge theory: the G-spaces are fibres of a bundle whose connection defines parallelism along curves, generally path-dependent (curvature = gauge field). Random choices will not match that parallelism, so the iron-ball patchwork is a fair analogy. The question is whether there is time for the mismatches to iron out.
An observer at p sees quasars q and r in opposite directions. With enough redshift their past light cones never intersect on Σ, so their gauge-boson choices were made independently. Yet the null lines qp and rp can carry only the photon, the one massless boson, so "photon" must mean the same thing all along both lines. If the choices at q and r differ, p should receive a baffling W–Z–γ confusion, or light would deviate from null paths and distant objects would not look sharp through telescopes. Inflation does not help, because the overlap it creates lies before the breaking surface. Penrose says he has not seen this discussed in the literature.
He does not abandon electroweak theory. Nature's true scheme, he believes, is still unknown; it should be finite without renormalization "tricks". Broken non-Abelian gauge symmetry gave a route to renormalizability and guided us toward real truths, but spontaneous breaking need not be Nature's actual mechanism; other routes reproduce the parameter relations (Llewellyn Smith 1973). Note 28.12 floats a role for quanglement between q and r.
Penrose doubts that large symmetry groups are "simple": to him they are complicated objects, and Nature may have fundamental asymmetries with symmetries only approximate (§34.8). This is a minority view. Since 2004 the electroweak crossover has been studied extensively on the lattice; in the standard model with a 125 GeV Higgs it is a smooth crossover, not a sharp transition, which softens (without endorsing) his worry about domains. His photon-confusion argument has had little uptake.
28.4 Inflationary cosmology
Origins
GUTs predicted far too many monopoles. In 1981 Alan Guth proposed (anticipated in essence by Alexei Starobinsky and Katsuhiko Sato) that an expansion by 1030, perhaps 1060, after monopole production but before 10−12 s would dilute them below detection. Inflation then acquired three more jobs:
| Problem | The puzzle | Inflation's claimed fix |
|---|---|---|
| Horizon | CMB temperature equal to 1 in 105 in directions u, v whose pasts never met (Fig. 28.5a) | Pushes the Big Bang back so the pasts overlap and thermalize (Fig. 28.5b) |
| Smoothness | Why matter and geometry are so uniform | Stretching irons out an irregular start |
| Flatness | Why space is so nearly flat | Stretching makes any region look K = 0 |
| Monopoles | GUT monopoles not seen | Diluted by expansion |
The de Sitter machinery
De Sitter space is a Lorentzian 4-sphere (signature + − − −) in Minkowski 5-space ds² = dt² − dw² − dx² − dy² − dz², pictured as a hyperboloid. Anti-de Sitter space is the analogue in a space of signature + + − − −; as a hyperboloid it has closed timelike curves, removable by "unwrapping" the (t, w) circles. Cutting de Sitter space along t = w and keeping the upper half gives the steady-state model with metric
ds² = dτ² − eAτ(dx² + dy² + dz²),
a flat FLRW model with exponential expansion. Bondi, Gold and Hoyle championed it in the 1950s and 1960s; it fell to the microwave background and distant galaxy counts. For (anti-)de Sitter space Rab ∝ gab; no ordinary matter has Tab ∝ gab (it would define no rest frame), so these are vacua with a cosmological constant: Rab = Λgab, with Λ = A².
- Cut de Sitter space to get the steady-state half.
- Select a greatly inflating slab between two constant-time surfaces.
- Cut a thin slice from a K = 0 FLRW model.
- Insert the slab. The result "pushes back" the Big Bang in the conformal diagram and widens particle horizons.
Driving it needs a new scalar inflaton φ, unrelated to other known fields (sometimes called a "Higgs" but not the electroweak one), possibly one per inflationary phase. Its potential V(φ) has a "marble" rolling down a slope through a false vacuum, inflation ending at the bottom. Scale comparison: today's Λ corresponds to about 10−30 the density of water; the inflationary false vacuum to about 1080 times water's density, dwarfing ordinary matter, which is why de Sitter describes that phase. Penrose regards the standard log–log history of the universe (Fig. 28.12) as very speculative before about 10−30 s, though it is presented as fact.
28.5 Are the motivations for inflation valid?
Penrose gives his "statutory warning": his critique is more negative than almost anyone's, and he recommends Guth's The Inflationary Universe for balance. He also concedes that bad motivations need not mean a wrong theory: Mach's principle guided Einstein yet is not part of general relativity, and Dirac's insistence on a first-order equation proved unnecessary. If inflation's predictions are confirmed, it can stand without its "ladder", and he notes inflationists' predictions "have measured up remarkably well".
He adds that cosmology attracts emotional and religious preferences, and that inflationists believe their theory "solves" the Big Bang's precision; yet he has never seen the Second Law puzzle seriously raised by inflationists. On aesthetics: the inflaton is ad hoc, and the preference for K = 0 is contentious; Penrose and many mathematicians find hyperbolic K < 0 more beautiful.
Suppose two regions have equal temperature at time t1. Either (a) they were unequal at an earlier t0 and thermalized, in which case entropy rose and the universe was even more special at t0: the problem got worse. Or (b) they were already equal, and nothing was explained. Invoking thermalization to explain the early universe's specialness is "worse than useless", because thermalization is itself an expression of the Second Law.
Why stretching cannot smooth a generic start
- Fractals do not iron out. Magnify the Mandelbrot set and it gets less smooth, not more. A generic initial geometry is likely fractal or worse.
- What generic looks like. Take a collapsing universe's messy Big Crunch of congealing black holes (Fig. 27.20a, b) and reverse time: that is a generic Big Bang. Penrose admits no one knows its detailed structure (the best guess is the chaotic BKL singularity of Belinskii, Khalatnikov and Lifshitz, 1970).
- The decisive argument. Start with any irregular collapsing universe; the singularity theorems say it ends in a generic singularity. Time-reverse it: a perfectly lawful evolution from a generic singularity to an irregular universe. The laws permit inflation, yet it need not occur or help. So "the physical possibility of an inflationary period is of no use whatever" for guaranteeing uniformity.
- Circularity. Phase transitions and symmetry breaking also run "by the good grace of the Second Law"; they use it rather than explain it. And all serious inflation calculations assume FLRW geometry from the start.
Note 28.20 traces the idea to chaotic cosmology (Misner and Zeldovich, 1960s), which also hoped thermal processes would smooth a random start.
28.6 The anthropic principle
The universe we perceive must be such as to produce perceivers. That explains, for instance, why our planet's temperature and water are congenial; elsewhere we would not be here.
Dirac (1937) noticed that the universe's age in Planck units is linked to the ratio of electric to gravitational force between proton and electron (Note 28.25: the cube root of the age is close to the square root of that force ratio). Taking this as a law, he suggested G decreases with time, which evidence now rules out. Robert Dicke (1957, 1961) and Brandon Carter (1973) showed the coincidence follows from the lifetime of Sun-like stars: beings who evolve near such a star necessarily observe at an epoch where it holds. A clean anthropic explanation.
| Version | What is varied | Penrose's assessment |
|---|---|---|
| Weak (Carter) | Where and when in one universe with fixed laws | Respectable, with uncertainty about what life needs |
| Strong | The constants themselves, across an ensemble of universes (or by "Divine Purpose") | Often a "cop-out" when theory runs out; he dislikes it |
Examples of apparent fine tuning:
- Hoyle's carbon level. Fred Hoyle predicted a then-unknown excited state of carbon needed for stellar nucleosynthesis of heavier elements; William Fowler's group found it in 1953. Penrose first heard the weak idea in Hoyle's BBC radio talks and the strong form in his lecture "Religion as a Science".
- Neutron heavier than proton. 1838 vs 1836 electron masses; stable nuclei and chemistry depend on this slight excess.
His objections: in a spatially infinite uniform universe (K ≤ 0), life will occur somewhere by chance if it is possible at all, so the strong principle can only demand that sentience be possible, which is unusable since we do not know its prerequisites. Better to ask, given the constants, where life is most probable: on an Earth-like planet near a Sun-like star after 109 to 1010 years.
Recycling universes
- Wheeler (1973). A cyclic universe whose bounces reshuffle the constants, physically realising the anthropic ensemble. Friedmann's K > 0 cycloid was once called "oscillating", but classical relativity cannot smooth the crunch-to-bang singularity.
- Smolin's The Life of the Cosmos. Each black-hole singularity spawns a new universe with slightly altered constants; natural selection favours universes that make many black holes, and ours seems tuned to do so. Penrose: the anthropic filter still applies (we cannot be in a "sentience-dead" phase); converting one hole's mass into a universe 1022 times heavier needs unknown physics where "all bets are off". Note 28.31 admits he floated the black-hole-baby idea non-seriously in his 1966 Adams Prize essay.
- His main objection to both. No known physics bounces singularities and readjusts constants; worse, it is geometrically implausible that the wildly irregular singularities of collapse could turn into the smooth, uniform Big Bang a new universe needs for a Second Law.
28.7 The Big Bang's special nature: an anthropic key?
The anthropic-inflationary hybrid: a generic Big Bang will not inflate as a whole, but a tiny smooth patch might, and life requires a big old universe, so we find ourselves in an inflated patch. Penrose's rebuttal is a costing exercise.
- Whole observable universe: precision 1 in 1010123 (black-hole entropy of its mass).
- Region one tenth the radius: mass 10−3 of the whole, black-hole entropy 10−6 (S ∝ M²), so precision only 1 in 1010117.
- Ratio: the bigger universe is about 1010123 times less likely (Exercise 28.8).
- A thousand small universes, matching the observers of one big one, are still cheaper by about the same factor (Exercise 28.9).
- Solar system by random collision of particles and radiation, inhabitants included: about 1 in 101060, "chicken feed" beside 1010123.
So life needs neither the CMB nor the uniform distant universe, nor even Darwinian evolution, nor a Second Law before life existed. The "cheapskate" Creator would pick the curve (c)(b) of Fig. 27.8, not the observed (d)(b), inflation or not. The anthropic principle does not merely fail to explain the specialness; it predicts a universe far less special than ours. Two attitudes remain: an "act of God", or a precise law fixing the Big Bang, presumably through quantum gravity. Penrose chooses the second, noting (Note 28.33) Abhay Ashtekar's suggestion that something other than quantum gravity might be responsible, while stressing that it was gravity alone that was special.
Penrose's costing is the ancestor of the modern Boltzmann brain problem: if observers are selected by probability, random fluctuations producing lone observers vastly outnumber evolved ones in a low-entropy universe. Defenders of the anthropic string landscape and eternal inflation (Susskind, Linde, Bousso) answer with measure prescriptions over the multiverse; no measure is agreed. Critics note that Penrose's own probabilities assume a uniform measure on phase space, which an anthropic theorist need not accept.
28.8 The Weyl curvature hypothesis
Gravity's degrees of freedom are carried by the Weyl conformal tensor Cabcd; in vacuum all curvature is Weyl. Weyl curvature distorts (tidal) while Ricci curvature reduces volume. The distinction is cleanest for light rays (and Λgab does not focus them; only the trace-free Ricci part matters, Note 28.34):
Ricci curvature (matter)
- Acts as a positive focusing lens.
- Magnifies the star field seen through a body.
- Dominant in a uniform matter distribution.
Weyl curvature (free gravity)
- Acts as a purely astigmatic lens: focusing in one plane, equal defocusing in the perpendicular plane.
- Turns small circles into ellipses, preserving area (Exercise 28.11).
- Grows as matter clumps, diverging at black-hole singularities.
The thought experiment: look at the stars through a transparent, non-refracting Sun (with massless neutrinos). Rays through the body are magnified (Ricci); rays outside the rim show astigmatic elliptical distortion (Weyl), which is essentially what Eddington's 1919 eclipse expedition saw.
Now follow a universe from near-uniform matter: initially curvature is Ricci-dominated; as matter clumps, Weyl curvature grows around the clumps and diverges at black-hole singularities. FLRW models are conformally flat (C = 0). So the geometric difference between the low-entropy Big Bang and high-entropy final singularities is: Weyl curvature zero (or small, e.g. Finite) initially, unconstrained and wildly divergent finally.
Cosmic censorship (unproved) says collapse produces black holes, not naked singularities that signals can both enter and leave (except in contrived cases). Then physical singularities are spacelike or null, either initial (signals escape into the future) or final (signals enter from the past).
The Weyl curvature is constrained to be zero (or at least very small) at initial singularities, in the actual physical universe.
Penrose's Weyl curvature hypothesis, §28.8This single constraint would deliver a Second Law in the form we observe. There is good mathematical evidence (Newman 1993; Claudel and Newman 1998; Tod and Anguige 1999) that it forces an early universe close to FLRW. Note 28.36 singles out Paul Tod's version: at any initial singularity there is a regular conformal geometry with boundary. As an assertion it is still close to "an act of God"; a theory is needed.
28.9 The Hartle–Hawking no-boundary proposal
Fifty years of quantum gravity have produced no consensus, and few approaches even address the Big Bang's nature. The notable exception is James Hartle and Stephen Hawking (1983).
- Wick rotation. Gian Carlo Wick's trick replaces t by τ = it, turning Minkowski space into Euclidean 𝔼4 with dℓ² = dτ² + dx² + dy² + dz². QFT is built there, where path integrals converge better (the rotation group O(4) is compact, the Lorentz group O(3,1) is not), then continued back; done carefully it secures positive frequency.
- Hawking's extension. Rotate not the background but the individual spacetimes summed in the gravitational path integral, so they may carry positive-definite (Riemannian) metrics, a large leap beyond Wick.
- No boundary. Near the Big Bang, Riemannian geometries dominate and close off the bottom smoothly, like the bottom of a bowl; later a transition (via complex metrics) leads to classical Lorentzian spacetime. This seems to favour a smooth early universe compatible with the Weyl curvature hypothesis.
- Unstable continuation. Path integrals are always approximated, then analytically continued, and a function known approximately on one axis can be wildly different on another. Add ε cos(Ax) to f(x), with ε tiny and A large: almost no change on the real axis, a huge change on the imaginary axis (Exercise 28.12, since cos(iAy) = cosh(Ay)).
- Hidden structure. Euclideanizable theories carry structures from a symmetry group of the "wrong signature"; why should the correct theory be of that kind?
- No time asymmetry. The proposal is time-symmetric, so it should apply to final singularities too. Hawking (1982) argued the closing-off simply defines which end is the "beginning", but Penrose replies that the final singularity's boundary is still there: "only one-half of the boundary-removal problem has been attended to".
- Riemannian vs Lorentzian. Note 28.39 cites Renate Loll and collaborators: summing Lorentzian geometries (causal dynamical triangulations) may behave very differently.
Try it in Python: why analytic continuation of an approximation is dangerous
import numpy as np
f = lambda z: np.exp(-z**2)
g = lambda z: f(z) + 1e-6*np.cos(50*z) # tiny wiggle added
x = np.linspace(-3, 3, 601)
print("max change on real axis:", np.max(abs(g(x)-f(x))))
for y in (0.1, 0.5, 1.0):
z = 1j*y
print(f"at x = {y}i: f = {f(z).real:.3g}, perturbed = {g(z).real:.3g}")
Output:
max change on real axis: 9.999999999177334e-07
at x = 0.1i: f = 1.01, perturbed = 1.01
at x = 0.5i: f = 1.28, perturbed = 3.6e+04
at x = 1.0i: f = 2.72, perturbed = 2.59e+15
A change of one part in a million on the real axis becomes a factor of 1015 one unit up the imaginary axis: Penrose's objection in three lines.
28.10 Cosmological parameters: observational status (2004)
K flip-flops. The original no-boundary proposal pointed to K > 0; when data seemed to favour K < 0, Hawking and Turok (1998) adapted it. Inflation predicted K = 0 for years; some inflationists (Bucher et al. 1995, Linde 1995) adapted to K < 0. Then Λ > 0 made K = 0 viable again, so small K of either sign is still open: "all bets are off".
- Baryons: Ωb ≈ 0.03, about 1/30 of critical.
- Dark matter: about 10 times the baryons, Ωd ≈ 0.3 (baryons included).
- Cosmological constant: ΩΛ ≈ 0.7, from the 1998 supernova teams (Perlmutter; Schmidt with "Kirschner").
- Total: Ω ≈ 0.3 + 0.7 = 1, consistent with K = 0.
- Vacuum-energy prediction: too big by 10120 (or at least 1060), the cosmological constant problem.
Notes and caveats in Penrose's account:
- MOND. Note 28.42 gives sympathetic attention to Mordehai Milgrom's modified dynamics, which fits galaxy data remarkably well but lacks a coherent theory.
- Acoustic peaks. The CMB power spectrum peaks near ℓ ≈ 200, from sound waves in the early plasma at the horizon scale at decoupling. Peak positions shift with K (smaller ℓ for K > 0), and the data are broadly consistent with K = 0, plus a nearly scale-invariant spectrum as some inflation models predicted.
- Low quadrupole. At ℓ = 2, data fall well below the scale-invariant prediction (confirmed by the next few harmonics), "almost hidden (accidentally?) by the vertical axis" in published plots; a curvature scale K ≠ 0 might explain it.
- Wasted information. The ℓ-spectrum uses a tiny fraction of the 2ℓ + 1 numbers per ℓ in WMAP's map.
- Gurzadyan's ellipticity. Vahe Gurzadyan and colleagues (1992 to 2004) report elongated temperature spots in COBE, BOOMERANG and WMAP maps, which they attribute to geodesic mixing in a K < 0 universe with Ω ≈ 0.9 and Λ of the supernova size.
- Coincidence problem. Ωd and ΩΛ change over time yet are comparable now.
Fashion renamed Λ dark energy, vacuum energy or quintessence and allowed it to vary. But ∇aTab = 0 permits adding a multiple of gab to Tab only if the multiple is constant (Exercise 28.13). A varying "Λ" must be paid for with non-conservation of ordinary mass-energy.
His conclusion: inflation is not confirmed, and even if it were, it would not touch the 1 in 1010123 problem. Any proposal (inflation, Hartle–Hawking) built on time-symmetric physics cannot explain a time-asymmetric singularity structure. The remedy, he will argue, needs time-asymmetric fundamental physics, tied to the unresolved measurement problem, hence Chapters 29 and 30.
| Proposal | What it claims to explain | Penrose's objection | Status in 2026 |
|---|---|---|---|
| Inflation | Horizon, flatness, smoothness, monopoles | Uses the Second Law; cannot smooth a generic start | Mainstream; predicted ns < 1 confirmed; no B-modes yet |
| Strong anthropic | Values of constants and initial state | Grossly too extravagant | Revived by the string landscape; measure problem unsolved |
| Wheeler / Smolin bounces | Variation of constants | No physics for bounce; irregular singularity cannot become smooth | Minority; Smolin's low neutron-star mass ceiling is strained by pulsars of at least 2 M☉ |
| Hartle–Hawking | Smooth beginning from quantum gravity | Unstable continuation; time-symmetric | Disputed: Lorentzian path-integral analyses (Feldbrugge, Lehners, Turok 2017) question stability |
| Weyl curvature hypothesis | Statement of the special initial state | Needs a theory | Tod's version led to Penrose's CCC (2005 onward) |
What the exercises ask
- Hats (28.1, 28.2). Show a given potential breaks SO(p) to SO(p − 1), and U(2) to U(1) via E = (|w|² + |z|² − 1)², linking to Clifford parallels.
- Monopoles (28.3). Use Chapter 19's integral formulae to show no arrangement of magnets and currents makes a monopole.
- De Sitter (28.4 to 28.6). Write the hyperboloid equations, find steady-state coordinates, find FLRW forms with hyperbolic slices, and see without calculation why Rab ∝ gab.
- Costing (28.7 to 28.9). Why the one-tenth region needs 10−6 of the entropy, and the comparative figures.
- Lensing (28.10, 28.11). Why Λ does not focus light; why Weyl distortion preserves area.
- Continuation (28.12). Use eAix + e−Aix to see the instability. Λ constancy (28.13).
| Term | Meaning |
|---|---|
| Spontaneous symmetry breaking | Symmetric laws, asymmetric ground state chosen at random |
| Phase transition | Abrupt change of stable state with temperature |
| Topological defect | Monopole, string or wall that no smooth deformation removes |
| Horizon problem | Regions in causal isolation share one temperature |
| Inflaton | Scalar field whose false vacuum drives inflation |
| De Sitter space | Vacuum with positive Λ; Lorentzian 4-sphere |
| Weak / strong anthropic | Selection of location / selection of laws and constants |
| Weyl curvature hypothesis | Initial singularities have vanishing (small) Weyl curvature |
| Cosmic censorship | Collapse singularities are hidden behind horizons |
| No-boundary proposal | Big Bang closed off by Riemannian geometries in a path integral |
- CMB verdicts. Planck 2018: curvature Ωk = 0.0007 ± 0.0019 (with BAO), so K = 0 to high precision; spectral index ns ≈ 0.965, a slight departure from scale invariance that simple inflation predicts. The low-ℓ deficit and other large-angle anomalies persist at the 2 to 3σ level.
- No primordial gravitational waves yet. BICEP/Keck (2021): r < 0.036; with Planck, about r < 0.032. This has eliminated the simplest φ² and φ⁴ inflation potentials; Starobinsky-type models survive.
- Dark energy wobbles. DESI DR2 (2025) baryon acoustic oscillations, combined with CMB and supernovae, prefer an evolving dark energy over a constant Λ at about 2.8 to 4.2σ, depending on the supernova sample. If confirmed, Penrose's §28.10 argument implies matter-energy must not be separately conserved, or a new field is at work.
- Budget and tension. Ωb ≈ 0.049, total matter ≈ 0.31, Λ ≈ 0.69. The Hubble tension (67 vs 73 km/s/Mpc) is unresolved; JWST finds surprisingly mature galaxies at z > 10.
- Monopoles and strings. No monopoles found (MoEDAL at the LHC adds limits); cosmic strings are constrained by CMB and by the pulsar-timing gravitational-wave background (NANOGrav and others, 2023).
- MOND tested. Wide-binary-star studies with Gaia (2023 to 2024) remain contested, with the most careful analyses disfavouring MOND.
- Supernova credit. The 2011 Nobel Prize went to Perlmutter, Schmidt and Riess; Penrose's "Kirschner" is Robert Kirshner, Schmidt's colleague.
Penrose's critique of inflation is a model of auditing explanations. Ask of any proposed fix: does it consume the very resource it claims to explain? In a bank's risk stack, a "data-quality" layer that relies on the same upstream feed it is meant to validate is thermalization in disguise: it can only spread an existing error, never explain where the clean signal came from.
Chapter 29 sets out the measurement paradox; Chapter 30 argues that gravitational state reduction is the time-asymmetric physics that could underwrite the Weyl curvature hypothesis; §34.4 and §34.3 revisit inflation and scientific fashion.
The Measurement Paradox
Quantum mechanics explains spectra, chemistry, lasers and superconductors, yet it runs on two incompatible rules: smooth deterministic U and the random jump R. Penrose sorts the responses into six ontologies, (a) Copenhagen, (b) many worlds, (c) environmental decoherence, (d) consistent histories, (e) pilot wave, (f) a new theory with objective R, and uses the density matrix to show why the "standard" three only hide the paradox. His conclusion: none supplies a scale at which the quantum gives way to the classical, so a new theory of type (f) is needed.
29.1 The conventional ontologies of quantum theory
Quantum theory's successes are vast: spectral lines, the stability of atoms, chemical bonds, colours and strengths of materials, ferromagnetism, phase transitions, black-body radiation, the reliability of inheritance, and twentieth-century phenomena such as liquid crystals, superconductivity, superfluidity, lasers, Bose–Einstein condensates, EPR non-locality and teleportation. Penrose calls it a revolution in our picture of reality greater than curved spacetime. "Or has it?" Many physicists hold that the formalism gives no picture of reality at all.
The trouble is the U/R conflict. U evolves the state vector |ψ⟩ deterministically by a differential equation, like Maxwell's field; R makes it jump discontinuously and at random, with only probabilities fixed. A world described by U alone would have been easy to accept as real. The observed world mixes U with interjections of R, which made physicists doubt |ψ⟩ could describe reality. This is the measurement problem, which Penrose prefers to call the measurement paradox.
(a) Copenhagen
- Niels Bohr's view: |ψ⟩ describes the experimenter's knowledge, not quantum-level reality.
- R is knowledge jumping, not physics.
- Only the classical world of apparatus is real. Variant: the classical level is the observer's consciousness.
(b) Many worlds
- |ψ⟩ is the whole reality; R never happens.
- All outcomes coexist in a grand superposition, the "multiverse", which Penrose prefers to call the omnium (a term from classicist Peter Derow).
- Observers' mind states are entangled with outcomes, each copy perceiving one result. Hugh Everett III, 1957; Penrose admits entertaining it privately in the mid-1950s.
Opposite as they look, (a) and (b) agree that |ψ⟩ does not describe the single-outcome world we experience, and both lean on a human perceiver: in (a) |ψ⟩ is an artefact of perception, in (b) ordinary reality is carved out by perception. In both, the jumping of R is "all in the mind".
The most prevalent view is (c) environmental decoherence, more pragmatic than ontological. A measured system is entangled with an environment of countless randomly moving particles whose details are unobservable; one sums over them to get a density matrix. Its holders call themselves positivists; Penrose quotes Stephen Hawking: "I don't demand that a theory correspond to reality because I don't know what it is... All I'm concerned with is that the theory should predict the results of measurements." Penrose's position is the reverse: ontology is essential. Note 29.4 places in camp (c) everyone who says cat superpositions are no problem because detecting their interference would be "far too expensive".
29.2 Unconventional ontologies
- (a) Copenhagen. No quantum reality; classical apparatus or consciousness is real.
- (b) Many worlds. Unitary |ψ⟩ of the universe is all; no R.
- (c) Environmental decoherence. Entangle with the environment, trace it out, read the diagonal density matrix as outcomes.
- (d) Consistent histories. Griffiths, Omnès, Gell-Mann and Hartle: coarse-grained histories with inserted projector sets.
- (e) Pilot wave. de Broglie, Bohm, Hiley: actual particle configurations guided by ψ.
- (f) New theory with objective R. Both U and R real; present quantum mechanics an approximation, experimentally distinguishable.
(d) and (e) change the formalism but are not expected to differ experimentally; (f) is. Penrose "comes clean": he is a strong believer in (f) and will present his own version in Chapter 30. Note 29.6 also mentions path-integral ontologies (Sorkin) and transactional pictures (Aharonov–Vaidman, Cramer, Costa de Beauregard) with one wavefunction propagating forward and another backward; none, in his view, resolves the paradox without further ingredients.
Projector sets and consistent histories
A measurement by an observable Q with distinct eigenvalues q1, …, qr can be replaced by its projector set E1, …, Er:
- Projectors: Ei² = Ei = Ei∗.
- Orthogonal: EiEj = 0 for i ≠ j.
- Complete: E1 + E2 + … + Er = I.
- Spectral form: Q = q1E1 + … + qrEr (the E's are Q's principal idempotents, Exercise 29.1).
- Projection postulate: on result qj, |ψ⟩ jumps to (a multiple of) Ej|ψ⟩, with probability ⟨ψ|Ej|ψ⟩ for normalised ψ.
In (d), a coarse-grained history is a Schrödinger evolution from |ψ0⟩ under H with projector sets inserted at chosen times. These are not measurements; they act more like refinements of coarse-graining boxes (as in §27.3). A family of histories is consistent (or "decoherent") if quantum probabilities obey classical probability rules, i.e. No interference between them (Note 29.9 gives the condition: the real part of a certain multi-projector expression vanishes when any projector pair differs). A set is maximally refined if no further projector set can be inserted without losing consistency. Penrose suggests one history from a maximally refined set as a natural "real world" ontology, though what he hears expressed is closer to the totality of all such sets, an ensemble even vaster than many worlds. Its advantage over (b): it does deliver the correct probabilities.
The pilot wave
(e) is "refreshingly down to Earth". For one spinless particle, its actual position is the firmer level of reality; it really goes through one slit, guided by ψ, which has a secondary reality. Often |ψ| defines a quantum potential and arg ψ the pilot wave. In general ψ lives on configuration space C and guides a point P; |ψ|² gives the probability density, P gives the actual configuration. Subtleties: ψ is highly non-local and holistic (unavoidable in any quantum theory); the initial distribution must be |ψ|² and remain so after successive measurements; reducing all measurements to position is questionable (strict position measurements are not legitimate, and spin sits awkwardly). Still, its ontological clarity is "greatly to its credit".
Why U and R cannot both be fundamental
- Discontinuity. R jumps (unless the state is already an eigenstate); U is continuous.
- Indeterminism. Even a gradual R gives different outputs from the same input, which no unitary map does.
- Yet they dovetail. R's squared-modulus rule uses scalar products that U preserves, giving conservation of probability. This tightness is why physicists are reluctant to "monkey with" quantum theory.
Penrose wants change, but not tinkering: a revolution that respects quantum theory's structure as relativity and quantum mechanics respected Newton's Lagrangian/Hamiltonian/symplectic structure. Most proposals so far (Note 29.12 lists Károlyházy, Komar, Pearle, Ghirardi, Kibble, Weinberg, Diósi, Percival, Gisin, Leggett and his own) are tinkering, though some may point the way.
29.3 The density matrix
Suppose the state is |ψ⟩, |ϕ⟩, …, or |χ⟩ (normalised) with probabilities p, q, …, s summing to 1. The density matrix (John von Neumann, 1932) is
D = p|ψ⟩⟨ψ| + q|ϕ⟩⟨ϕ| + … + s|χ⟩⟨χ|,
with index form Dαβ. It is Hermitian (D∗ = D), non-negative (⟨ξ|D|ξ⟩ ≥ 0) and of unit trace.
Why not just use a probability distribution on Hilbert space, as one uses one on classical phase space? Because a YES/NO question E has probability ⟨ξ|E|ξ⟩ for a state, hence for the mixture
probability of YES = trace(ED).
All measurement probabilities (and expectation values) need only D, and many different mixtures share the same D. The density matrix fuses two different kinds of probability, classical ignorance (p, q, …) and quantum squared moduli, without distinguishing them.
29.4 Density matrices for spin ½: the Bloch sphere
A spin-½ particle is up or down with probability ½ each. Measure up/down: the ½'s are classical. Measure left/right: each state gives ½ by the quantum rule, so again ½ each, now purely quantum. In any other direction, a blend of the two. Equally, an even mixture of left and right, or of any antipodal pair, gives the same D = ½I and identical predictions.
If the quantum state is real, these mixtures are ontologically distinct. Many physicists, especially decoherence adherents, instead treat D itself as the better description of reality and call it a "state": a pure state if D = |ψ⟩⟨ψ|, mixed otherwise. Penrose refuses that usage. A pure density matrix is equivalent to the point of projective Hilbert space ℙℋ (phase freedom |ψ⟩ ↦ eiθ|ψ⟩ removed), but phases matter when the system is part of something larger, and working with |ψ⟩⟨ψ| obscures the basic complex linearity. He keeps D as "a useful device", not reality.
The Bloch sphere: the general 2 × 2 Hermitian unit-trace matrix is D = ½(I + aσ1 + bσ2 + cσ3) (in Pauli form), and it is a density matrix exactly when
a² + b² + c² ≤ 1
(Exercise 29.8: the determinant, the product of eigenvalues, must be non-negative). The solid ball B³ holds all density matrices; its boundary S² holds the pure states and is the Riemann sphere of spin directions. For n > 2 states the space has n² − 1 dimensions and only part of its boundary, a ℂℙn−1, is pure (Note 29.15).
Any interior point L lies on infinitely many chords, each giving a decomposition into two pure states with weights in the ratio of the segment lengths (Exercise 29.9). Only at the centre are all the pairs orthogonal; orthogonality is not required of a mixture.
Try it in Python: one density matrix, many ontologies
import numpy as np
up, dn = np.array([1,0]), np.array([0,1])
rt, lt = (up+dn)/np.sqrt(2), (up-dn)/np.sqrt(2)
P = lambda v: np.outer(v, v.conj())
print(np.allclose(0.5*P(up)+0.5*P(dn), 0.5*P(rt)+0.5*P(lt))) # same D
M = np.array([[1,1],[1,0]])/np.sqrt(3) # Hardy-type state, rows Earth, cols Titan
D = M @ M.conj().T
print(np.round(D*3,6), np.round(np.linalg.eigvalsh(D),4), np.round([(3-5**.5)/6,(3+5**.5)/6],4))
for name,t in (("right",rt),("left",lt)):
e = M @ t; p = e@e; print(name, round(p,4), np.round(e/np.sqrt(p),4))
Output:
True
[[2. 1.]
[1. 1.]] [0.1273 0.8727] [0.1273 0.8727]
right 0.8333 [0.8944 0.4472]
left 0.1667 [0. 1.]
The first line confirms that up/down and right/left mixtures are the same D. The rest models a Hardy-type entangled pair with amplitudes |↑↑⟩ + |↑↓⟩ + |↓↑⟩: Earth's density matrix has unequal eigenvalues ½ ± √5/6, and if Titan measures right/left, Earth receives |↓⟩ with probability 1/6 or the state (2|↑⟩ + |↓⟩)/√5 with probability 5/6, two non-orthogonal states, neither of them an eigenvector of D.
29.5 The density matrix in EPR situations
An EPR pair in total spin 0 is emitted between Earth and Titan, twice as far from Earth (Titan is about 3 light hours away). A colleague on Titan measures up/down about half an hour before Penrose's particle reaches Earth, too soon for any message. Penrose's particle is then |↓⟩ or |↑⟩ with probability ½ each: D = ½I. If the colleague switched at the last minute to left/right, Penrose would instead have |→⟩ or |←⟩ with ½ each: the same D. It must be the same, or Titan could signal faster than light by choosing the measurement direction (Exercise 29.10).
So for an observer without information from Titan, D is an excellent description. Knowing the type of measurement changes one's ontology but not one's probabilities. Knowing the results does change them and imposes consistency constraints (Penrose cannot find |↑⟩ if the colleague found |↑⟩), and then only the full entangled |Ω⟩ = |↑⟩|↓⟩ − |↓⟩|↑⟩ will do.
The equal-eigenvalue D is special (it is a multiple of I, the same in every basis). With an initial spin-1 pair, any 2 × 2 density matrix can be produced (Exercise 29.13); the Hardy example of §23.5 gives unequal eigenvalues and a non-orthogonal decomposition depending on which direction Titan measures. With a spin-n/2 parent splitting into spin ½ (to Earth) and spin (n − 1)/2 (to Titan), Titan's measurement has n outcomes, giving mixtures of n states, more than the dimension. There is no unique ontology of probability-weighted states behind any density matrix.
Summing over the unknown states. Write the entangled state as ψαρ (α here, ρ there), normalised by ψαρψ̄αρ = 1. Earth's density matrix is Dαβ = ψαρψ̄βρ (contract over Titan's index); Titan's is the analogue contracted over α. This is the partial trace.
29.6 The FAPP philosophy of environmental decoherence
Viewpoint (c) treats the system as "here" and the environment as "there". Summing over the environment, much work shows the system's D becomes, very fast, almost diagonal in some preferred basis |1⟩, …, |n⟩, which is then read as a probability mixture of those states with probabilities p1, …, pn: R explained.
- Ontology does not follow. A diagonal D has many decompositions; nothing licenses reading it as "the state is |1⟩ or |2⟩ or …". (Exercise 29.15: every density matrix is diagonal in some basis.)
- Technology-dependent physics. Nothing forbids extracting the environment's information in principle; better technology would keep the state-vector description longer. Treating reality as a density matrix makes it depend on current technology. This is FAPP, John Bell's acronym for "for all practical purposes": a pragmatic convenience, not fundamental truth.
Penrose does allow that phase information might be lost in principle through some deeper principle, likely involving gravity:
- Spacetime foam. Wheeler's idea that at the Planck scale (~10−35 m) quantum fluctuations make spacetime a seething foam with topology changes, where phase relations might be "lost in the foam".
- Black-hole information loss. Hawking's (1976) suggestion that information swallowed by a black hole is lost, so external physics entangled with the infallen part is truly a density matrix.
29.7 Schrödinger's cat with Copenhagen ontology
Penrose's version: a source S emits one photon toward a beam splitter; in one beam a detector triggers a device that kills the cat, in the other the photon escapes and the cat lives. By linearity of U, the state becomes a complex superposition of a dead and a live cat (the cat being only dramatic; the experiment of §30.13 uses no animals).
- Copenhagen (a). The detector is a classical device; the photon's wavefunction is a calculating tool; with a 50/50 splitter, the cat has a 50% chance of dying. Physically correct, but why may a detector made of protons and electrons be treated classically, and at what stage does classicality arise? Bohr's stance was a necessity in the early days; it is a "stop-gap".
- Consciousness variant. If U holds right up to conscious beings, that is (b); if U fails for conscious beings, that is a version of (f), as proposed by Eugene Wigner (1961).
Take an Earth-like planet with no consciousness for light years around. Weather is chaotic, so within about a month its pattern depends on amplified quantum events. If only consciousness triggers R, the planet's weather is a superposed mess until a conscious traveller or probe looks, when it suddenly becomes ordinary weather "as though it had been ordinary weather all the time". No contradiction with experience, but Penrose finds this "Wigner reality" unbelievable. Note 29.20 insists his own view is fundamentally different from consciousness-causes-collapse, and that he has been misrepresented on this.
29.8 Can other conventional ontologies resolve the cat?
Many worlds (b)
Entangle cat, environment and observer:
|Ψ⟩ = w|live cat⟩|live env⟩|perceiving live cat⟩ + z|dead cat⟩|dead env⟩|perceiving dead cat⟩.
The claim is that perception always lands in one branch. Penrose: nothing in the formalism forbids a perception of a superposition. With w = z (environment absorbed into the cat states) the same state can be rewritten as
√8|Ψ⟩ = (|live⟩ + |dead⟩)(|perc. Live⟩ + |perc. Dead⟩) + (|live⟩ − |dead⟩)(|perc. Live⟩ − |perc. Dead⟩),
exactly as the EPR singlet can be rewritten in any basis. Unequal amplitudes do not rescue the view: then there is a unique orthogonal pairing, the Schmidt decomposition |Ψ⟩ = λ|α⟩|β⟩ + μ|ρ⟩|σ⟩, but the preferred cat states are generally superpositions of live and dead, not the states we want (as the Hardy example shows: its density-matrix eigenvectors differ from Titan's macroscopic alternatives).
Many worlds needs a theory of perception precise enough to say which states count as perceptions, to forbid superposed perceptions, and to reproduce the squared-modulus rule to quantum accuracy. No such theory exists, so (b) has not resolved the cat.
Decoherence (c), step by step
- The photon's emission is real; after the splitter there is a real superposition of two beams.
- Each branch evolves into cat plus environment: still a real superposition.
- The environment is summed over: a 2 × 2 density matrix. Ontology shift one: reality becomes D.
- D becomes almost diagonal in the (live, dead) basis. Ontology shift two: reality becomes "live or dead".
Since D has no unique decomposition, this double ontology shift is unjustified. Position (c) "is indeed FAPP, and it gives us no consistent ontology for physical reality".
29.9 Which unconventional ontologies may help?
- Consistent histories (d). The extravagant ontology needs a theory of perceivers (the IGUS, "information gathering and using system", of Gell-Mann and Hartle) which is far from adequate. The economical ontology depends on consistency selecting quasi-classical worlds, but Dowker and Kent (1996) showed consistency alone is far from enough. Above all, since the inserted projectors are explicitly not measurements, (d) says nothing about what a measurement is or why apparatus and cats behave classically while photons do not.
- Pilot wave (e). Clearest ontology among theories with standard predictions, but no parameter says which systems are "big" (particle-like) and which "small" (wave-like). Distance is not it, since quantum effects reach tens of kilometres. Any approach without measurable deviations lacks such a scale measure. And deterministic dynamics alone cannot produce R, which is probabilistic; probabilities must be put into the initial state.
- Objective R (f). Most proposals look unnatural, are non-relativistic, add arbitrary parameters, violate energy conservation, or conflict with observation. Penrose will be "uniformly unfair" to them all by presenting only his own minimalist proposal in Chapter 30.
| Ontology | Is ∣ψ⟩ real? | Does R happen? | Penrose's main objection |
|---|---|---|---|
| (a) Copenhagen | No | As a change of knowledge | Why is apparatus classical? A stop-gap |
| (b) Many worlds | Yes (the omnium) | No | Needs a precise theory of perception and of probabilities |
| (c) Decoherence | Shifts to D | Only FAPP | Double ontology shift; technology-dependent |
| (d) Consistent histories | Partly | R-like steps, not measurements | Dowker–Kent: consistency insufficient; no account of measurement |
| (e) Pilot wave | Yes (guiding) | Effectively, via configuration | No scale for big vs small |
| (f) Objective R | Yes | Yes, physically | Existing models unnatural; Penrose offers his own |
What the exercises ask
- Spectral decomposition (29.1). Q = Σ qjEj; diagonalisation; modifications for normal Q.
- Density matrix properties (29.2 to 29.4). Hermitian, positive, unit trace; probability = trace(ED).
- Spin mixtures (29.5, 29.6). Mixed classical/quantum probabilities for slope θ with the ½(1 + cos θ) rule; equality of the three D's.
- Bloch geometry (29.7 to 29.9). Pure density matrices of w|ψ⟩ + z|φ⟩; a² + b² + c² ≤ 1; chord-ratio weights.
- EPR (29.10 to 29.14). Why D cannot depend on Titan's choice; Hardy's matrix, its eigenvalues and distance from centre; any 2 × 2 D from a spin-1 parent; summing over unknown states.
- Decoherence and Schmidt (29.15, 29.16). Every D is diagonal somewhere; orthogonal decompositions occur only along eigenvectors.
| Term | Meaning |
|---|---|
| Measurement paradox | Conflict between deterministic U and probabilistic R |
| Omnium | Penrose's word for the many-worlds total state |
| Projector set | Orthogonal, complete set of projectors from an observable |
| Density matrix | D = Σ pi∣ψi⟩⟨ψi∣; probabilities via trace(ED) |
| Bloch sphere | Ball of 2-state density matrices, pure states on its surface |
| Partial trace | Summing over unobserved ("there") indices |
| FAPP | Bell's "for all practical purposes" |
| Schmidt decomposition | Unique orthogonal pairing in a bipartite entangled state |
| Consistent histories | Coarse-grained histories obeying classical probability |
| Pilot wave | Configuration guided by ψ on configuration space |
- No consensus, still. A 2025 Nature survey of more than a thousand physicists found no majority interpretation: Copenhagen-style views lead, with many-worlds, epistemic views (QBism) and pilot waves as substantial minorities.
- Is the state real? The PBR theorem (Pusey, Barrett, Rudolph 2012) shows, under mild assumptions, that |ψ⟩ cannot be mere knowledge about a deeper state: a strong argument for Penrose's ψ-ontic stance against reading (a) as "ignorance".
- Wigner's friend revived. Frauchiger and Renner (2018) and the local-friendliness no-go theorem (Bong et al. 2020, with photonic tests) show that universal U, single outcomes and locality cannot all hold: a sharp form of Penrose's §29.7 to §29.8 worry.
- Decoherence made visible. Decoherence is now engineered and measured routinely in superconducting qubits and trapped ions; quantum error correction below threshold (Google Willow, 2024) fights exactly the environmental entanglement of §29.6. Zurek's quantum Darwinism extends (c) to explain shared classical records, but does not address Penrose's ontology objection.
- Bigger superpositions. Matter-wave interference has reached molecules of about 25 000 u (2019) and, in 2025, sodium nanoclusters of several thousand atoms; Penrose's question "at what scale?" is now an experimental programme (Chapter 30).
- Bohmian trajectories. "Average trajectories" of photons were reconstructed by weak measurement (Kocsis et al. 2011), matching de Broglie–Bohm predictions, though without settling the ontology.
- Many-worlds rebuttals. Everettians (Deutsch, Wallace, Saunders) answer the preferred-basis worry with decoherence-selected branches and derive the Born rule from decision theory or symmetry ("envariance"); Penrose's chapter does not engage these arguments, which matured mostly after 2004 (Wallace's The Emergent Multiverse, 2012).
- Decoherence advocates reply that they never claimed to solve the single-outcome problem, only the preferred basis and the absence of interference; Penrose's critique lands on over-ambitious readings rather than the technical programme.
- Labels. The six-way taxonomy omits QBism and relational quantum mechanics, both now prominent.
The decoherence story is a lesson in auditable state. A risk system that summarises raw positions into aggregate exposures (a density matrix) can still price everything, but it can no longer say which underlying trades exist. Keep the "pure state" (trade-level lineage) wherever the regulator may later ask a question the summary cannot answer.
Chapter 30 states Penrose's objective-reduction proposal (f): gravity sets the scale, with reduction time τ ≈ ħ/EG, links it to black-hole information loss and the Weyl curvature hypothesis, and proposes a space experiment to test it.
Gravity's Role in Quantum State Reduction
This is Penrose's own proposal. Two independent lines lead to gravity. Time asymmetry: the Big Bang, black-hole information loss and the R process all break time symmetry, and they should balance in phase space. A clash of principles: a mass in superposition of two places gives two spacetimes with no common notion of time translation, so the superposition is ill defined and must decay, in an average time τ ≈ ħ/EG, where EG is the gravitational self-energy of the difference between the two mass distributions. The result is gravitational objective reduction (OR), a minimalist theory with a testable prediction: a superposed speck of mirror should collapse in about a tenth of a second.
30.1 Is today's quantum theory here to stay?
Penrose sees positive reasons, beyond Chapter 29's negative ones, for changing quantum mechanics, drawn from accepted principles and observed facts. Few physicists will entertain it. Yet quantum mechanics is young: about three quarters of a century since 1925. Newton's theory reigned nearly three times as long before relativity, and even counting Maxwell's fields as its first modification, it had over 175 exception-free years. Newton's theory also had no measurement paradox.
Mercury's perihelion anomaly was ascertained in 1843. In 1894 Asaph Hall (printed as "Aspeth") suggested replacing Newton's exponent 2 by 2.000 000 16, and Simon Newcomb showed it fitted the other planets too: tinkering. Einstein explained the anomaly "without fuss" by a radical change of perspective in which gravitational effects combine non-linearly. Penrose expects the linearity of U, which produces the measurement paradox, to be likewise an approximation to a subtle non-linearity.
General relativity is, to him, as great a revolution as quantum theory, and the two sit "most uncomfortably" together. The usual assumption is that Einstein must bend to quantum rules; the name "quantum gravity" presumes it. Penrose claims observational evidence that Nature's union is non-standard, with objective state reduction as a key feature.
30.2 Clues from cosmological time asymmetry
The singularities show the union's character: a special Big Bang, generic collapse singularities. That gross time asymmetry contradicts standard QFT:
- CPT theorem. Apply CPT to a generic final singularity and you get a permitted generic initial singularity; nothing then guides the Creator's pin to the tiny region B. CPT strictly assumes a flat Minkowski background, but most physicists would call that a technicality, and Penrose agrees time-symmetric GR is unlikely to become asymmetric under symmetric quantization.
- Asymmetric vacuum. Symmetry broken by a time-asymmetric vacuum |Θ⟩? In QFT the bra ⟨Θ| appears symmetrically and would have to represent the final state, which would then resemble the initial one, contradicting Chapter 27.
- Anomalies. Quantum failures of classical symmetries usually concern continuous symmetries realised by Poisson brackets; what must break here is discrete: anything containing T.
"Gravity just behaves differently from other fields." In the extreme regimes where quantum and gravitational effects meet, Nature has imposed a gross temporal asymmetry on gravity, and no standard time-symmetric quantum field theory can produce it.
30.3 Time asymmetry in quantum state reduction
U is time-symmetric; R is not. Penrose's experiment:
- Forward. S emits (and the emission is recorded; Note 30.3 suggests using one photon of a down-converted pair to trigger the record). Amplitudes 1/√2 for SBD and SBC. The squared-modulus rule says 50% at D, 50% at C: correct.
- Backward. Given a click at D, the alternatives are SBD and FBD (a photon from the floor reflected at B), again with amplitudes 1/√2, since the ratio is a property of the splitter. The rule says 50% from the floor: absurd. The truth is about 100% from S, 0% from F.
Objections citing the Second Law or the floor's low temperature miss the point: the miracle of the forward rule is that it never needs such circumstances, only amplitudes. Retrodiction needs everything else. Note 30.4 restates it as counting SBD among all SB· (forward) versus among all ·BD (backward) across many runs.
With pre- and post-selection (first measurement gives |ψ⟩, third gives |ϕ⟩), the probability of YES for an intermediate projector E is |⟨ϕ|E|ψ⟩|², symmetric in time (Aharonov, Bergmann, Lebowitz 1964; Aharonov and Vaidman 1990). But ordinary measurements specify |ψ⟩ and not |ϕ⟩, and probabilities work; specify |ϕ⟩ and not |ψ⟩ and they fail. Perhaps |ϕ⟩ is "random" in a Second-Law sense; Penrose finds that unclear, but sees a real link between R and the Second Law, hence with quantum gravity.
The jumping part of R can be told either way: eigenstates at the start of each U stretch (normal) or at the end (time-reversed, "teleological"). The transactional interpretation uses both state vectors at once; Penrose finds it "a little excessive" and prefers quanglement, which links states at different times without a propagation direction.
30.4 Hawking's black-hole temperature
Hawking (1974–75) showed a black hole has a temperature proportional to its surface gravity, consistent with T dS = dE at fixed angular momentum. In natural units, for a Kerr hole,
TBH = √(m² − a²) / [4π m (m + √(m² − a²))],
which for a non-rotating hole is T = ħc³/(8πGMk). It radiates a Planck spectrum. The temperature is absurdly small: about 10−7 K for a solar mass, comparable to the coldest laboratory temperatures (about 10−9 K).
Jacob Bekenstein (1972) had argued for black-hole entropy from the Second Law (lowering particles into a hole) but lacked the factor ¼ and a temperature; Hawking supplied both using QFT on a curved background. Penrose calls this, with the related Unruh effect, "the only reasonably reliable conclusion" so far from any quantum-gravity theory, and even that is not strictly quantum gravity.
- In Minkowski space. Positive frequency is the same for every inertial time parameter (and, for massless fields, under time-orientation-preserving conformal maps, a fact twistor theory uses).
- In curved spacetime. No natural time parameter. For stationary spacetimes, a timelike Killing vector κ defines one.
- Several Killing vectors. Inertial vs accelerating observers disagree: the accelerating observer sees a thermal vacuum, the Unruh effect (Unruh 1976), an ordinary temperature a real thermometer would register, though tiny for reasonable accelerations. A stationary observer near a big hole is accelerated (equivalence principle) and its Unruh temperature matches Hawking's.
- Algebraic QFT. Some drop "particles" and work with operator algebras (Kay, Wald, Hollands, Haag); Penrose suspects this is superior, and that QFT on a fixed background need not make complete sense anyway.
Hawking sidestepped most of this: he needs a positive/negative frequency split only at ℐ− and at ℐ+. The mismatch produces the thermal state, because some information from ℐ− is lost into the singularity instead of reaching ℐ+.
30.5 Black-hole temperature from complex periodicity
Gibbons and Perry (1976): complexify the Schwarzschild (or Kerr) metric; regularity forces a periodicity in imaginary time of 2πi times the inverse surface gravity, and in statistical mechanics an imaginary-time period is a temperature, the Hawking one.
In 𝔼² with polar coordinates (r, θ), a quantity smooth at the origin must have period 2π in θ. In the Lorentzian section 𝕄² (y imaginary, t = iy), the right-hand quadrant has real r and τ = iθ, the hyperbolic angle: the Rindler time of a uniformly accelerating observer at r = r0. A quantity analytic at the shared origin O is periodic in τ with imaginary period 2πi: a temperature. For the black hole, the maximally extended Schwarzschild spacetime K ("eternal black hole") plays 𝕄², and the "Euclideanized" space G (τ = iβθ) plays 𝔼², with O a 2-sphere common to both.
Penrose's doubt: a real hole formed by collapse contains no region O; the eternal metric applies only outside the infalling matter, and O lies outside that region. Perturbations of a realistic hole should diverge as one approaches O (Exercise 30.5). So it is "a beautiful piece of mathematics" that gives the right answer, a "strong indication" of inner consistency, but not a physical derivation.
He compares Brandon Carter's observation: the Kerr–Newman charged rotating hole (Newman 1965; parameters m, a, e; magnetic moment M = ae) has gyromagnetic ratio 2m × ae / (e × am) = 2, Dirac's value for the electron. No one calls this a derivation: an electron grossly violates the black-hole condition m² ≥ a² + e². (Note 30.16: the real electron differs from 2 by radiative corrections.) Newman (2001) interprets the coincidence as a displacement in a complex direction.
30.6 Killing vectors, energy flow, and time travel
The eternal hole K has two past infinities (ℐ−, ℐ−′) and two future ones: two universes joined by a wormhole that pinches off singularly both to the future and to the past. Each exterior sees a hole that is black and white at once. κ is timelike outside (regions ε and ε′) and spacelike inside (B−, B+), and it reverses time orientation between ε and ε′, so the conserved energy density Tabκb is positive for normal matter in ε and negative in ε′.
No observer can cross from ε to ε′; the worldline would have to be spacelike. Theorists (Novikov, Thorne, Davies) have studied holding wormholes open with negative energy densities from QFT, which could give science-fiction warp drives and time travel (Exercise 30.6: superluminal travel implies travel into one's own past). Penrose reads the serious motive as a test: a quantum-gravity theory that allows such things is suspect. He wonders if he is being too generous.
30.7 Energy outflow from negative-energy orbits
Hawking's intuitive picture: near the horizon, virtual pairs appear; occasionally one falls in and one escapes. To escape, it must become real with positive energy, so its partner must be a real particle with negative energy as measured from infinity. That is possible only inside the horizon, where κ is spacelike and paκa can be negative for a perfectly ordinary future-timelike 4-momentum (Exercise 30.7).
For a rotating hole the region where κ is spacelike extends outside the horizon: the ergosphere. A particle entering it can split, one piece falling in with negative energy, the other escaping with more energy than came in, extracting rotational energy: the Penrose process (Penrose 1969; Floyd and Penrose 1971). Fields work too. This is likely how quasars and radio galaxies are powered, perhaps mainly by swallowing negative-energy electromagnetic fields (Blandford–Znajek 1977; Begelman et al. 1984) or particles (Williams 1995–2004).
30.8 Hawking explosions
- Temperature: about 10−7 K for 1 M☉, inversely proportional to mass; no holes below about 1 M☉ are known astrophysically.
- When it starts losing: once the background drops below the hole's temperature, about 1016 years for 1 M☉ in a K = 0 = Λ universe (106 times the present age).
- Lifetime: about 1064 years, heating as it shrinks.
- End: at about 109 to 1010 K, a runaway explosion converts the remaining mass to radiation, small by astrophysical standards and independent of the original mass.
- Primordial mini-holes: mountain mass, proton size, could be exploding now; none seen.
What happens to the information that fell in?
| Option | Claim | Penrose's assessment |
|---|---|---|
| Loss | Information destroyed; unitarity violated | Most probable |
| Store | Information kept in a final remnant ("nugget") | Locked in forever, as good as lost; QFT of remnants very hard |
| Return | Information comes out in the final explosion | Information would have to sidle back across a spacelike singularity; implausible |
Most particle physicists prefer store or return to protect U. Penrose's case for loss: infalling matter crosses the horizon with nothing locally special; for a galactic hole, curvature and density there are like those in the Solar System. The horizon's very location is teleological: it depends on how much matter falls in later (Fig. 30.15). The matter is the information, and it is destroyed only at the singularity.
Hawking's position: loss from the start, with a mild violation of unitarity in which pure states evolve into density matrices under a "superscattering" operator $. Note 30.26 records with regret that in 2004 Hawking retracted loss in favour of return.
30.9 A more radical perspective
Penrose agrees with loss but wants more: Hawking's scheme is time-symmetric, so it allows white holes (time-reversed black holes) and the time-reverse of evaporation, even a black hole that evaporates into a growing white hole (Fig. 30.17), "an absurd-looking model" never seriously proposed. Such things would proliferate in the Big Bang and violate the Weyl curvature hypothesis. The disagreement between Hawking and Penrose over time asymmetry lasted "about 20 years" (Note 30.27).
Imagine a mirror-walled box larger than a galaxy, nothing entering or leaving, fixed total energy. Its phase space has two local entropy maxima: (b) a black hole holding most of the mass, in equilibrium with a little radiation; (c) thermal radiation and a few particles with no hole. Evolution flows between them.
- Black holes converge flow lines: many inputs, one output (information lost at singularities). Phase-space volume shrinks.
- R diverges them: one input, several outputs (the photon at S goes to D or C, while D's photon came only from S). Volume grows.
- Both violate Liouville's theorem; Penrose proposes they balance over phase space. It is the potential for black-hole formation that balances R, not a black hole at every measurement.
- He hoped to derive the rate of R from this balance but could not; hence the separate argument of §30.10 to §30.12.
30.10 Schrödinger's lump
Replace the cat with a lump moved slightly by the transmitted photon (Fig. 30.20). Let |χ⟩ be the lump in place and |φ⟩ displaced, each stationary with the same energy E: iħ∂|χ⟩/∂t = E|χ⟩ and iħ∂|φ⟩/∂t = E|φ⟩. Then any superposition |Ψ⟩ = w|χ⟩ + z|φ⟩ is stationary too (Exercise 30.9): standard quantum mechanics says it would last forever.
Add the Earth's stationary gravitational field: ∂/∂t becomes the timelike Killing vector κ (normalised at infinity, varying locally with gravitational time dilation, Exercise 30.10). Still fine: iħκ|Ψ⟩ = E|Ψ⟩.
Now include the lump's own gravity. Each location comes with its own nearly classical Einstein field (assuming, as conventional wisdom does, that quantum gravity reproduces classical fields for lumps), hence its own Killing vector: iħκχ|χ⟩ = E|χ⟩ and iħκφ|φ⟩ = E|φ⟩. Since κχ ≠ κφ, there is no Schrödinger equation for the superposition.
30.11 Fundamental conflict with Einstein's principles
The two Killing vectors live on different spacetimes. Treating them as one manifold with two metrics gχ, gφ requires a pointwise identification, which general covariance forbids. Here quantum superposition and general covariance collide head on.
Penrose's way forward: accept the clash and estimate the error in "cheating". Identify the spacetimes only so far as free fall (geodesics) agrees, in the spirit of the equivalence principle. Work in the Newtonian limit with Cartan's formulation (Christian 1995), where spacetime is a bundle of Euclidean 3-spaces over absolute time t. Even there, knowing t does not give ∂/∂t: that needs a family of curves across the 3-spaces (the "second fundamental confusion of calculus", §10.3), the problem of time of quantum cosmology.
- Identify the Euclidean 3-spaces of the two states.
- Error measure: integrate the squared difference of gravitational accelerations, ∫ (Γχ − Γφ)² d³x, i.e. ∫ |∇Φχ − ∇Φφ|² with ∇²Φ = −4πGρ (Exercise 30.11).
- Interpret it as an uncertainty in ∂/∂t, hence via Schrödinger's equation an energy uncertainty EG.
- Identify EG = the gravitational self-energy of the difference between the two mass distributions (one counted positive, the other negative).
- Rigid displacement: EG also equals the energy needed to pull one copy of the lump away from the other's gravitational field (Exercise 30.12 asks what changes if the lump is raised or compressed).
- Heisenberg time–energy: treat the superposition like an unstable particle: it decays to one location in about τ ≈ ħ/EG.
The unstable-nucleus analogy: U-238 lives about 109 years, so its energy uncertainty ħ/2T is about 10−51 J, a mass uncertainty about 10−44 of the nucleus. Diósi (1989) had considered both forms of EG, with a stochastic dynamics Penrose does not adopt; the variants are experimentally distinguishable and "not totally free of controversy". Note 30.37 sketches a sharper argument: the equivalence principle requires a phase with a cubic term in t between free-falling and supported frames (Exercise 21.6), so the two lump states sit in different vacua, a Galilean remnant of the Unruh effect, and superpositions of vacua should be unstable.
The timescale ħ/EG involves the quotient of the two small quantities ħ and G, and so need not be a small quantity in ordinary human terms.
Roger Penrose, §30.1330.12 Preferred Schrödinger–Newton states?
Objection. Any state can be written as a superposition of two others; choose a near-point-like |α⟩ and EG is near-infinite, so everything would collapse instantly, even a single electron. "If such behaviour were true, there would be no quantum mechanics."
Answer. The constituents must be stationary. A localized electron is not (it disperses instantly). But a free particle has no normalisable stationary state under the ordinary Schrödinger equation (Exercise 30.13). Include the particle's own gravity as a Newtonian potential Φ sourced by the expectation value of its mass density (gravity not quantized): the Schrödinger–Newton equation (Moroz, Penrose, Tod 1998). It has well-behaved stationary single-particle solutions. Their spread scales as 1/m³: for an electron, larger than the observable universe; for a hydrogen atom, slightly smaller.
A superposition of two Schrödinger–Newton stationary states spontaneously reduces to one of them in an average time τ ≈ ħ/EG, with EG the gravitational self-energy of the difference of their expectation-value mass distributions. Penrose holds that all state reduction is gravitational: even after environmental decoherence in a system too small for OR (say a DNA molecule), it is the total mass displacement in the environment that triggers OR.
Advantages and limits:
- Energy. Other OR schemes, including the ground-breaking Ghirardi–Rimini–Weber (1986) model, violate energy conservation slightly and "live with it". In gravitational OR, the energy uncertainty EG may cover any apparent non-conservation, a trade-off with the non-local, "slippery" nature of gravitational energy.
- Minimalism. No reduction dynamics is given, unlike Károlyházy, Frenkel, Pearle, Kibble, GRW, Ghirardi–Grassi–Rimini, Diósi, Weinberg, Percival, Gisin. Note 30.44: Károlyházy's and Percival's gravitational schemes predict quite different numbers.
30.13 FELIX and related proposals
- The cat. A tiny mirror M, about a speck of dust (one tenth of a hair's thickness, 1014 to 1016 nuclei, mass about 5 × 10−12 kg, about 10−3 cm across), rigid, on a mount restoring it in about 0.1 s (or 1 s).
- The kick. A single X-ray photon from laser L hits beam splitter B; the transmitted part reflects off M and displaces it by about one nuclear diameter.
- The wait. The two photon components are kept coherent by reflection between space platforms an Earth-diameter apart (about 0.1 s per round trip; the figure shows about ten diameters for a full second), then return so that the photon takes back its momentum and stops M exactly as it returns.
- The test. Recombined at B, the photon goes back to L if coherence survived, so detector D fires 0% of the time (standard QM, perfect setup); if OR reduced M, the photon is in one beam and D fires 50% of the time.
- Signature. Repeat many times, vary mirror size, material and timescale. Because EG depends on how the mass is distributed at nuclear scale, a more tightly localized distribution of the same mass gives a shorter reduction time (Fig. 30.25).
- Ground-based version. William Marshall, with Dik Bouwmeester and Christoph Simon (Marshall, Simon, Penrose, Bouwmeester 2003): a visible or infrared photon bouncing about 106 times in a cavity gives the mirror 106 small kicks. Feasible "in a couple of years", still five or six orders short of a definitive test, but a superposition 1012 times more massive than the 1999 record (C70 fullerenes, Arndt et al.).
- Credits. Note 30.41: Johannes Dapprich (a Mössbauer-crystal version), Anton Zeilinger's Innsbruck group (parameters), Anders Hansson (the space idea).
- Scale. EG of about 10−33 J gives a lifetime of about 0.1 s. Planck-scale quantities come from the product of ħ and G and are absurdly small; τ = ħ/EG comes from their quotient.
Try it in Python: Hawking's numbers and a FELIX-type collapse time
import math
G, hbar, c, k = 6.674e-11, 1.0546e-34, 2.998e8, 1.380649e-23
Msun, yr, u = 1.989e30, 3.156e7, 1.6605e-27
T = hbar*c**3/(8*math.pi*G*Msun*k)
t_ev = 5120*math.pi*G**2*Msun**3/(hbar*c**4)/yr
print(f"T_H(1 Msun) = {T:.1e} K, evaporation ~ {t_ev:.1e} yr")
M, mn, a, b = 5e-12, 28*u, 3.4e-15, 1e-15 # mirror mass, Si nucleus, radius, shift
N = M/mn
EG = N*G*mn**2*b**2/(2*a**3) # small-shift limit per nucleus
print(f"N = {N:.1e} nuclei, E_G = {EG:.1e} J, tau = hbar/E_G = {hbar/EG:.2f} s")
R = 5e-6; rho = 2330; Mb = 4/3*math.pi*R**3*rho
EG2 = (6/5)*G*Mb**2/R # sphere moved by more than its size
print(f"10-micron silicon sphere, full separation: tau = {hbar/EG2:.1e} s")
Output:
T_H(1 Msun) = 6.2e-08 K, evaporation ~ 2.1e+67 yr
N = 1.1e+14 nuclei, E_G = 2.0e-34 J, tau = hbar/E_G = 0.53 s
10-micron silicon sphere, full separation: tau = 4.4e-06 s
The mirror estimate, treating each nucleus as a uniform sphere displaced by a fraction of its radius, lands within a factor of a few of Penrose's 10−33 J and 0.1 s. The same sphere moved by more than its own diameter would collapse in microseconds: the mass distribution at nuclear scale is what makes FELIX's timescale human-sized.
If the experiment agrees with OR, or does not
Even confirmation might not convince: many would say U survives and phases are lost in metric fluctuations. Penrose compares them to Lorentz, who treated special relativity as corrections within an absolute-rest worldview, and calls that stance retrograde. If coherence survives, he would be bewildered, because quantum mechanics has "no credible ontology" anyway; only something as formidable as general relativity seems able to shift it, which is why he anticipates gravitational OR.
30.14 Origin of fluctuations in the early universe
Cosmology says galaxies grew from tiny quantum fluctuations in a nearly FLRW universe. But an exactly FLRW quantum state evolved by U stays exactly symmetric (Exercise 30.14): U is deterministic, and a symmetric start can only give a symmetric result. Heisenberg uncertainty does not mean Nature is "fuzzy"; it limits joint measurement of non-commuting quantities. Wheeler's foam is a superposition of irregular geometries, and the superposition can be symmetric although no component is.
A spin-0 (spherically symmetric) nucleus at the centre of a bubble chamber splits into charged fragments A and B flying in opposite directions. U keeps the state spherically symmetric: an entangled spherical wave of all antipodal pairs of tracks. Yet we see one pair of tracks. Some R must replace the symmetric superposition by a probability mixture of asymmetric outcomes. (Neville Mott, 1929, analysed cloud-chamber α tracks this way.) The early universe is the same problem at cosmic scale.
How do the standard views fare at about 1032 K, with no experimenters?
- Copenhagen: no apparatus, no measurement.
- Many worlds: the universe stays exactly FLRW to this day as a grand superposition; branching awaits observers (Wheeler's participatory universe would even have observers select the early geometry, Note 30.46).
- FAPP: decoherence licenses reading the superposition as a mixture; cosmologists in effect use the horizon as a cut-off. Kolb and Turner's textbook The Early Universe (1994, p. 286): "As each mode crosses outside the horizon, it decouples from the microphysics and 'freezes in' as a classical fluctuation." Penrose calls this illogical; Note 30.49 says the Hubble-radius cut-off is a purely classical effect of expansion with nothing to do with the quantum-to-classical passage.
His conclusion: departures from FLRW symmetry require objective reduction, but the minimalist stationary-state OR is too weak; a fuller OR theory handling superpositions of many non-stationary geometries is needed, and it will face the BOOMERanG and WMAP data. Because such reductions are highly entangled, they would produce EPR-type correlations across causally separated regions without inflation (Note 30.50 credits Bikash Sinha). Biology too (§§34.7, 34.10) lacks a clean system/apparatus split.
What the exercises ask
- Pre/post-selection (30.1, 30.2). Derive |⟨ϕ|E|ψ⟩|²; why time-reversed R works for amplitudes by unitarity.
- Hawking temperature (30.3). Obtain TBH from the Kerr area via T dS = dE.
- Rindler and perturbations (30.4, 30.5). Write (r, τ) in terms of (x, t); argue that perturbations of a realistic hole diverge toward O.
- Causality (30.6, 30.7). Superluminal travel implies a trip into one's own past; how a spacelike κ gives negative paκa.
- Superscattering (30.8). Index form of a map from pure states to density matrices.
- Lump (30.9 to 30.13). Stationarity of superpositions; Killing normalisation and clock rates; derive EG from ∫|∇Φ1 − ∇Φ2|² and Poisson's equation; displaced vs raised vs compressed lumps; why free particles lack stationary states.
- Symmetry (30.14). Why U preserves an exact FLRW symmetry.
| Term | Meaning |
|---|---|
| Pre/post-selection | Fixing states before and after; gives time-symmetric probabilities |
| Hawking temperature | T = ħc³/8πGMk for a non-rotating hole |
| Unruh effect | Uniformly accelerated observers see a thermal vacuum |
| Killing vector | Generator of a metric-preserving flow; defines stationarity |
| Ergosphere | Region outside a Kerr horizon where κ is spacelike |
| Penrose process | Extracting rotational energy via negative-energy orbits |
| Loss / store / return | Fates of information in black-hole evaporation |
| Superscattering $ | Hawking's map from density matrices to density matrices |
| EG | Gravitational self-energy of the difference of two mass distributions |
| Schrödinger–Newton equation | Schrödinger equation with self-gravity from the expectation-value mass density |
| Gravitational OR | Reduction in time ħ/EG |
| FELIX | Space interferometer test of OR with a superposed tiny mirror |
- Gran Sasso test. Donadi et al. (Nature Physics, 2021) searched underground for the faint spontaneous radiation that a collapsing charged particle should emit in Diósi's version of the model, and ruled out the parameter-free Diósi–Penrose model unless its mass-smearing length exceeds about 0.5 Å. Penrose has replied that his OR need not radiate in that way; the simplest radiating version is excluded.
- Mechanical cats. Optomechanics followed Marshall et al.'s path: ground-state cooling of mechanical resonators (2011), and in 2023 a 16-microgram sapphire resonator was put into a Schrödinger-cat state of motion (Bild et al., Science). Matter-wave interference reached sodium clusters of several thousand atoms in 2025. None yet reaches the EG regime where OR would bite.
- Gravity between tiny masses, and entanglement tests. Newtonian attraction between 90-milligram gold spheres was measured in 2021 (Westphal et al., Nature). The Bose–Marletto–Vedral proposals (2017) to detect gravity-mediated entanglement would show whether gravity can carry quantum superpositions, directly probing Penrose's §30.11 clash; they remain in development. Space missions such as MAQRO are proposed, not flown.
- Information paradox. After Hawking's 2004 concession, the AMPS firewall argument (2012) and then islands and replica wormholes (2019, Penington; Almheiri, Engelhardt, Marolf, Maxfield) reproduced the unitary Page curve in semiclassical gravity. Most theorists now side with return; Penrose continues to argue for loss, which his CCC cosmology (Hawking points) requires.
- Black holes and energy extraction. Event Horizon Telescope polarisation of M87* (2021) supports magnetically driven Blandford–Znajek jets, the field version of the Penrose process. Analog Hawking radiation has been seen in a Bose–Einstein condensate (Steinhauer, 2016 and 2019).
- Orch-OR. A 2024 rat study found that a microtubule-stabilising drug delayed loss of consciousness under isoflurane, which supporters cite; critics note the result does not test quantum effects, and decoherence estimates (Tegmark 2000) remain the central objection.
- Recognition. Penrose shared the 2020 Nobel Prize in Physics for showing that black-hole formation is a robust prediction of general relativity (the trapped-surface theorem of §27.9).
- Evaporation time. "Some 1064 years" for a solar-mass hole is about three orders too short; the standard figure (photons and gravitons only) is about 2 × 1067 years, as our Python run confirms. Other books by Penrose give the larger figure.
- The EG derivation is heuristic: Penrose admits the identification of the two spacetimes, the choice between self-energy and interaction energy, and the step from energy uncertainty to lifetime are all "incompletely motivated". Critics (e.g. Anastopoulos and Hu) argue that a semiclassical Schrödinger–Newton picture conflicts with other principles and that the cosmological argument against time-symmetric QFT does not single out his mechanism.
- Gibbons–Perry. Most relativists accept the Euclidean method as a valid derivation because it agrees with Hawking's calculation in all known cases; Penrose's scepticism is a minority view.
- Small slips. "Aspeth Hall" is Asaph Hall; "Simon Newcombe" is Simon Newcomb; U-238's half-life is 4.5 × 109 years, rounded to 109.
Penrose's method is worth copying in any architecture review: when two foundational principles each work alone (here, superposition and general covariance), push them into the same small scenario until they clash, then quantify the size of the clash rather than arguing about which principle wins. A stated error budget (his EG) turns a philosophical disagreement into a testable prediction.
Chapters 31 to 33 assess string theory, loop quantum gravity and twistor theory against the standard set here: does each account for time asymmetry and objective reduction? §34 returns to consciousness, biology and the role of fashion in physics; Penrose's later CCC (Cycles of Time) grows directly from §28.8 and §30.9.
Supersymmetry, Supra-dimensionality, and Strings
The longest chapter of the book is Penrose's guided tour of the mainstream route to quantum gravity: supersymmetry, extra spacetime dimensions, strings, branes, M-theory and holography. He explains each idea with real care, credits what is mathematically deep (the mirror-symmetry miracles, Witten's insights), and then presses one objection harder than any other: functional freedom. A field theory in 1 + 9 dimensions carries ∞M∞9 degrees of freedom against the ∞N∞3 we observe, and in his view no argument offered so far makes that excess go away.
31.1 Unexplained parameters
Most physicists, Penrose concedes at the start, expect the 21st century to bring extra dimensions, strings, membranes, D-branes, supersymmetry, quantum groups, non-commutative geometry or discreteness, rather than any change in the rules of quantum mechanics. Exotic pictures are not evidence; the task is to understand the motivation behind them. That motivation runs back to Chapters 24 to 26: relativity plus quantum theory forced QFT, QFT produced infinities, and renormalisation tamed them only by giving up on the values of mass and charge, which are inserted by hand. The standard model has "some 17 or more" such free parameters (the usual modern count is 19, or 26 once neutrino masses and mixings are included).
Two numbers frame the mystery:
- The fine structure constant. α = e²/ħc (in Gaussian form), with α−1 = 137.0359…. Arthur Eddington spent his last years (to 1946) trying to prove α−1 = 137 exactly. Modern physics treats couplings as running with energy, so the observed constants are only low-energy limits, which makes a pure-number formula look less likely.
- Planck units. Setting G = c = ħ = k = 1, the proton charge is e ≈ 1/√137 = 0.0854246 and the electron mass is me ≈ 4.3 × 10−23. The proton is only 1836 times heavier, and the electron neutrino is under 10−5 of me.
A historical aside on naming: George Johnstone Stoney proposed natural units in 1881, using the electron charge; Max Planck used his own constant to define absolute units in 1899, a year before quantum theory began, and returned to the idea in 1906. John Wheeler later championed them, so "Planck units" (or Planck–Wheeler units) stays.
The hierarchy problem is the same puzzle stated three ways: why particle masses are absurdly small in Planck units; why the Planck mass (~10−5 g, a small midge) dwarfs every particle mass; and why the Planck length (1.6163 × 10−35 m) sits about 20 orders of magnitude below particle-physics scales.
One hope, voiced by Oskar Klein around 1935, is that small observed charges and masses are finite renormalisations of respectable bare values (1 or 4π), which would follow if gravity supplied a cut-off at the Planck scale. Half a century on, bringing gravity in has made things worse: quantising Einstein's theory by standard methods gives a non-renormalisable theory. Many researchers have therefore altered Einstein's theory; almost nobody, Penrose notes pointedly, has proposed altering QFT, which is the change Chapters 27 to 30 argued for.
31.2 Supersymmetry
Penrose opens with a "statutory warning": he is "totally unconvinced" of supersymmetry's physical relevance in its particle-physics form. Its attraction is mathematical elegance and its undoubted power to cancel infinities: if you want a QFT free of uncontrollable divergences, making it supersymmetric makes the job enormously easier.
What it is. Ordinary symmetry groups rotate bosons among bosons and fermions among fermions. Supersymmetry rotates bosons into fermions. Since bosons obey commutation laws and fermions anticommutation laws, the generators that swap them must themselves anticommute, so they cannot be ordinary Lie-algebra generators. They belong to a super-Lie algebra, whose defining relations allow both brackets:
- Commutator. [a, b] = ab − ba (at least one of a, b bosonic).
- Anticommutator. [a, b]+ = ab + ba (both fermionic), echoing the QFT relations ab ± ba = c of §26.2.
The generators are built from Grassmann algebra elements (§11.6). Supergroups are now respectable pure mathematics, and supersymmetric arguments prove real theorems: Seiberg–Witten theory (1994) shortened some proofs in Donaldson's theory of 4-manifolds to about 1/1000 of their length (John Baez's estimate), and supersymmetry gave proofs of positive energy in general relativity (Witten 1981). None of that, Penrose insists, shows that Nature uses it.
- Electron (spin ½) → selectron (spin 0).
- Each quark → a spin-0 squark.
- Photon (1) → photino (½); W, Z → wino, zino (½).
- Graviton (2) → gravitino (3/2).
- Higgs (0) → higgsino (½).
None has ever been seen. The standard explanation is an unexplained supersymmetry-breaking mechanism that makes every partner far heavier, by 2004 "something like a thousand times the proton mass, or more". Penrose: "I am far from alone in believing that this looks a little contrived."
He adds puzzles of bookkeeping. The smaller-spin partner is decreed the heavier one, so a spin-0 elementary particle such as the then-undiscovered Higgs must be heavier than its partner, which raises the question why the lighter partner has not been seen. Believers in both supersymmetry and inflation must also say where the inflaton's φ particle fits.
The one piece of "positive" evidence is gauge-coupling unification. Treat the strong, weak and electromagnetic couplings as running constants and extrapolate to about 1028 K, some 10−39 s (about 10 000 Planck moments) after the Big Bang. Without supersymmetry the three curves narrowly miss one point; with it they meet.
Penrose rejects this as support "except perhaps to those already committed". The extrapolation assumes nothing new happens across the gap from the ~1014 K reachable by accelerators to 1028 K, fourteen orders of magnitude. He also notes the strong and weak strengths differ by ~1013 under ordinary conditions. The coupling-meeting plot remains a staple of supersymmetry advocacy, but its force depends on the "desert" assumption he names.
31.3 The algebra and geometry of supersymmetry
Supergravity amalgamates supersymmetry with Einstein's theory (with torsion included). The graviton's partner is the spin-3/2 gravitino, massless unless supersymmetry is badly broken. If gravity is geometry, should the gravitino be "super-geometry"? Theorists answer with supermanifolds, whose coordinates are Grassmann elements rather than real numbers.
The algebra is simplest with one anticommuting generator ε. Since εε = −εε, ε² = 0, and every element is a + εb:
- Sum. (a + εb) + (c + εd) = (a + c) + ε(b + d).
- Product. (a + εb)(c + εd) = ac + ε(ad + bc).
With N generators εiεj = −εjεi (so each εi² = 0), a general element is a + Σbiεi + Σcijεiεj + … + f12…Nε1ε2…εN, a 2N-dimensional algebra. The ordinary part is fancifully called the body, the nilpotent remainder the soul (raise any soul element to a high enough power and it vanishes).
Penrose finds the purely formal account unsatisfying and offers a geometric picture (credited partly to Abhay Ashtekar): regard the n-manifold M as a hypersurface in an (n + 1)-manifold M′, attending only to its first neighbourhood (first derivatives away from M, no curvature off it). Then ε is a 1-form of M′ restricted to M; body quantities live within M, soul quantities point out of it. With N generators, M sits in an (n + N)-manifold and N independent 1-forms feel out the N extra directions. One oddity remains: geometrically an odd p-form should anticommute with ε under the wedge product, but standard superalgebra takes them to commute, a notational convention that muddies the clean picture.
In particle physics N = 1 is usual because each particle belongs to a 2N-plet of partners, and "the observational problem is bad enough without this!"
31.4 Higher-dimensional spacetime
Supergravity's original excitement (late 1970s) was the hope of renormalisability. Pure Einstein gravity diverges at 2 loops, and with matter already at 1 loop, "a genuine disaster". Supergravity cancelled the 1-loop divergences, then failed at 2 loops. Moving to 11 dimensions looked more promising, but a fully renormalisable supergravity was never found and later work showed it cannot be. (On the 2026 status of this, see the update box.)
Why take extra dimensions seriously at all? Because of Theodor Kaluza (1919) and Oskar Klein. If the extra dimensions are small, we would not notice them: Penrose's hosepipe looks 1-dimensional from afar and 2-dimensional close up. Klein put the circumference at about the Planck length, the scale still favoured in supergravity and string theory. Some newer models allow extra dimensions as large as a millimetre, which would modify the inverse-square law; experiments to 2004 found no deviation down to half a millimetre.
- Freedom count (§16.7). A field with k free components on a q-dimensional initial surface has freedom ∞k∞q. Einstein vacuum: k = 4, q = 3; Maxwell: the same. Einstein–Maxwell together: ∞8∞3.
- 5-dimensional Ricci-flat theory. Initial surface 4-dimensional, k = 10: freedom ∞10∞4, vastly too big, "not because 10 is greater than 8 but because 4 is greater than 3".
- The fix. Impose a U(1) symmetry in the small dimension: a Killing vector, making the 5-space an S1-bundle B over spacetime M.
- The miracle. Ricci flatness of B (Rab = 0) plus the symmetry gives almost exactly Einstein–Maxwell on M; demand also that the Killing vector have constant negative norm, which kills an unwanted scalar field, and the match is exact.
Elegant, but in Penrose's view without compelling physical motivation; supersymmetry at least has the infinity-cancelling argument. Higher dimensions are popular today mainly because string theory requires them.
31.5 The original hadronic string theory
String theory began in hadron physics. Short-lived resonances (lifetimes ~10−23 s) crowd the hadron spectrum. In a scattering A + B → C + D, QFT says to add three families of Feynman graphs: (a) A and B fuse into an intermediate X, X′, X″ that decays to C + D; (b) an exchanged Y converts A→C and B→D; (c) an exchanged Z converts A→D and B→C; plus (d) loop graphs. The surprise was that each family alone gave the same, roughly correct, answer; adding them overcounts. This duality made no sense for point particles.
Gabriele Veneziano (1968) found an amplitude, built from Euler's beta function (1777), with the duality built in. Yoichiro Nambu (1970), with Susskind and Nielsen, explained it: model hadrons as strings. A string history is a 2-surface, and the three channels (a), (b), (c) become three views of one topologically identical surface; loops become surfaces of higher genus. Penrose heard this from Leonard Susskind around 1970 and was "extremely struck by the beauty and potential power" of the idea.
The string model also explained the straight Regge trajectories (spin plotted against mass squared lies on straight lines for families of hadrons), which Penrose says still has no complete alternative explanation. It promised finiteness, since non-point objects smear out short-distance divergences and one surface stands for many Feynman graphs at once; different particles became vibration modes of one string; and string histories are Riemann surfaces, bringing the "complex magic" of Chapter 8. Penrose, then deep in twistor theory, wanted to connect the two holomorphic pictures. That hope, he notes, may finally be realised by Witten's 2003 twistor-string work (§31.18, §33.14).
31.6 Towards a string theory of the world
String theory is "emotionally charged". To supporters it is the physics of the 21st century; to extreme detractors it has achieved nothing physically. Penrose gives the other side in their own words: Michael Green calls it "in a class of its own", and Edward Witten relays Daniele Amati's line that it is "a part of twenty-first-century physics that fell by chance into the twentieth century". Brian Greene's The Elegant Universe (1999) is the accessible, uncritical popular account.
A tourist seeks a building of sublime elegance in a vast city with no street names, no map and an overcast sky. At every fork the only guide is local beauty and a sense of overall consistency; some lovely courtyards turn out to hold plastic flowers. Join a group led by a brilliant guide who also has no map, and you gain company and quicker aesthetic judgement, but no better knowledge of the way. Each fork is a gamble; many forks make guessing right every time very unlikely. This is Penrose's picture of a theory steered almost entirely by mathematical aesthetics.
He contrasts Dirac's equation (one majestic aesthetic step from a body of experiment, then a cautious prediction confirmed) and Einstein's general relativity (guided by the principle of equivalence, a physical conviction). String theory, by contrast, "has been almost entirely mathematically driven", and almost every turn has moved it further from observation. Mathematical consistency is necessary, but when each fix is a brilliant guess the odds compound against you.
31.7 String motivation for extra spacetime dimensions
The first fork was an anomaly (§30.2): quantum commutators could not realise the string's parametrisation invariance. The anomalous term is proportional to 24 − σ, where σ = (space dimensions) − (time dimensions), so it vanishes for σ = 24: a spacetime of 26 dimensions. Penrose's reaction was "there ought to be a different way around this", strengthened by twistor theory, which singles out 1 + 3 dimensions (§§33.2, 4, 10). The theory lost popularity for nearly a decade, also because of tachyons, the rise of QCD as the explanation of hadron physics, and evidence that hadron constituents are pointlike: hadronic strings had loop sizes around 10−15 m, the size of the proton itself.
- 1968: Veneziano amplitude.
- 1970: Nambu, Susskind, Nielsen: strings.
- ~1971 to 1974: 26 dimensions from the anomaly; tachyons; QCD takes over hadrons.
- 1974: Scherk and Schwarz propose strings as gravity.
- 1984: Green and Schwarz: superstrings, 10 dimensions, the "first superstring revolution".
- 1995: Witten: dualities and M-theory, the "second revolution".
- 1996: Strominger–Vafa black-hole entropy.
- 1997/98: Maldacena's AdS/CFT.
- 2003: Witten's twistor string theory.
1984 changed everything. Michael Green and John Schwarz (subsuming earlier Schwarz–Joël Scherk work) added supersymmetry; the anomaly now vanishes for 8 − σ = 0, so spacetime has 10 dimensions; tachyons disappear. The massless spin-2 mode, an embarrassment for hadrons, became the graviton, and string theory was reinterpreted as quantum gravity with a string scale near the Planck length, some 20 orders smaller than before.
A technical point rarely mentioned in popular accounts: hadronic strings behaved like rubber bands (tension proportional to stretch, with zero natural length), whereas the new strings have constant tension ħc/α′, with the string constant α′ a tiny area. A classical constant-tension string would instantly shrink to a point, so the new object has no sensible classical counterpart.
31.8 String theory as quantum gravity?
The new theory was widely proclaimed "a complete consistent theory of quantum gravity". One prominent theorist said a proof of finiteness would not be worth reading because it was "so obviously finite"; Joseph Polchinski (1999) wrote "there are no alternatives… all good ideas are part of string theory".
Penrose's reaction, shared by his relativity colleagues, was "very negative". He attributes much of it to culture:
The QFT side
- Primary goal of the union: finiteness (renormalisability).
- Spacetime: a smooth background on which strings move.
- Quantum rules: untouchable.
The relativity side
- Primary goal: resolve the conceptual conflict between quantum principles and general covariance.
- Spacetime: should become quantum geometry, perhaps discrete.
- Quantum rules: may need to change (Chapter 30).
His frustration was that the problems relativists thought central were not even recognised as problems. A basic unexcited string carries no energy and does not curve the background at all; contrast the loops of Chapter 32, which create the spatial geometry, the metric living only along them.
What do string theorists mean by "gravity" in 10 dimensions? Tensor calculus works in any dimension, so the vacuum condition is again Rab = 0, expected (like 5-dimensional Kaluza–Klein) to hold all non-gravitational fields too. More exactly, Ricci flatness is only the first term of a power series in α′, higher terms being "quantum corrections" with higher derivatives of curvature. Extra fields appear: an antisymmetric tensor and the dilaton, a scalar governing scale (not a misspelling of "dilation"). Since α′ ≈ 10−68 m², a hair above the Planck length squared, Ricci flatness is an excellent approximation.
31.9 String dynamics
The string Lagrangian is 1/(2α′) times the area of the world sheet, the 2-surface the string sweeps out (the Nambu–Goto action). Classically the world sheet is a minimal surface (a timelike "soap film") in a background subject to no constraints. Quantum mechanically, anomaly cancellation demands 10 dimensions plus supersymmetry plus the curvature conditions on the background.
The lowest closed-string mode has quadrupole (ℓ = 2) structure and is massless because the string is so stiff: a spin-2 massless particle, just what a graviton is (in the perturbative description gab → gab + εhab). Hence Witten's claims: "string theory has the remarkable property of predicting gravity", and "the fact that gravity is a consequence of string theory is one of the greatest theoretical insights ever".
- Perturbative only. Almost all string calculations are power series (in α′ or in ε). Relativists do not accept a perturbative graviton as a theory with general relativity's principles.
- "Physics is a 2-dimensional QFT." One string philosophy treats spacetime as secondary to fields on the world sheet. Penrose: a field with finitely many components per point on a 2-surface has freedom ∞k∞2, hopelessly smaller than a dynamical spacetime needs.
- Ricci flatness everywhere. If one were quantising the classical system "background 9-space containing moving string", consistency would be needed only where the string is. String theory demands it everywhere, so the background is not really dynamical: "the spacetime simply provides a fixed background".
31.10 Why don't we see the extra space dimensions?
Take the 10-dimensional dynamics seriously and the functional-freedom problem returns with force. A Ricci-flat 10-space has n(n − 3) = 70 free functions per point on a 9-dimensional initial surface, so freedom ∞70∞9, compared with ∞N∞3 for any ordinary 4-dimensional field theory. As before, the explosion comes from 9 > 3, not from 70 versus N.
String theorists have two replies. One is hope that quantum consistency conditions will cut the freedom down (§31.16). The main one is the energy argument. Work perturbatively about 𝕄 × Y, Minkowski space times a compact Ricci-flat 6-space Y of Planck size. A product of Ricci-flat spaces is Ricci-flat (Exercise 31.3), and its metric is the block-diagonal direct sum of the two.
Write 𝕄 = 𝔼1 × 𝔼3 and expand perturbations in normal modes of 𝔼3 × Y: products of a mode on 𝔼3 (a continuous family of momentum states) with a mode on Y (a discrete family, because Y is compact). Penrose works the simplest case Y = S1 of radius ρ:
- Modes on the circle. einθ, n an integer (the Fourier modes of §9.2), with ρθ the distance round.
- Laplacian. ∇² = ∂²/∂x² + ∂²/∂y² + ∂²/∂z² + ρ−2∂²/∂θ²; on an n-mode the last term becomes −n²/ρ².
- Klein–Gordon in 5 dimensions. (□ + μ²/ħ²)ψ = 0 acquires the extra term, so an n-mode looks in 4 dimensions like a particle obeying (□ + μ²/ħ² + n²/ρ²)ψ = 0: mass raised from μ to √(μ² + ħ²n²/ρ²).
For ρ near the Planck length, every n ≠ 0 mode has at least Planck mass, far beyond any accelerator, so (the argument goes) the extra dimensions are frozen. The same reasoning is applied to a Planck-size Y: excitations need ~Planck energy; Y settled early in cosmic history while three dimensions grew enormous, and has stayed undisturbed since.
- ρ = 1.6 × 10−35 m (Planck): first mode 1.2 × 1019 GeV.
- ρ = 10−19 m: first mode ~2 TeV, the range the LHC probes.
- ρ = 0.1 mm: first mode ~2 × 10−12 GeV (a few meV), a "large extra dimension" testable only through gravity.
Try it in Python: Planck energy, freedom counts and the KK tower
import math
hbar,c,G=1.054571817e-34,2.99792458e8,6.67430e-11
EP=math.sqrt(hbar*c**5/G); lP=math.sqrt(hbar*G/c**3)
print(f"Planck energy {EP:.3e} J = {EP/4.184e9:.2f} t TNT")
print(f"Planck frequency {c/lP:.2e} Hz")
sun=1361*math.pi*6.371e6**2 # J delivered to Earth per second
print(f"Sun->Earth per second = {sun/EP:.1e} Planck energies")
for n in (4,5,10,11): print(n, n*(n-3)) # free functions per point
for rho in (1.6e-35,1e-19,1e-4):
print(rho, f"{hbar*c/rho/1.602176634e-10:.2e} GeV")
Output:
Planck energy 1.956e+09 J = 0.47 t TNT
Planck frequency 1.85e+43 Hz
Sun->Earth per second = 8.9e+07 Planck energies
4 4
5 10
10 70
11 88
1.6e-35 1.23e+19 GeV
1e-19 1.97e+03 GeV
0.0001 1.97e-12 GeV
The n(n − 3) line reproduces Penrose's counts: 4 for ordinary general relativity, 10 for Kaluza–Klein, 70 for 10-dimensional string gravity.
31.11 Should we accept the quantum-stability argument?
Penrose raises "profound reasons" to doubt the energy argument, after first noting the unexplained puzzle of why three dimensions grew and six did not.
The moduli problem. The shape of Y is fixed by moduli (as a Riemann surface's shape is, §8.4). Varying them costs zero energy, and string theorists like these modes because they connect to particle symmetries. Letting them vary over 𝔼3 gives an acceptable ∞N∞3. But some modes let moduli shrink to zero, producing a singular Y: a catastrophic instability, "unanswered; yet normally ignored".
Planck energy is not that big. About 2 × 109 J, roughly half a tonne of TNT. The Sun delivers some 108 times that to the Earth every second. On energy grounds alone, there is ample to excite Y across the whole universe.
Modes are not localised. The Y-excitations that are "inaccessible" are spread uniformly over all of 𝔼3. Nothing says they must be fed by a local particle collision; a non-linear disturbance of the entire geometry might do it.
Bend a hosepipe of tiny radius ρ into a huge circle of radius R ≫ ρ. A single quantum (an exciton) of a cross-sectional mode with frequency ν carries energy 2πħν, independent of R, so its local energy density falls as 1/R. In the limit of an infinite pipe, any local vibration must be built from ever more quanta, each ever weaker: a classical regime. The smallness of ρ is therefore no criterion for treating the extra dimensions quantum mechanically. Large numbers of quanta and large quantum numbers point the other way, as with a large angular momentum whose Majorana points scatter unless treated classically (§22.10). Penrose adds that a long optical fibre is a real physical analogue.
Without a theory that says when large systems behave classically (which, for Penrose, means the modified quantum mechanics of §§30.9 to 12), nothing guarantees that Y is immune. His conclusion: study perturbations of 𝕄 × Y classically.
31.12 Classical instability of extra dimensions
Classically things are worse than excessive freedom: a classical 𝕄 × Y universe with Planck-size compact Y is unstable, and singularities form "within a tiny fraction of a second".
The argument uses the Hawking–Penrose singularity theorem (1970), which the authors stated for any dimension. Consider perturbations that disturb only Y: the 6-space evolves into a Ricci-flat (1 + 6)-spacetime Z, the whole universe being Z × 𝔼3. The theorem says any Ricci-flat spacetime with a compact spacelike hypersurface, satisfying a generic condition (every causal geodesic meets "generic" curvature, k[aRb]cd[ekf]kckd ≠ 0) and free of closed timelike curves, must be singular.
- 𝔼1 × Y escapes only because it is non-generic.
- A generically perturbed Z is singular. If the perturbation is of Planck scale, the singularity arrives in about 10−43 s; smaller perturbations buy proportionally longer.
- Spilling into 𝕄 is worse. Perturbations that leak into ordinary space carry Planck-scale curvatures into it, in gross conflict with observation. A second application of the theorem (a point whose future light cone curls round and meets itself) covers this case: in exact 𝕄 × Y only a 2-dimensional subfamily of the 8-dimensional family of light rays fails to wander into Y and back, so a small generic perturbation tips it into the theorem's scope.
Penrose lists the escape routes honestly. Quantisation sometimes removes classical singularities (atoms are the classic case), but in most toy models of quantum gravity it does not. The exact string condition is Ricci flatness plus all orders in α′; if those terms respect the usual energy positivity, the theorem still applies, though QFT can violate local energy conditions. Worse, the all-orders condition is an infinite system of differential equations of unbounded order, so initial data need derivatives of all orders: freedom greater than ∞M∞9 for every M. He knows of no serious study of what data that system needs.
31.13 Is string QFT finite?
Finiteness is "the linchpin of the entire string idea", and Penrose finds three soft spots.
- Wick rotation. Physical world sheets are Lorentzian (1 + 1), with left- and right-moving disturbances at light speed; calculations use Riemannian world sheets, where these become holomorphic and antiholomorphic functions. The passage relies on a Wick rotation, justified only in flat backgrounds, not in serious non-perturbative gravity (compare his doubts about the Hawking approach, §28.9).
- Finiteness at fixed genus. For each world-sheet genus g (the analogue of g loops) the amplitude is claimed finite, but as of 2004 this was proved only to 2 loops for ultraviolet divergences, with no argument at all for the infrared ones.
- The sum over genus diverges. Even granting finite terms, the series over topologies diverges, and not in a tame way: it is not Borel-summable (Gross and Periwal 1988). Theorists read it as an expansion "about the wrong point" of an analytic amplitude, like expanding log z about z = 0. But then why trust any perturbative result?
Penrose's ledger for §§31.8 to 13: string theory has not shown that it reproduces 1 + 3 general relativity in any classical limit, has not shown its perturbative amplitudes are finite beyond two loops, and its total perturbation series diverges uncontrollably. "We do not yet know whether or not string QFT is actually finite."
31.14 The magical Calabi–Yau spaces; M-theory
String theorists themselves worried about something else: uniqueness. The early dream was that consistency would select one universe. Instead:
- Y spaces. A flat hypertorus (S1)6 cannot produce the standard model's chirality. The requirements then pick Calabi–Yau spaces (after Eugenio Calabi and Shing-Tung Yau): Kähler manifolds (compatible Riemannian metric and complex structure, hence also symplectic, Exercise 31.6) that are Ricci-flat and carry covariantly constant spinor fields. Those spinors act as the supersymmetry generators; the group rotating them among themselves plays the role of the particle symmetry group.
- No continuous symmetries. Calabi–Yau spaces have none, so the 10-space is not a fibre bundle of them; the internal symmetries act on spinors only, which Penrose finds geometrically suspect because spinors cannot be rotated without rotating the ambient space.
- A peculiar GUT. The groups that arise are much larger than the standard model's and must be broken down; "this programme has not yet been successfully achieved".
- Tens of thousands of classes of Calabi–Yau space, each with continuous moduli.
- Five string theories: Type I (open and closed strings), Type IIA, Type IIB, Heterotic O(32) and Heterotic E8 × E8. In heterotic strings the left- and right-movers seem to live in spacetimes of 26 and 10 dimensions, which "hardly makes good geometrical sense, certainly not to me(!)".
Algebraic geometers wanted the number of rational curves (genus-0 complex curves) of each degree on the quintic Calabi–Yau 3-fold. Geir Ellingsrud and Stein Arild Strømme counted directly: 2875, 609 250, 2 682 549 425. Philip Candelas and collaborators, assuming string theory's mirror symmetry (which swaps complex and symplectic structure and turns a hard count into an easy one on the mirror space), got 2875, 609 250, 317 206 375. Mathematicians assumed the physicists were wrong; then a computer-code error was found in the direct count, and the correct value was exactly Candelas's. The mirror method then produced the counts for degrees 4 to 10, up to 704 288 164 978 454 686 113 488 249 750. Kontsevich and others later proved the formulas mathematically.
In 1995 Witten launched the "second superstring revolution": S-, T- and U-dualities (strong–weak duality, mirror symmetry and relatives) make the five theories equivalent descriptions; one theory's small-scale limit matches another's large-scale limit; Yang–Mills theory has an electric–magnetic-like duality; Calabi–Yau spaces turn out mutually dual. Witten proposed that the five theories plus 11-dimensional supergravity are six faces of an unknown M-theory.
M-theory adds p-branes (p space dimensions plus time, strings being 1-branes) and D-branes, and is roughly 11-dimensional (1 + 10): Witten argued that the earlier "1 + 9" was itself an approximation. F-theory (Vafa 1996) goes to 12 = 2 + 10, with two time dimensions. The changing dimension count is treated as an energy-dependent effect, more dimensions appearing at higher energies, which Penrose calls a "seemingly cavalier attitude".
31.15 Strings and black-hole entropy
The Bekenstein–Hawking entropy SBH = ¼ × A kc³/(Għ) had never been obtained as Boltzmann's log of a phase-space volume by counting microstates. In 1996 Andrew Strominger and Cumrun Vafa did a count with strings and branes that gave it, hailed as solving "a quarter-century-old puzzle". Penrose calls this "very considerably overblown":
- 5 dimensions first. The original count was for black holes in 5-dimensional spacetime; 4-dimensional versions came later.
- Extremal only. It covers extremal holes (Hawking temperature zero) and small perturbations. An ordinary Kerr hole (mass m, angular momentum am) needs m ≥ a; extremality m = a is astrophysically unattainable.
- A different animal. The string holes are modelled on Reissner–Nordström (charge e, black hole if m ≥ ∣e∣, extremal if m = ∣e∣), with a supersymmetric Yang–Mills field replacing Maxwell's: a BPS state (Bogomol'nyi–Prasad–Sommerfield), with no known relevance to the actual world.
- No horizon. The counting is done in flat space, where there is no event horizon.
- Count string configurations of mass M in a fixed region on a Planck lattice: entropy from log(count).
- Treat G as adjustable: G grows with the string coupling gs (G ∝ gs²), and gs is the expectation value of the dilaton.
- At small G there is no black hole; "crank up Newton's constant" until the region falls inside its Michell radius 2MG/c².
- Scaling arguments carry the string entropy across, giving S ∝ A qualitatively.
- For the exact coefficient, count BPS states with fixed charges; supersymmetry fixes mass from charges. The log of the count gives exactly A/4 in the extremal case, and later work matched near-extremal corrections, rotation and 4 dimensions.
Two further objections. In the string picture entropy hardly increases when the hole forms, contrary to the standard view (§27.10), and the horizon does no work in the count, unlike the loop-variable count of §32.6. And there is a technical problem raised by Ashtekar: the argument seems to need positive specific heat, but black holes usually have negative specific heat (feed one energy and it cools, since TBH = 1/(8πm) for Schwarzschild). Specific heat is positive only very near extremality: m > a > (2√3 − 3)1/2m for Kerr and m > ∣e∣ > (√3/2)m for Reissner–Nordström (the extracted text garbles both bounds; these are the standard values).
31.16 The "holographic principle"
Perturbation theory is string theory's weakness, and the holographic conjecture, promoted to a "principle", promised exact results: the states of a string theory on a spacetime M correspond one-to-one with those of an ordinary QFT on a lower-dimensional spacetime ℰ, often pictured as M's boundary, as a hologram encodes 3 dimensions on 2.
Juan Maldacena (1997): string theory on M = AdS5 × S5 is equivalent to N = 4 supersymmetric Yang–Mills on ℰ, the 4-dimensional conformal infinity of AdS5 (topologically S3 × 𝔼1, the Einstein cylinder, universal cover of compactified Minkowski space). The S5 has cosmological radius set by the negative cosmological constant. Two things strike Penrose:
- ℰ is not M's boundary. M is 10-dimensional, ℰ 4-dimensional; M's conformal infinity is more like ℰ × S5.
- No small-dimension excuse. The S5 is huge, so the energy argument of §31.10 is unavailable. An ordinary field on M has freedom ∞M∞9, on ℰ only ∞E∞3. One-particle states are ordinary fields, so even the Fock spaces differ in size. Either the string theory has drastic undiscovered constraints, or the Yang–Mills side needs infinitely many fields (N → ∞). The usual choice N = 4 gives an internal SO(6) meant to match the SO(6) of S5; Penrose calls matching a spacetime symmetry to an internal group "fundamentally misconceived" unless the symmetry is imposed by Killing vectors, as Kaluza and Klein did.
Support comes from matching BPS states, from the common symmetry group SO(2, 4) × SO(6), and from further "coincidences". The conjecture grew out of the black-hole entropy work (a black hole as a thermal state on ℰ), which at best concerns cosmological-size holes.
Penrose's functional-freedom objection is real mathematics, but the standard answer is that the correspondence is between full quantum theories, where bulk locality and the classical field count are emergent and only approximate at large N and strong coupling. Thousands of checks (anomalies, correlation functions, integrability spectra, entanglement entropies via Ryu–Takayanagi) now make AdS/CFT the best-tested non-perturbative definition of quantum gravity in anti-de Sitter space. The live criticism has shifted to Penrose's other point: our universe has positive Λ, and no comparably precise holography exists for it.
31.17 The D-brane perspective
String theory is hard to criticise because it metamorphoses: attacks on one form are declared irrelevant to the next. The D-brane turn is Penrose's example of a change of philosophy made without announcement.
D-branes make sense of the open strings of Type I: each end must sit on a D-q-brane, a timelike (1 + q)-dimensional stable BPS solution of 11-dimensional supergravity (or a dual theory), carrying supersymmetric Yang–Mills charges at minimum energy. "D" is for Dirichlet (after Peter Gustav Lejeune Dirichlet, 1805 to 1859, the Dirichlet boundary problem). They are often treated as classical objects in the full 1 + 9 or 1 + 10 spacetime.
The new philosophy: we live on a D-3-brane, so the extra dimensions are unseen because our brane does not extend into them. This shrinks the problem, since we feel the bulk only where it touches the brane, and the freedom might drop to an acceptable ∞M∞3. But only if the restricted dynamics is an ordinary initial-value problem on the brane, which is unlikely: expect ∞M∞4. "The problem has still not gone away!"
D-branes have been used against the hierarchy problem (gravity weaker by ~1040): two branes, one "large" one "small", with exponential warping between them (Randall and Sundrum 1999). M-theory pictures with an 11th dimension as an interval between two boundary branes (or a circle) are of this type. Penrose also dismisses the ekpyrotic universe of Steinhardt and Turok (2002), a Big Bang from colliding branes, for ignoring the Big Bang's real puzzle, its specialness (§27.13).
31.18 The physical status of string theory?
Penrose's verdict is careful. Some claims can be discounted altogether, notably that string theory gave a "complete consistent theory of quantum gravity". Yet "something of genuine significance" is going on behind the scenes. He quotes the mathematician Richard Thomas (Imperial College): the dualities "constantly surprise us with new predictions… Every prediction made, suitably interpreted mathematically, has turned out to be correct… To a mathematician these things cannot be coincidence, they must come from a higher reason."
I can't emphasise enough how deep some of these dualities are; they constantly surprise us with new predictions.
Richard Thomas, in an e-mail to PenroseWitten's role matters. He has steered the field since the late 1980s ("where Witten goes, it does not take long for the rest to follow"; Maldacena's paper sat largely unnoticed until Witten took it up in 1998, then became the most cited). He won the Fields Medal in 1990. Penrose testifies from Oxford seminars that many original ideas "actually came wholly or at least partly from Witten". Witten himself credits physical insight (path integrals, supersymmetry, strings) rather than mathematics; if that is right it is perhaps the strongest case that Nature favours supersymmetry and strings. "On the other hand, perhaps he is a more remarkable mathematician than he admits to being!"
Two analogies temper the enthusiasm:
Deep coincidence, mathematical
Andrew Wiles proved Fermat's Last Theorem by showing two very different calculations always give the same list (part of the Taniyama–Shimura conjecture, completed by Breuil, Conrad, Diamond and Taylor). Mirror symmetry is similar: two infinite lists that coincide. Such coincidences have mathematical reasons, discovered in time, and are not offered as evidence for physical theories.
Deep coincidence, misleading
Woldemar Voigt (1912) built a theory of the anomalous Zeeman and Paschen–Back effects on a wrong oscillator model. Fifteen years later Heisenberg and Jordan redid it with quantum mechanics and got "exactly the old Voigtian formulae". The reason, Heisenberg said, "was a purely formal and mathematical one". Exact agreement did not make Voigt's physics right.
The most promising recent development, for Penrose, is Witten's 2003 twistor string theory, which works in ordinary 4-dimensional spacetime (still supersymmetric) and combines twistor and string ideas to compute gluon scattering (§33.14).
Worked example: why 9 beats 70
Compare the "size" of two solution spaces, ∞70∞9 (10-dimensional Ricci-flat) and ∞1000∞3 (a 4-dimensional theory with a thousand fields).
- Discretise each initial surface with L lattice points per dimension. The 9-surface has L9 points, the 3-surface L3.
- Degrees of freedom: 70L9 versus 1000L3.
- Ratio: 0.07 L6. At a modest L = 100 it is already 7 × 1010; as L → ∞ it diverges.
- So no finite number of extra components in 4 dimensions matches the freedom of a 10-dimensional field. This is the precise content of Penrose's slogan that functions of more variables always win (§16.7).
Test yourself
- Why must supersymmetry generators anticommute? They turn bosons (commuting) into fermions (anticommuting), so the generator itself must be "fermionic".
- What made 26 become 10? Supersymmetry changes the anomaly coefficient from 24 − σ to 8 − σ.
- Why is the S5 of AdS/CFT a problem for the energy argument? It is cosmologically large, so its modes are not expensive to excite.
- What does the Hawking–Penrose theorem say about 𝔼1 × Y? Nothing; it is non-generic. A generic perturbation is forced singular.
- Theodor Kaluza (1919), Oskar Klein: the fifth dimension; Klein's Planck-scale size and cut-off idea.
- Gabriele Veneziano, Yoichiro Nambu, Leonard Susskind, Holger Nielsen: dual models to strings.
- John Schwarz, Joël Scherk, Michael Green: strings as gravity; the 1984 superstring.
- Edward Witten: M-theory, dualities, AdS/CFT follow-up, twistor strings; Fields Medal 1990.
- Eugenio Calabi, Shing-Tung Yau: Calabi–Yau manifolds.
- Philip Candelas: mirror-symmetry curve counts.
- Andrew Strominger, Cumrun Vafa: black-hole microstate counting (1996).
- Juan Maldacena: AdS/CFT (1997).
- Lisa Randall, Raman Sundrum: warped braneworlds (1999).
Terms to know
| Term | Meaning |
|---|---|
| Super-Lie algebra | Lie algebra extended with anticommutators [a, b]+ for fermionic pairs |
| Body / soul | Ordinary part / nilpotent Grassmann part of a superalgebra element |
| Gravitino | Spin-3/2 partner of the graviton in supergravity |
| Kaluza–Klein mode | Excitation around a compact dimension; mass √(μ² + ħ²n²/ρ²) |
| String constant α′ | Area scale (~10−68 m²); tension ħc/α′ |
| Dilaton | Scalar field whose expectation value sets gs |
| Calabi–Yau space | Compact Ricci-flat Kähler 3-fold with constant spinors |
| Moduli | Zero-energy shape parameters of Y |
| Duality (S, T, U) | Equivalences between apparently different string theories |
| BPS state | Supersymmetric minimum-energy state, mass fixed by charges |
| D-q-brane | (1 + q)-dimensional surface where open strings end |
| Functional freedom | ∞k∞q: k functions of q variables |
- "String theory predicts gravity, so it is confirmed." It contains a massless spin-2 mode and Einstein-like consistency conditions, perturbatively, in 10 dimensions; no 4-dimensional prediction has been tested.
- "Tiny extra dimensions are automatically invisible." Only if the energy argument holds; Penrose's exciton and singularity arguments challenge it.
- "Penrose dismisses the mathematics." He praises mirror symmetry and Witten; he doubts the physics.
- Planck numbers. The text gives the Planck energy as "around 1012 joules" and a "Planck frequency of ~10−43 s". The correct values are ≈ 2 × 109 J (which matches his own "one tonne of TNT", really about half a tonne, and his "108 times" solar comparison) and a frequency of ~1043 Hz (10−43 s is the Planck time).
- Names. The Norwegian mathematicians are Geir Ellingsrud and Stein Arild Strømme (spelled "Ellingstrud" and "Arilde" in the text); Amati's first name is Daniele.
- Parameter count. "Some 17 or more" free parameters; the standard tally is 19 (26 with neutrino masses).
- Tone. Penrose declares his bias openly, but the chapter is a critique by a rival programme's founder; Polchinski's and Greene's replies to similar criticism (and the Smolin/Woit debates of 2006) are the other half of the argument.
The superpartners did not come. The LHC ran at 13 TeV (2015 to 2018) and has run at 13.6 TeV since 2022 (Run 3). ATLAS and CMS exclude gluinos below roughly 2.2 to 2.4 TeV and light-flavour squarks below about 1.8 TeV in simple models, with no hint of supersymmetry, so the "naturalness" motivation Penrose mocks has largely collapsed. The Higgs (2012, 125 GeV) arrived alone. Supergravity's finiteness hope partly revived: N = 8 supergravity is now known finite through five loops in four dimensions (Bern and collaborators), though its full status is unsettled. Inverse-square-law tests now reach about 50 micrometres (Eöt-Wash, 2020) without deviation, closing most large-extra-dimension scenarios. On the theory side, the swampland programme (Vafa 2005; de Sitter conjecture 2018) argues most effective theories cannot come from strings, and some theorists read DESI's 2024 to 2025 hints of evolving dark energy as friendly to string-motivated quintessence. AdS/CFT has grown into the "It from Qubit" view of spacetime as entanglement, and the island formula (2019) reproduced the Page curve of black-hole evaporation semiclassically.
Penrose's functional-freedom test is a portable sanity check for any model with hidden degrees of freedom: count what the model can represent, not just how many parameters it lists. An architecture whose latent state lives on a bigger "surface" than its observable interface will always have more freedom than the interface can constrain, which is the formal version of why under-determined models overfit and why platform designs that promise everything need an explicit symmetry (a Killing-vector-style constraint) to stay governable.
Chapter 32 follows the relativists' road, Ashtekar variables and loop quantum gravity, where geometry is built by the loops rather than laid down beforehand. Chapter 33 develops twistor theory, the reason Penrose insists on 1 + 3 dimensions, and returns to Witten's twistor strings. Chapter 34 takes up the question raised by Voigt and mirror symmetry: how far can mathematical beauty guide physics?
Einstein's Narrower Path; Loop Variables
Against "the only game in town", Penrose sets the relativists' road: quantise Einstein's actual 4-dimensional theory, with no extra dimensions and no supersymmetry. Ashtekar's variables (1986) made the equations polynomial; loop variables (1988) turned general covariance on the initial 3-surface into pure topology; and the basis states turned out to be Penrose's own spin networks of the 1950s, now carrying quanta of area. He calls these "the most important developments in the canonical approach since Dirac", while naming what is still missing: the Hamiltonian dynamics, a geometric reason for the Barbero–Immirzi parameter, and any sign of time asymmetry or state reduction.
32.1 Canonical quantum gravity
Penrose's preference is for a "more tightly controlled position" than the string programme: 4-dimensional Lorentzian spacetime, Einstein's field equation without supersymmetry, in a genuinely quantum setting. (A note adds the irony that Einstein himself, in his unified-field years, did not always keep to his own narrow path.) The chapter covers Ashtekar variables, loop variables and spin networks; the next adds twistors, discrete spacetime, quantum groups and non-commutative geometry.
The direct route is canonical quantisation: write general relativity in Hamiltonian form and replace momenta by operators. Three obstacles:
- General covariance. Coordinates carry no meaning, and the naive rule pa → iħ∂/∂xa already fails in curvilinear coordinates (§21.2).
- Non-polynomial Hamiltonian. The standard Hamiltonian is a tangle of square roots and denominators.
- Constraints. Besides evolution equations off the initial 3-surface S, there are equations within S that the data must satisfy. They are necessary and sufficient for consistent evolution, which then preserves them.
- 1932 onwards: Dirac builds a quantisation framework for constrained systems, driven by gravity's constraints.
- 1950s to 1960s: Pirani and Schild, Bergmann, Arnowitt–Deser–Misner (1962); Wheeler–DeWitt equation (1967), "quantum gravity's Schrödinger equation" on the space of 3-geometries.
- 1981/82: Amitabha Sen's connection makes the constraints polynomial (Witten uses the same connection in his 1981 positive-energy proof; Penrose and MacCallum had used it in 1972 for hypersurface twistors).
- 1986: Abhay Ashtekar's "new variables".
- 1988: Rovelli, Smolin and Jacobson: loop variables.
- 1990s: spin-network basis; Thiemann's Hamiltonian (1996 to 2001); spin foams (Barrett, Crane, Baez, Reisenberger, Rovelli).
32.2 The chiral input to Ashtekar's variables
Ashtekar's original variables treat the two helicities of the graviton differently: they are left–right asymmetric.
First, why is the graviton spin 2 and the photon spin 1? A geometric test: for spin σ, rotating a plane wave by π/σ about its direction sends the field to its negative, and 2π/σ restores it.
| Wave | Field quantity | Rotation to negative | Rotation to restore | Helicities |
|---|---|---|---|---|
| Light | Electric and magnetic vectors | π | 2π | ±1 |
| Gravity | Quadrupole distortion (Weyl curvature) | π/2 | π | ±2 |
| Spin ½ | Spinor | 2π | 4π | ±½ |
Chirality enters through duals. Using the Levi-Civita tensor εabpq (ε0123 = 1), the Maxwell tensor Fab and the Weyl tensor Cabcd have duals ∗Fab = ½εabpqFpq and ∗Cabcd = ½εabpqCpqcd (dualising the second pair gives the same, Exercise 32.1). For complex fields, read as positive-frequency wavefunctions:
- Right-handed photons and gravitons: the self-dual parts ⁺F = ½(F − i∗F), ⁺C = ½(C − i∗C), with ∗(⁺F) = i ⁺F.
- Left-handed: the anti-self-dual parts ⁻F = ½(F + i∗F), ⁻C = ½(C + i∗C), with ∗(⁻F) = −i ⁻F.
A self-dual 2-plane element contracted into an anti-self-dual Weyl or Maxwell tensor gives zero (Exercise 32.2). In Ashtekar's framework, ⁺C and ⁻C play different roles.
Chirality as a convenience
The asymmetry is an unimportant feature of mathematics that happens to simplify the Hamiltonian. Einstein's theory has no left–right asymmetry and gravity shows none.
Chirality as a clue
Nature is chiral: the weak interaction sees only left-handed particles (§25.3). If quantum gravity lays the framework for all physics, a built-in chirality (as in heterotic strings, Ashtekar variables and twistors) would make the weak interaction's asymmetry far less mysterious.
32.3 The form of Ashtekar's variables
The chirality comes from preferring unprimed 2-spinors αA over primed ones (in the electron's Dirac spinor the unprimed part is the left-handed zig, the one the weak force couples to, §25.3).
- Momentum γ. The inverse 3-metric of S (a density), referred to a spinor basis and written as 2-forms.
- Position Γ. The unprimed spin connection of the 4-space, restricted to S: it says how to carry a 4-space spinor αA parallel to itself along any curve in S.
- Quantisation. In the Γ representation, γ → iħ δ/δΓ (a functional derivative, §20.5); in the γ representation, Γ → −iħ δ/δγ.
- Decomposition. Γ = Γ1 + iΓ2, with Γ1 from S's intrinsic curvature and Γ2 from its extrinsic curvature (how S bends in M). The opposite chirality would give Γ1 − iΓ2.
- Bundle reading. Γ is a connection on a bundle over S with fibre the spin space 𝕊 and group SL(2, ℂ).
The technical snag. SL(2, ℂ) is non-compact, with unwanted infinite-dimensional, mostly non-unitary irreducible representations, which wreck rigorous construction. So the programme switched to
Γη = Γ1 + ηΓ2, with η a non-zero real number, the Barbero–Immirzi parameter.
The group becomes SU(2), compact, with finite-dimensional unitary representations: exactly the spin states of ordinary quantum mechanics, labelled by n = 2j = 0, 1, 2, …. Classically every Γη is related to Γ by a canonical transformation, so the classical theories are equivalent; but quantisation is not invariant under such changes (§21.2), so the quantum theories may differ. Penrose: it is "an unresolved issue how much damage" the switch does, and values other than ±i (or 0) have no geometric justification.
32.4 Loop variables
Carry an unprimed spinor round a closed loop in S using Γ. It returns transformed by a 2 × 2 matrix TAB, basis-dependent; but the trace TAA is basis-independent (Exercise 32.3), a property of the connection and the loop alone. This is a Wilson loop (after Kenneth Wilson, gauge theory, 1974 to 1976). In 1988 Carlo Rovelli, Lee Smolin and Ted Jacobson made these traces the loop variables of general relativity; the basic quantum states are essentially their eigenstates.
These states are geometrically very singular, like Dirac delta functions (§9.7). Not the curvature but the entire metric is concentrated on the loops. Concretely, "metric" means an area measure: a test surface T in S acquires area only where it crosses a loop, each crossing of a loop with spin j contributing
ΔA = 8πGηħ √(j(j + 1)), i.e. 8πη√(j(j + 1)) Planck areas.
Because only crossings count, how close two loops are is meaningless; only linking, knotting and intersection and the discrete spins matter, so general covariance within S is solved "completely" by staying topological.
String theory
- Perturbative: power series about a weak field.
- Background flat (𝕄 × Calabi–Yau).
- Strings move in a pre-existing spacetime.
Loop variables
- Non-perturbative from the start.
- Basis states far from flat: δ-function area.
- Loops create geometry; a near-classical space is a superposition of fine weaves.
32.5 The mathematics of knots and links
Loops lead into knot theory: whether a loop can be deformed into a circle without passing through itself, whether several loops can be separated. Classic cases: the trefoil (knotted), a messy but unknotted loop, a simple link, the Whitehead link (inseparable with linking number zero) and the Borromean rings (inseparable though no pair is linked). The Alexander polynomial (early 20th century) was joined by physics-inspired invariants: Jones, HOMFLY, Kauffman polynomials.
These come from a diagrammatic algebra generalising Penrose's tensor diagrams (§12.8), where it now matters whether one index line passes over or under another. The Kauffman bracket identity uses a complex number A with q = A² = eiπ/r; A = −1 gives the binor calculus underlying spin networks (Penrose 1971). Such q-deformed structures are often called "quantum groups", which Penrose calls misleading: there is no clear relation to quantum theory, and their fundamental physical use is "largely conjectural".
Witten (1988) connected Jones polynomials to topological quantum field theory, where field equations vanish locally and all information sits in global structure and "glitches". The example: general relativity in 1 + 2 dimensions. The Weyl tensor vanishes identically in 3 dimensions, so empty space is flat; a point source cuts out a wedge and glues the faces (a conical singularity, like a cosmic string). Classically source world lines are straight; the quantum theory allows them curved, knotted and linked, which yields insight into knot invariants (though not rigorous theorems, owing to wild divergences). Loop gravity resembles this (area only at the loops) but keeps real field equations. Penrose suggests TQFT ideas might pair naturally with twistor space, where field equations also disappear locally (§33.11).
32.6 Spin networks
Loops alone do not give an orthonormal basis; loops must intersect, and the structures at the intersections are "formally very close" to the spin networks Penrose invented nearly 50 years earlier for a different purpose.
Why he invented them (1950s). He wanted physics built on discreteness and a form of Mach's principle (encouraged by Dennis Sciama): space should be derived from relations between objects, not presupposed. The ideal ingredient was total spin: the number n = 2j (in units of ħ/2) is direction-independent yet tied to directions; its magnitude is √(j(j + 1))ħ, the same factor in the loop area formula.
Make two EPR–Bohm pairs (A, B) and (C, D) of 1-units (spin ½), each pair from a 0-unit. Combine B and D: the result is a 0-unit with probability ¼ or a 2-unit with probability ¾. Combine A and C instead: the same. But the outcomes are correlated: a 0-unit from B + D rules out a 2-unit from A + C. Such probabilities do not depend on any orientation, and Penrose argued they must always be rational, Nature choosing among finitely many discrete options.
Rules. Exactly three lines meet at each vertex, which makes probabilities unique; the graph plus spin labels is all the data. A combinatorial ("counting") procedure gives every probability, all rational. Geometry emerges: a unit of large spin defines a direction (a spinning tennis ball's axis); the angle between two large units is measured by moving a 1-unit from one to the other and noting the probability of up versus down. One extra step separates quantum probability from probability of ignorance (insufficient connections, cf. Density matrices): repeat the transfer and keep only cases where the probabilities recur. Then the spin-geometry theorem (Penrose 1971; Moussouris 1983) shows the angles obey exactly Euclidean 3-geometry.
Try it in Python: the ¼–¾ split and the area spectrum
import numpy as np, math
up,dn=np.array([1,0]),np.array([0,1])
s=(np.kron(up,dn)-np.kron(dn,up))/math.sqrt(2) # a 0-unit of two 1-units
psi=np.kron(s,s).reshape(2,2,2,2).transpose(1,3,0,2).reshape(4,4) # (B,D)x(A,C)
p0=np.linalg.norm(np.outer(s,s)@psi)**2
print(f"P(B+D -> 0-unit) = {p0:.4f}, P(2-unit) = {1-p0:.4f}")
print("A,C state after B,D gave 0:", np.round((psi.T@s)/np.linalg.norm(psi.T@s),3))
for eta in (math.log(2)/(math.pi*math.sqrt(3)), 0.2375):
print(round(eta,4),[round(8*math.pi*eta*math.sqrt(j*(j+1)),3) for j in (0.5,1,1.5,2)])
Output:
P(B+D -> 0-unit) = 0.2500, P(2-unit) = 0.7500
A,C state after B,D gave 0: [ 0. 0.707 -0.707 0. ]
0.1274 [2.773, 4.528, 6.2, 7.842]
0.2375 [5.169, 8.441, 11.559, 14.621]
The second line shows the correlation: once B + D form a 0-unit, A + C are forced into the 0-unit (singlet) state. The last two lines give the lowest area quanta in Planck areas for the two historical values of η.
How loop gravity changes them.
- Higher valence. Nodes come from intersecting loops, so four or more lines meet; uniqueness is lost and an intertwiner must be specified at each node (an "X" written as a combination of "H"-shaped pairs of trivalent vertices).
- Embedding. The networks are embedded in S, so knotting and linking carry information.
- Meaning of n. In loop gravity n measures area, not angular momentum; the two are dimensionally different, which is why G appears.
Dynamics is unfinished. Spin networks solve the constraints within S, "no mean achievement", but not the evolution off S (the Hamiltonian constraint). Thomas Thiemann proposed one answer; whether it is right for Einstein's theory is doubted.
Black-hole entropy. Here loops shine. Working directly with Schwarzschild or Kerr geometry and counting spin-network punctures of the horizon, large holes give S ∝ A; the Bekenstein–Hawking coefficient ¼ required η = log 2/(π√3) ≈ 0.127 (Ashtekar, Baez, Corichi, Krasnov 1998). One value then works for charge, rotation and cosmological constant, and two infinite sequences computed differently agree term by term. A note records that in 2004 this value was found in error (Domagała and Lewandowski; Meissner), giving η ≈ 0.2375; the discussion is otherwise unaffected.
The black-hole success led some to regard a real η as physically correct. Penrose finds it "hard to believe": there is no geometric reason, and any real η destroys the chirality that motivated the variables. Γη then transports spinors by "a peculiar but even-handed mixture of intrinsic and extrinsic parts, whose meaning I find particularly obscure".
32.7 Status of loop quantum gravity?
Penrose declares an interest: the founders are friends, he held visiting posts at Syracuse and Penn State, and spin networks are his. His assessment:
For: - Addresses Einstein's actual theory inside QFT, non-perturbatively. - Most important canonical advance since Dirac began the subject. - Handles the 3-space part of general covariance. - Discreteness of geometry emerges (area quanta). - Now includes electromagnetism (Varadarajan 2000/01) and other interactions. - Convincing black-hole entropy from real 4-dimensional horizons.
Against: - Forced onto Γη with undetermined η, not the geometric Γ. - Hamiltonian dynamics not unambiguously defined. - Built on a 3 + 1 split, so full 4-dimensional covariance opens a "Pandora's box", the problem of time (frozen time). - Superpositions of spin networks have no common location to compare: how does a classical world emerge? - No sign of the time asymmetry at singularities that Chapter 30 demands (early loop work on singularities: Bojowald 2001).
On the problem of time Penrose repeats his conviction (§30.11): it will not be solved until state reduction R is understood, and that needs a revision of principles. Here he sees an opening. In his original spin networks, every edge label was effectively the result of an R measurement of total spin, with probabilities arising when two units merge. If R is a gravitational process (OR, Chapter 30), gravity and spin-network probabilities cannot be separated, and a full union of loop variables and spin networks might have to build in state reduction, giving a lead to gravitational OR. Absent such a formalism, it is speculation.
Less radical 4-dimensional extensions exist: spin foams (Crane, Barrett, Baez, Reisenberger, Rovelli, Perez), 2-complexes whose faces carry spins, pictured as a spin network evolving in time; their link to quantum gravity was not yet worked out in 2004, and links with twistor theory are possible.
Worked example: counting a horizon (the idea behind the black-hole result)
- A horizon of area A is pierced by N spin-network edges. Each puncture with spin j adds 8πη√(j(j + 1)) Planck areas.
- Suppose, crudely, every puncture has j = ½: each adds 8πη(√3/2) = 4√3πη and carries 2 states (m = ±½).
- Then N = A/(4√3πη) and the number of states is 2N, so S = N log 2 = A log 2/(4√3πη).
- Setting S = A/4 gives η = log 2/(π√3) ≈ 0.127: exactly the 1998 value. Counting the other spins properly (the 2004 correction) raises it to ≈ 0.2375.
Test yourself
- Why does a real η remove chirality? Γ1 + ηΓ2 treats intrinsic and extrinsic parts with real weights, so it no longer singles out self-dual (i-weighted) structure.
- What does a loop state assign area to? Only to points where a test surface crosses a loop.
- What was missing from 2004 loop gravity that Penrose most wants? Dynamics, 4-dimensional covariance, and a role for state reduction.
- Abhay Ashtekar: new variables (1986).
- Amitabha Sen: the polynomial connection (1981/82).
- Carlo Rovelli, Lee Smolin, Ted Jacobson: loop variables (1988).
- Kenneth Wilson: Wilson loops.
- Fernando Barbero, Giorgio Immirzi: the real parameter η.
- Thomas Thiemann: Hamiltonian constraint (1996 to 2001).
- Louis Crane, John Barrett, John Baez, Mike Reisenberger: spin foams.
- Martin Bojowald: loops and singularities (2001).
- Dennis Sciama: Penrose's mentor, Mach's principle.
Terms to know
| Term | Meaning |
|---|---|
| Constraint | Equation the data must satisfy within S |
| Wheeler–DeWitt equation | Canonical quantum gravity's Schrödinger equation on 3-geometries |
| Self-dual / anti-self-dual | ∗f = if / ∗f = −if: right- / left-handed parts |
| Barbero–Immirzi η | Real parameter in Γη = Γ1 + ηΓ2 |
| Wilson loop | Trace of the holonomy of a connection round a loop |
| Weave | Fine superposition of loops approximating a classical 3-geometry |
| Intertwiner | Data fixing how spins combine at a higher-valent node |
| q-deformation | Kauffman-type algebra with q = eiπ/r; "quantum group" |
| Spin foam | 2-complex history of spin networks |
| Problem of time | Time evolution indistinguishable from a coordinate change |
- The η value. The text's η = log 2/(π√3) is the 1998 value; Penrose's own note flags the 2004 correction (≈ 0.2375, Meissner and Domagała–Lewandowski), later refined further depending on the counting scheme.
- Interest declared. Penrose is candid that loop gravity uses his spin networks and is run by friends; his sharper criticism of strings than of loops reflects his relativist priorities, which he states openly.
- Probabilities rational? His early belief that all fundamental probabilities are rational is a philosophical stance; standard quantum mechanics gives irrational ones freely (cos² of generic angles).
Loop gravity since 2004. Loop quantum cosmology replaced the Big Bang singularity with a quantum bounce (Ashtekar, Pawłowski, Singh 2006), and work continues on possible imprints in the CMB. The EPRL spin-foam model (Engle, Pereira, Rovelli, Livine 2007/08) became the standard covariant formulation; its semiclassical limit reproduces Regge calculus, and numerical spin-foam computations of transition amplitudes began in the 2020s. The Barbero–Immirzi value remains scheme-dependent, and the full Hamiltonian dynamics is still debated. No experiment has seen discrete area: gamma-ray-burst timing (Fermi GRB 090510, LHAASO's GRB 221009A) rules out the simplest linear-in-energy Lorentz violation beyond the Planck scale, which constrains some discrete-spacetime models but not loop gravity's Lorentz-covariant versions. Penrose's 1950s spin-geometry theorem gained new life in quantum-information approaches to emergent space.
Spin networks are an early example of an idea now everywhere in AI and data architecture: meaning from relations rather than coordinates. A graph whose nodes carry only local labels, with geometry reconstructed from the statistics of interactions, is close kin to graph neural networks and knowledge graphs, where position emerges from connectivity. The lesson Penrose draws (separate genuine uncertainty from ignorance caused by missing links) applies directly to inferring structure from sparse relational data.
Chapter 33 gives Penrose's own radical alternative, twistor theory, which keeps the chirality that Ashtekar variables lost and in which field equations vanish into the holomorphic structure of twistor space. It also surveys discrete spacetime, causal sets and non-commutative geometry.
More Radical Perspectives; Twistor Theory
Penrose first surveys the genuinely radical options: finite fields, lattices, causal sets, Regge calculus, topos theory, n-categories and Connes's non-commutative geometry. Then he presents his own forty-year programme. In twistor theory the light ray is primary and the spacetime point is derived: an event becomes a Riemann sphere in a complex 3-dimensional twistor space, massless fields become holomorphic sheaf cohomology, the field equations evaporate into holomorphy, and curved twistor spaces give the non-linear graviton. He is candid that it is "not really a physical theory" yet, and that the googly problem (the right-handed graviton) took 25 years to approach.
33.1 Theories where geometry has discrete elements
Should physics abandon the real-number continuum (§3.3)? Loop gravity moves toward discreteness but still embeds its networks in a continuous 3-surface. More radical options:
- Finite fields. Yrjö Ahmavaara (1965): replace ℝ by 𝔽p, integers modulo a huge prime p.
- Lattices. Periodic spacetime lattices (Snyder 1947, Schild 1949, 't Hooft); "rather more Lorentz-invariance than one might expect", but still trouble.
- Causal sets. Rafael Sorkin: spacetime is a discrete, perhaps finite set of points whose only structure is causal order (who can signal whom). Random sprinkling lets Lorentz invariance emerge. Earlier relatives: Kronheimer and Penrose (1967), Myrheim (1978), 't Hooft (1978).
- Quantum set theory and quaternionic geometry (David Finkelstein), octonionic physics (Corinne Manogue, Tevian Dray).
- Regge calculus (Tullio Regge, 1959/61). Spacetime as a 4-dimensional polytope of 4-simplices, curvature concentrated as δ-functions on 2-dimensional "bones", with a deficit angle at each; quantum states as Feynman sums over such shapes. A cosmic string has exactly this geometry.
- Topos theory (Richard Jozsa, Christopher Isham): a set theory built on intuitionistic logic, which rejects proof by contradiction.
- Category and n-category theory (Eilenberg and Mac Lane, 1945): "abstract nonsense" of objects and arrows, with links to loops, spin foams and q-deformation. Penrose would "not altogether" be surprised to see it replace spacetime notions this century.
- Non-commutative geometry (Alain Connes, Fields Medal 1982).
Non-commutative geometry, explained. The smooth real functions on a manifold M form a commutative algebra A, and (Gelfand-type theorems) M can be reconstructed from A alone: the two are equivalent. Quantum mechanics produces non-commutative algebras, for example x and p with pbxa − xapb = iħδba, or the angular-momentum algebra L1L2 − L2L1 = iħL3. "Reconstructing a space" from such an algebra gives a non-commutative geometry, for instance the non-commutative sphere. Connes's standard-model construction takes A = A1 × A2: functions on a (Euclidean-signature) spacetime times a finite non-commutative algebra encoding the internal symmetries ("two copies" of spacetime). It is not yet Lorentzian, uses little of the idea's richness, but "makes a start" and predicts the Higgs mass.
Twistor theory goes the other way: no imposed discreteness, but a deeper role for complex numbers, the same numbers that run quantum mechanics, so linking "the physics of the large and the physics of the small".
33.2 Twistors as light rays
Two guiding principles:
- Complex magic in spacetime. Quantum spin states correspond to directions through the Riemann sphere (§22.9), and the celestial sphere of any observer is also naturally a Riemann sphere (§18.5). This is special to 4 dimensions with Lorentzian signature.
- Quantum non-locality. EPR and quanglement (§23.10) show physics is not fully local. Spin-network lines can be read as quanglement links, and with any time direction (forwards, sideways, backwards). Twistor theory is a relativistic continuation of the spin-network programme, with idealised light rays as carriers of quanglement and spacetime constructed afterwards.
The reversal. In spacetime a light ray is a locus and an event a point; in twistor space a light ray is a point and an event is a locus, the Riemann sphere of all rays through it. The correspondence is non-local, not point-to-point.
Dimension counting. The space of light rays ℙℕ has 5 real dimensions (Exercise 33.1: a point of a 3-space plus a direction, 3 + 2), so it cannot be complex. Give the rays helicity and energy (one more real number) and we get the 6-real-dimensional ℙ𝕋 = ℂℙ3, a complex 3-manifold, which ℙℕ cuts into ℙ𝕋+ (positive helicity) and ℙ𝕋− (negative). Twistors are not massless particles; they are the variables in which massless particles are described, as position vectors are not particles.
Conventional "quantum spacetime"
Quantise the metric; light cones become fuzzy, so "spacelike" is uncertain. Then QFT's rule that spacelike-separated field operators commute cannot even be stated.
Twistorial picture
Quantise in twistor space. Light rays stay sharp; whether they intersect becomes uncertain, so events become fuzzy instead.
The spin-network shortfall pointed here too: spin gives angles but not distances, which need linear momentum, i.e. The Poincaré group. Because that group is not semi-simple, Penrose looked in the late 1950s to the semi-simple conformal group, which preserves light cones (not the metric) and is the symmetry group of ℙℕ (its non-reflective part also of ℙ𝕋±). (John Moussouris's 1983 thesis did build Poincaré spin networks, needing extra labels.)
33.3 Conformal group; compactified Minkowski space
Massless field equations (Maxwell, for example) are invariant under the 15-dimensional conformal group, not just the 10-dimensional Poincaré group. If masslessness is fundamental and mass arrives later via the Higgs, the conformal group deserves a basic place.
The conformal group acts on compactified Minkowski space 𝕄#, built as the Riemann sphere is built from the plane by adding ∞: add a whole light cone at infinity 𝒥. Take 𝕄's past and future null infinities 𝒥−, 𝒥+ and identify each point a− with the antipodal point a+ where its light cone refocuses; identify i−, i0, i+ as one point i. The result is compact, with topology S1 × S3 (Exercise 33.2), and carries a conformal Lorentzian metric (metrics equivalent under g → Ω²g, Ω > 0, which preserves null cones).
- Ambient space. Pseudo-Euclidean 𝔼2,4 with ds² = dw² + dt² − dx² − dy² − dz² − dv².
- Null cone K. w² + t² − x² − y² − z² − v² = 0, a 5-dimensional cone through the origin O.
- Minkowski space inside. The section of K by the null hyperplane w − v = 1 has induced metric dt² − dx² − dy² − dz²: exactly 𝕄, embedded as a "paraboloid".
- 𝕄# is the space of generators of K (lines through O on K). Generators not in w − v = 0 meet 𝕄 once; those in it give the points of 𝒥.
- Symmetry. O(2, 4) maps generators to generators, preserving the conformal structure; ±I act trivially, so the conformal group is O(2, 4) up to sign. The subgroup preserving w − v = 0 is Poincaré. This is the higher-dimensional version of the sphere-and-Lorentz-group picture of §18.5.
33.4 Twistors as higher-dimensional spinors
The terse definition: a twistor is a reduced (half) spinor for O(2, 4). For a 2n-dimensional space with group O(n − r, n + r), reduced spinors form a 2n−1-dimensional space; here n = 3, giving a 4-dimensional complex space, twistor space 𝕋. The construction generalises to any spacetime dimension, but only even dimensions give reduced (chiral) spinors, and chirality is what may one day house the weak interaction.
Twistors refer to the conformal group, which moves points; they are global objects, not attached to a point like vectors or ordinary spinors. That is an advantage for replacing spacetime, a difficulty for curved spacetimes without conformal symmetry (resolved in §§33.11, 12).
The deep reason for 4 dimensions: the celestial sphere is a conformal manifold in any dimension, but only in 1 + 3 is it naturally a complex manifold (the Riemann sphere). General results say twistor space is complex only when (space dimensions − time dimensions) ≡ 2 (mod 4). Kaluza–Klein (1 + 4), 10- and 11-dimensional supergravity, 26-dimensional bosonic strings, 10-dimensional superstrings, M-theory and 12-dimensional F-theory all fail this test.
33.5 Basic twistor geometry and coordinates
Twistor space 𝕋 is a complex 4-dimensional vector space with coordinates Z0, Z1, Z2, Z3 (index form Zα). A twistor Z is incident with the event R = (t, x, y, z) (with c = 1) when
(Z0, Z1)T = (i/√2) [[t + z, x + iy], [x − iy, t − z]] (Z2, Z3)T,
"from which the basics of flat-space twistor geometry all follow".
- Conjugation. The complex conjugate of a twistor is a dual twistor Z̄α with components (Z̄0, Z̄1, Z̄2, Z̄3) = (conj Z2, conj Z3, conj Z0, conj Z1), the pairs swapped.
- Norm. Z̄αZα = Z0Z̄2 + Z1Z̄3 + Z2Z̄0 + Z3Z̄1 = ½(∣Z0 + Z2∣² + ∣Z1 + Z3∣² − ∣Z0 − Z2∣² − ∣Z1 − Z3∣²), signature (+ + − −); the symmetry group SU(2, 2) is locally O(2, 4).
- Null twistors. A twistor meets a real event only if Z̄αZα = 0.
| Space | Real dim. | Meaning |
|---|---|---|
| 𝕋 | 8 | All twistors (complex 4-space) |
| ℕ | 7 | Null twistors, Z̄·Z = 0 |
| 𝕋± | 8 | Positive / negative twistors |
| ℙ𝕋 = ℂℙ3 | 6 | Projective twistors, ratios Z0:Z1:Z2:Z3 |
| ℙℕ | 5 | Light rays in 𝕄# |
| ℙ𝕋± | 6 | Positive / negative helicity massless particles |
Geometry from incidence.
- A null projective twistor is a light ray. All events incident with it are mutually null-separated. If Z2 = Z3 = 0 it is a ray at infinity (a generator of 𝒥).
- An event is a projective line. Fixing R gives two linear equations, so its twistors form a ℂℙ1 = Riemann sphere lying in ℙℕ. The line I (Z2 = Z3 = 0) represents the vertex i of 𝒥, and points of 𝒥 are lines meeting I.
- Null separation is intersection. Events P and R are null-separated exactly when their lines meet in ℙℕ (at the twistor of the ray joining them).
So Minkowski space can be redefined as the space of complex lines in ℙℕ: light rays first, points second.
Try it in Python: incidence, nullity and light rays
import numpy as np
rng=np.random.default_rng(1)
def rmat(t,x,y,z): return np.array([[t+z,x+1j*y],[x-1j*y,t-z]])/np.sqrt(2)
def norm(Z): return (Z[0]*np.conj(Z[2])+Z[1]*np.conj(Z[3])
+Z[2]*np.conj(Z[0])+Z[3]*np.conj(Z[1])).real
t,x,y,z=rng.normal(size=4); pi=rng.normal(size=2)+1j*rng.normal(size=2)
Z=np.concatenate([1j*rmat(t,x,y,z)@pi, pi]) # twistor through event R
print("norm of twistor through a real event:", round(norm(Z),12))
eta=np.array([-np.conj(pi[1]),np.conj(pi[0])]) # displacement killing pi
M=0.7*np.outer(eta,np.conj(eta))
d=np.sqrt(2)*np.array([(M[0,0]+M[1,1]).real/2,M[0,1].real,M[0,1].imag,(M[0,0]-M[1,1]).real/2])
Q=np.array([t,x,y,z])+d
print("same twistor incident with Q:", np.allclose(1j*rmat(*Q)@pi, Z[:2]))
print("interval R-Q:", round(d[0]**2-d[1]**2-d[2]**2-d[3]**2,12))
W=Z+np.array([0.3,0,0,0])
print("perturbed twistor: helicity s = norm/2 =", round(norm(W)/2,4))
for S in (-2,-1,-0.5,0,0.5,1,2): print(f"helicity {S:+}: degree {-2*S-2:+}")
Output:
norm of twistor through a real event: 0.0
same twistor incident with Q: True
interval R-Q: 0.0
perturbed twistor: helicity s = norm/2 = 0.2716
helicity -2: degree +2
helicity -1: degree +0
helicity -0.5: degree -1.0
helicity +0: degree -2
helicity +0.5: degree -3.0
helicity +1: degree -4
helicity +2: degree -6
A twistor through a real event is null; a second event incident with the same twistor is at zero interval (the twistor is a light ray); nudging the twistor off ℕ gives it a helicity; and the last lines tabulate the homogeneity rule of §33.7.
33.6 Geometry of twistors as spinning massless particles
Write Z = (ω, π): ωA = (Z0, Z1) an unprimed 2-spinor, πA′ = (Z2, Z3) a primed one. The conjugate has the parts reversed, Z̄ = (π̄, ω̄), and the incidence relation is simply
ω = irπ, i.e. ωA = irAA′πA′.
- Momentum. pa = π̄AπA′: automatically null, as a massless particle's must be.
- Angular momentum. Symmetrised ω π̄ gives the anti-self-dual part, ω̄ π the self-dual part of the 6-angular momentum Mab.
- Origin shift. Moving the origin by q: π unchanged, ω → ω − iqπ (momentum is origin-free, angular momentum is not); incidence and norm are preserved (Exercise 33.14).
- Helicity. s = ½ Z̄αZα, half the twistor norm: positive twistors are right-handed, negative ones left-handed, null ones are spinless rays.
- Phase. A non-null twistor up to Z → eiθZ is exactly a classical spinning massless particle.
Complex pictures. In complexified Minkowski space ℂ𝕄#, every twistor is incident with a 2-complex-dimensional α-plane (self-dual); every dual twistor with a β-plane (anti-self-dual). Complex conjugation swaps them, and in ℙ𝕋 swaps points and planes.
The real picture: the Robinson congruence. Conjugate a non-null twistor to a dual twistor, a plane in ℙ𝕋; it meets ℙℕ in a real 3-dimensional family of light rays. At one instant, this family is drawn as a system of oriented circles (and one straight line) filling 3-space: the stereographic projection of the Clifford parallels on S3 (§15.4). Put a photon at each point moving along its circle's tangent, and the whole pattern moves rigidly at light speed along the straight line. The smallest circle has radius spin/energy; its centre roughly locates the particle (though not Lorentz-covariantly). The twisting of this configuration gave twistors their name.
33.7 Twistor quantum theory
Twistor variables mix position and momentum, so they are quantised as canonical conjugates of each other:
ZαZ̄β − Z̄βZα = ħδαβ, with the Z's commuting among themselves and the Z̄'s likewise (no i, Exercise 33.19).
Penrose notes in passing that treating non-commuting Z and Z̄ as coordinates would lead into non-commutative geometry, a path he knew of no one pursuing in 2004.
The key consequence. A wavefunction f(Zα) must be "independent of Z̄", i.e. ∂f/∂Z̄α = 0: the Cauchy–Riemann equations. Twistor wavefunctions are holomorphic, and Z̄ acts as Z̄α = −ħ∂/∂Zα, a holomorphic operator, so holomorphy survives quantisation. The momentum and angular-momentum commutators come out right.
Helicity becomes Euler's operator. With ordering taken into account,
s = −½ħ(Zα∂/∂Zα + 2), where Υ = Zα∂/∂Zα is the Euler homogeneity operator.
Euler showed Υf = uf exactly when f is homogeneous of degree u, f(λZ) = λuf(Z). Hence a massless particle of helicity S has a twistor function holomorphic and homogeneous of degree −2S − 2.
| Particle | Helicity S | Degree of f |
|---|---|---|
| Left-handed graviton | −2 | +2 |
| Left-handed photon | −1 | 0 |
| Neutrino | −½ | −1 |
| Massless scalar | 0 | −2 |
| Antineutrino | +½ | −3 |
| Right-handed photon | +1 | −4 |
| Right-handed graviton | +2 | −6 |
The lop-sidedness (+2 against −6) shows the theory's built-in chirality, harmless for linear fields, central for gravity.
33.8 Twistor description of massless fields
A free massless particle's "Schrödinger equation" is the massless free-field equation. In 2-spinor form, with symmetric fields of n indices:
- Negative helicity: ∇AA′ψAB…D = 0.
- Positive helicity: ∇AA′ψA′B′…D′ = 0.
- n = 0: the wave equation □ψ = 0; n = 1: the Dirac–Weyl neutrino; n = 2: Maxwell's equations (anti-self-dual and self-dual); n = 4: linearised Einstein vacuum equations.
The twistor contour integral. Take a homogeneous twistor function f. For positive helicity multiply by πA′…πD′ (n times); for negative, apply ∂/∂ωA n times. Multiply by τ = dπ0′ ∧ dπ1′, substitute ω = irπ, and integrate over a 2-dimensional contour in the twistor line of the event R. The result is a field ψ(r) that automatically satisfies the massless field equations, and every positive-frequency solution arises this way. "The massless field equations seem to evaporate away", converted into pure holomorphy. (Historical roots: Whittaker 1903 and Bateman 1904/1944 for the wave and Maxwell equations.)
Positive frequency is secured by demanding the integral still works when R's line lies entirely in ℙ𝕋+, i.e. For complex events in the forward tube 𝕄+ (imaginary part of the position vector timelike and past-pointing). Mixed helicities (a plane-polarised photon) simply add the two twistor functions. The subtlety: f is not really a function but a cohomology element.
33.9 Twistor sheaf cohomology
Building the idea. Construct a manifold from patches Ui glued by transition functions (§12.2). If the gluings differ infinitesimally from the identity, each overlap carries a vector field Fij saying how Ui slides relative to Uj, with:
- Antisymmetry: Fji = −Fij.
- Cocycle condition on triple overlaps: Fij + Fjk = Fik.
- Triviality: shunting each whole patch by Hi gives Fij = Hi − Hj, which changes nothing and is factored out.
Replace vector fields by holomorphic functions fij with the same rules (fij + fjk + fki = 0), reduced modulo hi − hj: this is first (Čech) holomorphic sheaf cohomology. Refining coverings stops at Stein sets (where first cohomology vanishes), so the element is independent of the covering. With two patches, a twistor function f = f12 is equivalent to g when f − g = h1 − h2, and equivalent functions give the same contour integral; more patches need branched contours. Penrose credits Michael Atiyah for an important early input to this realisation (1970s; full treatment Eastwood, Penrose and Wells 1981).
Cohomology is essentially non-local: restrict an element to a small enough region and it vanishes. Its value at a point means nothing. Penrose finds this "tantalizingly reminiscent" of EPR non-locality and suspects something important lies behind it. Other examples of such global "things": a whole vector bundle, trivial over small regions. He calls sheaf cohomology a Platonic notion with "a life of its own", since several very different definitions agree.
33.10 Twistors and positive/negative frequency splitting
The Riemann sphere splits a function on its equator into positive- and negative-frequency parts extending into the two hemispheres (§9.2). Twistor space does the same, globally, one level up:
| Riemann sphere (ℂℙ1) | Projective twistor space (ℂℙ3) |
|---|---|
| Equator S1 (the real line) | ℙℕ (light rays) |
| Two hemispheres | ℙ𝕋+ and ℙ𝕋− |
| A function on S1 (0th cohomology) | A massless field = 1st cohomology on ℙℕ |
| Positive-frequency part extends to one hemisphere | Positive-frequency field extends into ℙ𝕋+ (forward tube) |
This splitting motivated twistor theory in 1963, more than 12 years before the cohomology description of fields was found. Only first cohomology works this way, and only it can deform twistor space. A string-like extension: just as strings use higher-genus Riemann surfaces, one can build "pretzel twistor spaces" with handles and holes bounded by copies of ℙℕ, and a QFT on them (Hodges, Penrose, Singer 1989), status unclear.
33.11 The non-linear graviton
So far twistor functions are "paint" on a fixed space. Let the paint dry: turn the function into a vector field on the overlaps, slide the patches, and exponentiate into a finite deformation, a curved twistor space.
Anti-self-dual gravity (Penrose 1975/76).
- A left-handed graviton (S = −2) has a twistor function f homogeneous of degree 2.
- The sliding vector field is F = (∂f/∂ω0)∂/∂ω1 − (∂f/∂ω1)∂/∂ω0, homogeneous of degree 0, so it acts on projective twistor space.
- No π-derivatives appear, so the curved space 𝒯 still projects onto π-space; each fibre is a complex symplectic 2-manifold (a holomorphic fibration).
- Spacetime points are holomorphic cross-sections of this projection (in the flat case the map π → (irπ, π), i.e. The line R).
- Kodaira's theorem (1962): the broken lines are replaced by a 4-complex-parameter family of holomorphic curves, so the "spacetime" M is again 4-dimensional, a surprise of complex analysis.
- Points of M are null-separated when their curves meet. M's Weyl curvature is anti-self-dual and M is Ricci-flat: a solution of the full non-linear Einstein vacuum equation.
The catch. A real Lorentzian space with anti-self-dual Weyl curvature is conformally flat, and Ricci-flat on top, simply flat. So M is necessarily complex: interpreted (if of positive frequency) as a left-handed non-linear graviton, a wavefunction obeying a non-linear equation. "Deviations from standard rules of linear quantum mechanics are beginning to appear", as Chapter 30 wanted. And every point of curved twistor space has a neighbourhood identical to flat twistor space: the structure is "floppy", all curvature information is global, and "there are no field equations in twistor space".
Gauge fields. Richard Ward (1977) built the analogous construction for anti-self-dual Yang–Mills fields, which grew into a large theory of integrable systems (Mason and Woodhouse).
33.12 Twistors and general relativity
The non-linear graviton is only "half a graviton". Using dual twistors gives the right-handed half but loses the left, and mixed states need both in one description (ambitwistors, pairs WαZα = 0, achieve reflection symmetry but in a classical, not wavefunction, style).
Exponentiating the degree −6 twistor functions to make a right-handed non-linear graviton is the googly problem, after the cricket ball that spins right-handedly though bowled with a leg-spinner's action. After nearly 25 years, Penrose's 2001 proposal "twists up" the fibres of the projection 𝒯 → ℙ𝒯 using the vector field C f−6 Zα∂/∂Zα, so both helicities live in one curved twistor space. For asymptotically flat spacetimes there is an explicit construction of 𝒯 from M, and a conjectural reverse construction tied to Ezra Newman's light-cone cuts of 𝒥+. In 2004, key steps remained unresolved.
33.13 Towards a twistor theory of particle physics
Two programmes are needed:
- Twistor diagrams (Andrew Hodges and students, from the early 1970s): high-dimensional contour integrals replacing Feynman diagrams, avoiding many infinities, but still needing Feynman expressions as a guide rather than an independent principle.
- Twistor particle theory (Zoltán Perjés, George Sparling, Lane Hughston, Paul Tod, Tsou Sheung Tsun, mid-1970s to early 1980s): massive particles need several twistors Xα, …, Zα; transformations among them that leave total momentum and angular momentum unchanged give internal groups that include and slightly extend U(2) (electroweak) and SU(3) (strong). It stalled for technical reasons; a googly solution for gauge fields could revive it, possibly tied to the Chan–Tsou dual-group model (§25.8), since twistors naturally give each gauge group in self-dual and anti-self-dual versions.
33.14 The future of twistor theory?
Penrose gives his own statutory warning: he has spent more than half his life on it, its community is "exceedingly small" next to string theory's, and it is "in no way" mainstream.
Strengths
- Deep influence on mathematics: integrable systems, representation theory, differential geometry (Merkulov and Schwachhöfer's solution of the holonomy problem), hyperkähler manifolds, Zoll spaces.
- Massless fields, linear and non-linear, captured with startling economy.
- Built-in 4 dimensions and chirality.
Weaknesses (Penrose's own list)
- Largely mathematically driven, the charge he made against strings.
- Chirality may go too far: gravity shows no left–right asymmetry (though the algebras of (Z, −ħ∂/∂Z) and (ħ∂/∂Z̄, Z̄) are formally identical, which may hide it).
- Not a physical theory: no unambiguous predictions.
- No Lagrangian/path-integral formulation: field equations have evaporated, but path integrals need configurations that violate them.
- Says nothing yet about state reduction.
His optimistic analogy: twistor theory may be like the Hamiltonian formalism, which changed no classical physics yet proved to be exactly the springboard quantum mechanics needed. Strings and twistors are incompatible as they stand (different dimensions): "it is a prediction of twistor theory that the aspirations of string theory are wrong, or conversely", unless string extra dimensions are reinterpreted as internal. Witten's 2003 twistor string, in 4 dimensions, joins them.
The holomorphic philosophy suggests negative spatial curvature, K < 0. FLRW models are conformally flat and fit flat twistor space; their symmetry group is holomorphic only for K < 0, where it is the Lorentz group acting on the Riemann sphere at the boundary of hyperbolic 3-space. Current twistor constructions also accommodate the vacuum equations naturally only for Λ = 0, but observation says Λ > 0, which Penrose treats as a challenge, not a refutation. Finally, the theory must eventually produce non-holomorphic things: probabilities ∣z∣² and real spacetime points; hyperfunctions (§9.7) offer hope.
Worked example: a photon's twistor function
- A right-handed photon (S = +1) needs f homogeneous of degree −2S − 2 = −4.
- Take f(Z) = 1/[(AαZα)²(BβZβ)²] for fixed dual twistors A, B: holomorphic away from two planes, and degree −4.
- Two patches: U1 where A·Z ≠ 0, U2 where B·Z ≠ 0. F lives on the overlap and cannot be split as h1 − h2, so it is a genuine cohomology element.
- Multiply by πA′πB′ and integrate round the contour separating the two poles on the line R: the result is a self-dual Maxwell field φA′B′(r), an elementary state of the kind twistor theorists use as building blocks, finite and of positive frequency when the line where the two singular planes meet lies in ℙ𝕋−, so that every line of ℙ𝕋+ meets the two planes at distinct points the contour can separate.
- Replace the powers by degree 2 + 2 with π's swapped for ∂/∂ω's and the same recipe gives the left-handed photon.
Test yourself
- Why can ℙℕ not be a complex manifold? It has odd real dimension (5).
- What does the twistor norm measure? Twice the helicity.
- What replaces the field equations in twistor space? Holomorphy plus homogeneity; the information sits in global cohomology.
- Why must the non-linear graviton be complex? A real Lorentzian Ricci-flat space with anti-self-dual Weyl curvature is flat.
- Rafael Sorkin: causal sets.
- Tullio Regge: Regge calculus (1959/61).
- Alain Connes: non-commutative geometry.
- Ivor Robinson: the Robinson congruence.
- Kunihiko Kodaira: deformation theorem behind the non-linear graviton.
- Michael Atiyah: early input to twistor cohomology.
- Richard Ward: twistor construction of anti-self-dual Yang–Mills (1977).
- Andrew Hodges: twistor diagrams.
- George Sparling, Lane Hughston, Paul Tod, Tsou Sheung Tsun, Zoltán Perjés: twistor particle theory.
- Ezra Newman: light-cone cuts; H-space.
Terms to know
| Term | Meaning |
|---|---|
| Twistor | Element of 𝕋 ≅ ℂ4; reduced spinor of O(2, 4); Z = (ω, π) |
| Incidence | ω = irπ: twistor Z passes through event r |
| Null twistor | Z̄·Z = 0: a light ray |
| 𝕄# | Compactified Minkowski space, topology S1 × S3 |
| Robinson congruence | Real light-ray picture of a non-null twistor |
| Euler operator Υ | Zα∂/∂Zα; eigenvalue = homogeneity degree |
| Sheaf cohomology | Overlap functions modulo trivial ones; non-local |
| Forward tube | Complex events whose lines lie in ℙ𝕋+ |
| Non-linear graviton | Curved twistor space giving an anti-self-dual Ricci-flat complex spacetime |
| Googly problem | Constructing the right-handed (degree −6) graviton |
- Self-assessment. Penrose applies to twistors much of the critique he applied to strings, which is to his credit; but his optimism about the 2001 googly proposal was not borne out quickly (see update).
- Connes's Higgs. The early non-commutative standard model predicted a Higgs near 170 GeV, excluded at the Tevatron in 2008; the 125 GeV Higgs required an extra scalar field (Chamseddine and Connes, 2012).
- K < 0. The predicted negative curvature is not seen: Planck 2018 with BAO gives Ωk = 0.0007 ± 0.0019, flat within errors.
- Spelling. Finkelstein (not "Finklestein"), Kauffman (not "Kauffmann"), Sorkin's first name Rafael.
The twistor revival. Penrose's hope for Witten's 2003 paper came true in a way he did not foresee. Twistor-string theory inspired the BCFW recursion (Britto, Cachazo, Feng, Witten, 2005), momentum twistors (Hodges, 2009) and the amplituhedron (Arkani-Hamed and Trnka, 2013), a geometric object whose "volume" gives planar N = 4 Yang–Mills amplitudes with locality and unitarity emergent, exactly the kind of non-spacetime primacy twistor theory promised. Twistor methods now underpin celestial holography: the w1+∞ symmetry of gravity scattering (Strominger 2021) is the symmetry of twistor space (Adamo, Mason, Sharma), and Costello and Paquette derived celestial chiral algebras from twistor space (2022). Penrose himself proposed "palatial twistor theory" (2015), attacking the googly problem by quantising twistor space into a non-commutative algebra, the very route he noted untried in §33.7. Causal-set theory produced Sorkin's order-of-magnitude anticipation of the observed Λ, before its 1998 discovery. Penrose received the 2020 Nobel Prize for the singularity theorem used against extra dimensions in §31.12.
Twistor theory is a case study in choosing the right representation: a problem that is a messy PDE in one description becomes pure holomorphy in another. In AI terms it is the payoff of a good latent space, where constraints are satisfied by construction rather than enforced by penalties. Its weakness is the same as an elegant architecture with no data: beauty without a falsifiable output. Penrose's own Hamiltonian analogy (a reformulation that later became indispensable) is the honest business case for funding such reframings at modest scale.
Chapter 34 steps back from all the programmes of Chapters 31 to 33 and asks how physics actually progresses: the role of fashion, mathematical beauty, experiment, and the unresolved measurement problem that Penrose believes is the real gateway to quantum gravity.
Where Lies the Road to Reality?
The last chapter is Penrose's verdict on the state of fundamental physics. We are much farther from a final theory than string enthusiasts claim; general relativity is the 20th century's greatest single achievement; quantum theory is incomplete until the measurement paradox is solved, and he expects that solution to involve gravity and to be testable with near-future technology. Along the way he dissects fashion, Popper's refutability, the pull of mathematical beauty and "miracles", the roles of complex numbers and symmetry, and the place of consciousness in physics, ending with the hope that "some subtle change in perspective, something that we all have missed" will open the road.
34.1 Great theories of 20th-century physics, and beyond?
The road so far: Greek geometry, Newtonian mechanics, Maxwell, thermodynamics, special and general relativity, quantum mechanics and QFT, and the standard models of particles and cosmology. Talk of being "almost there" with a theory of everything has become harder since string theory "transmogrified" into M- or F-theory, whose nature is admitted to be unknown.
Penrose's ranking: general relativity is the greatest single achievement of the 20th century. Quantum theory explains incomparably more, but it is not yet coherent because of the measurement paradox; when completed (he expects this century) it will be greater still and should contain Einstein's theory as the large-mass, large-distance limit.
General relativity is here to stay at large scales (with Λ allowed), though it must change at the Planck length (10−35 m) or near singularities where density nears the Planck value, ~5 × 1093 times that of water. On Λ: as a curvature it corresponds to a length of order the observable universe; as a density it is at most 2 or 3 times the mean matter density, ~10−27 kg m−3, emptier than any laboratory vacuum. QFT's vacuum-fluctuation estimate is ~10120 (or in some versions 1060) times larger, the notorious puzzle; Penrose is "less disturbed than many", expecting the whole notion of vacuum fluctuations to be overhauled.
Experiments do not contradict him. Entanglement over ~15 km involves photons of ~10−19 J, far from the gravitational OR threshold. Zeilinger's group interfered C60 and C70 fullerenes (about a nanometre across) over separations of ~10−7 m; by the §30.11 criterion such superpositions would survive about a hundred thousand years before OR, so no conflict. FELIX (space-borne) or Dik Bouwmeester's ground-based alternative could test OR directly.
Testing "conventional" quantum gravity
Effects only at the Planck scale; needs particle energies absurdly beyond any accelerator. Exceptions: large extra dimensions (inverse-square tests) and Lorentz-violation searches in gamma-ray timing.
Testing gravitational OR
Quantum rules themselves change when masses move: superposed mirrors or massive molecules, "just about within the scope of present-day technology". A positive result would at last give physical guidance to a field run on mathematical desiderata.
Try it in Python: how long does a superposition survive gravitational OR?
Penrose's rule (§30.11) is τ ≈ ħ/EG, with EG the gravitational self-energy of the difference between the two superposed mass distributions. A crude uniform-sphere version (EG ≈ (6/5)Gm²/R for a displacement larger than the radius R):
import math
G,hbar=6.67430e-11,1.054571817e-34; amu=1.66053907e-27
def tau(m,R): return hbar/((6/5)*G*m*m/R)
for name,m,R in [("C60 molecule",720*amu,0.5e-9),
("Na cluster ~1.7e5 u",1.7e5*amu,4e-9),
("1 micron grain",4/3*math.pi*(0.5e-6)**3*2000,0.5e-6),
("10 micron sphere",4/3*math.pi*(5e-6)**3*2000,5e-6)]:
t=tau(m,R); print(f"{name:20s} tau ~ {t:.1e} s ({t/3.156e7:.1e} yr)")
Output:
C60 molecule tau ~ 4.6e+14 s (1.5e+07 yr)
Na cluster ~1.7e5 u tau ~ 6.6e+10 s (2.1e+03 yr)
1 micron grain tau ~ 6.0e-01 s (1.9e-08 yr)
10 micron sphere tau ~ 6.0e-06 s (1.9e-13 yr)
Treating the fullerene as a smooth sphere gives an even longer life than Penrose's "hundred thousand years" (his estimate concentrates the mass in the nuclei, raising EG); either way molecules are safe. The decisive regime is micron-scale objects held in superposition for around a second, exactly what optomechanics and levitated-particle experiments are now approaching.
34.2 Mathematically driven fundamental physics
Progress has always needed a balance between mathematics and controlled experiment. Without experiment, the balance is lost: mathematical coherence (Penrose's word for consistency plus economy) becomes the main guide, and aesthetic judgement swells. He grants that aesthetics matters, and that coherence is at least objective, but insiders may see unity outsiders miss, and outsiders may judge more soberly than specialists whose long focus distorts judgement.
William Rowan Hamilton found the quaternions in 1843 and spent his last 22 years trying to express Nature's laws in them, seduced by their rare division-algebra property. That work had little direct influence. What mattered came by abandoning division: Clifford's generalisation, then Pauli and Dirac, with Lorentzian signature, which produced spinors and the electron equation. Meanwhile Hamilton's other work (Hamiltonians, Hamilton's principle, Hamilton–Jacobi) became the springboard for quantum mechanics.
Mathematical spin-off is real and old: Apollonius's conics (~200 BC) served Kepler and Newton; Fermat's little theorem (1640) became the basis of modern cryptography; calculus spread everywhere. But the converse inference, that a theory which stimulates good mathematics is therefore physically right, needs "great caution". Penrose has often heard mathematicians delighted that their result "has applications in physics" merely because it bears on string theory: "there is (as yet) no observational reason to believe that string theory is physics".
34.3 The role of fashion in physical theory
- String theory: 69
- Loop quantum gravity: 25
- QFT in curved spaces: 8
- Lattice approaches: 7
- Euclidean quantum gravity: 3
- Non-commutative geometry: 3
- Quantum cosmology: 1
- Twistors: 1
- Others: 6
String theory outnumbered all the rest combined, presented by Carlo Rovelli at the GR15 conference in Pune, December 1997. Were science a democracy, the string majority would decide everything.
Science is not a democracy, but fashion cannot be ignored. Penrose recalls fashions that faded though they held truth (Regge trajectories, Geoffrey Chew's analytic S-matrix) and fashions that seem less believable (the "squashed 7-sphere" of 11-dimensional supergravity). Large programmes grow at the expense of small ones; jet travel, e-mail and unrefereed preprints create bandwagons; young researchers cannot master several programmes and so follow the established; funding committees staffed by the successful favour experiments that suit current perspectives, locking theory in.
Dirac (1928) used 4-spinors; Bartel van der Waerden (1929) gave the more flexible 2-spinor calculus, which Robert Geroch showed makes QED much simpler. Physicists stuck with Dirac. Dirac himself used 2-spinors in 1936 for higher-spin equations, but others' rediscoveries in 4-spinor form get the citations: Duffin–Kemmer–Petiau (1936 to 1939), Rarita–Schwinger (1941). In the 1970s Bruno Zumino told Penrose he once published an idea in 2-spinors; months later Abdus Salam published it in 4-spinors and got all the credit, so Zumino resolved never to use the superior notation again. Penrose learned 2-spinors from Dirac's own lectures in the early 1950s.
34.4 Can a wrong theory be experimentally refuted?
Karl Popper's criterion (refutability) is "too stringent" and "too idealistic" for big science. Supersymmetry is the example: almost treated as part of the standard model with no experimental support; if accelerators find no superpartners, theorists can always say the breaking scale is higher. Many GUT and string predictions are "quite safe from refutation" because their particles are too heavy to make.
Yet un-Popperian theories can be scientific:
- Dirac's monopole. One monopole anywhere would explain charge quantisation. Finding one confirms the theory; failing to find one never refutes it.
- Beyond the horizon. The claim that the unobservable universe resembles the observed part is part of standard cosmology but unrefutable.
| Claim | Refutable? | Confirmable? |
|---|---|---|
| K = 0 exactly | Yes, by any measured deviation | No: errors always allow slight curvature |
| K > 0 | Yes, if actually K < 0 | Yes |
| K < 0 | Yes, if actually K > 0 | Yes |
All three are equally scientific, but a theory predicting K ≠ 0 at least has a chance of confirmation.
Inflation's moving target. For a decade inflation "predicted" K = 0. In the mid-1990s the matter density came out at Ωd ≈ 0.3, and inflationists produced open (K < 0) models; the Hawking school's no-boundary K > 0 also bent toward K < 0. After 1998, supernovae gave Λ > 0 with ΩΛ ≈ 0.7, total ≈ 1, and most inflationists reverted to K = 0. "I am not sure what Popper would have had to say about all this!" Quintessence (Steinhardt et al. 1999) even suggests a new inflationary phase is beginning. Penrose adds that data are often first analysed through the fashionable theory: BOOMERanG was read as showing K = 0, while Vahe Gurzadyan's ellipticity analysis of the same data (and later WMAP) suggested K < 0, and WMAP's low ℓ = 2 quadrupole was "strangely hidden by the vertical axis" of the standard plot.
Penrose's sympathy for K < 0 and for Gurzadyan's ellipticity analysis has not aged well. Planck 2018 combined with BAO gives Ωk = 0.0007 ± 0.0019, flat to a fraction of a percent, and the ellipticity claims did not gain acceptance. His underlying point (that heavily processed data are read through the dominant model, and raw-data access matters) remains sound; the low quadrupole persists as a mild "CMB anomaly".
Penrose insists the apparent subjectivity is ours, not Nature's: there is an objective world; fashion, funding and human limits merely shape our groping toward it.
34.5 Whence may we expect our next physical revolution?
He calls his picture "more pessimistic" than popular accounts but "more realistic", and rejects John Horgan's End of Science (1996). Vast stored data may hide clues, as the equivalence principle lay in Galileo-era observations for centuries before Einstein saw it.
The needed perspective must address the measurement paradox and quanglement, which he believes are tied to the equivalence principle (Chapter 30). Will it come from a "new Einstein" working alone (general relativity was largely a one-person theory, despite Lorentz, Poincaré, Mach, Minkowski, Grossmann) or from experiment-driven teamwork (quantum mechanics was a many-person theory)? Teamwork, massive computation and fashion dominate today; Penrose doubts they will produce the new perspective unless experiments reveal gravity bending quantum rules. Otherwise a one-person approach, driven by mathematical aesthetics plus physical insight, is likelier.
The programmes are partly incompatible. Loops and twistors share much and might combine (via spin networks, spin foams, n-categories or non-commutative geometry). String theory's higher dimensions (especially those violating the twistor condition of §33.4) conflict with both; strings as such and even supersymmetry do not. Penrose expects the truth to lie between "synthesise everything" and "only one survives": something of value may survive even in theories whose main tenets are abandoned. He notes the recent shift (Witten 2003) toward taking 1 + 3-dimensional string ideas seriously.
34.6 What is reality?
Modern science dodges "what?" and "why?" in favour of "how?", yet answers what- and why-questions freely at shallow levels (what an aurora is, why the Sun shines) while balking at deep ones (what an electron is, why space has three dimensions). Every programme of Chapters 31 to 33 describes reality through mathematical models, as if seeking it in Plato's world; and the deeper we probe, the more we are driven there. That is the first mystery of §1.4.
- Platonic-mathematical world: absolute Truth, intertwined with Beauty (beauty guiding correctness in physics). Possibly the most primitive, since mathematics "conjures its very self into existence through logic alone".
- Physical world: rests on a small part of the Platonic world (Mystery 1: why mathematics governs physics).
- Mental world: arises from a small part of the physical (Mystery 2: how matter gives rise to mind); Morality belongs here.
- Back to Platonic: minds access a small part of the mathematical world (Mystery 3), and each world seems to encompass the next entirely while depending on only a small part of its predecessor: a cyclic paradox.
Penrose accepts a kind of reality for mathematics but "might baulk" at identifying physical reality with it.
34.7 The roles of mentality in physical theory
Penrose has avoided consciousness in this book (he treated it in The Emperor's New Mind, 1989, and Shadows of the Mind, 1994), but it intrudes in three places:
- The anthropic principle. Any observable universe must allow consciousness, which might constrain constants. But the principle is nearly unusable because we know so little about what consciousness needs, and in an infinite uniform universe (K ≤ 0) every configuration occurs somewhere. He prefers constants that are mathematically determinable.
- Interpretations of R. Almost all depend on a perceiving being: Copenhagen (wavefunction "in the mind"; the classical apparatus is a stopgap because apparatus is quantum too: Schrödinger's cat), decoherence (information "lost" only subjectively, so lost to whom?), many worlds (which states are "observer states"? Incomplete without a theory of observers), consistent histories (the IGUS of Gell-Mann and Hartle), and Wigner's mind-collapse. Only de Broglie–Bohm and objective-collapse theories avoid observers.
- His reversal. In gravitational OR, reduction is spontaneous and needs no observer. Rather than consciousness causing R, a physically real R process is (partly) responsible for consciousness.
Stuart Hameroff proposed A-lattice neuronal microtubules as the site (perhaps also synaptic clathrins, structurally like C60). Consciousness would need large-scale quantum coherence across brain regions (with features of high-temperature superconductivity), and a conscious event would be a partial orchestrated reduction (Orch-OR) once enough protein mass moves coherently. Andrew Duggins's test targets the binding problem: look for Bell-inequality violations in how separate brain areas (motion, colour, shape) combine into one percept. Results were "inconclusive, but with some encouraging aspects" (unpublished in 2004). Penrose also restates his Gödel-based argument against computational functionalism: the missing OR theory must be non-computable.
Penrose's Gödelian argument is rejected by most logicians and philosophers of mind (Feferman, Putnam, Chalmers and others argue it assumes we can know our own reasoning is sound). Max Tegmark (2000) estimated microtubule decoherence times of 10−13 s or less, far too short; Hameroff and colleagues dispute his parameters. The Gran Sasso radiation test (Donadi et al., Nature Physics 2021) ruled out the simplest parameter-free Diósi–Penrose collapse model, though variants with a larger mass-smearing scale survive and Penrose argues his own version is not the one tested. Duggins's Bell test never produced a published positive result.
34.8 Our long mathematical road to reality
The single most important insight of 2500 years is that there is a deep unity between certain areas of mathematics and the workings of the physical world. If the road has an end, that end must have "a profoundly deep underlying simplicity", which Penrose sees in none of the current proposals. (He sides with Wigner's "unreasonable effectiveness of mathematics" over Andrew Gleason's view that mathematics is simply "the science of order".)
He singles out two unaddressed questions of principle:
1. Complex numbers. Many physicists find the reals natural and the complex numbers mysterious; Penrose finds holomorphy natural and asks why real structures matter at all. Quantum mechanics is not fully holomorphic: Hermitian observables, unitarity, orthogonality and the squared-modulus rule z → ∣z∣² all use complex conjugation. Holomorphicity breaks exactly where measurement enters, where quantum information becomes classical probability. If gravitational OR is right, the real structure of spacetime will connect to that same operation. A lesson for twistor theorists? Or a sign that discrete combinatorics should emerge from complex magic?
2. Symmetry. Is it fundamental and spontaneously broken (the standard view of U(2) electroweak, broken about 10−12 s after the Big Bang, and of GUTs), or approximate, emerging from a less symmetric deeper theory (as with symmetries of atomic spectra, per Freeman Dyson)? Both kinds exist (superconductivity breaks U(1) spontaneously). A striking third route: piece a complex manifold of sphere topology together any way at all and Riemann's theorem gives exactly the Riemann sphere, with exact symmetry SL(2, ℂ) arising from no imposed symmetry.
Further points: are the constants fixed in the early universe (Wheeler/Smolin) or mathematically determined (his preference; compare Eddington)? Neutrino masses mean a neutrino is not purely a left-handed "zig", so chirality cannot simply be blamed on the neutrino; conventionally it is built in from the start. And time asymmetry cannot come from early-universe symmetry breaking, because that picture uses the Second Law and cannot derive it.
34.9 Beauty and miracles
Beauty in successful physics: Euclid; Newton with its symplectic structure; Maxwell; general relativity; quantum spin; Dirac's equation; Feynman's path integrals. Yet as pure mathematics these would "stand up rather well, but not overwhelmingly". Much greater beauty lies in mathematics with little or no physical use: Cantor's theory of the infinite (one of the most beautiful contributions in all mathematics), Gödel's theorem, category theory, Wiles's proof of Fermat's Last Theorem, the classification of simple groups, Riemann's ζ-function (despite intriguing links such as Berry and Keating's work). So beauty is "an ambiguous guide at best".
Miracles exert stronger pull: unexpected agreements that seem to signal the right track.
| "Miracle" | What it seemed to show | What happened |
|---|---|---|
| Supergravity divergences cancel | Renormalisable quantum gravity at hand | Divergences returned at higher loop order; revived later inside M-theory |
| Mirror symmetry, 317 206 375 curves | String/M-theory on the right lines | Strong support for the mathematics, later largely proved |
| Twistor functions solve massless field equations | Twistor theory on the right lines | Still a reformulation |
| Non-linear graviton | Twistors encode real gravity | Only half a graviton until the googly is solved |
| Dirac's equation gives spin; Bohr's quantisation gives hydrogen; GR gives Mercury's 43″ | Correct physics | Physical miracles, confirmed |
The distinction: physical consequences that match nature are genuine confirmation; purely mathematical miracles may be "debunked" once understood, though their psychological force remains. String and twistor miracles "cannot both be unambiguous signposts", since the theories conflict. The escape route he highlights is Witten's twistor string: take the string target space to be projective twistor space ℙ𝕋 = ℂℙ3 (a supersymmetric version, formally a Calabi–Yau, to cancel an anomaly whose importance Penrose suspects is "over-rated") instead of a 6-dimensional Calabi–Yau, with genus-0 world sheets for tree-level Yang–Mills. Perhaps what is deep in string theory is QFT built from maps of Riemann spheres into complex manifolds (σ-models), relocated to twistor space.
- Supergravity's divergence order. §34.9 says divergences returned at third order; §31.4 says two loops. The standard account: one- and two-loop divergences cancel in pure supergravity and a counterterm becomes allowed at three loops; N = 8 supergravity has since been shown finite through five loops in four dimensions.
- Krakatoa in 535. The global cooling of 536 is real, but its source is debated (a combination of eruptions, with Ilopango in El Salvador now a leading candidate for 539/540).
- Thera. The 1628 BC date comes from tree-ring links that have been revised; radiocarbon work points to roughly 1600 BC. The idea that Thera caused the fall of Knossos is doubtful, since Minoan palace culture continued for generations, and the Atlantis link remains speculation.
- Forces. The weak force as "about 10−7 of the strong" is a rough, scale-dependent comparison; Penrose himself notes such comparisons are loose.
- Self-interest. Penrose's even-handed critique of fashion comes from the founder of a one-paper-a-month programme; he says so, but readers should weigh it.
34.10 Deep questions answered, deeper questions posed
Penrose ends with pride and humility. Physics has given medicine (X-rays, ultrasound, tomography, lasers, radiation therapy), electricity, materials, television, mobile phones, computers and the internet. Chemistry is in principle physics, mostly quantum mechanics; biology seems, consciousness apart, to rest on physics we basically understand, so it too is ultimately governed by mathematics: a seed grows into a plant through DNA whose stability depends on quantum rules (Schrödinger, What is Life?, 1944).
- Weak force: ~10−7 of the strong and 10−5 of electromagnetism, yet its radioactive decays heat Earth's interior and drive volcanoes: the 535 eruption (likely Krakatoa, again in 1883) and Thera (~1628 BC), which probably ruined Minoan Crete and may underlie the Atlantis legend.
- Gravity: ~10−40 of the electric force in hydrogen, ~10−38 of the weak, yet it powers quasars via black holes.
- 3C 273, the brightest quasar, appears only ~10−6 as bright as Sirius.
- Andromeda, the farthest naked-eye object, is only ~10−3 of the distance to 3C 273 and ~10−4 of the distance to the edge of the observable universe.
Spacetime singularities in black holes remain the most profound known mystery that current theory cannot describe. The 21st century may outdo the 20th, but only with powerful new ideas in directions significantly different from those being pursued: "Perhaps what we mainly need is some subtle change in perspective, something that we all have missed…"
Worked example: is K = 0 a Popperian claim?
- Suppose a theory predicts K = 0 exactly. A measurement giving Ωk = 0.010 ± 0.002 would refute it: refutable.
- Now suppose the measurement gives Ωk = 0.0007 ± 0.0019 (Planck 2018 plus BAO). Consistent with zero, but equally consistent with Ωk = −0.001 or +0.002: K = 0 is not confirmed, only not yet refuted.
- A theory predicting K < 0 with Ωk ≈ 0.01 (as some open-inflation models did) would be refuted by that measurement, while one predicting Ωk ~ 10−5 (typical of eternal inflation's curvature) remains untestable for decades.
- Penrose's moral: a prediction's scientific value depends not only on refutability but on whether it can ever be confirmed, and on whether its advocates hold still.
Test yourself
- Why does Penrose rank general relativity above quantum theory? Quantum theory is not yet coherent: the measurement paradox.
- Where does holomorphicity break in quantum theory? At measurement: conjugation, orthogonality, ∣z∣².
- What separates a "physical miracle" from a "mathematical miracle"? The first is a confirmed prediction about nature (Mercury's perihelion); the second is an unexpected internal agreement (mirror symmetry).
- Why are gravitational-OR tests more feasible than string tests? They need massive superpositions, not Planck energies.
- Carlo Rovelli: the 1997 fashion survey.
- Karl Popper: refutability (1934).
- Bartel van der Waerden, Robert Geroch: 2-spinor calculus and its advocacy.
- Bruno Zumino, Abdus Salam: the 2-spinor citation story.
- Anton Zeilinger: fullerene interference (1999).
- Dik Bouwmeester: ground-based OR experiment.
- Vahe Gurzadyan: CMB ellipticity.
- Stuart Hameroff, Andrew Duggins: microtubules; Bell tests in perception.
- Eugene Wigner, Andrew Gleason: opposite views on mathematics' effectiveness.
- Erwin Schrödinger: What is Life? (1944).
Terms to know
| Term | Meaning |
|---|---|
| Gravitational OR | Objective reduction with lifetime τ ≈ ħ/EG |
| Orch-OR | Penrose–Hameroff: orchestrated OR in microtubules as conscious events |
| Popperian | Refutable by observation |
| Mathematical coherence | Consistency plus economy, parts working in accord |
| Spin-off | Mathematics from physics finding unrelated uses |
| "Miracle" | Unexpected agreement read as a sign of correctness |
| Binding problem | How separate brain areas yield one percept |
| IGUS | Gell-Mann and Hartle's "information gathering and utilising system" |
Gravitational OR, 2004 to 2026. Penrose received the 2020 Nobel Prize in Physics (for singularity theorems, not OR). The Gran Sasso test (2021) excluded the simplest Diósi–Penrose model; others now bound it with gravitational-wave detectors and cold-atom experiments. Massive superpositions have grown: Vienna's matter-wave interferometers passed 25 000 u (2019) and reached metal clusters of order 105 u (2025), still far below the micron-and-second regime where OR should bite, and ground-cooled levitated nanoparticles are the leading route. Proposals to test whether gravity can entangle two masses (Bose et al., Marletto and Vedral, 2017) would decide whether gravity must be quantum; as of 2026 no such entanglement has been demonstrated. Entanglement now spans 1 200 km via the Micius satellite (2017), and loophole-free Bell tests (2015) won the 2022 Nobel. On fashion: string theory still leads hep-th output but its share has fallen, while quantum-information approaches to gravity, amplitudes and swampland work have grown; a 2024 animal study (Wiest et al.) found a microtubule-stabilising drug delayed anaesthetic unconsciousness in rats, cited by Orch-OR supporters and disputed by critics.
Penrose's sociology of science maps onto any expensive R&D portfolio. Bandwagons form when evaluation is hard and communication easy; committees of incumbents fund what fits the current paradigm; a Popper-proof hypothesis (supersymmetry "just above" the next accelerator, or an AI capability "just one more scale-up" away) can absorb resources indefinitely. His remedies translate directly: keep a funded minority portfolio, insist on cheap decisive tests where they exist (his OR experiments over Planck-energy dreams), separate physical miracles (results matching the world) from internal miracles (benchmarks agreeing with each other), and release raw data so it can be read through more than one model.
Antea at the window
The book closes, as it opened, with a short story. The Prologue's Am-tep, a craftsman in ancient Crete, glimpsed the mathematics of the world before Thera erupted; the Epilogue's Antea, a young physicist, faces the next frontier at dawn.
Antea, a postdoctoral physicist from a small town in southern Italy, with artistic as well as mathematical gifts, works through the night in the upper library of the Albert Einstein Institute in Golm, near Potsdam, founded at the end of the 20th century near Einstein's old holiday cottage. Her field is quantum gravity; her ideas are unorthodox, "fundamentally at variance" with her colleagues'.
She has been reading about the gigantic explosions in galactic nuclei, powered by black holes, whose central singularities await the missing theory. Her real interest is the explosion "to end all explosions, or rather, the one that began them all": the Big Bang, whose singularity holds mysteries greater still, and whose resolution lies in uniting Einstein's theory with quantum principles.
Looking east through the great window, she reflects that a photon from any cosmic explosion, however distant, experiences no time at all in reaching her, and the same holds for its gravitons, some of which might be caught by the institute's gravitational-wave detector near Hannover (GEO600, about 250 km away). Just before sunrise she sees a rare green flash, then the deep red Sun. The experience mingles with the mathematics that has troubled her all night. "Then an odd thought overtook her…"
The Epilogue is Penrose's final argument in narrative form. The light-ray that takes no proper time from the explosion to Antea's eye is the twistor's founding object (Chapter 33), and the conformal picture in which massless particles experience no time is the seed of his later conformal cyclic cosmology. The "odd thought" left unfinished is the "subtle change in perspective" of §34.10: the road continues.
What Antea might think in 2026. The gravitational-wave detectors she imagines have since heard over 200 black-hole and neutron-star mergers (LIGO first detection 2015; GW170817 with a light counterpart in 2017, showing gravitons and photons arrive together to within about 10−15). Penrose's own "odd thought" became conformal cyclic cosmology (Cycles of Time, 2010), in which the remote future of one aeon, populated only by massless particles that "experience no time", is conformally identified with the Big Bang of the next.
Master Takeaways
Thirty-four chapters reduce to one picture: mathematics of extraordinary precision governs the physical world, yet the two great theories built from it disagree at their foundations. Penrose's road ends at a junction where gravity, time asymmetry and quantum measurement meet, and he bets that one idea will resolve all three.
- Physics lives in mathematics, not beside it. The three-worlds picture (Platonic, physical, mental) frames the book: a small, exact fragment of mathematics governs physics to one part in 1011 or better, and that fit is a mystery to be respected, not explained away.
- The Big Bang was absurdly special, and the specialness was gravitational. The Second Law requires an initial state occupying about 1 part in 1010123 of phase space; matter was thermal but Weyl curvature was zero. Inflation and anthropic arguments cannot account for this.
- Quantum theory is incomplete. It runs on two incompatible rules, unitary U and reduction R; Copenhagen, many worlds, decoherence and consistent histories all hide the clash, and none supplies a physical scale for the classical world.
- Gravity should collapse superpositions. A mass in two places means two spacetimes with no common time; the superposition decays in about τ ≈ ħ/EG. This is objective reduction, a minimal and testable proposal.
- General relativity is the century's greatest achievement, and its lessons are geometric. Gravity is curvature, felt as tides; the field equation follows from Newton's 4πGM law plus energy conservation; gravitational energy cannot be localised.
- Fashion is not evidence. String theory is mathematically deep but its extra dimensions carry excess functional freedom (∞∞9 against the observed ∞∞3); a theory should be judged by contact with nature, not by the number of people working on it.
- Complex numbers are physics, not bookkeeping. One complex derivative implies analyticity; ∮dz/z = 2πi powers contour calculus; quantum amplitudes are complex, and positive-frequency splitting on the Riemann sphere is what makes a field quantum.
- Forces are curvature of connections on bundles. Maxwell's potential is a U(1) connection; the weak and strong forces use SU(2) and SU(3) fibres; each requires an exact symmetry, which makes the badly broken electroweak SU(2) a puzzle Penrose keeps pressing.
- Spinors are the price of solid matter. A spinor returns to itself only after 4π; fermions obey exclusion; without them atoms would collapse.
- The diagonal argument links infinity, computation and proof. Cantor's slash shows α < 2α; the same move proves the halting problem undecidable and drives Gödel's theorem, which Penrose reads as evidence that understanding is not algorithmic.
- Minkowski geometry is Euclid with one sign flipped. The flip produces null directions, the reversed triangle inequality (twin effect), hyperbolic velocity space and E = mc² as the time component of a 4-momentum.
- Phase space is the arena of both mechanics and entropy. The symplectic form, Liouville's theorem and Noether's theorem live there, and so does Boltzmann's S = k log V.
- Entanglement is the rule, not the exception. Multi-particle states live on configuration space; Bell, Stapp and Hardy show no local picture of separate particles works; Penrose's quanglement zig-zags in time without signalling.
- Spin turns quantum amplitudes into geometry. Every spin-½ state is "up" in some direction; a spin-j state is 2j Majorana stars on the Riemann sphere.
- Dirac's square root explained spin and predicted antimatter. Factorising the wave operator with Clifford algebra gave spin, the g ≈ 2 magnetic moment and the positron (Anderson, 1932).
- The standard model works but is not final. About 19 free parameters, three unexplained generations, chirality put in by hand, and gauge symmetry hidden by a vacuum.
- QFT's power comes with inconsistencies. Renormalisation tames infinities, but inequivalent vacua, divergent series and the vacuum-energy problem show the framework is unfinished.
- Loop quantum gravity took Einstein's narrower path seriously. Ashtekar variables and spin networks gave quantised area and volume; the Hamiltonian dynamics and the Barbero–Immirzi parameter remain unsettled.
- Twistors make the light ray primary. Spacetime points become Riemann spheres in twistor space, massless field equations dissolve into holomorphy, and the googly problem remains the obstacle to a full theory.
- Time asymmetry has three faces that should be one. The special Big Bang, black-hole information loss and the R process all break time symmetry, and Penrose argues they balance in phase space.
- Hyperbolic geometry is physical. Whatever the shape of space, the space of relativistic velocities is hyperbolic, and the celestial sphere transforms by Möbius maps under Lorentz boosts.
- Mathematical beauty is a guide, not a proof. Penrose values "miracles" in mathematics yet warns that beauty has misled physicists as often as it has guided them; Popperian refutability keeps theories honest.
- Consciousness is part of the physics problem. The book mostly avoids it, but Penrose's position is clear: if understanding is non-computable, some non-computable physics, probably in R, must underlie it.
- Expect a revolution bigger than the twentieth century's. The final theory, he argues, is far away, and it will come from a change of perspective that unites gravity and quantum mechanics.
Frameworks and mental models
| Name | What it says | Use it when |
|---|---|---|
| Three worlds, three mysteries | Platonic, physical and mental worlds; each depends on a small part of the one before | Asking why mathematics works or what minds can know |
| U and R | Quantum evolution is unitary and deterministic until measurement, which is random and irreversible | Diagnosing what an interpretation actually explains |
| Six ontologies (a to f) | Copenhagen, many worlds, decoherence, consistent histories, pilot wave, objective R | Comparing interpretations by what they claim is real |
| Gravitational OR | Superposed mass distributions decay in τ ≈ ħ/EG | Designing or judging collapse experiments |
| Weyl curvature hypothesis | Initial singularities have zero Weyl curvature; final ones do not | Explaining the arrow of time and the Second Law |
| Phase-space volume | Entropy is the log of the coarse-graining volume, S = k log V | Estimating how improbable a state is |
| Functional freedom ∞N∞n | Fields on n-dimensional spaces have vastly more freedom than on fewer | Testing claims that extra dimensions are harmless |
| Bundle connection = force | Gauge potential is a connection; field strength is its curvature | Understanding why forces need exact symmetries |
| Positive-frequency splitting | Quantisation separates positive and negative frequencies on the Riemann sphere | Seeing what makes a field quantum, and where vacua differ |
| Diagonal slash | A list cannot contain its own diagonal complement | Proving uncountability, undecidability and incompleteness |
| Twistor correspondence | Light rays are points of twistor space; spacetime points are Riemann spheres | Reformulating massless physics in holomorphic terms |
| Fashion vs refutability | Popularity is not evidence; theories must risk refutation | Assessing a research programme or a technology bet |
Then and now: 2004 vs 2026
| Question | Penrose in 2004 | State in 2026 |
|---|---|---|
| Higgs boson | Expected, not found | Discovered 2012; couplings match the standard model so far |
| Gravitational waves | Indirect (binary pulsar) | Direct detection 2015; hundreds of mergers through LIGO–Virgo–KAGRA O4 |
| Black holes | Strong indirect evidence | Imaged by the Event Horizon Telescope (M87 2019, Sgr A 2022); Penrose's 2020 Nobel for showing black-hole formation is a robust consequence of GR |
| Supersymmetry | Widely expected at the LHC | No superpartners found through LHC Run 3 |
| Bell non-locality | Strong but with loopholes | Loophole-free tests 2015; 2022 Nobel to Aspect, Clauser, Zeilinger |
| Gravitational collapse | Proposed; experiments planned | Simplest Diósi–Penrose model constrained by the Gran Sasso radiation test (2021); gravity-mediated entanglement experiments still in development |
| Dark energy | Cosmological constant Λ | Λ still fits most data; DESI results hint that dark energy may evolve |
| Twistors | Witten's twistor string theory just appeared (2003) | Twistor methods now standard in scattering amplitudes (amplituhedron, 2013) |
| Neutrino masses | Small, unknown | Bounded below 0.45 eV by KATRIN (2025); ordering still open |
| Quantum computing | Theoretical | Error-corrected logical qubits below threshold (2024–25); no bearing yet on R |
- Partisan but transparent. Penrose is an advocate for gravitational collapse, the Weyl curvature hypothesis and twistors, and he says so. His treatment of string theory and inflation is sharper than the field's consensus, and many cosmologists regard inflation as well supported by the CMB's nearly scale-invariant, adiabatic, Gaussian fluctuations.
- The Gödel argument remains a minority view. Most logicians and philosophers (Feferman, Putnam, Chalmers among them) reject the inference from incompleteness to non-computable minds.
- Errors of detail. The editions contain slips: swapped sine/cosine in a note, the Moon–Sun tidal ratio, a W mass of 81.4 GeV, a parameter count of "about 17", dropped factors of ½. They are flagged where they occur and do not affect the main arguments.
- Dated in places. Written before the Higgs discovery, gravitational-wave detection and loophole-free Bell tests; the evidence has moved in his favour on some points (no SUSY) and against him on others (the simplest collapse model constrained).
- Not a textbook, not a popular book. The mathematics is real but proofs are sketched; the reader gets understanding and orientation, not technique.
Who's who
| Person | Role in the book |
|---|---|
| Pythagoras, Euclid, Eudoxos | Proof, geometry, the theory of proportion that anticipates the reals |
| Gauss, Bolyai, Lobachevsky, Lambert | Non-Euclidean geometry |
| Euler, Cauchy, Riemann | Complex analysis, Riemann surfaces, curvature |
| Fourier, Sato | Frequency decomposition; hyperfunctions |
| Hamilton, Clifford, Grassmann | Quaternions and the algebras behind spinors |
| Cartan, Lie, Killing | Exterior calculus, connections, Lie groups and their classification |
| Cantor, Russell, Turing, Gödel | The ladder of infinity, computation and incompleteness |
| Galileo, Newton | The first two spacetimes and universal gravitation |
| Maxwell, Minkowski, Einstein | Classical fields, spacetime geometry, general relativity |
| Lagrange, Hamilton, Jacobi, Noether | Reformulated mechanics; symmetry and conservation |
| Planck, Bohr, de Broglie, Schrödinger, Heisenberg | Founders of quantum theory |
| Dirac, Anderson, Feynman | Relativistic electron, the positron, path integrals |
| Bell, Hardy, Stapp, Aspect | Non-locality theorems and experiments |
| Yang, Mills, Weinberg, Salam, Glashow, Higgs | Gauge theories and electroweak unification |
| Boltzmann, Bekenstein, Hawking | Entropy, black-hole entropy, radiation and information loss |
| Guth, Linde, Hartle | Inflation and the no-boundary proposal |
| Everett, Bohm, Ghirardi–Rimini–Weber, Diósi | Many worlds, pilot waves, collapse models |
| Witten, Green, Schwarz, Maldacena | Strings, M-theory, holography |
| Ashtekar, Rovelli, Smolin | Loop quantum gravity and spin networks |
| Connes, Sorkin, Regge | Non-commutative geometry, causal sets, Regge calculus |
Connect it
- Model risk is a functional-freedom problem. Penrose's objection to extra dimensions applies to over-parameterised models in banking: if a model has far more freedom than the data constrain, its fit says little. Count the degrees of freedom before trusting the curve.
- Symmetry as architecture. Gauge theory builds every force from an exact symmetry plus a connection. Enterprise platforms work the same way: an invariant contract (schema, API, control framework) with local adapters is what lets components be "parallel transported" across a large estate without drift.
- U and R in AI systems. LLM agents evolve smoothly through probability distributions and then commit to one action, an irreversible R-like step. Governance belongs at those commitment points: logging, human approval, reversibility.
- Gödel and AI claims. The diagonal argument is a standing caution against claims that any fixed system can certify its own correctness; independent validation in model-risk frameworks such as PRA SS1/23 is the institutional version of stepping outside the system.
- Fashion versus refutability. Penrose's critique of research fashion maps onto technology adoption: prefer bets with clear, falsifiable success criteria over the "only game in town".
About this book
The Road to Reality: A Complete Guide to the Laws of the Universe by Roger Penrose, 2004. This is a chapter-by-chapter study of the book, with summaries, maps, tables and diagrams; short quotations keep their page references. It is shared free for personal study, is not for sale, and is not endorsed by the author or publisher. Please read and buy the original.
Insight Editions · rajeshrmahapatra.com/insight-editions