Intelligence, Agency & Consciousness · Paper 0084

When the best move needs a little noise

A greedy SAT solver knows which one-bit neighbour looks best now. Selman, Kautz and Cohen showed why that is not enough: a deliberately imperfect move, focused on a clause still false, can open routes that pure improvement repeatedly misses.

Intelligence, Agency & Consciousness · Paper 0084

When the best move needs a little noise

Rajesh Ranjan Mahapatra

A greedy SAT solver knows which one-bit neighbour looks best now. Selman, Kautz and Cohen showed why that is not enough: a deliberately imperfect move, focused on a clause still false, can open routes that pure improvement repeatedly misses.

© 2026 Rajesh Ranjan Mahapatra. 30 min read

When the best move needs a little noiseAll AI Research Library

TLDR

Five-point orientation
  1. Greed can strand search. GSAT’s best available flip can circle a plateau or remain in a local minimum even when a satisfying assignment exists elsewhere.
  2. Not all randomness is equal. Annealing accepts uphill moves by temperature; random noise flips any variable; random walk restricts disruption to variables in currently unsatisfied clauses.
  3. Focus won the comparison. In the paper’s tuned experiments, mixed random walk increasingly dominated the alternatives as hard random formulae grew.
  4. Clause-first sampling matters. WalkSAT first selects an unsatisfied clause, then a variable inside it, thereby favouring variables occurring in several current defects.
  5. Evidence has boundaries. The results compare 1994 implementations on selected satisfiable instances; local search still cannot certify unsatisfiability.
01 · why disturb a good rule?

A local score can be accurate and still be strategically wrong

The 1994 paper begins where GSAT leaves off: complete assignments, one-variable flips and a score equal to the number of satisfied clauses. Its new question is how to escape when the best immediate neighbour does not lead down to zero defects.

Let U(x) count the clauses unsatisfied by assignment x. Basic GSAT evaluates every one-bit neighbour and chooses a flip producing the greatest reduction in U. If several flips tie, it samples among them. A zero-change move crosses flat ground; a negative improvement moves uphill. The local calculation can be perfectly correct while the path remains globally poor, because U records height but not the connectivity of lower regions.

A local minimum has no strictly better neighbour. A plateau is a connected set of equal-scoring assignments explored through sideways moves. Continuing across plateaux already improved GSAT, but a finite trajectory can encounter a plateau with rare exits or none reachable without first making U larger. Repeated restarts attack the problem globally by discarding the complete assignment. Noise attacks it locally by temporarily relaxing greed.

The authors compare three relaxation mechanisms under tuned parameters. Simulated annealing samples a variable and accepts an uphill move with a temperature-dependent probability. Random noise mixes greedy GSAT with a uniformly random variable flip. Mixed random walk also mixes with greed, but its random branch chooses only a variable appearing in an unsatisfied clause. That small restriction is the paper’s central causal proposal.

Calling these methods “noise” can obscure their structure. A random-walk flip is stochastic, yet it is not ignorant: the current residual formula filters the eligible variables. Every such move touches at least one failed constraint. It may break several satisfied clauses, and it is not guaranteed to improve the score, but it spends disruption at the active boundary between the current assignment and a solution.

The comparison concerns discovery, not proof. Each method can return a satisfying assignment whose clauses are independently checked. Exhausting restarts supplies no refutation. The study therefore asks which incomplete procedure finds witnesses faster on its test classes, not which decides SAT in general.

A plateau separates greedy search from a lower basinA greedy walker circles equal-height states while a red noisy step rises briefly before a teal route descends to a model.plateauU=2U=2U=2U=3U=0 ✓
Figure 1 · Escape may require temporary damage. Greedy evaluation describes the next edge, not whether a lower basin is reachable without an uphill step.Source scope: primary paper, introduction and local-minima discussion.

Worked example 1 · the honest uphill move

Suppose every one-bit neighbour of x leaves two clauses false, except one neighbour that leaves three false but connects on its next step to a model. Sideways-only GSAT cannot take the necessary first edge. A noise branch can, even though its immediate score is objectively worse.

Causal probe 1 · replace clause count with distance to a known model

If the solver secretly knew Hamming distance to a model, many traps would disappear. SAT search does not possess that oracle. Noise is useful precisely because the available clause count is informative but imperfect.

02 · three escape policies

Temperature, global noise and defect-focused walk are different experiments

All three policies can make uphill moves, but they use different information and therefore induce different transition probabilities over the same Boolean hypercube.

Annealing chooses a variable uniformly, computes δ, the increase in the number of unsatisfied clauses caused by flipping it, and always accepts δ≤0. If δ>0, it accepts with probability exp(−δ/T). At high temperature, even damaging moves are common. At low temperature, the chain behaves more greedily. The authors test constant temperatures and geometric cooling schedules.

Random noise retains GSAT’s best-flip branch with probability 1−p. With probability p it chooses uniformly from all variables. This eliminates the exponential acceptance calculation and gives every hypercube edge some chance, but many noisy flips can concern variables irrelevant to any current defect. A variable appearing only in already satisfied clauses cannot directly repair the residual set.

Mixed random walk uses the same probability gate but narrows the random branch. Construct the set of variables that occur in at least one unsatisfied clause, choose uniformly from that set and flip. The move is focused without being greedy. It does not calculate which variable repairs the selected clauses, and a chosen variable may actually break more clauses than it makes.

The baseline, basic GSAT, normally chooses a maximum-gain variable. If all moves are uphill it can technically choose the least bad one, but the authors say such forced uphill events are rare and ineffective. Their escape mechanisms make non-greedy disruption an explicit recurring policy rather than an accidental last resort.

Fair comparison requires tuning. The study varies MAX-FLIPS and MAX-TRIES, p for the two mixtures, temperature from 5 to 0 in steps of 0.05, and geometric cooling schedules. Only the best settings enter the tables. That protocol demonstrates each family near its tested optimum; it does not show that one universal setting dominates every distribution.

Three policies choose moves with different informationThree columns show temperature acceptance, a draw from all variables, and a draw only from variables in red unsatisfied clauses.ANNEALINGaccept uphille−δ/Tuniform variablescore-based gateRANDOM NOISEabcdraw from allvariablesRANDOM WALKfalse clausea ∨ ¬c ∨ ddraw only fromactive defects
Figure 2 · Randomness has an address. Annealing filters by score cost, random noise has global reach, and mixed random walk filters the eligible set through unsatisfied clauses.Source scope: primary paper, “Simulated Annealing” and “The Random Walk Strategy”.

Worked example 2 · eligibility before desirability

If only clause (a∨¬c∨d) is false, its three variables form the walk set. Variable b is excluded even if flipping b would change other clauses. Greedy choice ranks all variables by gain; focused walk instead restricts by relevance and then samples.

Causal probe 2 · make every variable occur in a false clause

The random-walk set becomes the complete variable set, so mixed random walk and random noise have the same random branch. Any remaining difference must come from implementation or sampling, not focus.

03 · annealing’s contract

Temperature prices damage but does not identify the damaged constraint

Simulated annealing offers a general escape principle: accept all improving and sideways proposals, and sometimes accept a worsening one according to its energetic cost.

For SAT, energy is the number of unsatisfied clauses. A proposed flip that reduces or preserves energy is accepted. A flip increasing energy by δ is accepted with probability exp(−δ/T). At T=0 the uphill probability vanishes; at larger T it rises. The paper describes the zero-temperature resemblance to GSAT but notes a crucial difference: annealing proposes one random variable, whereas GSAT explicitly takes a best neighbour when one exists.

A cooling schedule begins hot and multiplies T by a factor below one. Early exploration can cross large barriers; late search settles. The intuitive physical analogy is attractive, but the empirical question is whether the schedule spends its flips at useful temperatures for the specific landscape. A theoretically elegant schedule can be badly matched to a bounded run.

The authors found no tested geometric schedule superior to the best constant temperature. Extremely slow cooling did not significantly reduce the average restart count. They suggest that most SAT work lies in satisfying the last few clauses, corresponding to a low-temperature tail where a geometric schedule changes little. This is an experimental interpretation, not a theorem about all SAT distributions.

Best temperature varied by problem class: 0.2 for the hard random formulae, 0.5 for planning and 0.15 for Boolean circuit synthesis. That variation is itself evidence against treating “temperature” as an intrinsic property of SAT. It is a control parameter coupling proposal scale, landscape and computational budget.

The paper counts a simulated-annealing flip only when the proposed change is accepted. Wall time and accepted moves nevertheless agree in the ranking of policies, which helps rule out a conclusion driven solely by implementation overhead. It does not equalise the number of evaluated proposals, an important detail for modern replication.

choose variable v uniformly δ ← U(x with v flipped) − U(x) if δ ≤ 0: accept if δ > 0: accept with probability exp(−δ / T)
Annealing acceptance falls with damage and rises with temperatureCurves for three temperatures decline exponentially as the number of newly unsatisfied clauses increases.uphill cost δacceptance probabilityhigh Tmedium Tlow T
Figure 3 · Temperature is a probabilistic toll. The same damaging move is more likely when the control parameter is high; the rule still does not ask which clause is false.Source scope: primary paper, simulated-annealing definition and parameter study.

Worked example 3 · a two-clause penalty

At T=0.5, a move with δ=2 is accepted with probability e⁻⁴, about 0.018. At T=2 the same move is accepted with probability e⁻¹, about 0.368. Temperature changes willingness to pay; it does not change the measured cost.

Causal probe 3 · cool before the last clauses

If temperature reaches near zero while the assignment remains trapped behind a one-clause barrier, the remaining run is effectively greedy. Stretching the early hot phase helps only if its extra exploration reaches a better basin before cooling.

04 · random noise

Global disturbance spends probability on inactive variables

Random noise is the simplest mixture: with probability p ignore gain and flip any variable; otherwise execute GSAT’s best move.

The mechanism is easy to implement and ensures that every one-bit edge is eventually possible. It also cleanly separates exploitation and exploration. The greedy branch uses the score of all neighbours; the noisy branch uses no clause information at all. This can break deterministic cycles and open an uphill route without maintaining temperature or a cooling clock.

Its weakness appears when the residual defect is sparse. Imagine a thousand-variable assignment with two unsatisfied three-literal clauses. At most six distinct variables occur in those clauses. A global random flip has probability no more than 6/1000 of touching one of them directly. The other 994 choices may alter already satisfied constraints while leaving both active defects untouched.

That calculation does not prove an irrelevant flip is useless. Changing a distant variable can prepare later moves or avoid breaking a clause during repair. The paper’s claim is statistical and comparative: focus gives each exploratory step a more immediate relationship to what remains wrong, and its advantage grew on their larger hard-random instances.

In Table 1, random noise improves on basic GSAT for formulae it solves, but neither noise nor annealing finds solutions for the three largest listed instances within the stated limits. On the circuit-synthesis set, random noise can actually degrade basic GSAT. A perturbation policy is not valuable merely because it is stochastic; it must match the residual structure.

The optimal tested p for both noise mixtures lies between 0.5 and 0.6 throughout the experiments. That is a strikingly large exploratory share, not a tiny occasional tremor. Yet it should be read as the best region within those parameter sweeps, machines and problem sets, not a timeless prescription.

Global noise dilutes attention across many variablesA red unsatisfied clause points to three relevant variables while a random selector spins across a much larger field.UNSATISFIEDa ∨ ¬c ∨ dabcdefghijklglobal draw: most targets are not in the residual clause
Figure 4 · Reach without focus. Global noise can cross any edge, but a sparse residual makes most variables indirect targets.Source scope: primary paper, random-noise definition and conclusion.

Worked example 4 · six relevant variables in a thousand

With two disjoint false three-clauses, at most six variables are immediately relevant. Random noise touches that set with probability 0.006. A focused walk chooses from it with probability one, though the chosen flip may still worsen total score.

Causal probe 4 · thicken the residual

As unsatisfied clauses collectively contain nearly every variable, global noise wastes less reach. The focusing advantage should shrink, which makes residual coverage a useful explanatory measurement in a replication.

05 · mixed random walk

Let the current failures define where chance may act

The paper’s winning strategy is a mixture, not pure randomness: with probability p choose a variable occurring in an unsatisfied clause; with probability 1−p make GSAT’s best local move.

The random branch begins by calculating a relevance set R(x): every variable appearing, positively or negatively, in at least one clause false under x. A uniform draw from R guarantees that the flipped variable participates in a current defect. The greedy branch still evaluates the entire formula, so exploitation remains global even while exploration is focused.

A variable in a false clause is not necessarily a good flip. A three-literal clause is false because all three literals currently have the wrong value, so flipping any member makes that clause true. Yet that variable can also be the sole true literal in several other clauses, making those clauses false. Focus guarantees at least one clause made; it does not control how many are broken.

This is precisely why walk is different from a greedy repair. It preserves uncertainty among eligible interventions. Variables whose immediate make-minus-break score looks poor can be chosen because the local score may be misleading about access to future basins. The residual set supplies direction without reinstating the ranking that caused the trap.

The probability gate creates two timescales. Greedy steps exploit the slope produced by clause count. Walk steps reconfigure the neighbourhood in a defect-related way. With p around one half in the reported tests, the solver alternates these roles frequently enough that “noise” becomes part of normal motion rather than an emergency after explicit trap detection.

The procedure need not label a state as a local minimum before walking. This matters because identifying plateau geometry could itself be costly, and a trajectory may benefit from disruption before it demonstrably stalls. The fixed mixture is memoryless: the same p applies whether the last ten moves improved or not.

with probability p: R ← variables occurring in at least one unsatisfied clause flip a uniformly sampled member of R otherwise: flip a variable with maximum make-minus-break gain
A probability gate mixes greedy and focused walk movesA rotating gate sends one branch to maximum gain and the other to variables collected from unsatisfied clauses, then rejoins at a flip.draw rr ≥ p · GREEDYmaximum gainr < p · WALKvariable in false clauseone flip
Figure 5 · Exploitation and exploration share every trajectory. The method does not wait to diagnose a trap; a fixed Bernoulli gate repeatedly chooses the move family.Source scope: primary paper, mixed random-walk rule.

Worked example 5 · make one, break three

If variable c occurs in a false clause but is the sole support of three satisfied clauses, flipping c changes U by +2: one defect is repaired and three are created. The move is focused and uphill at once. That combination is allowed by design.

Causal probe 5 · set p to its endpoints

At p=0 the method is basic GSAT. At p=1 every step is a focused random walk and immediate gain is ignored. The strong intermediate settings show that neither unqualified greed nor unqualified walking explains the result; their mixture does.

06 · hard random formulae

The advantage widened near the satisfiability transition

The main scaling comparison uses randomly generated 3CNF near the clause density where instances are empirically hardest and satisfiable and unsatisfiable cases occur in roughly equal measure.

Each instance has N variables, L clauses and three distinct literals per clause, with signs negated independently at probability one half. Around 1994, the authors place the difficult region near L≈4.3N, noting convergence towards 4.25 for larger N. A generator outside this transition can produce formulae so under- or over-constrained that strategy differences disappear.

Table 1 ranges from 100 variables and 430 clauses to 2,000 variables and 8,480 clauses. At 100 variables, all strategies have similar wall times. As N rises, mixed random walk separates dramatically. It reports solutions for every listed size; basic GSAT fails from 800 upward within the cutoff, while annealing and random noise fail on the largest three.

At 600 variables, basic GSAT averages about 30 million flips and 500 restarts, compared with about 242 thousand flips and one restart for walk. At 2,000 variables, walk averages about 23 million flips and 1.1 restarts. The important signature is not merely fewer operations: mixed walk is almost guaranteed to find a model on these selected satisfiable instances once a run begins.

The table’s R is average restarts before success. The authors use at least 100 random restarts per method and instance, increasing to 1,000 when more than 20 are needed. An asterisk means no solution after more than ten hours or 1,000 restarts. Such censoring must not be silently converted into an average runtime.

The paper emphasises that the ordering by flips matches the ordering by seconds, reducing concern that one C implementation simply has cheaper iterations. Hardware was an SGI Challenge with a 70 MHz MIPS R4400. These timings establish a historical experiment, not a fair race against current complete SAT solvers.

Reported strategy outcomes widen with random formula sizeFour coloured paths span instance sizes; only mixed random walk remains strongly successful at two thousand variables, while other paths end earlier.variables near L/N ≈ 4.3reported tractabilitybasic GSAT stopsannealing / noise stopmixed walk reaches 2,000
Figure 6 · Focus mattered more as the tested instances grew. This qualitative reconstruction encodes the table’s success boundary, not a new benchmark curve.Source scope: primary paper, Table 1 and hard-random discussion.

Worked example 6 · read the 2,000-variable row

Walk’s 3,255 seconds, roughly 23 million flips and R=1.1 describe successful runs on the listed satisfiable case. Asterisks for the other strategies mean censored non-discovery, not infinite time and not proof that the instance lacks a model.

Causal probe 6 · move away from the transition

At much lower density, many assignments may satisfy all clauses; at much higher density, an instance may be unsatisfiable. Either shift can collapse a witness-finding comparison. Hold generator and known status constant before attributing a speed change to policy.

07 · planning minima

Near-solutions can violate the world in one impossible way

Blocks-world encodings test whether focused noise remains useful when clauses come from a structured planning model rather than an anonymous random generator.

The planning formulae are difficult for basic GSAT because extremely deep local minima can encode assignments that satisfy nearly every individual clause while failing to represent any legal plan. Clause count rewards local consistency, but the remaining contradiction may require coordinated changes across time steps and state variables.

The paper’s vivid example is Towers of Hanoi. A near-assignment can behave as though a disc slips out from the bottom of a stack. Such a history satisfies many constraints yet differs profoundly from every legal solution. Repairing one clause in isolation can recreate another because the physical invariant is distributed across the encoding.

On the “Hanoi” and “huge” cases, basic GSAT fails within the limit. Mixed walk runs in 39 and 38 seconds respectively. The paper reports it at about one hundred times faster than annealing on the two largest problems and more than two hundred times faster than random noise. Its average restart counts, 2.6 and 1.1, also remain far below the alternatives.

The planning set uses a higher best annealing temperature, 0.5, than the random and circuit-synthesis sets. This is consistent with deeper barriers requiring more willingness to accept damage, although the paper’s tables cannot by themselves identify barrier depth as the unique cause.

Structured success answers a reasonable challenge to the random-formula experiment: perhaps focused walk only exploits quirks of the fixed-clause generator. Planning broadens external validity. It does not prove universality, because both domains are still translated into CNF and share the same clause-based residual representation.

A planning assignment can be clause-close but physically impossibleTwo Towers of Hanoi scenes compare a legal move with an impossible disc slipping from beneath a stack, despite similar clause scores.LEGAL HISTORYCLAUSE-CLOSE IMPOSSIBILITYconstraints and physics agreea bottom disc “escapes”
Figure 7 · A low defect count need not be a nearly legal plan. CNF constraints distribute a world invariant across many clauses, so a semantic repair may require an uphill route.Source scope: primary paper, planning-problem discussion and Table 2.

Worked example 7 · one impossible shortcut

A candidate history may encode correct initial and final towers and most frame constraints, yet move a covered disc. Only a small residual exposes the impossibility. Flipping the offending action bit alone can violate the goal or transition clauses, creating a barrier around the near-plan.

Causal probe 7 · preserve planning structure outside CNF

A neighbourhood that moves a whole legal action rather than one Boolean variable may remove the impossible-history basin. That would test representation and neighbourhood together; it would not refute the CNF experiment, whose intervention is specifically on Boolean flips.

08 · circuits as structured evidence

Focused walking survived the loss of random wiring

Circuit synthesis and diagnosis move the evaluation from generic benchmarks towards encodings with recognisable engineering tasks and sharply structured constraints.

In circuit synthesis, the formula asks for a logical circuit consistent with specified input-output behaviour. On five difficult randomly wired instances inherited from Kamath and colleagues, mixed walk and annealing both improve substantially on basic GSAT; walk is somewhat better. Random noise, however, does not improve and can degrade performance.

The authors then consider practical multiple-output structures such as adders and comparators, which contain no random component. GSAT with walk solves the listed instances from fractions of a second to several minutes. A then-fast complete Davis–Putnam variant solves only two of six within the cutoff, although the paper notes preliminary evidence that random variable permutations can improve complete search.

These comparisons are historically important because structure was often expected to favour systematic reasoning. The result shows that a local objective plus focused stochastic motion can exploit at least some highly organised encodings. It does not establish that incomplete search dominates systematic SAT on circuits generally.

Circuit diagnosis supplies a related but distinct task: encode test-pattern generation and find assignments revealing faults. Mixed walk again performs well compared with the complete procedure. A successful assignment is practically meaningful and directly checkable against the encoded circuit, preserving the asymmetric output contract of local SAT.

The lesson is narrower and more useful than “randomisation beats logic”. The residual clauses expose where a current circuit candidate disagrees with required behaviour. Focusing random choice on variables participating in those disagreements can be effective even when the formula was generated deterministically.

Synthesis and diagnosis produce different SAT witnessesAn input-output table flows to a circuit design on the left, while a faulty circuit flows to a diagnostic test pattern on the right.I/O BEHAVIOUR00→0 · 01→1 …synthesised circuitFAULT MODELgood ≠ faulty outputdiagnostic patterninputs exposing fault
Figure 8 · A shared SAT engine, different checked products. Synthesis returns a design; diagnosis returns an input pattern. Both expose structured residual clauses to the walk policy.Source scope: primary paper, circuit-synthesis and circuit-diagnosis sections, Tables 3–5.

Worked example 8 · the comparator boundary

A two-bit comparator must agree with all sixteen input combinations. A candidate circuit that fails only at 10 versus 01 has a small residual but may require rewiring several gate-choice variables. Focus keeps exploration connected to that failing row without presuming which gate edit is globally right.

Causal probe 8 · randomise variable names only

Renaming variables preserves the formula’s graph while changing deterministic tie order. If performance shifts, an implementation’s ordering policy: not circuit semantics: contributes to the result. Multiple permutations should be reported rather than selecting the best.

09 · from GSAT with walk to WalkSAT

Choose a false clause first, then choose its variable

The paper introduces WSAT, later known as WalkSAT, by reversing the centre of gravity: instead of adding walk to a greedy algorithm, add greediness as a heuristic inside a clause-centred walk.

WSAT first samples one unsatisfied clause. It then chooses a variable from that clause, either uniformly or according to a greedy heuristic. Every flip therefore addresses a specifically sampled defect. The candidate set is at most the clause length: three variables for 3CNF: rather than the union of variables across all false clauses.

This two-stage sample is not equivalent to choosing uniformly from the union. A variable appearing in several unsatisfied clauses can be reached through each one, so its marginal probability is higher. Under clause-first selection, current defect multiplicity becomes an implicit weight. Under GSAT’s p=1 walk, the maintained no-duplicates list gives each relevant variable equal probability.

The distinction surprised the authors in circuit diagnosis. GSAT with 100 per cent walk failed on those problems, while WSAT with random within-clause selection solved all of them. The result demonstrates how apparently tiny sampling details can define a different Markov chain and materially change search.

Tables 4 and 5 show substantial WSAT speed-ups over GSAT with walk on the reported circuit sets. For the 3-bit adder cases, times fall from 94.1 and 456.6 seconds to 1.0 and 0.7 seconds. Clause-first focus is therefore more than a terminological update in these experiments.

Greedy WSAT variants require specifying the within-clause score and tie rule. Later WalkSAT traditions often use break count, preferring variables that damage few satisfied clauses, with a noise probability selecting a random clause member. The 1994 text sketches the new algorithm and reports early data; it does not exhaust every modern variant.

Union-first and clause-first walking weight variables differentlyOn the left each distinct relevant variable has one ticket; on the right a variable occurring in three false clauses receives three routes to selection.GSAT WALK · UNION FIRSTWSAT · CLAUSE FIRSTabcdone ticket per distinct variablea ∨ b ∨ c¬a ∨ c ∨ da ∨ ¬b ∨ da has three clause routes
Figure 9 · Sampling order changes the distribution. Deduplicating variables makes relevance binary; selecting a clause first preserves multiplicity among current defects.Source scope: primary paper, “Modifying the Random Walk Strategy”.

Worked example 9 · three routes to a

Suppose three false 3-clauses all contain a, while b, c and d appear once each. Union-first walk samples uniformly from {a,b,c,d}, so P(a)=1/4. Clause-first then variable sampling gives a probability contribution of 1/9 from each clause, totalling 1/3.

Causal probe 9 · deduplicate clauses before sampling

Removing repeated false clauses changes WSAT probabilities even when logical models are unchanged. That reveals clause multiplicity as algorithmic weight and makes duplicate policy part of a reproducible benchmark definition.

10 · maximum satisfiability

The same focused mixture improved the best value when zero defects was unavailable

MAX-SAT asks for an assignment satisfying as many clauses as possible. It turns local SAT search from witness discovery into explicit optimisation and makes the best observed residual meaningful even when no model exists.

Hansen and Jaumard had compared five MAX-SAT procedures: basic local search, two deterministic Johnson algorithms, simulated annealing and their steepest-ascent/mildest-descent method with a tabu-like memory. The last, called zsamd, was the strongest of that group. Selman, Kautz and Cohen repeat the principal random 3SAT experiments with GSAT plus walk.

For each problem size, fifty random formulae are generated and each is solved one hundred times from different initial assignments. The table reports the mean best and mean average residual counts. On the 500-variable, 5,000-clause cases, mixed walk’s best assignment leaves an average of 161.2 clauses unsatisfied and its run mean is 163.6. It consistently improves the listed alternatives.

The small gap between best and mean indicates stable outcomes across restarts, and the authors suggest the best values may be close to optimum. “May” is important: without a bound or complete optimisation proof, repeated convergence does not certify optimality. Many local basins can share the same suboptimal height.

MAX-SAT clarifies why a noisy move can be rational even when it temporarily lowers objective value. The run retains the best assignment seen, so exploration may damage the current state without losing the incumbent. State and memory now have separate roles: the current assignment can wander; the recorded best protects achieved value.

The extension also broadens the paper’s thesis. Defect-focused noise is not useful only because a perfect SAT witness terminates search. It can improve the quality of approximate solutions under an optimisation contract, provided evaluation records best-so-far performance and does not confuse it with a proof of optimality.

Current and best-so-far MAX-SAT scores follow different pathsA jagged current score falls during exploratory moves while a monotone best-so-far staircase retains improvements.search stepsclauses satisfiedcurrent assignment may worsenincumbent never worsens
Figure 10 · Exploration need not erase achievement. MAX-SAT evaluation stores an incumbent separately from the deliberately noisy current state.Source scope: primary paper, maximum-satisfiability section and Table 6.

Worked example 10 · best 161.2, mean 163.6

The decimal is an average across generated formulae, not a fractional clause in one assignment. The close values summarise repeatability under the run budget; neither establishes that 161.2 corresponds to the unknown optimum.

Causal probe 10 · forget the incumbent

If the algorithm reports only its final state, a useful late exploratory move can leave the output worse than an earlier state. Best-so-far memory changes the optimisation contract even though it does not alter transition probabilities.

11 · executable noise laboratory

Watch eligibility, probability and gain select different flips

The laboratory exposes a four-variable formula. Choose a strategy, noise level and starting assignment; each deterministic demonstration step displays whether the greedy or stochastic branch acted and which residual clause justified a focused walk.

Current assignment and residual
Greedy gains
Eligible focused set
Last action

The formula has seven clauses over a, b, c and d. Every assignment and one-bit neighbour is enumerated, making the display an exact finite landscape rather than a suggestive animation. A teal ring marks the current state, green marks a satisfying assignment and gold marks one-bit neighbours.

For reproducibility, the laboratory uses a fixed numeric sequence instead of hidden randomness. On mixed policies, a sequence value below p activates noise or walk; otherwise the exact maximum-gain set is used. Global noise cycles through all variables. Mixed walk cycles through the union of variables in false clauses. WSAT cycles first through a false clause and then through its members.

The displayed gain is the decrease in unsatisfied clauses after a flip. A negative number is uphill. Focused eligibility does not imply positive gain, which is the mechanism’s essential distinction. Once a model is reached, the next button begins a new deterministic trajectory rather than damaging the verified witness.

Three exhaustive audits run on load. For all sixteen assignments, the greedy choice must belong to the full arg-max set; every focused candidate must occur in a currently unsatisfied clause; and every vertex labelled as a model must satisfy every original clause. These oracles test mechanism, not the paper’s historical timing claims.

Worked example 11 · read a focused uphill step

If the action says “walk · c · gain −1”, c was eligible because it occurred in a false clause, but its flip created one more net defect. That is not a failed greedy calculation. It is the deliberate exploration branch doing what greed forbids.

Causal probe 11 · drag p from zero to one

At zero, both mixtures always take the best gain. At one, global noise ignores the residual, mixed walk uses the residual union, and WSAT preserves clause multiplicity. The endpoints isolate candidate generation from the probability gate.

12 · evidence, reproduction and limits

Rebuild the comparison without turning a winner into a law

The primary paper offers a careful comparative experiment, but a modern reproduction must preserve its generator, status selection, parameter search, stopping rules and sampling semantics before interpreting speed.

Begin with the correct primary source: Bart Selman, Henry A. Kautz and Bram Cohen, AAAI-94 pages 337–343. The canon spreadsheet’s linked file AAAI94-008 is a different paper by Linda M. Wills and Janet L. Kolodner. The official source for this record is AAAI94-051. Correcting that mismatch prevents an apparently precise citation from grounding the wrong research.

Recreate random 3CNF with documented N, L, clause-length, sign probability, duplicate policy and density. Establish satisfiability independently with a complete solver, because local-search non-discovery cannot classify instances. Report how satisfiable cases were selected near the transition and preserve censored failures rather than averaging them away.

For every strategy, record the full parameter grid and total proposal budget. Annealing counts accepted flips in the paper; also report considered proposals. For mixtures, state whether variable occurrence lists are deduplicated. For WSAT, distinguish uniform clause sampling, uniform within-clause sampling, greedy scoring and tie rules. Publish independent seeds.

Measure wall time, proposals, accepted flips, restarts, success probability and the distribution of time-to-witness. Historical tables give means; modern work should add quantiles and confidence intervals because randomised runtimes can have heavy tails. Fixing one “lucky” seed creates a demonstration, not an estimate.

Replicate each problem class separately. Random 3CNF, planning, synthesis, diagnosis and MAX-SAT have different residual structures and best parameters. A policy’s average across them can conceal reversals, such as global random noise helping hard-random formulae yet degrading the circuit-synthesis set.

Finally, compare against modern baselines only with explicit framing. The 1994 complete solver, compiler and hardware are historically informative. Contemporary CDCL, stochastic local search and hybrid solvers answer a different performance question. A faithful replication and a present-day benchmark can coexist, but their conclusions must not be merged.

ClaimWhat the paper supportsBoundary to preserve
Mixed walk is superiorBest tuned results across the reported benchmark classes, increasingly strong on large random instances.Not a theorem for every CNF distribution or parameter budget.
Cooling did not helpNo tested geometric schedule beat the best constant temperature.Does not exclude every adaptive or problem-specific schedule.
R near one is reliableFew average restarts on selected satisfiable instances.Does not certify unsatisfiability or worst-case runtime.
MAX-SAT values are close to optimalSmall best-to-mean gaps suggest stability.No optimality proof or approximation bound is supplied.
WSAT changes samplingClause-first choice weights multiply occurring defect variables.Exact probabilities depend on clause and tie policies.

Worked example 12 · one fair budget

Give each configuration ten million variable proposals, record accepted flips separately and repeat across independent formulae and seeds. Then a low annealing acceptance rate cannot appear artificially efficient merely because rejected proposals vanish from its flip count.

Causal probe 12 · tune on the test set

Selecting p or T on the same instances used for the headline result estimates the best observed setting optimistically. Divide formulae into tuning and evaluation sets, or use nested resampling, to measure how well a policy transfers.

Two comprehensive reviews

Scholarship, teaching and execution review

Review one: fidelity and evidence. This reconstruction preserves complete-assignment local search, unsatisfied-clause energy, sideways and uphill motion, the three escape families, parameter tuning, constant versus geometric temperature, the hard-random transition, planning minima, circuit synthesis and diagnosis, WSAT’s two-stage sampling, MAX-SAT incumbents and the incomplete failure contract. Numerical claims are tied to the 1994 tables rather than presented as current records.

Review two: teaching and implementation. Ten paper-specific SVGs make plateau escape, policy information, annealing acceptance, global dilution, the p gate, scaling, impossible plans, circuit products, sampling multiplicity and incumbents visible. Twelve worked examples and twelve causal probes isolate mechanisms. The laboratory enumerates the complete small state space and names three exact oracles.

Source-integrity review. Author order and pagination follow the paper itself: Bart Selman, Henry A. Kautz and Bram Cohen, 337–343. The canon’s author order and AAAI94-008 URL were checked against the scan and corrected here to AAAI94-051. The wrong link is documented instead of silently used.

Accessibility and responsive review. Every SVG includes a unique title, description, caption and source scope. Labels and geometry carry meaning in addition to colour. Motion stops under reduced-motion preference. Controls are labelled; outcomes use text and a live region; grids collapse at 900 and 600 pixels; the evidence table scrolls on narrow screens.

Memory studio

Twelve handles for recall

01 · ResidualThe clauses still false under the complete assignment.
02 · PlateauConnected equal-score states can hide rare exits.
03 · UphillTemporary damage can open a lower basin.
04 · TemperatureAnnealing prices damage by exp(−δ/T).
05 · Global noiseEvery variable is eligible, relevant or not.
06 · Focused walkRandomness is restricted to variables in false clauses.
07 · Mixture pA probability gate alternates exploration and greed.
08 · TransitionHard random 3SAT depends strongly on clause density.
09 · Restart RAverage fresh starts before a witnessed solution.
10 · Clause firstWSAT preserves current defect multiplicity.
11 · IncumbentMAX-SAT remembers the best state while the current state wanders.
12 · BoundaryNon-discovery is never a proof of unsatisfiability.
Place in the canon

From greedy complete guesses to heuristic search under uncertainty

Canon 0083 introduced GSAT’s radical simplification: begin with a complete interpretation, count satisfied clauses, follow the best one-bit neighbour and restart. Canon 0084 shows that this evaluative agency needs controlled disobedience. A score can guide most actions while a defect-focused stochastic policy periodically refuses its ranking.

The paper also sharpens the meaning of attention. Random noise distributes exploration across the whole assignment. Mixed walk attends to variables implicated in current failure. WSAT narrows attention further by selecting one failed clause and preserving multiplicity. These are increasingly structured ways to decide where uncertainty may act.

Canon 0085, David Bryce, Subbarao Kambhampati and David E. Smith’s “Planning Graph Heuristics for Belief Space Search”, will move from a single complete world to planning under incomplete information. Heuristic evaluation will operate over belief states: sets of possible worlds: where reachability, mutex relations and uncertainty must be estimated together.

Interpretive synthesis

Useful agency can be neither deterministic nor indiscriminate

Mixed random walk supplies a compact model of bounded intervention. The system exploits a scalar objective, but it does not mistake that objective for complete knowledge of the landscape. It uses present failures to constrain experimentation while tolerating immediate loss.

The focused move is not intelligent because it predicts a successful future. It is intelligent in a weaker operational sense: uncertainty is allocated where constraints currently fail. The distinction between relevance and desirability protects the mechanism from a common error: assuming that attention must already know the answer.

WSAT adds another lesson. Sampling order is part of representation. A set of relevant variables erases how often each variable participates in failure; clause-first selection preserves that multiplicity. Two algorithms described casually as “flip a variable in an unsatisfied clause” can therefore behave differently.

The experiments also resist a universal recipe. Best temperature changes across domains, noise can hurt an easy structured set, and the strongest advantage appears as random instances grow. Competence is an interaction among objective, neighbourhood, proposal distribution, stopping rule and problem generator.

These mechanisms model search policy, not phenomenal awareness. They show how a bounded agent can combine exploitation with relevant exploration and verify a discovered witness. Nothing in stochastic focus, successful SAT search or adaptive-looking trajectories establishes consciousness.

Publication brief

What this companion adds

This companion reconstructs the 1994 comparison from local minima through annealing, global noise, mixed random walk, hard-random scaling, planning traps, circuit encodings, clause-first WSAT, MAX-SAT memory and modern reproduction boundaries.

The inspected primary is Bart Selman, Henry A. Kautz and Bram Cohen, “Noise Strategies for Improving Local Search”, Proceedings of AAAI-94, pages 337–343. The official AAAI94-051 scan corrects the canon spreadsheet’s misdirected AAAI94-008 link.

Ten accessible animated SVGs, twelve worked examples, twelve causal probes, twelve memory cards, two reviews, an evidence ledger and an executable four-variable laboratory make the intervention auditable. Exact tests verify greedy arg-max membership, focused eligibility and every reported model.

References

Primary and contextual sources

  1. Bart Selman, Henry A. Kautz and Bram Cohen, “Noise Strategies for Improving Local Search”, Proceedings of AAAI-94, 337–343 (1994). Correct official AAAI paper.
  2. Bart Selman, Hector Levesque and David Mitchell, “A New Method for Solving Hard Satisfiability Problems”, Proceedings of AAAI-92, 440–446 (1992).
  3. Bart Selman and Henry A. Kautz, “Domain-Independent Extensions to GSAT: Solving Large Structured Satisfiability Problems”, IJCAI-93 (1993).
  4. Scott Kirkpatrick, C. Daniel Gelatt and Mario P. Vecchi, “Optimization by Simulated Annealing”, Science 220, 671–680 (1983).
  5. David Mitchell, Bart Selman and Hector Levesque, “Hard and Easy Distributions of SAT Problems”, AAAI-92, 459–465 (1992).
  6. Pierre Hansen and Brigitte Jaumard, “Algorithms for the Maximum Satisfiability Problem”, Computing 44, 279–303 (1990).
  7. Thomas Larrabee, “Test Pattern Generation Using Boolean Satisfiability”, IEEE Transactions on Computer-Aided Design (1992).
  8. Bart Selman, Henry Kautz and Bram Cohen, “Local Search Strategies for Satisfiability Testing”, DIMACS Series 26, 521–532 (1996).