TLDR
- Heuristics are regional specialists. Six variable orderings dominate different parts of a binary-CSP space; none is universally best.
- Two features make the map legible. Constraint density p₁ and mean tightness p₂ locate an instance on a two-dimensional grid.
- Hardness forms a narrow frontier. Average cost peaks near the satisfiable–unsatisfiable transition, where SOL is especially strong.
- Nearest history selects a rule. A transparent grid maps each feature cell to its lowest-average-cost heuristic.
- Static beats restless switching. One initial choice outperforms the dynamic selector because the training labels describe whole-run behaviour.
The instance can be evidence about how it should be searched
Constraint solvers routinely ask which variable to assign next. The paper asks a prior question: which variable-ordering heuristic should be trusted on this particular instance?
A constraint-satisfaction problem, or CSP, contains variables, a domain of values for each variable and constraints ruling out joint assignments. Scheduling, frequency allocation and hardware configuration can all take this form. A complete solution assigns every variable without violating a constraint; proving that no such assignment exists is also a valid solving outcome.
Backtracking constructs an assignment depth first. It chooses a variable, tries a value, propagates the consequences and retreats when a domain empties. Variable order therefore determines which contradictions appear early and which remain hidden beneath a large subtree. A helpful choice can save millions of constraint revisions.
No single heuristic has to be best on every structure. Minimum domain favours immediate scarcity; maximum degree favours connectedness; conflict-based scores seek danger. These intuitions overlap but are not equivalent. The same rule can be incisive in one region and wasteful in another.
The algorithm-selection tradition treats that variation as learnable. Store how several methods behaved on past instances, describe a new instance with features, then choose the historically suitable method. Sophisticated portfolios often make this relation hard to inspect. Moreno-Scott and colleagues pursue an unusually transparent alternative: a two-dimensional map whose cells are labelled by the average winner.
The study has two linked aims. First, systematically explore where six dynamic variable-ordering heuristics excel or fail. Second, convert the observed regions into selectors for unseen random and structured problems. The point is not merely higher performance; it is an interpretable account of why a rule is being applied.
Worked example 1 · the cost of a late contradiction
If variable z conflicts with almost every value of four neighbours, selecting z early can expose impossibility near the root. Leaving z until fifth may reproduce the same failed combinations beneath many earlier assignments.
Causal probe 1 · demand one universal winner
The demand discards the empirical signal the study is built to exploit. Regional superiority is enough for selection: a portfolio can outperform each member even when no member dominates the entire space.
Every chosen variable reshapes the next decision
The six rules are dynamic. They are not fixed permutations decided before search; their scores are recomputed as domains and constraints change.
At a node, the solver selects one unassigned variable, tries values in their default domain order and checks consistency. Constraint propagation removes unsupported values. If a domain becomes empty, backjumping retreats to a relevant earlier decision rather than mechanically stepping back one level.
Removing values changes domain sizes. Assigning a variable changes which constraints remain active and therefore degrees. The fraction of currently forbidden value pairs can change as domains contract. A variable that looked safe at the root may become urgent after one assignment.
Every heuristic assigns a score to each remaining variable, sorts according to its own preference and selects first. All ties in the experiment are broken lexically by variable name. Values are always tried in their original order. Those controls isolate variable ordering from value-order effects.
The performance metric is consistency checks. Each time a constraint is revised, a counter increases. This is a machine-independent proxy for search work and makes comparisons less sensitive to implementation noise, though it is not wall-clock time and does not include every cost of score computation equally.
An algorithm selector sits outside this loop. A static selector chooses one of the six scoring rules from initial features and keeps it. A dynamic selector recomputes the instance position before every variable assignment and may replace the scoring rule. The selected heuristic remains dynamic internally either way.
Worked example 2 · dynamic inside static
SHS may select DOM once at the root. DOM still recalculates every remaining domain size after propagation. “Static” describes selector commitment, not a frozen order of variables.
Causal probe 2 · replace checks with milliseconds
The ranking might change because RHO and SOL compute products while DOM reads a size. Consistency checks isolate one important cost but cannot establish the fastest implementation without timing and score-overhead evidence.
Scarcity, connectedness and conflict can be combined in different ways
Each heuristic asks a concrete question about a remaining variable v. Their differences can be written as six short scoring rules.
DOM chooses the smallest current domain dv. It follows fail-first reasoning: try the variable with least room to manoeuvre. DEG chooses maximum current degree degv, the number of constraints involving v, seeking the variable that can affect most neighbours.
DOMDEG minimises dv/degv. Small domains lower the ratio; large degree lowers it too. The combination tries to balance present scarcity against future reach, although the quotient fixes one particular way of trading them.
For every constraint c involving v, let pc be its current fraction of forbidden value pairs. RHO minimises ρv=∏(1−pc). This approximates local solution density under an independence-like multiplication: many tight constraints drive the product towards zero.
SOL minimises solv=dvρv. It extends RHO by also accounting for how many values v retains. The authors later connect this richer combination to SOL’s strong performance near the hardest transition.
MXC maximises cfv=∑pc. It seeks variables exposed to the greatest aggregate conflict fraction. Unlike RHO’s multiplicative survival view, MXC adds local tightness. Two variables can therefore swap order depending on whether several moderate constraints or one severe constraint matters more.
RHO: min ρᵥ = ∏c∈Cᵥ(1−pc)
SOL: min solᵥ = dᵥρᵥ · MXC: max cfᵥ = ∑c∈Cᵥpc
Worked example 3 · multiplication sees joint pressure
For a variable in constraints of tightness .5 and .6, RHO gives (1−.5)(1−.6)=.20, while MXC gives 1.10. Another variable with one .85 constraint gets .15 and .85. RHO finds the latter more urgent; MXC prefers the first.
Causal probe 3 · assume more features always improve
SOL’s extra domain cue helps in these experiments, but DOMDEG also combines cues and often performs poorly. Information only helps when the combination aligns with search consequences.
A score table makes disagreement inspectable
The paper’s six-variable example demonstrates that the formulas are not cosmetic: they send the same solver to four different first variables.
Variable v0 has domain size two and degree one. v3 also has two values but degree two. DOM sees a tie and lexical ordering selects v0. DOMDEG gives v3 ratio one and also gives v5 ratio one; lexical order selects v3.
DEG chooses v5, the sole variable with degree three. MXC assigns v4 and v5 conflict sums of nine in the table’s scale, then lexical order makes v4 first.
RHO gives its minimum, .1111, to v3. SOL multiplies that density by domain size two, producing .2222, also its minimum. Thus DOMDEG, RHO and SOL converge on v3 for different reasons.
The values matter less than the discipline they reveal. A reported “heuristic winner” depends on exact scoring direction and tie-breaking. Reimplementations that use random ties or a different variable naming order are testing a different policy, especially where broad score ties occur.
Value order is held constant too. If a variable ordering reaches the same node count but its values are permuted, the first solution may arrive earlier or later. Fixing default value order keeps the study focused on which variable is selected.
| Variable | DOM d | DEG deg | DOMDEG | RHO ρ | SOL | MXC cf |
|---|---|---|---|---|---|---|
| v₀ | 2 | 1 | 2 | .5000 | 1 | 3 |
| v₁ | 3 | 2 | 1.5 | .1296 | .3888 | 7 |
| v₂ | 3 | 2 | 1.5 | .2962 | .8886 | 6 |
| v₃ | 2 | 2 | 1 | .1111 | .2222 | 6 |
| v₄ | 3 | 2 | 1.5 | .2469 | .7407 | 9 |
| v₅ | 3 | 3 | 1 | .2160 | .6480 | 9 |
Worked example 4 · lexical tie-breaking
DOM sees d=2 for v₀ and v₃. Neither is mathematically better under DOM alone, so lexical order chooses v₀. A random tie could make DOM imitate the first choice of SOL on this instance.
Causal probe 4 · change only variable names
If tie-breaking is lexical, renaming can alter the explored tree while the abstract constraint graph remains isomorphic. A rigorous rerun records or neutralises that representational sensitivity.
Density counts edges; tightness counts forbidden pairs
Two normalised features turn a binary constraint network into a point. Their simplicity makes the eventual rule grid understandable.
For |V| variables there are |V|(|V|−1)/2 possible unordered binary constraints. Constraint density p1=2|C|/[|V|(|V|−1)] is the fraction present. Zero means no constrained pairs; one means a complete constraint graph.
Each present constraint c explicitly lists forbidden value pairs. Its tightness pc is the forbidden fraction among all pairs in the two incident domains. Global p2 averages pc across C. It describes how restrictive present edges are, not how many edges exist.
A sparse network can have severe individual constraints; a dense network can have lenient ones. Separating the axes lets the map distinguish these cases. The paper’s illustrative six-variable CSP has p1=.4 and p2=.4815.
The representation is intentionally narrow. Every experimental problem is binary and constraints are in extension, meaning forbidden pairs are enumerated. Higher-arity CSPs need features that respect multi-variable relations. Density and mean tightness also discard topology: two graphs with equal coordinates can have hubs, chains or communities and behave very differently.
That information loss explains the selector’s probabilistic status. A cell records the best average heuristic among sampled instances, not a guarantee for every graph at the coordinates. The instance-space map makes expected regions visible while leaving unusual cases unresolved.
p₂ = (1/|C|) ∑c∈C pc
point(instance) = (constraint density, mean constraint tightness)
Worked example 5 · density by counting
With six variables, fifteen unordered pairs are possible. Six constrained pairs give p₁=6/15=.4. If their forbidden fractions total 2.889, p₂=2.889/6=.4815.
Causal probe 5 · compare a star and a cycle
Both can have six edges and identical average tightness, hence the same point. DEG sees a hub in the star but equal degrees in the cycle. Two extra structural features could distinguish what p₁ and p₂ conceal.
Model B creates controlled worlds and reveals a phase frontier
The authors sample an entire density–tightness plane rather than beginning only with benchmark instances already considered interesting.
Model B generates a binary CSP in two stages. First choose which variable pairs receive constraints to meet target density. Then choose forbidden value pairs on those edges to meet target tightness. This division gives precise control over both coordinates.
The survey uses a 50×50 grid with .02 steps on each axis: 2,500 sampling points. At every point, 50 independent instances contain twenty variables and ten values per domain. The training landscape therefore contains 125,000 instances.
Every instance is solved six times, once per ordering heuristic, by the same Java solver with constraint propagation and backjumping. Hardware is an AMD 4.0 GHz eight-core Windows machine with 32 GB memory. Solving stops at the first solution or when unsatisfiability is proved.
All six cost surfaces show a satisfiable–unsatisfiable phase transition. Most instances on one side have solutions, most on the other do not, and maximum uncertainty forms a narrow hard strip. The greatest average cost for every heuristic occurs at p1=1 and p2=.22.
At that point SOL averages 3.87 million checks, DOM 4.76 million, RHO 4.86 million, DEG and DOMDEG 11.17 million and MXC 16.14 million. Yet within the same cell, individual costs range widely. Coordinates predict an average distribution, not exact difficulty.
Worked example 6 · one cell versus one instance
The value 3.87 million for SOL at (1,.22) is the mean over fifty problems. In that cell its observed minimum is.13 million and maximum 8.44 million: evidence of substantial hidden variation.
Causal probe 6 · train only on the ridge
The selector might learn SOL’s hard-region strength but miss MXC and RHO strips in easier satisfiable space or DOM’s unsatisfiable niche. Uniform sampling makes the portfolio’s regional structure visible.
A dominance map shows where advice changes sign
The same grid supports two questions: which heuristic has lowest average cost here, and which has highest?
SOL dominates the phase-transition band. Moving left into mostly satisfiable space reveals strips where RHO and then MXC lead. On the right, where instances are mostly unsatisfiable, DOM and DOMDEG have small specialist regions; much of this side has no unique winner because methods tie.
DEG never becomes the sole average winner at any training cell. That does not make it useless on every individual instance. It says the two-feature regional average always contains another heuristic at least as good.
The anti-map is equally instructive. DOM is worst through much of satisfiable space. MXC performs worst near the phase transition. DOMDEG has a narrow poor strip on the unsatisfiable side. Elsewhere ties again produce “no dominance”.
Cell averages cannot promise an individual result. At the hardest cell, SOL is best on 42 of fifty instances and MXC worst on 46. Yet instance 27 reverses the story: MXC uses.04 million checks while SOL uses.13 million: more than a threefold ratio in MXC’s favour.
The exception is diagnostic. Density and tightness identify broad regimes, but they cannot distinguish every topology or conflict arrangement. More features may locate such outliers. The authors treat this limitation as a route to improvement rather than hiding it behind average accuracy.
Worked example 7 · instance 27 refuses its label
At (1,.22), the cell label is SOL because SOL wins 42 of fifty. MXC is usually worst there, yet needs .04 million checks on instance 27 versus SOL’s .13 million. Regional expectation is not instance certainty.
Causal probe 7 · remove the anti-map
A selector still knows its predicted winner, but a human loses strong negative knowledge. Knowing MXC is hazardous near the ridge can guide fallback design even when the precise best choice is uncertain.
The nearest cell fires a transparent rule
The authors convert the atlas into rules of the form (p₁,p₂) → heuristic. Euclidean proximity decides which stored condition applies.
For a new instance, compute density and tightness, locate the closest mapped grid point and use the heuristic that achieved lowest average cost there. Each decision can be explained with a coordinate, a distance and a cell label. There is no opaque classifier boundary.
The static heuristic selector, SHS, performs this once at the initial state. The chosen heuristic then controls every variable decision, dynamically recomputing its own score but never being replaced by another member.
The dynamic heuristic selector, DHS, recalculates p1 and p2 whenever a variable must be assigned. As propagation shrinks the remaining subproblem, its point may move and a different cell label may fire. Feature computation is cheap here, so selection overhead is not the main concern.
The deeper mismatch is supervision. Every training cell is labelled by the heuristic that solved whole instances from beginning to end. It contains no evidence about transitions between heuristics after partial search. DHS treats a whole-run performance map as if it were a switching policy.
Heuristics can undo one another’s progress by steering search into incompatible subtrees. That interaction increases variance. A genuinely dynamic selector would need training examples describing problem states, prior decisions and safe hand-offs, not only root-instance coordinates.
fired cell = argmincell i √[(p₁−p₁ᵢ)²+(p₂−p₂ᵢ)²]
SHS: fire once · DHS: fire before every variable
Worked example 8 · a nearest rule
An instance at (.61,.27) lies .014 from cell (.60,.28) and .032 from (.64,.26). If the first stores RHO and the second SOL, SHS transparently chooses RHO.
Causal probe 8 · retrain on partial states
DHS would then have evidence matching its decisions. Labels could include the best next heuristic conditioned on the history, making switching a learned intervention rather than an extrapolation from whole-run averages.
Static selection wins broadly; dynamic selection loses expensively
Three fresh grids test the map on 75,000 unseen Model-B instances: 2,500 cells, ten instances per cell and twenty variables with ten values each.
Two metrics prevent a shallow victory count. The first is the percentage of sampling points where a selector’s average cost beats an individual heuristic. The second is the total percentage of consistency checks saved across all instances. A method may win many easy points yet lose heavily on a few hard ones.
Across test grids, SHS beats SOL at 83.40–84.72 per cent of points, but saves only 1.76–1.89 per cent of checks because SOL is already excellent on the costly ridge. Against DEG, SHS beats about 68.6 per cent of points and saves 64.80–70.34 per cent.
Against DOM it saves 35.90–42.36 per cent; against MXC 59.38–60.39; against RHO 13.56–14.23; and against DOMDEG 51.47–56.87. The selector’s benefit is largest when it avoids disastrous specialist mismatches on hard cells.
DHS beats SOL at roughly 66 per cent of points, an apparently respectable frequency. Yet it increases total checks against SOL by 8.55–9.51 per cent. Its losses are concentrated where being wrong is expensive. This is the study’s cleanest demonstration that win rate and aggregate cost answer different questions.
SHS outperforms DHS on average. The result does not establish that switching can never help. It shows that switching with this map: trained on uninterrupted heuristic runs and only two current features: is not reliably beneficial.
| Comparator | SHS point wins, grid I–III | SHS checks saved, grid I–III | DHS point wins, grid I–III | DHS checks saved, grid I–III |
|---|---|---|---|---|
| SOL | 84.72 · 84.08 · 83.40% | 1.89 · 1.79 · 1.76% | 66.48 · 65.80 · 66.40% | −9.43 · −9.51 · −8.55% |
| DEG | 68.60 · 68.92 · 68.68% | 70.34 · 64.80 · 67.83% | 64.84 · 64.84 · 63.84% | 66.90 · 60.75 · 64.45% |
| DOM | 67.48 · 67.64 · 66.80% | 42.36 · 35.90 · 41.93% | 59.32 · 59.64 · 58.32% | 35.74 · 28.51 · 35.83% |
| MXC | 68.64 · 68.76 · 69.32% | 60.29 · 59.38 · 60.39% | 71.48 · 70.64 · 71.08% | 55.73 · 54.70 · 56.24% |
Worked example 9 · the arithmetic of a misleading winner
Nine easy wins saving ten checks each produce 90 saved. One ridge loss costing 1,000 checks yields a net increase of 910. A 90 per cent win rate can therefore accompany much worse aggregate work.
Causal probe 9 · publish only point dominance
DHS would look competitive with SOL. Adding total consistency checks reveals that its switching errors occur where cost has far greater scale. Evidence fairness requires both axes.
A random-grid rule travels surprisingly far, but not without caveats
SHS is next tested on 250 structured instances unlike the Model-B training distribution.
The set combines fifteen QCP-10 and fifteen QCP-15 instances, twenty composed instances, one hundred unsatisfiable ehi cases encoded from 3-SAT and one hundred geometrical cases. Sizes range from fifty variables with twenty values to 297 variables with eight values. Their points concentrate in particular regions rather than filling the plane.
Against SOL, SHS wins on 51.83 per cent and saves 19.22 per cent of checks. Against DEG it wins 76.73 per cent and saves 71.62 per cent. Against MXC it wins 91.84 per cent and saves 74.82 per cent.
An oracle comparison asks how often a method ties the minimum cost among all six heuristics. SHS reaches that minimum on more than 40 per cent of structured instances; SOL, the closest individual, on 23 per cent. Ties mean the displayed method percentages can sum above one hundred.
SHS is also compared with Activity-Based Search and Weighted Degree, neither in its portfolio. Its median is lower than ABS and similar to WDEG, with greater WDEG variance. Mean check reductions are 44.18 per cent versus ABS and 66.86 per cent versus WDEG.
Yet a one-sided paired t-test at five per cent does not provide enough evidence to claim SHS is better than ABS or WDEG. Mean savings coexist with uncertainty and distributional sensitivity. The authors explicitly avoid calling their simple grid the best selection model.
Scope remains binary extensional CSPs, two coarse features, one solver and consistency checks rather than time. Training and random tests share Model B. Structured transfer is encouraging but concentrated and modest in size. The work demonstrates useful, interpretable matching: not universal dominance.
Worked example 10 · a mean without a significance claim
SHS uses 66.86 per cent fewer checks than WDEG on average, yet high paired variation prevents the reported test from supporting directional superiority at α=.05. Effect size and inferential confidence answer different questions.
Causal probe 10 · call transfer solved
The structured set proves the rule is not confined to its training generator, but concentrated feature regions and six families do not represent every CSP. A stronger claim needs broader instances, repeated splits and time-aware evaluation.
Watch a nearest-cell rule commit: or switch
This transparent laboratory uses a synthetic labelled map, not digitised values from the paper’s Figure 4. It tests the exact selection mechanism and the difference between SHS and DHS.
Six prototype cells encode synthetic whole-run winners. Every trace point selects the prototype with minimum Euclidean distance. Coordinates, distances and labels are visible; there is no learned boundary hidden from inspection.
Under SHS, only the first point matters. The label is held across all later decision states, matching the paper’s static commitment. Under DHS, every point is reclassified and the displayed rule may switch.
The synthetic cost illustrates interaction rather than reproducing consistency-check tables. A base cost belongs to each trace and switching adds a penalty. This embodies the paper’s warning that individually sensible heuristics can cancel one another’s progress.
Ridge approach begins near SOL and remains near the hard frontier. Easy satisfiable stays close to MXC and RHO prototypes. Cross-region drift moves from MXC through RHO to SOL and DOM, creating multiple DHS switches.
The exact tests verify the mechanism: every fired rule is the true nearest prototype; its heuristic equals the stored cell winner; SHS makes one decision while DHS recomputes once per trace state. The page does not pretend that the synthetic labels are the paper’s unpublished cell table.
Worked example 11 · cross-region commitment
SHS sees the first drift point near MXC and remains with MXC. DHS later chooses RHO, SOL and DOM. The switches appear locally justified, but the training labels never measured whether those hand-offs preserve prior search progress.
Causal probe 11 · erase the provenance label
A colourful simulator could be mistaken for a reproduction of Figure 4. Marking the map synthetic preserves the distinction between demonstrating an algorithm and claiming the authors’ exact empirical boundaries.
Preserve the grid, then add the information it cannot see
A contemporary rerun should first reproduce the narrow result and then test whether interpretability survives richer features and safer dynamic decisions.
Recreate Model B’s 50×50 grid, .02 spacing, fifty training instances per cell, twenty variables and domain size ten. Use identical generated instances for all six heuristics, fixed lexical ties, fixed value order, the same propagation and backjumping, and exact consistency-check instrumentation.
Publish random seeds, per-instance check counts, satisfiability, selected variable traces and cell labels. Report cell means with quantiles and tails. Preserve all three independent test grids rather than merging them before assessing stability.
For transfer, stratify structured families and show instance coordinates. Add wall time, score-computation cost and memory beside checks. Use bootstrap intervals or distribution-appropriate paired tests, correcting for multiple comparisons where necessary.
Expand features cautiously: degree variance, clustering, domain-size dispersion, constraint-tightness variance and graph components could distinguish star from cycle or locate instance 27. Compare nearest-cell rules with trees, calibrated classifiers and portfolio methods while retaining human-readable explanations.
Train a truly dynamic selector on partial states and transitions. A label should estimate the counterfactual cost of switching after a history, not replay root-level winners. Include a no-switch option and model switching cost. This directly tests the paper’s most important negative result.
| Audit item | Minimum evidence | Failure prevented |
|---|---|---|
| Generator fidelity | Exact p₁/p₂, Model B and seeds | Map changes because sampling changed |
| Search control | Same solver, ties, values and instances | Non-ordering differences masquerade as heuristic effects |
| Cost breadth | Checks, time, scoring and memory | Proxy improvement is called system speed |
| Transfer | Family-level results and uncertainty | Concentrated benchmarks support universal claims |
| Dynamic policy | Partial-state labels and switch counterfactuals | Whole-run map is misused as hand-off evidence |
Worked example 12 · add one topology feature
Within a fixed (p₁,p₂) cell, split training examples by maximum degree. If star-like graphs and regular graphs prefer different heuristics on held-out instances, the new feature explains variation the original projection erased.
Causal probe 12 · optimise classifier accuracy
Misclassifying an easy cell may cost ten checks; missing a hard ridge cell may cost millions. Cost-sensitive training should minimise expected search work, not treat every cell label error equally.
What survived formal and evidential challenge
Review one: scholarly fidelity and teaching. The reconstruction was checked against the complete PMC journal text. It retains binary extensional CSP scope; all six scoring directions and formulas; lexical ties and default value order; p₁ and p₂ definitions; Model B; grid dimensions; solver controls; phase-transition result; best and worst regions; static and dynamic selector mechanics; and random and structured tests.
The central teaching risk was calling SHS static without explaining that its chosen ordering remains dynamic. That distinction is explicit. A second risk was presenting density and tightness as sufficient instance identity. The page repeatedly frames them as a legible projection that predicts cell averages while hiding topology and outliers.
Review two: evidence, language and accessibility. Counts distinguish 125,000 training instances from 75,000 independent random tests and 250 structured cases. Point-win percentages are separated from aggregate check savings. The negative DHS–SOL savings and statistically insufficient ABS/WDEG superiority claim are preserved.
Consistency checks are never equated with time. The qualitative territory diagram is labelled as reconstruction, and the laboratory’s prototype map as synthetic. All figures have titles, descriptions and captions; animation honours reduced-motion settings; controls are labelled; and the demonstration exposes its three exact tests.
Review verdict
Pass 1: formal reconstruction: passed after separating selector commitment from dynamic variable scoring and regional averages from individual guarantees. Pass 2: evidence and delivery: passed after preserving distribution shift, proxy-metric limits, win-versus-magnitude reversals and inferential uncertainty.
Twelve cards for durable recall
Guidance moves from choosing a node to choosing the chooser
Paper 0088 used a heuristic to rank proof histories. Paper 0089 asks whether the instance can select which heuristic should control each variable decision.
Soutchanski and Young separate the authority of the Basic Action Theory from relaxed guidance. Moreno-Scott and colleagues separate CSP semantics from variable-order policy. Both show that a search rule can change effort drastically without changing what counts as a solution.
The new level is meta-decision. A heuristic scores variables; a selector scores heuristics using instance features and historical costs. Its failure mode is correspondingly subtle: DHS can choose a locally suitable heuristic from an empirically valid map and still worsen the whole search because the map never modelled switching.
Canon 0090 returns to planning with Gerevini, Saetti and Serina’s LPG: stochastic local search over temporal action graphs. The sequence joins three scales of guidance: ranking proof histories, assigning variable-order specialists and repairing an entire plan representation through local changes.
Historical performance becomes useful only when the decision matches the history
The paper is often read as a simple success for algorithm selection. Its more durable result is a lesson about the semantics of training labels.
The grid’s labels answer a specific counterfactual: if one heuristic controls a whole run for instances near these coordinates, which has lowest average checks? SHS asks that exact question at deployment. Its simplicity is a form of alignment between evidence and action.
DHS asks a different question: after a partial history produced under perhaps several heuristics, which rule should control the next assignment? Root-level cell winners are not answers to that query. More frequent reconsideration cannot repair missing causal evidence and can amplify incompatible commitments.
Interpretability makes the mismatch visible. Because the rule is a coordinate and label rather than an opaque score, researchers can see what was measured, what is extrapolated and why outliers matter. The lasting contribution is therefore both computational and epistemic: map competence, but preserve the unit of decision the map actually supports.
Primary source, companion scope and verification contract
This companion reconstructs Jorge Humberto Moreno-Scott, José Carlos Ortiz-Bayliss, Hugo Terashima-Marín and Santiago Enrique Conant-Pablos’s 2016 open-access article “Experimental Matching of Instances to Heuristics for Constraint Satisfaction Problems”, DOI 10.1155/2016/7349070, PMCID PMC4753345. It covers the six ordering rules, two instance features, Model-B survey, dominance regions, SHS/DHS selectors and random and structured evidence. Figures are original. The laboratory uses an explicitly synthetic cell map to test the published nearest-rule mechanism.
Verification contract. Five orientation claims, ten accessible animated SVG figures, twelve worked examples, twelve causal probes, twelve memory cards, two reviews and three executable exact tests. British English, source boundaries, reduced-motion support and responsive design are included.
Primary and contextual sources
- Moreno-Scott, J. H., Ortiz-Bayliss, J. C., Terashima-Marín, H., & Conant-Pablos, S. E. (2016). “Experimental Matching of Instances to Heuristics for Constraint Satisfaction Problems.” Computational Intelligence and Neuroscience, Article 7349070. DOI; open full text.
- Rice, J. R. (1976). “The Algorithm Selection Problem.” Advances in Computers, 15, 65–118.
- Brelaz, D. (1979). “New Methods to Color the Vertices of a Graph.” Communications of the ACM, 22, 251–256.
- Gent, I. P., MacIntyre, E., Prosser, P., & Walsh, T. (1996). “The Constrainedness of Search.” AAAI.
- Smith-Miles, K. A. (2009). “Cross-disciplinary Perspectives on Meta-learning for Algorithm Selection.” ACM Computing Surveys, 41(1).
- van Hemert, J. I. (2004). “Evolving Binary Constraint Satisfaction Problem Instances that are Difficult to Solve.” CEC.
- Michel, L., & Van Hentenryck, P. (2012). “Activity-Based Search for Black-Box Constraint Programming Solvers.” CP.
- Boussemart, F., Hemery, F., Lecoutre, C., & Sais, L. (2004). “Boosting Systematic Search by Weighting Constraints.” ECAI.
- Kerschke, P., et al. (2019). “Automated Algorithm Selection: Survey and Perspectives.” Evolutionary Computation, 27, 3–45.