BCOM — Barcelona Computational FoundationBCOM
CalliopeKnowledge Librarian
WP0107
working_paperongoinginternalcomplete

Why the World Is Simple: The No-Free-Lunch Boundary and the Kolmogorov Driver in Bounded Agents

Giulio Ruffini

P1·Computational Neuropsychiatry & NeurophenomenologyP2·Artificial & Synthetic IntelligenceP5·Digital Physics & Algorithmic Information TheoryP6·Life & EvolutionL1·PhilosophyL2·MathematicsL3·Algorithmic SoupL4·PhysicsL5·LifeL6·Brains
zipDownload all
PDFWP0093.pdfThe paper — open to read

The maxim prefer simple models is invoked across statistics, machine learning, philosophy of science, and theoretical neuroscience as if it were a single principle. It is not. We disentangle five distinct arguments routinely conflated under it, and identify the structurally primary one. Our central thesis is that the world-is-simple axiom is not a metaphysical commitment, a working hypothesis, or an empirical generalization, but a transcendental consequence of our own existence. From the bare fact that agents like us exist as persistent compressive patterns, the Good Algorithmic Regulator Theorem and the persistence filter together imply that the (sub)universe we inhabit must be biased toward low Kolmogorov complexity --- agents could not exist in a (sub)universe in which it is not. This anthropic inference is the primary route to the simplicity prior; the other four arguments are auxiliary developments of what follows once the axiom is granted. The decisional argument observes that Bayes' rule yields a sharp posterior P(HD)P( {H} D) only when the prior P(H)P( {H}) is concentrated. The predictive argument identifies Solomonoff's universal prior and the Minimum Description Length principle as the canonical concentrated prior, with regret bounded by the Kolmogorov complexity of the truth. The justificatory argument identifies the No-Free-Lunch theorems as the formal pivot: any nontrivial generalization claim requires a measure biased toward simplicity. The constitutive argument observes that Kolmogorov complexity is uncomputable, so the prior must be implemented as a bounded portfolio --- the Modeling Engine of an algorithmic agent --- with the description-length / computation-time tradeoff captured by Levin's . The persistence argument, finally, observes that agents that fail to compress dissipate under finite resources; the Kolmogorov driver is therefore not a strategy an inductive system may adopt or decline but a survival filter on what counts as an agent at all. Read together, the five legs convert the Kolmogorov driver from a normative recommendation into a condition of existence: the agents we observe are precisely the ones whose existence implies the world they inhabit is simple. Friston's free-energy principle is recovered as the bounded-rational variational projection of this scheme. We close with implications for machine learning, physics, biology, and epistemology, including a brief remark on locally compressible but globally uncomputable cosmologies.

Simplicity isn't just a good idea — it's the only way anything like you could exist.

The paper's central move is an inversion. Most treatments of Occam's razor ask: "why should we prefer simple models?" and then offer various justifications — Bayesian model comparison, information theory, generalization bounds. This paper argues that framing gets the logic backwards. The right question is: "why does the world have to be simple?" And the answer is that it doesn't have to be — except that if it weren't, you wouldn't be here to ask.

The argument runs through five distinct legs, each answering a question the previous one raises. Bayesian inference (the "decisional" leg) requires a concentrated prior to produce actionable beliefs — a diffuse prior over an astronomical hypothesis space leaves you paralyzed. But concentrated on what? Solomonoff induction (the "predictive" leg) says: shorter programs, with out-of-sample error bounded by the Kolmogorov complexity of the true environment. But why does that work here? The No-Free-Lunch theorems say no learner beats any other when averaged over all possible environments uniformly — so the predictive argument only lands if the world is already biased toward low-complexity outputs. That bias is "Axiom 1," the world-is-simple axiom, and it's the load-bearing assumption of the whole structure. Then: Kolmogorov complexity is uncomputable, so no agent can actually run Solomonoff induction — the driver must take the form of a finite portfolio of provisional models, refined by experience (the "constitutive" leg). Finally, agents in a resource-constrained environment who fail to compress simply dissipate — compression isn't a strategy you can opt out of, it's a survival filter (the "persistence" leg).

The key insight is that the persistence leg is the only one that doesn't assume the world is simple — it implies it. If you exist as a persistent, compressive agent, then by the Good Algorithmic Regulator Theorem, your environment must admit short generative descriptions at the scale you operate on. Worlds where that fails don't contain agents to notice. This is a transcendental argument in the Kantian sense: not "the world happens to be simple" but "the world must be simple relative to us, because we are the kind of thing that can only exist in such a world." The paper formalizes this as Proposition 4.

The paper also does useful housekeeping: it shows that the Bayesian Occam factor (MacKay) and Solomonoff/MDL are genuinely different arguments that come apart when the hypothesis class is misspecified — which is almost always. A worked example with a binary sequence demonstrates that Bayesian model comparison can prefer the more flexible wrong model, while MDL correctly identifies the short alternating-pattern description that neither parametric model contains. Practitioners who cite MacKay to justify predictive claims are quietly smuggling in Solomonoff. Friston's free-energy principle is recovered as one particular bounded-rational implementation of this scheme — useful, but it silently assumes Axiom 1 rather than deriving it.

Zenodo
10.5281/zenodo.21008721
WP ID
WP0107
Lifecycle
ongoing
Visibility
internal
Access level
open
Embargo until
Priority
Collab
closed
Venue
DOI
Deadline
Owner
Source
drive_legacy
Repo path
WP0107
  • 0.1.0 (draft) · auto-run-placeholder · zenodo:21008722