Derivation of the Free Energy Principle from UHM
The functional this page minimises is a cross-entropy, and it does not do what the page claimed. For states , with ,
which is linear in . Its minimum over all CPTP channels is , reached by the channel that sends onto an eigenvector of its largest eigenvalue — not by the self-model . The classical case is the same: is minimised by the point mass on , not by . Example: for the value is at and at .
Retracted for that reason: Theorem 3.1 (registry row 39e) — is not the minimiser; Theorem 4.2 (iii) — the minima of the UHM functional and of Friston's free energy differ; Theorem 4.2 (iv) — fails on the same example (); Theorem 4.3 — the optimum is not ; Corollaries 7.1–7.2, which rest on Theorem 3.1. Four steps of the derivation were wrong, and each is marked where it occurs: §4.1, "" (the difference from is , which depends on ); §4.4, Step 2, which lost ; §4.5, Step 3, " with equality at " (Gibbs' inequality bounds , with the arguments the other way round); §4.5, Step 4, " does not affect the optimal ". The proof of Theorem 3.1 also used " for Lindblad evolution", which holds only for unital generators; for every Lindblad semigroup with a stationary state what holds is that the relative entropy to that state does not increase (Spohn 1978), and UHM's own dynamics lowers the entropy on its way from to the attractor (T-96).
What stands: the categorical definition of (§2); Theorem 4.1 as an identity — on diagonal states the functional equals , the cross-entropy, which is not Friston's free energy; Theorem 5.1. Open — research programme [Pr]: whether minimises any natural functional, and whether Friston's free energy arises as a limit of UHM.
1. Problem Statement
1.1 Two definitions of φ
In UHM, the self-modeling operator φ has two representations:
Canonical definition (categorical):
φ is defined as the left adjoint to the canonical inclusion of subobjects.
Variational characterization (retracted 2026-09-25 — the right-hand side is minimised by a projection onto the top eigenvector of , not by ; box above):
1.2 Questions this document answers
| Question | Status |
|---|---|
| Proof of equivalence of the two definitions | Theorem 3.1 — retracted [✗] |
| Classical limit of the variational principle | Theorem 4.1 [T] — an identity: the limit is the cross-entropy, not Friston's free energy |
| Connection to Friston's FEP | Theorem 4.2 — (iii)–(iv) retracted [✗]; (i)–(ii) are identifications, not theorems |
| Complete reduction of to | Theorem 4.3 — retracted [✗] |
| Justification of vs | Theorem 5.1 [T] |
2. Categorical Foundations
2.1 ∞-topos structure
Let be the ∞-topos of sheaves over the category of density matrices with the Grothendieck topology .
Key elements:
- — subobject classifier
- Characteristic morphism: for
2.2 Subobject category Sub(Γ)
Definition 2.1. is a category whose objects are monomorphisms , and morphisms are commutative triangles.
In the context of UHM, is interpreted as the category of logically consistent states — those satisfying the internal logic .
Key property: In the ∞-topos, is a lattice with greatest element and least element .
2.3 Operator φ as left adjoint
Definition 2.2 (Canonical definition of φ).
is defined as the left adjoint to the canonical inclusion :
Universal property: For all and :
Interpretation: is the best (minimal) logically consistent approximation of .
2.4 φ as co-reflector
From the theory of adjoint functors it follows that:
Lemma 2.1. is a co-reflector:
where the colimit is taken over the diagram of all subobjects .
3. Theorem on Variational Characterization
3.1 Preliminary definitions
Definition 3.1 (Spectral entropy).
For a density matrix with eigenvalues :
Remark: In this context for density matrices. The distinction arises only for non-Hermitian operators (see §5).
Definition 3.2 (Quantum KL-divergence).
For density matrices with :
Definition 3.3 (Variational functional).
where is a CPTP channel (completely positive trace-preserving).
3.2 Central theorem
Let be defined categorically as the left adjoint to the inclusion .
Then:
where is the invariant measure on the state space (uniqueness of is guaranteed by primitivity of the linear part [T]).
Retracted [✗]: the functional is the cross-entropy , minimised by a projection onto the top eigenvector of , not by (box at the top).
3.3 Proof
Retracted [✗] — kept for the record. Step 3 holds only for unital generators; Step 4 (stationarity equals minimal entropy production) is Prigogine's near-equilibrium principle, not a theorem about ; Step 5 introduces an "entropy production" of a channel without derivation; and the conclusion is false (box at the top).
Step 1: Connection of φ with the logical Liouvillian.
From the theorem on stationary distribution:
where is the logical Liouvillian, and the limit is read as the projector onto the zero mode of the linearised generator (only the linear part is primitive; the full has the nontrivial fixed point of T-96 — see the convention note).
Step 2: Dissipative structure of .
has Lindblad form:
where are operators derived from the classifier atoms (see Axiom Ω⁷ §classifier-atoms).
Step 3: Connection of dissipation with entropy.
For Lindblad evolution the following holds (Spohn, 1978):
with equality at the stationary state.
Step 4: Variational formulation of stationarity.
The stationary state is characterized by the condition:
This is equivalent to the minimum of entropy production:
where is the entropy production function.
Step 5: Explicit form of the functional.
For a CPTP channel , the entropy production function has the form (Lindblad, 1975):
With the choice (the initial state as reference):
The identification Γ_ref = Γ is a motivated definition (self-referential minimization), not a derivation from L_Ω. Motivation: autopoiesis (A1) requires that the system minimize the difference between itself and its model, which corresponds to Γ_ref = Γ. Alternative choices (Γ_ref = I/7 or Γ_ref = ρ*) give different functionals. The choice Γ_ref = Γ is the unique one for which the minimum of F coincides with the fixed point of φ (theorem).
[✗] With Γ_ref = Γ the minimum sits at a projection onto the top eigenvector of Γ, which is not the fixed point of φ; the "theorem" in the previous sentence is retracted.
Since does not depend on :
Step 6: Identification.
Taking into account for density matrices (Theorem 5.1):
3.4 Remarks on the proof
Remarks:
- Existence and uniqueness of the invariant measure are guaranteed by primitivity of the linear part [T] (Evans 1977, Spohn 1976)
- The equality holds only for normal operators (Theorem 5.1 [T])
Categorical correctness:
- Steps 1–2 follow from L-unification
- Steps 3–5 use standard open quantum systems theory
- The identification in Step 6 establishes the desired equivalence
[✗] Steps 3–6 do not establish it (box at the top).
4. Classical Limit: Complete Derivation of FEP
This section attempted to show that Friston's FEP is a special case of the UHM variational principle, arising in the transition to the classical limit; the attempt fails (box at the top), and each error is marked where it occurs. The derivation consists of three stages: (i) definition of the classical limit as (decoherence), (ii) reduction of the quantum functional to the classical one, (iii) identification of UHM elements with Friston's constructions. The section concludes with an analysis of what is lost in the classical limit.
4.1 Friston's FEP (original formulation)
According to Friston (2010), an agent interacting with the environment minimizes variational free energy:
where:
- — hidden (latent) states of the world
- — observations (sensory data)
- — recognition density — the agent's internal model
- — generative density — joint model
- — energy of the generative model
- — Shannon entropy of the recognition density
Key inequality (evidence lower bound, ELBO):
Proof: , and .
Equivalent form via KL-divergence:
[✗] Retracted form (2026-09-25): the page previously wrote the right-hand side as . That is the cross-entropy ; it differs from by , which depends on .
4.2 Classical limit of UHM: formalization via
Definition 4.1 (Classical limit of UHM).
The classical limit of UHM is defined by two equivalent conditions:
(a) Decoherence of off-diagonal elements. The density matrix loses coherences:
(b) Zero-reflection limit. The reflection measure tends to its minimum:
Lemma 4.1 (Classical limit).
(a) Decoherence (γ_{ij} → 0 for i ≠ j) implies R → 1/(7·1) = 1/7 (since P → max_i γ_{ii}² ≤ 1, and for equilibrium diagonal Γ: P ≈ 1/7, R ≈ 1).
(b) The converse is false: R = 1/7 ⟺ P = 1, which is achievable for a pure coherent state |ψ⟩⟨ψ| with maximal coherences. The classical limit is defined by condition (a) — decoherence, not through R.
Proof. (a) When for , the purity reduces to . Off-diagonal coherences enter directly into the Gap operator (see Gap dynamics); at all Gap elements vanish: . For an equilibrium diagonal matrix : , . For a single dominant : , .
(b) Counterexample: pure state gives , , but has maximal coherences for all . Therefore is not equivalent to decoherence.
Physical meaning. The classical limit is complete decoherence: the system loses all quantum correlations between dimensions. In terms of consciousness: the system is not integrated (), not reflexive (), has no Gap structure. This is the world of purely classical probabilities.
(c) Restriction of the CPTP channel. In the classical limit, the CPTP channel preserves diagonality:
The channel degenerates into a stochastic matrix — a classical Markov transition.
4.3 Reduction of the quantum functional
In the classical limit ( for ), the UHM variational functional (Definition 3.3) reduces to the classical functional below — the cross-entropy , which is not Friston's variational free energy (§4.1):
Proof.
Step 1 (Spectral entropy → Shannon entropy). For diagonal matrices, eigenvalues coincide with diagonal elements:
This is a direct consequence of Theorem 5.1 ( for density matrices).
Step 2 (Quantum KL → classical KL). For diagonal matrices, the Umegaki quantum divergence reduces:
Step 3 (Substitution). Combining steps 1 and 2:
Remark. The averaging in Theorem 3.1 reduces in the classical limit to the ordinary mathematical expectation over the stationary distribution of a Markov chain (uniqueness guaranteed by primitivity of ).
4.4 Derivation of Friston's classical variational free energy
This subsection attempted the complete derivation of from the variational characterization of ; it fails at Step 2 (marked).
Step 1 (Identification of variables). Within UHM, introduce the identification:
| UHM | FEP (Friston) | Meaning |
|---|---|---|
| (generative density) | Full system state = generative model of the world | |
| (recognition density) | Self-model = approximate inference | |
| Optimal self-model = true posterior | ||
| Variational free energy | ||
| Variational inference |
Step 2 (Expanding the functional). Write in the classical limit:
Simplifying:
[✗] Error (retracted 2026-09-25): the terms cancel, so the sum is , the cross-entropy — not . Everything below that rests on this line falls with it.
In the continuous limit (, sums → integrals):
This was claimed to be exactly Friston's variational free energy; it is not (see the error above).
Step 3 (Equivalent forms). Expanding :
The first term is complexity (deviation from prior), the second is accuracy (expected likelihood). Minimization of = balance of accuracy and complexity — this is the classical analog of balancing spectral entropy and KL-divergence in Theorem 3.1.
Let be the state of a holon in the classical limit ( for ). Then:
(i) The self-modeling operator in the classical limit is identified with the recognition density: .
(ii) The density matrix is identified with the generative model: .
(iii) Minimization of the UHM functional coincides with minimization of Friston's free energy:
(iv) The key inequality (ELBO) is derived automatically:
Closedness of identification [D]. The identification is not an external assumption but the definition of self-reference. In the variational formulation the divergence measures deviation from the system's own state. A self-referential system by definition uses itself as a generative model — this is not an assumption but a tautology of self-modeling.
Retracted [✗]: (iii) the left side equals , the right side is at ; (iv) fails for , where .
Proof of (iv). From the definition of KL-divergence:
Therefore:
Since the stationary state of a primitive Lindbladian maximizes entropy among reachable states (Frigerio, 1978), we have . Therefore, the ELBO lower bound takes the form:
In the classical limit , and the inequality takes the form , if is identified with the entropy of the marginal probability of observations.
[✗] The chain above proves only ; the claimed fails on the example in the box at the top.
4.5 Spectral entropy + KL → variational free energy
This subsection claimed to show explicitly how minimization of the quantum functional in the classical limit becomes minimization of Friston's variational free energy; Steps 3 and 4 are wrong (marked).
Let be a diagonal density matrix, a CPTP channel preserving diagonality. Then the problem
is identical to the problem
where is the -simplex of probability distributions.
Moreover, the minimum is achieved at (recognition density coincides with generative), which corresponds to (identity channel).
Retracted [✗]: the first problem is solved by the point mass on (value ), the second by (value ); they are not the same problem.
Proof.
Step 1 (Parameterization). In the classical limit, optimization over CPTP channels preserving diagonality is equivalent to optimization over stochastic matrices with . The result , where . The set of reachable for fixed is a convex subset of containing (at ).
Step 2 (Explicit functional). By Theorem 4.1:
This is the cross-entropy .
Step 3 (Minimization). The cross-entropy is minimized at (by the Lagrange multiplier method with the constraint , or from the property , with equality at ).
[✗] Error (retracted 2026-09-25): for fixed , is linear in and is minimised by the point mass on ; Gibbs' inequality gives , with the arguments the other way round. Example: gives at and at .
Step 4 (Identification with FEP). Friston's free energy:
Upon discretization :
UHM functional in the classical limit:
The difference is an additive term , which does not depend on and therefore does not affect the optimal for fixed :
Thus, the optimal recognition densities coincide.
[✗] Error (retracted 2026-09-25): depends on , so adding it moves the optimum: , but is the point mass on .
4.6 Correspondence of constructions
Full correspondence table between UHM and FEP:
| UHM construction | FEP construction | Limiting transition |
|---|---|---|
| — generative model | , | |
| — categorical self-model | — optimal recognition density | Bayesian inversion |
| — spectral entropy | — Shannon entropy | |
| — quantum KL | — classical KL | Diagonal limit |
| — variational functional | — free energy | Theorem 4.1 |
| Primitivity of | Ergodicity of Markov chain | Lindblad → Markov generator |
| CPTP channel | Stochastic matrix | Complete positivity → positivity |
| — fixed point | Posterior distribution | Self-modeling → Bayesian inference |
| Markov blanket (algebraic) | Markov blanket (graphical) | → conditional independence graph |
[✗] (2026-09-25): the rows identifying with the optimal recognition density, with Friston's free energy and with the posterior rest on Theorems 4.2 (iii) and 4.3 and are retracted with them; the other rows are notational correspondences.
4.7 What is lost in the classical limit
The transition destroys three fundamental structures of UHM that have no classical analogs.
4.7.1 Coherences (off-diagonal elements)
Quantum coherences () are correlations between the holon's dimensions not describable by classical probabilities.
In the full UHM functional, coherences contribute:
where the quantum remainder:
At this term vanishes: .
Consequence. Classical FEP cannot describe information integration between dimensions ( depends on coherences), quantum qualia (structure of subspaces ), or interference between different aspects of the self-model.
4.7.2 Gap operator
The Gap operator describes opacity between dimensions. In the classical limit:
The Gap structure disappears completely. This means loss of:
- Consciousness bifurcations (discontinuous transitions between regimes)
- Non-Markovian memory effects (Gap oscillations)
- Hamming code H(7,4) in the error correction structure (see Gap dynamics)
4.7.3 Regeneration
The regenerative term of the evolution equation is responsible for nonlinear feedback: the system actively restores coherences rather than passively dissipating.
In the classical limit ():
since regeneration operates on off-diagonal elements. Only the linear dissipation remains, which in the classical limit reduces to a Markov generator:
— the standard Q-matrix of a continuous Markov chain.
Consequence. In the classical limit the UHM functional retains only passive minimization (dissipation); UHM's quantum dynamics adds active regeneration — the system's ability to restore complex structures lost during decoherence. This contrasts two regimes of UHM's own functional; it says nothing against Friston's FEP, which includes action through active inference and has a quantum formulation (§6.3).
4.8 What is preserved: prediction error minimization
Despite the losses, the core of the variational principle survives the classical limit:
The principle "the system minimizes a functional balancing accuracy and complexity" is preserved across all regimes:
| Regime | Functional | Accuracy | Complexity |
|---|---|---|---|
| Quantum (UHM) | |||
| Classical (FEP) |
Prediction error minimization (PEM) is the classical limit of categorical self-modeling .
Retracted [✗]: this rests on Theorems 4.2 (iii) and 4.3; the quantum row's functional is the cross-entropy, whose minimiser is a pure state.
This was offered as the reason Friston's FEP works for classical systems (the brain in the neurocomputational description, biological organisms); with the reduction retracted, it explains nothing.
4.9 Structural diagram
┌─────────────────────────────────────────────────────────────────┐
│ UHM (∞-topos) │
│ │
│ Level 0: Ω (primitive) │
│ ↓ │
│ Level 1: φ ⊣ i (categorical definition) │
│ ↓ │
│ Level 2: φ = lim e^{tℒ_Ω}[Γ] (dynamical) │
│ ↓ │
│ Level 3: φ = argmin [S_spec + D_KL] (T 3.1, retracted ✗) │
│ ↓ │
│ ┌─────────────────────────────────────────────────────────┐ │
│ │ Classical limit: Γ_ij → 0, R → 1/7 │ │
│ │ (lost: coherences, Gap, ℛ) │ │
│ │ ↓ │ │
│ │ ┌───────────────────────────────────────────────────┐ │ │
│ │ │ Friston's FEP: min F = min [⟨E⟩ - H] │ │ │
│ │ │ (SPECIAL CASE: claim retracted ✗) │ │ │
│ │ │ (preserved: prediction error minimization) │ │ │
│ │ └───────────────────────────────────────────────────┘ │ │
│ └─────────────────────────────────────────────────────────┘ │
└─────────────────────────────────────────────────────────────────┘
The arrows from Level 3 down depict the retracted derivation (box at the top); Levels 0–2 are unaffected.
5. S_spec vs S_vN: justification of the choice
5.1 Definitions
Von Neumann entropy:
Spectral entropy:
where are eigenvalues of operator .
5.2 When they coincide
For density matrices (Hermitian, positive semi-definite, unit trace):
Proof: For all , therefore .
5.3 Why use S_spec in UHM?
Reason 1: Generalization to non-Hermitian operators.
In some formalisms (Kraus operators, non-physical states), non-Hermitian operators appear. is defined for them; is not.
Reason 2: Connection to Kolmogorov complexity.
In the original UHM formulation (axiom-omega.md):
— spectral entropy (replacing uncomputable Kolmogorov complexity)
Kolmogorov complexity is uncomputable. serves as a computable upper bound:
5.4 Recommendation
For practical purposes in UHM:
- Use for density matrices (standard quantum theory)
- Keep the notation to indicate the connection with complexity theory
- In documentation indicate: " for density matrices"
6. Comparison with Friston's FEP
6.1 Correspondence table
| Aspect | FEP (Friston) | UHM |
|---|---|---|
| Status | Postulate (phenomenological) | No variational principle for φ: Theorem 3.1 retracted (§3) |
| Domain | Classical distributions in the original formulation; generic quantum systems in Fields, Friston, Glazebrook and Levin (2022) | Density matrices on |
| Operator | Implicit | Explicit CPTP channel |
| Justification | Thermodynamics + Bayesian inference | Categorical adjunction |
| Circularity | Not resolved | Resolved (hierarchy Ω → φ) |
| Time | External parameter | Emergent (▷ on Ω) |
6.2 How did Friston derive FEP without UHM?
Friston used three independent arguments:
1. Information-theoretic (Bayesian):
This is an identity — a consequence of the definition of KL-divergence. FEP postulates that systems minimize F.
2. Thermodynamic:
Fluctuation theorems (Jarzynski, Crooks) connect free energy with non-equilibrium work. Stationary systems minimize F for thermodynamic reasons.
3. Cybernetic (self-organization):
Systems that do not minimize surprise "dissipate" — lose their identity. Survival ≡ minimization of F.
6.3 What UHM adds, and what it does not
1. Categorical justification:
In UHM, φ is defined by the structure of the ∞-topos. That a variational principle follows from it as a consequence was the claim of Theorem 3.1, retracted 2026-09-25; the page therefore has no variational principle for φ to set against the FEP's.
2. Quantum formulation — not a first:
UHM works with density matrices on . That the FEP is confined to classical distributions is not true: Fields, Friston, Glazebrook and Levin formulated it for generic quantum systems in the language of quantum information theory, with quantum systems acting as observers and agents (Prog. Biophys. Mol. Biol. 173, 36–59, 2022; arXiv:2112.15242). What this page set out to add was narrower still — a variational characterisation of its self-model on and a reduction of its decohered limit to the classical variational free energy (§3–§4) — and both are retracted (box at the top). The page does not compare this functional with the Fields et al. formulation, and neither is shown to contain the other.
3. Resolution of circularity:
UHM explicitly constructs the hierarchy: Ω → L_k → ℒ_Ω → φ (see dependency DAG). In FEP the connection between generative model and dynamics is implicit.
4. Emergent time:
In UHM, time is derived from the temporal modality ▷ on Ω. In FEP, time is an external parameter.
7. Consequences for UHM
7.1 Confirmation of consistency
The proof of Theorem 3.1 was taken to confirm the list below; items 1–2 are retracted with it (box at the top):
The variational characterization is a consequence of the categorical definition[✗]The classical limit reproduces Friston's FEP[✗]- UHM's functional is quantum, but a quantum FEP predates it (Fields et al. 2022, §6.3); no relation between the two is proved here
7.2 Clarification of statement status
| Statement | Old status | New status |
|---|---|---|
| φ = argmin [S_spec + D_KL] | "Property 4" | Theorem 3.1 — retracted 2026-09-25 [✗]: the argmin is a projection onto the top eigenvector of Γ |
| Classical limit of the functional | Implicit | Theorem 4.1 [T] (an identity: the limit is the cross-entropy) |
| FEP ⊂ UHM | Claimed | Not shown: Theorem 4.2 (iii)–(iv) retracted [✗] |
| Not proven | Not proven: Theorem 4.3 retracted [✗] | |
| S_spec = S_vN for ρ | Not clarified | Theorem 5.1 [T] (proven) |
7.3 New corollaries
Corollary 7.1 (UHM's quantum variational principle) — retracted 2026-09-25 [✗].
The page stated that for quantum systems the generalized principle holds:
where is the initial/reference state. The functional equals , so its minimiser is a projection onto the top eigenvector of — a pure state, not a principle for open systems.
Corollary 7.2 (Thermodynamic interpretation) — retracted 2026-09-25 [✗].
The page stated that minimization of is equivalent to minimization of entropy production in an open quantum system; this rested on Steps 4–5 of the proof of Theorem 3.1, which are not established.
8. Technical Lemmas
Lemma A.1 (Entropy production in Lindblad dynamics)
For :
Corrected 2026-09-25: the inequality holds for unital generators (, for instance all normal). For a general Lindblad generator with a stationary state , what holds is that the relative entropy does not increase, (Spohn 1978; monotonicity of relative entropy under CPTP maps); itself can fall — UHM's dynamics lowers it on the way from to the attractor (T-96).
Lemma A.2 (Uniqueness of stationary state)
If is primitive (no non-trivial subspaces), then .
Lemma A.3 (Convergence to stationary)
For primitive :
9. References
- Friston K. "The free-energy principle: a unified brain theory?" Nature Reviews Neuroscience 11, 127-138 (2010)
- Spohn H. "Entropy production for quantum dynamical semigroups" Journal of Mathematical Physics 19, 1227 (1978)
- Lindblad G. "On the generators of quantum dynamical semigroups" Communications in Mathematical Physics 48, 119-130 (1976)
- Lurie J. "Higher Topos Theory" Princeton University Press (2009)
- Fields C., Friston K., Glazebrook J.F., Levin M. "A free energy principle for generic quantum systems" Progress in Biophysics and Molecular Biology 173, 36-59 (2022); arXiv:2112.15242
10. Summary
Theorems:
- Theorem 3.1 — retracted [✗]: the functional is minimised by a projection onto the top eigenvector of , not by the categorically defined φ
- Theorem 4.1 [T]: In the classical limit (, ) the UHM functional reduces to , the cross-entropy (not Friston's free energy)
- Theorem 4.2 — (iii)–(iv) retracted [✗]: the classical limit of the UHM functional does not reproduce Friston's FEP
- Theorem 4.3 — retracted [✗]: the two minimisation problems have different solutions (point mass on against )
- Theorem 5.1 [T]: for density matrices
Main conclusion (corrected 2026-09-25): the page does not derive Friston's FEP from UHM. What it establishes is Theorem 4.1 (an identity) and Theorem 5.1; whether φ minimises any natural functional, and whether the FEP arises as a limit of UHM, are open — research programme [Pr].
Withdrawn: it concerned the variational principle of Theorem 3.1, retracted above. The box read: the variational principle is compatible with the octonionic interpretation: the norm of () ensures consistency of the metric used in with the algebraic structure of the state space. Bridge [T] (T15). See structural derivation.
Related documents:
- Axiom Ω⁷ — definition of φ
- Formalization of φ — constructive realization
- Theories of consciousness — comparison with FEP