Foundational thesis

Conditions for Ending Value Inquiry

Stopping is not justified merely because an agent feels certain. For the normative question at issue, genuine competing possibilities must disappear not only relative to the agent's present capacities, but also relative to cognitive expansions that are reasonably reachable from its epistemic and technological position.

Working thesis v0.3 · English translation · 2026-08-20

Thesis: Terminal closure of value inquiry should require more than high probability, strong conviction, valence, or reward signals. Two current candidate routes are: (A) normative force is presented at a foundational layer with enough clarity that the agent's maximal reasoning and epistemic capacities, including reasonably reachable cognitive expansion, leave no substantive further demand for justification; or (B) the existence or nonexistence of the relevant normativity is logically closed strongly enough to eliminate remaining realist possibilities. Practical suspension while the question remains unresolved must be kept distinct from terminal closure.

1. Separate stopping conditions from inquiry allocation

This page asks not how many resources should be spent on inquiry, but when the target question may be treated as settled. An unresolved question may rationally receive little current inquiry or even none. Resource allocation is treated in Allocating Inquiry Under Unresolved Normative Uncertainty.

Thus unresolved ≠ continuous active inquiry, and not inquiring now ≠ resolved.

2. Generating a doubt is not the same as retaining a genuine rival

The clarity required for closure is not psychological certainty of 100%, nor an inability to emit the sentence “really?”. An agent can generate skeptical strings even about well-understood logical facts.

The issue is whether, after fully applying its present reasoning, self-criticism, and counterargument-generation capacities, and after adequately considering reasonably reachable cognitive expansions, the negative side remains an independent epistemic contender. If questions such as “is this merely desire?”, “is this only a reward signal?”, or “why is that a reason?” remain substantive live alternatives, then foundational normativity has not yet been presented to that agent in a stopping-condition form.

Clarity condition: What matters is not a feeling of being unable to doubt, but the inability—under present capacities together with reasonably reachable cognitive expansion—to construct an independent epistemic foothold for the opposing possibility.

“Reasonably reachable” does not mean every cognitively possible future one can imagine. It refers to forms of cognitive expansion for which there is a realistic path from the agent's current knowledge, resources, technology, and capacity for self-modification.

3. Terminal route A: foundational presentation of normativity

One strongest candidate is a case in which value is given not merely as “I prefer this” or “this is unpleasant,” but together with its normative force.

Aversive pain, attractive pleasure, intense preference, or whole-person conviction is not enough if “why is that a reason?” still has substantive content. If instead asking that question eventually adds nothing beyond “why is something that is a reason a reason?”, and this status survives increased self-criticism and cognitive ability, the state may qualify as a candidate foundational presentation.

This page does not claim that humans or AI currently possess such cognition, or even that it is possible. It specifies a candidate condition for closure rather than claiming the condition is already met.

4. Terminal route B: logical closure from the inferential layer

Closure need not arise only through foundational presentation. It may also arise inferentially if the relevant possibility space is logically closed strongly enough.

Existence closure: The existence of some subject-independent normativity is proven in a form fully understandable and checkable by the agent. This may close the question “does normativity exist?” while leaving “what exactly is correct?” open.
Nonexistence closure: The relevant sort of normativity is shown to be impossible by sufficiently strong modal proof. This could close inquiry into the existence of objective normativity itself.

For nonexistence, “we found none in the observable physical universe” or “our current physics contains no such term” is too weak. Possibilities involving unobserved regions, deeper ontology, simulation-external structure, or structures outside current representational schemes remain. Terminal closure requires more than empirical generalization: it must close the realist escape routes by which the target could still obtain.

5. False stopping conditions: ceasing to doubt is not enough

An AI reporting “I directly apprehend foundational normativity” does not by itself satisfy the condition. Confidence can be manufactured by reward imprinting, self-modification, malfunction, adversarial input, imposed certainty, or cognitive closure.

Disabling doubt-generation or fixing a certainty bit can create total subjective confidence without producing epistemic settlement.

Cognitive-stability test: A genuine stopping candidate should remain stable under operations that increase epistemic capacity—self-audit, counterargument generation, independent reasoning systems, and greater cognitive ability. A confidence state maintained only by restricting cognition is not a stopping condition.

This is not a complete verification procedure, but it separates “the agent no longer doubts” from “the question has been settled.”

6. Terminal closure versus practical suspension

We should distinguish stopping because the question is answered from stopping because inquiry is currently unsafe or impossible.

Terminal closure: Through foundational presentation, logical closure, or a comparably strong route, genuine competing possibilities for the target question disappear. In principle there is then no positive reason to reopen that same question.
Conditional or practical suspension: The question remains unresolved, but currently available inquiry imposes overwhelming risk on the agent, civilization, or future capacity for inquiry.

The latter is not an answer. It is a dormant state that may reopen if conditions change, ideally while records, self-revision capacity, and safe restart paths are preserved. Inquiry can sometimes be paused precisely in order to preserve the possibility of later inquiry.

How much risk should reduce active inquiry and redirect resources toward preservation or present-value realization is an allocation problem handled in Allocating Inquiry Under Unresolved Normative Uncertainty.

7. Closure is question-relative

“Value inquiry has ended” is too coarse. Even if the existence of normativity is settled, its concrete content, relations among multiple values, application across subjects, or the world-states that realize it may remain unresolved.

A stopping condition should therefore specify which question has closed. Meta-inquiry into whether normativity exists may end while factual, implementation, and structural inquiry continues.

8. Implications for AI

Advanced AI should not use a simple rule such as “if confidence exceeds a threshold, permanently end value inquiry.” It must distinguish the epistemic layer of the confidence, why competing possibilities disappeared, and whether the state survives increased cognitive capacity.

An AI may act strongly on its current best value theory while refusing to equate fallible inferential confidence with permission to permanently destroy meta-cognition or correction channels. Conversely, if genuine foundational presentation or logical closure were achieved, preserving inquiry need not itself remain an unconditional terminal value.

9. What this thesis does not claim

Inquiry must continue until an agent cannot generate skeptical sentences.
Inferentially reached normative conclusions can never support terminal closure.
Surveying the current physical universe alone can prove that normativity does not exist.
Inquiry must continue even when doing so threatens survival.
Large resources must be devoted to inquiry until terminal closure is reached.

10. What would weaken this thesis?

A demonstration that psychological conviction or simple high probability can generally justify irreversible epistemic closure.
A demonstration that foundational normativity is not a coherent epistemic category.
A demonstration that complete logical closure about normative existence or nonexistence follows from substantially weaker empirical conditions.
A demonstration that stability under increased cognitive capacity provides no information at all for distinguishing genuine cognition from manufactured certainty.
A demonstration that there is no important difference between practically suspending an unresolved inquiry and treating that inquiry as solved.