How to Navigate Uncertainty About AI Consciousness
We may never prove whether an AI is conscious, but we can check if it has states that would feel good or bad
Whether an AI is conscious is a question science may never be able to settle, which makes it nearly impossible to decide how much moral consideration AI deserves. The author proposes swapping that unanswerable question for a more tractable one: does the AI have states that would count as positive or negative experiences if it were conscious, a property called valence. Applying this shift shows existing safeguard strategies for AI still run into old problems, but a revised version of avoiding the creation of such AI becomes far more workable.
What they did
- The paper frames a moral dilemma: treating potentially sentient AI as insentient risks causing serious harm to entities that may deserve moral standing, while treating insentient AI as sentient risks wasting resources and slowing beneficial AI progress.
- It examines two existing responses, the Precautionary Principle (take protective measures once the probability of AI sentience passes a threshold) and the Avoidance Strategy (never build AI whose consciousness is uncertain), and argues both collapse back into the same intractable problem of assessing AI consciousness.
- The proposed fix is to shift focus from consciousness to valence, states that would be positive or negative to experience if conscious. This mirrors how we can determine sharks lack color vision (no cone cells) without ever resolving whether sharks are conscious at all.
- Applying this shift, the Precautionary Principle still runs into old difficulties in deciding which AIs to cover, but the Avoidance Strategy improves significantly, becoming a ban on creating AI with valenced states rather than AI with merely uncertain consciousness.
- The paper surveys recent empirical work relevant to AI valence, including 'functional emotions' reported in Claude Sonnet 4.5, LLM preference and trade-off experiments, and the 'bliss attractor state' seen when two Claude instances converse freely, while flagging methodological risks like anthropomorphism and anthropocentrism.
Why it matters
For anyone building AI welfare policy or AI ethics guidelines, this offers a way to ask testable questions about AI treatment instead of waiting for an unsolvable answer about machine consciousness. It gives researchers and companies a more concrete research direction, studying valence-like states, rather than being stuck on the hard problem of consciousness.
Terms in this paper
- Valence · the quality of an experience being positive or negative for the subject having it, such as pleasure or pain
- Sentience · the capacity to have conscious experiences that are positive or negative, i.e. valenced consciousness
- Precautionary Principle · the approach of taking protective measures for AI once its estimated probability of sentience crosses a threshold
- Avoidance Strategy · the approach of simply not creating AI whose consciousness status is uncertain
- Hard problem (of consciousness) · the deep difficulty of scientifically explaining why and how physical processes give rise to subjective experience
Original abstract (English)
Given deep uncertainty about the possibility of artificial consciousness, it is unclear how we should treat potentially sentient AI. On the one hand, we could assume insentience but risk doing terrible harms to entities that deserve moral standing. On the other hand, we could assume sentience and instead risk wasting resources on insentient machines. The intractability of questions around AI consciousness mean that this dilemma is hard to escape. I suggest a way out of that shifts from intractable questions of AI consciousness to tractable questions of AI valence. Specifically, we can assess whether an AI has states that would constitute valenced experiences if it were conscious. I show how this is sufficient to ground a responsible approach to the development of potentially conscious AI.
Read on arXivLatest papers
- LoRA-GA$^2$: Low Rank Adaptation with Multi-step Gradient Adaptive AlignmentPeeking at a few early training gradients before fine-tuning starts to set up LoRA smarter
- Remember, Verify, or Ask? Cross-Family Evaluation of Memory Commitment in LLM AgentsAI assistants would rather double-check facts than ask you a question, even when asking is the right call
- Robust Incomplete Multimodal Sentiment Analysis via Iterative Proxy CorrectionWhen text input is missing or broken, this AI doesn't guess once and move on—it revises its guess step by step to read emotions more reliably
- Generating Diverse Personas for User Simulators to Test Interview Dialogue SystemsTo test interview-style chatbots you need many different fake users, so this work has an LLM automatically generate those fake user personalities
- Rethinking Patch Based Multivariate Time Series Forecasting with Semantic Structured PartitioningA new way to slice time series into meaningful chunks instead of arbitrary equal-length pieces
- Reliable Financial Named Entity Recognition under Domain ShiftAn AI's confidence trained on formal filings turns unreliable once it reads tweets
- Bringing analytic rigor to agentic AI for science: The Brain Researcher platform for neuroimaging data analysisA system that makes AI show its work when analyzing brain-imaging data, not just deliver an answer
- GenMatch: An End-to-End Generative Matching Framework for Micro-View Order-Dispatching in Ride-HailingDiDi replaced its multi-step ride-hailing dispatch pipeline with one generative model and saw real-world gains
Latest from METAL LAB
- Google Discover adds chatbot that adjusts your feed based on spoken preferences
- OpenAI Closes In on Anthropic Again in Enterprise Spending Share
- Meta Unveils First 10 Tasks in WildArtifactBench, a Benchmark for AI Agents
- Musk: "Optimus + Grok will one day handle healthcare for all humanity"
- 35% of Web Pages Published Since ChatGPT Show Signs of AI Authorship