When Clean Signals Are Not Enough: Detecting Structural Ambiguity for Safe Wearable Stress Classification

arXiv:2608.183972026-08-20

A stress-detecting wearable AI averaged 93% accuracy but totally failed on one person, so researchers built a pre-check that flags risky readings before the AI even makes a guess

Wearable stress classifiers can look great on average while completely missing a specific individual. The researchers found that for Subject 14 in the WESAD dataset, the link between skin conductance and pulse signals weakens right as stress begins, causing a Random Forest model to score F1=0 for that person despite 93.0% mean accuracy overall. They built ICCM, a lightweight monitor that checks whether incoming signals match a person's own baseline before classification, catching part of the anomaly but not fully fixing the missed-stress failure.

What they did

A Random Forest classifier using wearable sensor data (pulse/BVP, skin conductance/EDA, temperature) hit 93.0% mean accuracy on WESAD but got F1=0 for Subject 14, completely missing that person's stress episodes
The team defines this as 'structural ambiguity': each physiological channel looks individually plausible, but the pattern of how the channels relate to each other doesn't match the person's own non-stress baseline
They built ICCM, which computes a subject-specific baseline of how signals normally correlate (using Pearson correlation, max-lag cross-correlation, and Granger-style directional coupling), scores each new 60-second window against that baseline, and routes it into one of three zones: pass to the classifier, defer, or abstain
ICCM requires no retraining of the existing classifier and was tested on WESAD (15 subjects) and Stress-Predict (35 subjects), where overall (pooled) correlation between the ambiguity score and per-subject accuracy was negative and statistically significant
However, removing Subject 14 makes the WESAD correlation disappear, and rank-based correlation tests were not significant either. False-positive counts dropped only slightly (29 to 27, and 94 to 92) without statistical significance, and ICCM withheld only 3 of Subject 14's 21 missed stress windows -- catching part of the problem but not repairing the core failure

TABLE I: Robustness and selective performance. Covered metrics condition on windows receiving a prediction.
	WESAD	Stress-Predict
Subjects	15	35
Mean accuracy / F1	0.930 / 0.799	0.739 / 0.154
Pearson r (p)	−0.607 (.016)	−0.412 (.014)
Spearman ρ (p)	0.016 (.955)	−0.300 (.080)
Pearson without S14	0.185 (.526)	–
FP: model / ICCM	29 / 27	94 / 92
FP: random / confidence	29 / 25	87 / 71
FP paired p	.157	.317
FN: model / ICCM covered	71 / 65	572 / 542
Sensitivity: model / covered	.773 / .781	.129 / .131
Specificity: model / covered	.974 / .975	.951 / .949
Mean abstention / coverage	0.3% / 96.8%	2.5% / 94.4%
Subjects >2-pp accuracy drop	0	2

Why it matters

This exposes a real risk in wearable health AI: strong average accuracy can hide complete failure for specific individuals, which matters directly for patient safety if such systems trigger clinical alerts. The researchers are also explicit that their monitor is an interpretable warning signal, not a validated safety guarantee, which is an important caution against overtrusting wearable AI in real clinical use.

Terms in this paper

WESAD · A widely used wearable stress-detection dataset with physiological recordings from 15 subjects
F1 score · A classification metric combining precision and recall; a score of 0 means the model caught none of the target cases correctly
structural ambiguity · A condition where individual signals look normal but the way they relate to each other doesn't match the person's own baseline pattern
ICCM (Individual Conformal Coupling Monitor) · A pre-inference monitor that checks how well incoming signal patterns match a person's baseline and decides whether to classify, defer, or abstain
LOSO cross-validation · Leave-one-subject-out validation, where each subject is held out as the test case in turn while the model trains on everyone else

Figures we cannot republish

Fig. 1: Aggregate accuracy conceals Subject 14’s missed-stress failure (F1=0). EDA and BVP decouple near stress onset; residual artifacts cannot be excluded.
Fig. 2: ICCM system architecture. Wearable sensor streams (BVP, EDA, TEMP) are passed to the Coupling Divergence Engine within the Orchestrator. During offline calibration, the engine computes a subject-specific hybrid coupling baseline 𝐯0 and baseline distances {D1,…,Dk} from resting-state windows. At inference time, each 60-second window is evaluated using a hybrid coupling vector 𝐯⁡(t) combining Pearson correlation, max-lag cross-correlation, and Granger-style directed coupling, converted to an empirical conformal-style rank score p⁡(t), and routed through a 3-Zone Safety Gate: Zone 1 (p≥α) passes to the classifier, Zone 2 (p≈α) defers to the next window, and Zone 3 (p<α/2) triggers abstention. The term “safe” denotes the system objective, not a clinical guarantee.
Fig. 3: Full-cohort Pearson associations between structural ambiguity and LOSO accuracy. WESAD is high-leverage: excluding Subject 14 gives r=0.185 (p=0.526), and Spearman ρ=0.016 (p=0.955). Stress-Predict Spearman ρ=−0.300 (p=0.080).

See the figures in the original paper →

Original abstract (English)

Wearable stress classifiers can achieve strong average performance while failing completely for a particular individual. On WESAD, a Random Forest reaches 93.0% mean accuracy yet yields F1 = 0 for Subject 14, whose cross-signal coupling weakens near stress onset. We call this structural ambiguity: individually plausible physiological channels form an inter-signal pattern that is poorly supported by the person's non-stress reference. We introduce th

Authors · Saba A. Farahani, Hung Cao, Amir M. Rahmani

Read on arXiv

Latest papers

All papers →