ADAPT: Physics-Aware Diffusion-based World Models for Adaptive Predictive Transferable HVAC Control
An AI that keeps buildings comfortable and efficient even when the season or climate changes, by teaching it the physics of heat
Heating, ventilation and air conditioning (HVAC) accounts for roughly a third of global energy use and CO2 emissions, but controlling it is hard because walls and floors store and slowly release heat, and existing AI controllers fail when deployed in a new season or climate. The authors built ADAPT, a diffusion-model-based predictor that also follows a building heat-balance equation, to forecast how indoor temperature will evolve and guide a reinforcement-learning controller. Compared with the strongest existing method, ADAPT cut energy use by 7.3% and occupant discomfort by 30.2% under matched conditions, and degraded only marginally when tested on unseen seasons or climate regions.
What they did
- Built an 'indoor environmental world model' using a diffusion model that predicts future indoor conditions from limited sensor readings, capturing the building's hidden heat storage.
- Predicts a 'thermal baseline' showing how temperature would evolve if the previous HVAC action were simply held, helping the reinforcement-learning controller judge the delayed effect of its current decision.
- Added a learnable multi-zone heat-balance equation covering heat exchange between zones, with the outdoors, solar radiation, occupant body heat, and HVAC equipment, to keep the diffusion model's predictions physically plausible.
- Tested on SemiBuildingSim (based on a real office building) and the open-source Sinergym simulator, ADAPT reduced energy consumption by 7.3% and occupant discomfort by 30.2% versus the best baseline under matched (in-distribution) conditions.
- Under unseen conditions such as summer-to-winter season transfer and Stockholm-to-Arizona climate transfer, ADAPT showed only marginal performance drop, far more robust than existing approaches.
| Algorithm | Energy (kWh) ↓ Abs PMV ↓ | PPD (%) ↓ | Action Fluctuation ↓ |
|---|---|---|---|
| MPC | 251.00 ± 9.79 | 0.56 ± 0.06 16.20 ± 1.08 | 9.94 ± 1.13 |
| A2C | 247.28 ± 3.21 | 0.48 ± 0.03 13.05 ± 1.46 | 6.02 ± 1.03 |
| PPO | 236.52 ± 2.90 | 0.46 ± 0.04 12.62 ± 0.75 | 4.94 ± 1.46 |
| DQN | 248.41 ± 3.89 | 0.50 ± 0.05 13.02 ± 0.77 | 6.59 ± 0.55 |
| BDQ | 241.87 ± 2.73 | 0.45 ± 0.05 11.40 ± 1.28 | 5.40 ± 0.46 |
| TransformerRL | 233.97 ± 4.36 | 0.42 ± 0.03 11.72 ± 1.62 | 4.66 ± 0.65 |
| Hyperparameter | Value |
|---|---|
| Planning horizon 𝐻 | 6 |
| Number of candidate sequences 𝑁 | 16 |
| Number of elite samples 𝐾 | 4 |
| Planning iterations 𝑀 | 3 |
| Discount factor 𝛾 | 0.98 |
| Hyper-parameter | Value | Hyper-parameter | Value |
|---|---|---|---|
| Optimizer | Adam | Learning rate | 2×10−3 |
| Discount factor 𝛾 | 0.99 | Replay buffer size | 5×105 |
| Batch size | 64 | Exploration 𝜀 | 1.0 → 0.04 |
| Target update interval | 1000 steps | TD(𝜆) parameter | 0.8 |
| Bootstrap horizon 𝐻 | 3 | Forecaster horizon 𝐻fore | 3 |
| Network architecture | (512, 512) | Forecaster History step 𝑇 | 6 |
| Parameter | DQN | BDQ | A2C | PPO | TransformerRL |
|---|---|---|---|---|---|
| Learning rate | 2×10−3 | 2×10−3 | 8×10−4 | 10−3 | 10−3 |
| Discount factor 𝛾 | 0.99 | 0.99 | 0.98 | 0.98 | 0.98 |
| Batch size | 64 | 64 | 40 | 1200 | 1200 |
| Network hidden dim | 256 | 512 | 256 | 256 | 256 |
| GAE 𝜆 | – | – | 0.9 | 0.8 | 0.8 |
| PPO Clip 𝜀 | – | – | – | 0.2 | 0.2 |
| Entropy coef. | – | – | 0 | 0.01 | 0.01 |
| Parameter | MBVE | MBPO | DreamerV3 |
|---|---|---|---|
| Rollout / Imagination horizon | 8 | 8 | 8 |
| Transitions / Starts per iter. | 256 | 1024 | 256 |
| Blend / Return 𝜆 | 1.0 | – | 0.95 |
| Warmup (iters) | 3 | 3 | 3 |
Why it matters
Because dense indoor sensing is costly and raises privacy concerns, operators often have only limited data from a single season or building, yet still need controllers that work reliably elsewhere; this work shows a path to that kind of transferable control. By combining energy savings, occupant comfort, and physically grounded predictions, it also offers a practical tool aligned with building decarbonization goals.
Terms in this paper
- diffusion model · a generative AI method that starts from random noise and gradually removes it to produce realistic data, here used to forecast future indoor conditions
- thermal inertia · the tendency of walls, floors and furniture to store heat and release it later, delaying the visible effect of HVAC actions
- partially observable Markov decision process (POMDP) · a decision-making framework where the true internal state is hidden and only partial sensor readings are available
- out-of-distribution (OOD) · conditions such as an unseen season or climate that differ from what the model was trained on
- reinforcement learning · an AI training method where a controller learns actions by trial and error to maximize a reward signal
Figures we cannot republish
- Figure 1
- Figure 2
- Figure 3
- Figure 1: Overall framework of ADAPT. The training process of ADAPT is divided into two phases. Phase I: Physics-aware Diffusion IEWM Training. Phase II: Online RL Policy Learning. IEWM is frozen during phase II. 3.3 Physics-aware Thermal Regularization The conditional diffusion IEWM can effectively model offline trajec- tories. However, vanilla data-driven learning may exploit domain- specific st
- Figure 1: Overall framework of ADAPT. The training process of ADAPT is divided into two phases. Phase I: Physics-aware Diffusion IEWM Training. Phase II: Online RL Policy Learning. IEWM is frozen during phase II. 3.3 Physics-aware Thermal Regularization The conditional diffusion IEWM can effectively model offline trajec- tories. However, vanilla data-driven learning may exploit domain- specific st
- Figure 7
- Figure 8
- Figure 9
- Figure 10
- Figure 11
Original abstract (English)
Buildings account for roughly one-third of global energy consumption and CO$_2$ emissions. Optimizing indoor climate systems plays a critical role for urban climate mitigation aligned with UN Sustainable Development Goals 11 and 13. However, indoor delayed thermodynamic responses and partial observability severely hinder existing methods, which are primarily limited by implicit thermal inertia, occupancy dynamic prediction, and cumulative prediction errors, especially for out-of-distribution environments. In practice, these challenges are further exacerbated by the high cost and privacy burden of dense indoor sensing, forcing operators to collect only limited data in a single operating regime while expecting controllers to generalize reliably across unseen seasons and climate regions. To address this problem, we propose ADAPT, a physics-aware conditional diffusion indoor environmental world model for HVAC control. The model predicts a short-horizon held-action thermal baseline to capture the latent thermal inertia of the buildings. The diffusion backbone utilizes the robustness of generative models, while a learnable multi-zone heat-balance regularizer constrains generated trajectories to satisfy transferable building thermodynamics without requiring known building geometry or manually calibrated thermal parameters. A credit assignment is then design for the downstream reinforcement learning. Extensive experiments on SemibuildingSim and Sinergym demonstrate that ADAPT reduces HVAC energy consumption by 7.3\% and occupant discomfort by 30.2\% compared with state-of-the-art baselines under IID control. Under OOD control scenarios spanning unseen seasons and climate regions, ADAPT maintains robust performance with only marginal degradation relative to its IID performance, substantially outperforming existing methods in transfer robustness.
Read on arXivLatest papers
- Specification-delta-driven data governance: an empirical study of the {\guillemotleft}spec-delta{\guillemotright} as the unit of change in lakehouse data platformsTreating data-platform changes like reviewable spec snippets instead of code diffs: an experiment design paper
- Are LLMs becoming similarly creative? Evidence from three years of modelsNewer AI chatbots are giving increasingly similar answers to each other, three years of data show
- Auditing Cross-Lingual Fairness in Language Model WatermarkingAI text watermarks that are supposed to catch machine-written content work far less reliably in many non-English languages, and the gap tracks language families, not individual languages
- TESTNAV: Pareto-Guided Search for Compositional Robustness TestingA smarter way to test AI models against combined real-world glitches, without checking every possible combination
- Optimal Skill Selection for LLM Agents with Provable Bicriteria GuaranteesA method that picks which 'skill documents' to feed an AI coding agent, with mathematically guaranteed near-optimal results
- Reliable Financial Named Entity Recognition under Domain ShiftAn AI's confidence trained on formal filings turns unreliable once it reads tweets
- FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM ServingMaking sparse attention fast enough and accurate enough for real LLM serving, not just papers
- Robust Incomplete Multimodal Sentiment Analysis via Iterative Proxy CorrectionWhen text input is missing or broken, this AI doesn't guess once and move on—it revises its guess step by step to read emotions more reliably
Latest from METAL LAB
- Google Discover adds chatbot that adjusts your feed based on spoken preferences
- OpenAI Closes In on Anthropic Again in Enterprise Spending Share
- Meta Unveils First 10 Tasks in WildArtifactBench, a Benchmark for AI Agents
- Musk: "Optimus + Grok will one day handle healthcare for all humanity"
- 35% of Web Pages Published Since ChatGPT Show Signs of AI Authorship
Figures: Xu Yang et al., arXiv:2608.19804, CC BY 4.0