ADAPT: Physics-Aware Diffusion-based World Models for Adaptive Predictive Transferable HVAC Control
An AI that keeps buildings comfortable and efficient even when the season or climate changes, by teaching it the physics of heat
Heating, ventilation and air conditioning (HVAC) accounts for roughly a third of global energy use and CO2 emissions, but controlling it is hard because walls and floors store and slowly release heat, and existing AI controllers fail when deployed in a new season or climate. The authors built ADAPT, a diffusion-model-based predictor that also follows a building heat-balance equation, to forecast how indoor temperature will evolve and guide a reinforcement-learning controller. Compared with the strongest existing method, ADAPT cut energy use by 7.3% and occupant discomfort by 30.2% under matched conditions, and degraded only marginally when tested on unseen seasons or climate regions.
METAL MEDIA explanatory visual
An AI that keeps buildings comfortable and efficient even when the season or climate changes, by teaching it the physics of heat
- 01Built an 'indoor environmental world model' using a diffusion model that predicts future indoor conditions from limited sensor readings, capturing the building's hidden heat storage.
- 02Predicts a 'thermal baseline' showing how temperature would evolve if the previous HVAC action were simply held, helping the reinforcement-learning controller judge the delayed effect of its current decision.
- 03Added a learnable multi-zone heat-balance equation covering heat exchange between zones, with the outdoors, solar radiation, occupant body heat, and HVAC equipment, to keep the diffusion model's predictions physically plausible.
- 04Tested on SemiBuildingSim (based on a real office building) and the open-source Sinergym simulator, ADAPT reduced energy consumption by 7.3% and occupant discomfort by 30.2% versus the best baseline under matched (in-distribution) conditions.
- 05Under unseen conditions such as summer-to-winter season transfer and Stockholm-to-Arizona climate transfer, ADAPT showed only marginal performance drop, far more robust than existing approaches.
What they did
- Built an 'indoor environmental world model' using a diffusion model that predicts future indoor conditions from limited sensor readings, capturing the building's hidden heat storage.
- Predicts a 'thermal baseline' showing how temperature would evolve if the previous HVAC action were simply held, helping the reinforcement-learning controller judge the delayed effect of its current decision.
- Added a learnable multi-zone heat-balance equation covering heat exchange between zones, with the outdoors, solar radiation, occupant body heat, and HVAC equipment, to keep the diffusion model's predictions physically plausible.
- Tested on SemiBuildingSim (based on a real office building) and the open-source Sinergym simulator, ADAPT reduced energy consumption by 7.3% and occupant discomfort by 30.2% versus the best baseline under matched (in-distribution) conditions.
- Under unseen conditions such as summer-to-winter season transfer and Stockholm-to-Arizona climate transfer, ADAPT showed only marginal performance drop, far more robust than existing approaches.
| Algorithm | Energy (kWh) ↓ Abs PMV ↓ | PPD (%) ↓ | Action Fluctuation ↓ |
|---|---|---|---|
| MPC | 251.00 ± 9.79 | 0.56 ± 0.06 16.20 ± 1.08 | 9.94 ± 1.13 |
| A2C | 247.28 ± 3.21 | 0.48 ± 0.03 13.05 ± 1.46 | 6.02 ± 1.03 |
| PPO | 236.52 ± 2.90 | 0.46 ± 0.04 12.62 ± 0.75 | 4.94 ± 1.46 |
| DQN | 248.41 ± 3.89 | 0.50 ± 0.05 13.02 ± 0.77 | 6.59 ± 0.55 |
| BDQ | 241.87 ± 2.73 | 0.45 ± 0.05 11.40 ± 1.28 | 5.40 ± 0.46 |
| TransformerRL | 233.97 ± 4.36 | 0.42 ± 0.03 11.72 ± 1.62 | 4.66 ± 0.65 |
| Hyperparameter | Value |
|---|---|
| Planning horizon 𝐻 | 6 |
| Number of candidate sequences 𝑁 | 16 |
| Number of elite samples 𝐾 | 4 |
| Planning iterations 𝑀 | 3 |
| Discount factor 𝛾 | 0.98 |
| Hyper-parameter | Value | Hyper-parameter | Value |
|---|---|---|---|
| Optimizer | Adam | Learning rate | 2×10−3 |
| Discount factor 𝛾 | 0.99 | Replay buffer size | 5×105 |
| Batch size | 64 | Exploration 𝜀 | 1.0 → 0.04 |
| Target update interval | 1000 steps | TD(𝜆) parameter | 0.8 |
| Bootstrap horizon 𝐻 | 3 | Forecaster horizon 𝐻fore | 3 |
| Network architecture | (512, 512) | Forecaster History step 𝑇 | 6 |
| Parameter | DQN | BDQ | A2C | PPO | TransformerRL |
|---|---|---|---|---|---|
| Learning rate | 2×10−3 | 2×10−3 | 8×10−4 | 10−3 | 10−3 |
| Discount factor 𝛾 | 0.99 | 0.99 | 0.98 | 0.98 | 0.98 |
| Batch size | 64 | 64 | 40 | 1200 | 1200 |
| Network hidden dim | 256 | 512 | 256 | 256 | 256 |
| GAE 𝜆 | – | – | 0.9 | 0.8 | 0.8 |
| PPO Clip 𝜀 | – | – | – | 0.2 | 0.2 |
| Entropy coef. | – | – | 0 | 0.01 | 0.01 |
| Parameter | MBVE | MBPO | DreamerV3 |
|---|---|---|---|
| Rollout / Imagination horizon | 8 | 8 | 8 |
| Transitions / Starts per iter. | 256 | 1024 | 256 |
| Blend / Return 𝜆 | 1.0 | – | 0.95 |
| Warmup (iters) | 3 | 3 | 3 |
Why it matters
Because dense indoor sensing is costly and raises privacy concerns, operators often have only limited data from a single season or building, yet still need controllers that work reliably elsewhere; this work shows a path to that kind of transferable control. By combining energy savings, occupant comfort, and physically grounded predictions, it also offers a practical tool aligned with building decarbonization goals.
Terms in this paper
- diffusion model · a generative AI method that starts from random noise and gradually removes it to produce realistic data, here used to forecast future indoor conditions
- thermal inertia · the tendency of walls, floors and furniture to store heat and release it later, delaying the visible effect of HVAC actions
- partially observable Markov decision process (POMDP) · a decision-making framework where the true internal state is hidden and only partial sensor readings are available
- out-of-distribution (OOD) · conditions such as an unseen season or climate that differ from what the model was trained on
- reinforcement learning · an AI training method where a controller learns actions by trial and error to maximize a reward signal
Figures we cannot republish
- Figure 1
- Figure 2
- Figure 3
- Figure 1: Overall framework of ADAPT. The training process of ADAPT is divided into two phases. Phase I: Physics-aware Diffusion IEWM Training. Phase II: Online RL Policy Learning. IEWM is frozen during phase II. 3.3 Physics-aware Thermal Regularization The conditional diffusion IEWM can effectively model offline trajec- tories. However, vanilla data-driven learning may exploit domain- specific st
- Figure 1: Overall framework of ADAPT. The training process of ADAPT is divided into two phases. Phase I: Physics-aware Diffusion IEWM Training. Phase II: Online RL Policy Learning. IEWM is frozen during phase II. 3.3 Physics-aware Thermal Regularization The conditional diffusion IEWM can effectively model offline trajec- tories. However, vanilla data-driven learning may exploit domain- specific st
- Figure 7
- Figure 8
- Figure 9
- Figure 10
- Figure 11
Original abstract (English)
Buildings account for roughly one-third of global energy consumption and CO$_2$ emissions. Optimizing indoor climate systems plays a critical role for urban climate mitigation aligned with UN Sustainable Development Goals 11 and 13. However, indoor delayed thermodynamic responses and partial observability severely hinder existing methods, which are primarily limited by implicit thermal inertia, occupancy dynamic prediction, and cumulative prediction errors, especially for out-of-distribution environments. In practice, these challenges are further exacerbated by the high cost and privacy burden of dense indoor sensing, forcing operators to collect only limited data in a single operating regime while expecting controllers to generalize reliably across unseen seasons and climate regions. To address this problem, we propose ADAPT, a physics-aware conditional diffusion indoor environmental world model for HVAC control. The model predicts a short-horizon held-action thermal baseline to capture the latent thermal inertia of the buildings. The diffusion backbone utilizes the robustness of generative models, while a learnable multi-zone heat-balance regularizer constrains generated trajectories to satisfy transferable building thermodynamics without requiring known building geometry or manually calibrated thermal parameters. A credit assignment is then design for the downstream reinforcement learning. Extensive experiments on SemibuildingSim and Sinergym demonstrate that ADAPT reduces HVAC energy consumption by 7.3\% and occupant discomfort by 30.2\% compared with state-of-the-art baselines under IID control. Under OOD control scenarios spanning unseen seasons and climate regions, ADAPT maintains robust performance with only marginal degradation relative to its IID performance, substantially outperforming existing methods in transfer robustness.
Read on arXivLatest papers
- SWE-bench Science: Can Coding Agents Resolve Engineering Tasks in Science?AI coding agents were tested on fixing real scientific software, and even the best one failed more than half the time
- FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM ServingMaking sparse attention fast enough and accurate enough for real LLM serving, not just papers
- PolicyGuide: From Guarding One Action to Guiding the Whole Workflow for Policy-Compliant LLM AgentsMaking customer-service AI agents follow the whole procedure, not just avoid one bad action
- EXIMO: VLM Guided Exploration of VLA PoliciesTeaching a robot new chores without human teleoperation, by letting a chatty AI supervise it
- EnvHarness: Awakening Static Worlds for Agent LearningInstead of building new training worlds from scratch, this work adds a plug-in layer that reshapes existing ones around each agent's actual weaknesses
- Bounded Sovereignty and the Control Tax: Pricing AI Oversight When the Deployer Does Not Own the ModelCompanies that rent AI instead of owning it can only do half of AI safety oversight
- PersonalBench: Measuring the Authorship Gap in LLM PersonalizationAI can be prompted to write 'like someone,' but its own voice never fully disappears
- Automated Summarization of Financial News Using Large Language Models and Retrieval-Augmented Generation: An Early Empirical Study (Fall 2023)Testing AI summaries of stock news, the simple approach beat the trendy retrieval-based one
Latest from METAL MEDIA
Figures: Xu Yang et al., arXiv:2608.19804, CC BY 4.0