每天早上一封邮件，把昨天的 AI 梳理好订阅邮件

METAL LAB

Spike-based Belief Propagation in Nonlinear Dynamical Systems

arXiv:2608.199072026-08-21

像大脑一样用脉冲信号做概率推理,让神经网络学会控制小车爬坡

这篇论文把模仿大脑神经元通过短暂电脉冲(脉冲信号)传递信息的脉冲神经网络,和在不确定情况下用概率做判断的贝叶斯推理结合起来,提出了一种控制方法。研究者用经典的山地车问题来测试这个方法,该问题中小车动力不足,必须先反向倒退积蓄动能,才能冲上山顶到达目标位置。结果显示,这种基于脉冲的控制器成功让小车到达目标,表现与传统数值计算的参照控制器相似。

他们做了什么

  1. 作者把一种称为置信传播的概率推理方法(通过图上局部消息传递来更新概率估计)直接用脉冲神经网络的动态过程来实现,使系统能够实时估计小车这种非线性、多变量系统的状态并规划下一步动作。
  2. 利用神经工程框架(NEF)把位置、速度等连续数值编码成神经元群体的脉冲活动模式,再用无迹卡尔曼滤波这种近似方法,把经过非线性变换后的分布重新整理成高斯分布(正态分布)。
  3. 实验中用Nengo工具搭建脉冲神经网络,用RxInfer框架自动完成推理计算,分别为重力、摩擦力、引擎力三个部分设置了300个、100个、100个神经元。
  4. 在山地车环境测试中,脉冲控制器和此前研究中的参照式主动推理控制器都表现出先反向移动积蓄动能、再冲向目标的相同策略,并且都成功到达并越过目标位置,说明脉冲方案在质的层面重现了参照方法的控制策略。
Figure 1: (left) The Mountain Car environment; (right) trajectory of the car position when the agent naively applies the maximum forward engine force at every time step. The orange curve shows the resulting position over time, while the dashed green line indicates the goal position. This strategy fails to reach the goal state; see Section 2.
Figure 1: (left) The Mountain Car environment; (right) trajectory of the car position when the agent naively applies the maximum forward engine force at every time step. The orange curve shows the resulting position over time, while the dashed green line indicates the goal position. This strategy fails to reach the goal state; see Section 2.
x˙t=x˙t−1+Fg​(xt−1)+Ff​(x˙t−1)+Fa​(ut)(15a)
xt=xt−1+x˙t,(15b)
Figure 4: NEF-based function transformation between two spiking neural populations. Input signal x is encoded into input currents IP for ensemble P. Synaptic weights W connect population P to population Q, implementing the transformation f⁡(x) implicitly. The decoder DQ reconstructs the output signal z≈f⁡(x) from the spiking activity RQ.
Figure 4: NEF-based function transformation between two spiking neural populations. Input signal x is encoded into input currents IP for ensemble P. Synaptic weights W connect population P to population Q, implementing the transformation f⁡(x) implicitly. The decoder DQ reconstructs the output signal z≈f⁡(x) from the spiking activity RQ.
p⁡(s0)=𝒩⁡(s0|(−0.5, 0), 10−12​I)(23a)
p⁡(uk)=𝒩⁡(uk| 0, 1012).(23b)
Figure 5: Illustration of the unscented transform. A Gaussian distribution is represented by a deterministic set of sigma points, which are propagated through a nonlinear function. The transformed points are then used to reconstruct a Gaussian approximation of the resulting distribution.
Figure 5: Illustration of the unscented transform. A Gaussian distribution is represented by a deterministic set of sigma points, which are propagated through a nonlinear function. The transformed points are then used to reconstruct a Gaussian approximation of the resulting distribution.

为什么重要

脉冲神经网络只在产生脉冲时才计算,天然适合运行在省电的类脑硬件(神经形态芯片)上,这项工作为把概率推理和控制搬到这类低功耗硬件上迈出了一步。它也把计算神经科学和概率控制理论这两个原本各自发展的领域联系了起来。

Figure 6: Comparison of the reference active inference controller (left), versus the proposed controller (right) for the Mountain Car environment. The top panel shows the vehicle position over time, with the dashed horizontal line indicating the goal position. The bottom panel shows the corresponding engine force applied at each time step. Both methods exhibit the characteristic Mountain Car strategy of initially moving away from the goal to build momentum before ascending the hill. In both cases, the vehicle successfully reaches and overshoots the goal position, demonstrating successful task completion.
Figure 6: Comparison of the reference active inference controller (left), versus the proposed controller (right) for the Mountain Car environment. The top panel shows the vehicle position over time, with the dashed horizontal line indicating the goal position. The bottom panel shows the corresponding engine force applied at each time step. Both methods exhibit the characteristic Mountain Car strategy of initially moving away from the goal to build momentum before ascending the hill. In both cases, the vehicle successfully reaches and overshoots the goal position, demonstrating successful task completion.

本文术语

  • 脉冲神经网络(SNN) · 像生物神经元一样通过离散的短暂脉冲而非连续数值来传递信息的人工神经网络
  • 置信传播(Belief Propagation) · 在图结构上仅通过相邻节点间的局部消息交换来更新整体概率分布的推理算法
  • 因子图(factor graph) · 用图的形式表示变量及其之间概率关系(因子)的模型
  • 神经工程框架(NEF) · 一种把连续数值编码解码为神经元群体脉冲活动、并通过突触权重实现函数变换的方法体系
  • 无迹卡尔曼滤波(Unscented Kalman Filter) · 用少量代表性采样点来近似非线性变换后概率分布形状的技术
(b) Proposed (spiking-based) method.
(b) Proposed (spiking-based) method.

论文原文摘要（英文）

This paper presents a Bayesian control framework that integrates spike-based dynamics with probabilistic inference for adaptive control. Bayesian inference is widely regarded as a core computational principle of brain function, providing a normative framework for perception, decision-making, and learning under uncertainty. By combining a biologically inspired spiking neural model with Bayesian inference principles, we propose a brain-like control algorithm capable of operating in uncertain environments. We use the mountain car parking problem as a benchmark with non-linear dynamics. Our results demonstrate that the proposed controller can successfully update states in real time and generate goal-directed action plans through spike-driven dynamics. The results highlight the proposed model's potential as a bridge between computational neuroscience and probabilistic control theory.

作者 · Sepideh Adamiat, Hongye Wang, Wouter M. Kouw, Bert de Vries

在 arXiv 阅读

最新论文

全部论文 →

METAL LAB 最新报道

图片来源： Sepideh Adamiat et al., arXiv:2608.19907, arxiv-nonexclusive