Everything K-culture — comebacks to K-beauty, straight to your inboxGet it in your inbox

METAL MEDIA

Spike-based Belief Propagation in Nonlinear Dynamical Systems

arXiv:2608.199072026-08-21

A brain-like spiking neural network learns to park a car using probabilistic reasoning

This paper combines spiking neural networks, which pass information the way brain neurons do through brief electrical pulses called spikes, with Bayesian inference, a method for reasoning under uncertainty using probabilities. The team tested this on the Mountain Car problem, where an underpowered car must first roll backward to build momentum before it can reach a goal position up a hill. The spike-based controller successfully reached the goal, behaving similarly to a conventional non-spiking controller used as a reference.

METAL MEDIA explanatory visual

A brain-like spiking neural network learns to park a car using probabilistic reasoning

  1. 01The authors built a control method that runs belief propagation, a way of updating probability estimates through local message passing on a graph, directly through spiking neural network dynamics, allowing real-time state estimation and action planning for a nonlinear, multi-variable system.
  2. 02Continuous values like the car's position and velocity are encoded as spike patterns across populations of neurons using the Neural Engineering Framework (NEF), and an Unscented Kalman Filter is used to approximate the resulting distributions as Gaussians after passing through nonlinear functions.
  3. 03The spiking networks were built with the Nengo toolbox and integrated into the RxInfer inference framework, using neuron populations of 300 (gravity component), 100 (friction), and 100 (engine force).
  4. 04In the Mountain Car test, both the spike-based controller and a reference active inference controller from prior work first moved away from the goal to gain momentum, then drove toward and overshot the target, showing the spiking version reproduced the same qualitative control strategy.
An explanatory diagram made by METAL MEDIA, not a figure supplied by the paper's authors.

What they did

  1. The authors built a control method that runs belief propagation, a way of updating probability estimates through local message passing on a graph, directly through spiking neural network dynamics, allowing real-time state estimation and action planning for a nonlinear, multi-variable system.
  2. Continuous values like the car's position and velocity are encoded as spike patterns across populations of neurons using the Neural Engineering Framework (NEF), and an Unscented Kalman Filter is used to approximate the resulting distributions as Gaussians after passing through nonlinear functions.
  3. The spiking networks were built with the Nengo toolbox and integrated into the RxInfer inference framework, using neuron populations of 300 (gravity component), 100 (friction), and 100 (engine force).
  4. In the Mountain Car test, both the spike-based controller and a reference active inference controller from prior work first moved away from the goal to gain momentum, then drove toward and overshot the target, showing the spiking version reproduced the same qualitative control strategy.
Figure 1: (left) The Mountain Car environment; (right) trajectory of the car position when the agent naively applies the maximum forward engine force at every time step. The orange curve shows the resulting position over time, while the dashed green line indicates the goal position. This strategy fails to reach the goal state; see Section 2.
Figure 1: (left) The Mountain Car environment; (right) trajectory of the car position when the agent naively applies the maximum forward engine force at every time step. The orange curve shows the resulting position over time, while the dashed green line indicates the goal position. This strategy fails to reach the goal state; see Section 2.
x˙t=x˙t−1+Fg​(xt−1)+Ff​(x˙t−1)+Fa​(ut)(15a)
xt=xt−1+x˙t,(15b)
Figure 4: NEF-based function transformation between two spiking neural populations. Input signal x is encoded into input currents IP for ensemble P. Synaptic weights W connect population P to population Q, implementing the transformation f⁡(x) implicitly. The decoder DQ reconstructs the output signal z≈f⁡(x) from the spiking activity RQ.
Figure 4: NEF-based function transformation between two spiking neural populations. Input signal x is encoded into input currents IP for ensemble P. Synaptic weights W connect population P to population Q, implementing the transformation f⁡(x) implicitly. The decoder DQ reconstructs the output signal z≈f⁡(x) from the spiking activity RQ.
p⁡(s0)=𝒩⁡(s0|(−0.5, 0), 10−12​I)(23a)
p⁡(uk)=𝒩⁡(uk| 0, 1012).(23b)
Figure 5: Illustration of the unscented transform. A Gaussian distribution is represented by a deterministic set of sigma points, which are propagated through a nonlinear function. The transformed points are then used to reconstruct a Gaussian approximation of the resulting distribution.
Figure 5: Illustration of the unscented transform. A Gaussian distribution is represented by a deterministic set of sigma points, which are propagated through a nonlinear function. The transformed points are then used to reconstruct a Gaussian approximation of the resulting distribution.

Why it matters

Because spiking neural networks only compute when spikes occur, they are well suited to energy-efficient neuromorphic hardware, so this work is a step toward running probabilistic reasoning and control directly on such low-power brain-like chips. It also links two research traditions, computational neuroscience and probabilistic control theory, that had mostly developed separately.

Figure 6: Comparison of the reference active inference controller (left), versus the proposed controller (right) for the Mountain Car environment. The top panel shows the vehicle position over time, with the dashed horizontal line indicating the goal position. The bottom panel shows the corresponding engine force applied at each time step. Both methods exhibit the characteristic Mountain Car strategy of initially moving away from the goal to build momentum before ascending the hill. In both cases, the vehicle successfully reaches and overshoots the goal position, demonstrating successful task completion.
Figure 6: Comparison of the reference active inference controller (left), versus the proposed controller (right) for the Mountain Car environment. The top panel shows the vehicle position over time, with the dashed horizontal line indicating the goal position. The bottom panel shows the corresponding engine force applied at each time step. Both methods exhibit the characteristic Mountain Car strategy of initially moving away from the goal to build momentum before ascending the hill. In both cases, the vehicle successfully reaches and overshoots the goal position, demonstrating successful task completion.

Terms in this paper

  • spiking neural network (SNN) · an artificial neural network that communicates via brief discrete pulses (spikes) like biological neurons, instead of continuous values
  • Belief Propagation · an inference algorithm that updates probability estimates over a graph using only local message exchanges between connected nodes
  • factor graph · a graph representation showing variables and the probabilistic relationships (factors) linking them
  • Neural Engineering Framework (NEF) · a method for encoding and decoding continuous values as neural population spike activity, and implementing function transformations via synaptic weights
  • Unscented Kalman Filter · a technique that approximates how a probability distribution changes after passing through a nonlinear function, using a small set of representative points
(b) Proposed (spiking-based) method.
(b) Proposed (spiking-based) method.

Original abstract (English)

This paper presents a Bayesian control framework that integrates spike-based dynamics with probabilistic inference for adaptive control. Bayesian inference is widely regarded as a core computational principle of brain function, providing a normative framework for perception, decision-making, and learning under uncertainty. By combining a biologically inspired spiking neural model with Bayesian inference principles, we propose a brain-like control algorithm capable of operating in uncertain environments. We use the mountain car parking problem as a benchmark with non-linear dynamics. Our results demonstrate that the proposed controller can successfully update states in real time and generate goal-directed action plans through spike-driven dynamics. The results highlight the proposed model's potential as a bridge between computational neuroscience and probabilistic control theory.

Authors · Sepideh Adamiat, Hongye Wang, Wouter M. Kouw, Bert de Vries

Read on arXiv

Latest papers

All papers →

Latest from METAL MEDIA

Figures: Sepideh Adamiat et al., arXiv:2608.19907, arxiv-nonexclusive