This module contains one single class that simulates controller-system (agent-environment) loops. The system can be of three types:

  • discrete-time deterministic

  • continuous-time deterministic or stochastic

  • discrete-time stochastic (to model Markov decision processes)


  • All vectors are treated as of type [n,]

  • All buffers are treated as of type [L, n] where each row is a vector

  • Buffers are updated from bottom to top


Simulator(system, state_init[, sys_type, …])

Class for simulating closed loops (system-controllers).