Simulink Environments

Model reinforcement learning environment dynamics using Simulink® models

In a reinforcement learning scenario, the environment models the dynamics with which the agent interacts. The environment:

  1. Receives actions from the agent

  2. Outputs observations resulting from the dynamic behavior of the environment model

  3. Generates a reward measuring how well the action contributes to achieving the task

You can create predefined and custom environments using Simulink models. For more information, see Create Simulink Environments for Reinforcement Learning.

Functions

expand all

rlPredefinedEnvCreate a predefined reinforcement learning environment
rlSimulinkEnvCreate reinforcement learning environment using dynamic model implemented in Simulink
createIntegratedEnvCreate Simulink model for reinforcement learning, using reference model as environment
validateEnvironmentValidate custom reinforcement learning environment
rlFiniteSetSpecCreate discrete action or observation data specifications for reinforcement learning environments
rlNumericSpecCreate continuous action or observation data specifications for reinforcement learning environments
getActionInfoObtain action data specifications from reinforcement learning environment or agent
getObservationInfoObtain observation data specifications from reinforcement learning environment or agent
bus2RLSpecCreate reinforcement learning data specifications for elements of a Simulink bus

Blocks

RL AgentReinforcement learning agent

Topics

Create Simulink Environments for Reinforcement Learning

Model environment dynamics using a Simulink model that interacts with the agent, generating rewards and observations in response to agent actions.

Define Reward Signals

Create a reward signal that measures how successful the agent is at achieving its goal.

Load Predefined Simulink Environments

You can train agents in environments for predefined Simulink models for which the actions, observations, rewards, and dynamics are already defined.

Water Tank Reinforcement Learning Environment Model

Create a reinforcement learning Simulink environment that contains an RL Agent block in place of a controller for the water level in a tank.