Skip to content

feat(rsl-rl): support DM Control Suite environments - #356

Open
sylvesterkaczmarek wants to merge 1 commit into
google-deepmind:mainfrom
sylvesterkaczmarek:fix/dm-control-rsl-rl-111
Open

sylvesterkaczmarek wants to merge 1 commit into
google-deepmind:mainfrom
sylvesterkaczmarek:fix/dm-control-rsl-rl-111

Conversation

@sylvesterkaczmarek

Copy link
Copy Markdown

Fixes #111

Summary

  • add a baseline RSL-RL PPO config for DeepMind Control Suite environments
  • reuse the existing DM Control Brax PPO learning rate, discount, entropy, and rollout-length settings where they map directly to RSL-RL
  • route DM Control environments through train_rsl_rl.py
  • add regression coverage for the config mapping and required RSL-RL runner fields

Notes

This provides a runnable baseline rather than claiming per-task RSL-RL tuning. The task-specific settings already present in the DM Control Brax PPO config are preserved where they have direct RSL-RL equivalents, while the remaining runner defaults follow the existing RSL-RL configs in this repository.

Testing

Added focused tests in mujoco_playground/_src/dm_control_suite/dm_control_suite_params_test.py.

@sylvesterkaczmarek
sylvesterkaczmarek force-pushed the fix/dm-control-rsl-rl-111 branch from 365ba18 to a300ad0 Compare August 26, 2026 09:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Modifying train rsl_rl for DeepMind Control Suite

1 participant