Propose backend-independent reinforcement learning framework#704
Open
promotesd wants to merge 1 commit into
Open
Propose backend-independent reinforcement learning framework#704promotesd wants to merge 1 commit into
promotesd wants to merge 1 commit into
Conversation
promotesd
marked this pull request as ready for review
July 16, 2026 09:38
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This Draft PR proposes a backend-independent reinforcement-learning architecture for
TurtleBot 4 and asks maintainers to decide package ownership before any implementation
is proposed upstream.
The RFC separates:
Why
RL examples tend to couple reward logic, ROS callbacks, simulator resets, and learning
frameworks. That makes deterministic testing difficult, adds dependencies to unrelated
users, and makes simulator-to-robot transitions unsafe. The proposed boundaries keep
existing TurtleBot 4 packages unchanged and make environment-dependent validation
explicit.
Requested maintainer direction
In particular, I would appreciate guidance on:
or in a dedicated TurtleBot 4 RL repository;
turtlebot4_simulator; andexample.
Scope and impact
This PR adds one RFC document. It does not add packages, dependencies, ROS interfaces,
runtime behavior, or trained models. Follow-up implementation PRs would be split only
after the repository ownership questions are resolved.
Prototype evidence
A full prototype is available for review in
promotesd/turtlebot4#1. Its automated
ROS build, Python/static checks, deterministic Mock integration, documentation, and
dependency review pass. Local environment-dependent validation also completed 100
timestamp-valid Gazebo Harmonic resets. These results demonstrate feasibility; they do
not claim upstream acceptance or physical-robot validation.
Validation
jazzy: one Markdown file onlygit diff --check: passedThis remains a Draft while the architecture and repository split are discussed.