docs: a fourth rule a first implementation gets wrong - #4
Merged
Merged
Conversation
The page listed three rules a first implementation gets wrong. There is a fourth, and it cost a real run: everything the server knows about an environment lives for exactly one connection, so a client that reconnects and sends the feedback it was holding puts a transition built from an empty observation into the training buffer. Neither side reports an error. Specified in plugrl-protocol SPEC.md section 7.6; the server-side half is plugrl-server#4. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The protocol tour listed three rules a first implementation usually gets wrong. There is a fourth, and it cost a real run.
A reconnect starts from nothing. Everything the server knows about an environment lives for exactly one connection. A client that reconnects and sends the
feedbackit was holding puts a transition built from an empty observation into the training buffer, and neither side reports an error.Added to both the English and Chinese pages, headings renumbered.
mkdocs build --strictpasses.Specified in PlugRL/plugrl-protocol#3 as SPEC §7.6; server-side fix in PlugRL/plugrl-server#4.
🤖 Generated with Claude Code