Lazy code colorization - #1792

Merged

tompng merged 26 commits into

ruby:masterfrom

skatkov:lazy-tokens

Sep 2, 2026

Commits on Sep 1, 2026

deferred token stream
skatkov
committed
62ee6e9
minimize tests
skatkov
committed
3997d70
simplify code
skatkov
committed
9a4c121
defer code parsing completely, not partially
skatkov
committed
e8c9ea0
Routed all TokenStream mutators through token_stream
skatkov
committed
b0f8534
file-scoped deferred colorization with one parse, node-ID dispatch, source release, and thread safety
skatkov
committed
e6e1c87
frozen first reads work
skatkov
committed
a99de37
Don't retain every Prism node
skatkov
committed
3c567b6
Loader registration now happens only after method acceptance
skatkov
committed
5aeb918
TokenStream now uses one @token_stream value: eager array or memoizing loader
skatkov
committed
b5cfbc8
Failures retain source and register atomic retry
skatkov
committed
b80411d
simplifications
skatkov
committed
a743cc5
return per-context Mutex to guard against races
skatkov
committed
650067c
Memoized deferred loader results inside collect_tokens
skatkov
committed
5c22044
Workaround for TruffleRuby tests
skatkov
committed
abd2502
Moved call-count coverage into ruby_colorizer_test.rb
skatkov
committed
ac9647e
simplify materialize method
skatkov
committed
a59ee70
remove mutex
skatkov
committed
043e2fa
Simplify loader code
skatkov
committed
cff9eff
split ivar into two
skatkov
committed
3d0529b
Adding #materialized? method
skatkov
committed
c659174
handle token_stream differently
skatkov
committed
6ac06b3
assign stagged_tokens without traversal
skatkov
committed
9138c74
convert into private methods materialized? and materialize
skatkov
committed
43f4cbc
remove line
skatkov
committed
94cec28
Potential fix for pull request finding

skatkov
and
Copilot
committed
8977b6c