Skip to content

Respect exclude patterns in reproducibility test - #5471

Merged
PauloVLB merged 6 commits into
google:masterfrom
emaxx-google:repro-excl-patt
Sep 28, 2026
Merged

PauloVLB merged 6 commits into
google:masterfrom
emaxx-google:repro-excl-patt

Conversation

@emaxx-google

@emaxx-google emaxx-google commented Sep 15, 2026 •

Copy link
Copy Markdown
Contributor

Filter out crashes that match any exclude pattern during the reproducibility test. This fixes the issue that a crash would be treated as allegedly reliably reproducible even if all reproducibility runs matched the exclude pattern.

Before this commit, the exclude patterns (ignore_stacktrace) were checked in a few scenarios (check_for_initial_crash, variant_task, reproduce_with_retries, check_for_bad_build), but not in test_reproduce_reliability.

b/551164285

Filter out crashes that match any exclude pattern during the reproducibility
test. This fixes the issue that a crash would be treated as alleged reliably
reproducible even if all reproducibility runs matched the exclude pattern.

Before this commit, the exclude patterns (ignore_stacktrace) were checked in
a few scenarios (check_for_initial_crash, variant_task, reproduce_with_retries,
check_for_bad_build), but not in test_reproduce_reliability.

b/551164285
@emaxx-google
emaxx-google marked this pull request as ready for review September 15, 2026 20:30
@emaxx-google
emaxx-google requested a review from a team as a code owner September 15, 2026 20:30
@decoNR

decoNR commented Sep 17, 2026

Copy link
Copy Markdown
Contributor

/gcbrun

@decoNR

decoNR commented Sep 17, 2026

Copy link
Copy Markdown
Contributor

/gcbrun

@decoNR

decoNR commented Sep 19, 2026

Copy link
Copy Markdown
Contributor

/gcbrun

Comment thread src/clusterfuzz/_internal/bot/testcase_manager.py Outdated
@PauloVLB

Copy link
Copy Markdown
Collaborator

/gcbrun

@emaxx-google

Copy link
Copy Markdown
Contributor Author

Thanks! Could you please merge it into the tree if this looks good?

@PauloVLB

Copy link
Copy Markdown
Collaborator

/gcbrun

@PauloVLB
PauloVLB merged commit 7f88d73 into google:master Sep 28, 2026
14 of 15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants