Agentic CI: Issue & PR Triage Tracker #562

Activity

1. andreatnvidia

   pinned this issue on Apr 20, 2026
2. github-actions commented on May 11, 2026

   

   github-actionsBot

   on May 11, 2026 – with GitHub Actions

   Last edited by github-actions

   Contributor

   More actions

   Repository Triage Report — 2026-10-26

   Open issues: 58 (57 excluding this tracker) | Open PRs: 10 | Healthy (no action needed): 15 issues, 8 PRs

   ---

   Close as resolved (1)

   #	Title	Action	Evidence	Rationale
   #966	Harden Slurm inference routing, backpressure, and failover	Close (or close once feat/slurm-execution lands on main)	Merged #967 "feat(slurm): harden inference proxy" says Closes #966	Auto-close likely did not fire because #967 targeted the Slurm feature branch, not main.

   Close as duplicate (0)

   No exact duplicates found. Partial overlap (#1033 / #92) is listed under maintainer decision.

   Needs maintainer decision (8)

   #	Title	Action	Evidence	Rationale
   #969	Run Slurm generation without a client image using a versioned vLLM serving image	Confirm acceptance, then close	Merged #970 "Addresses #969", says live-cluster E2E still pending	Implementation is merged; only cluster validation remains.
   #1085	Slurm: support Qwen3.8-capable vLLM runtimes	Decide remaining scope	Merged #1086 removed the version allowlist ("Related to #1085")	#1086 says it does not establish Qwen3.8 compatibility; decide whether to keep this open.
   #1033	Responses API and Vertex AI: model access for a multi-turn benchmark	Split or link to #92	Vertex AI part overlaps #92 (older)	Combined request; the Responses API part is new scope.
   #711	Allow model providers to restrict workflows to approved models	Decide direction	needs-discussion, 150d inactive	Policy/design question with no recorded outcome.
   #677	Add first-class reranking model support	Decide direction	needs-discussion, 160d inactive	Needs a scope decision before anyone can pick it up.
   #354	Add other common params to ChatCompletionInferenceParams	Decide direction	needs-discussion, updated 2026-09-23	Open question on which params to add.
   #352	Ability to control order of multi-modal context along with prompts	Decide direction	needs-discussion + on-roadmap, 157d inactive	On roadmap but design still unresolved.
   #182	Improve validation in structured generation columns	Decide or close	needs-discussion, ~270d inactive	No discussion since January.

   Ready for assignment (10)

   #	Title	Action	Evidence	Rationale
   #1089	Expression column with dtype="int" loses precision above 2**53	Triage + assign	Unlabeled, no assignee, no PR	Narrow dtype-coercion bug with a clear repro.
   #1088	Jinja templates see JSON-scalar-looking string cells as numbers/booleans/None	Triage + assign	Unlabeled, no assignee, no PR	Clear scope; probably the same cell-decoding path as merged #1059/#1062.
   #1082	Preserve existing destination files when dataset exports fail	Assign	bug, no assignee, no PR	Well-scoped write-to-temp-then-rename fix.
   #1056	refactor: finalize dataset directory before media initialization	Assign	task, follow-up named in merged #1051	Small low-priority refactor with scope already defined.
   #1048	get_models: build facades for caller's model configs, with async clients	Triage + assign	Unlabeled, no assignee	Specific API request; needs a triaged label before PRs are accepted.
   #1010	Agent skills hide information in unspecified field	Assign	bug, no assignee, no PR	Docs/skill fix, likely small.
   #956	Expose structured model cost/usage in DatasetCreationResults	Assign	enhancement + triaged, no assignee	Already triaged; scope is clear.
   #741	Public async runs cannot tune row-group horizon/adaptive admission	Assign	bug, updated 2026-10-06	Exposing existing knobs through the public config.
   #503	Add request/response logging hook to native model client	Assign	enhancement, updated 2026-10-06	Well-defined hook point in the model client.
   #246	Update health-checks to account for multi-modality	Assign	enhancement, updated 2026-10-06	Concrete gap in health-check coverage.

   Stuck PR (2)

   #	Title	Action	Evidence	Rationale
   #1075	chore: drop Python 3.10 support	Fix check or waive	1 failing check (require-nvskills-ci), updated 2026-10-23	Gating check fails; companion refactor #1087 already merged.
   #1041	docs: clarify column dependency sources (draft)	Nudge author to sign off	DCO check failing, draft	Fixes #1002; blocked only on DCO sign-off.

   Duplicate PRs (0)

   None. #1070 and #1077 both handle forked children but fix different state (OTel metrics vs sampler RNGs).

   Stale, consider closing (23)

   #	Title	Action	Evidence	Rationale
   #885	Add keyed execution for group-scoped consistent generation	Close or re-prioritize	66d, no assignee	No traction since filing.
   #862	Support es_SV locale in PersonSampler / managed datasets	Close or re-prioritize	75d, no assignee	Depends on a dataset that does not exist yet.
   #860	Expose terminal failed-column and seed-row provenance in public results	Close or re-prioritize	75d, no assignee	No follow-up.
   #837	chore: consolidate docs/ and fern/ into one documentation tree	Close or re-prioritize	88d, no assignee	docs/ still exists; not started.
   #809	refactor: interface-layer OpenTelemetry runtime follow-ups	Close or re-prioritize	110d, no assignee	Deferred follow-ups never picked up.
   #804	Harden Agentic CI PR reviews for forked pull requests	Re-check vs #1081	111d, no assignee	Open PR #1081 moves PR reviews to Autobot, which may make this moot.
   #790	feat: generate an exact number of rows matching a declared criterion	Close or re-prioritize	117d, no assignee	Feature request with no traction.
   #694	Consolidate user configuration into a single TOML file	Close or re-prioritize	110d, no assignee	No traction.
   #760	enforce from __future__ import annotations via ruff FA102	Close or re-prioritize	129d, no assignee	Still not enabled in ruff config.
   #758	Native provider request support for non-chat plugin model calls	Close or re-prioritize	131d, no assignee	No traction.
   #695	Report per-column idle time in end-of-run metrics	Fold into #645 epic or close	158d, no assignee	Overlaps the async observability epic #645.
   #660	Document async scheduling architecture, capacity, and operations	Fold into #645 epic or close	165d, no assignee	Plan item under #645 with no activity.
   #659	uv tool update removes DataDesigner plugin installs	Close or re-prioritize	165d, no assignee	User-facing bug with no follow-up.
   #651	Design resource-vector and provider-aware admission policies	Fold into #645 epic or close	158d, no assignee	Spike with no activity.
   #637	Split docs preview build and deploy workflows	Re-check vs merged #976/#1032	166d, no assignee	Recent Fern CI work may cover part of this.
   #619	Push Data Designer datasets to Harbor Hub	Close or re-prioritize	172d, no assignee	No traction.
   #601	tests: cover structural_impact.py pure helpers	Close or re-prioritize	175d, no assignee	Small agentic-ci tooling task, never picked up.
   #573	Concrete schemas for all nemotron-personas datasets	Close or re-prioritize	185d, no assignee	New persona datasets (#1061) have landed since; scope may have changed.
   #563	Skill: auto-port custom columns to plugin packages	Close or re-prioritize	189d, no assignee	No traction.
   #386	Add structured metadata to log records	Close or re-prioritize	199d, no assignee	No traction.
   #362	Allow keeping failed-to-parse record fields as null	Close or re-prioritize	231d, no assignee	No traction.
   #211	Batch-level error rates for early shutdown	Confirm roadmap or close	179d, on-roadmap	On roadmap but untouched for six months.
   #400	Enable non-existent tool fallback with MCP server	Assign or close	Updated 2026-10-06, created 228d ago	Recently bumped but still has no owner (listed here, not under assignment, because it is old).

   ---

   Healthy items (15 issues + tracker, 8 PRs)

   Issues:

   • Support external model providers in Slurm runs #1079 Support external model providers in Slurm runs — dhruvnathawani — 2026-10-23 (PR feat(slurm): support hosted models through native DD provider settings #1080)
   • Children forked after a run generate identical sampler data #1076 Children forked after a run generate identical sampler data — binaryaaron — 2026-10-22 (PR fix: reseed shared sampler RNGs in forked children #1077)
   • ValidationColumnConfig misaligns rows and discards the whole batch after an upstream row is dropped #1073 ValidationColumnConfig misaligns rows after an upstream row is dropped — suryapilla — 2026-10-23 (PR fix: align validation results with input index #1078)
   • chore: remove nbconvert workaround after upstream nh3 release #1054 chore: remove nbconvert workaround after upstream nh3 release — andreatnvidia — 2026-10-19 (blocked on upstream)
   • Codex rollout reader drops raw reasoning from open-model servers #1017 Codex rollout reader drops raw reasoning from open-model servers — jiwasawa — 2026-10-21 (PR fix: read raw Codex reasoning content #1063)
   • docs: required_columns description is incomplete for LLM and multimodal columns #1002 docs: required_columns description is incomplete — Khprateek — 2026-10-16 (PR docs: clarify column dependency sources #1041)
   • Persist allocation-local performance telemetry for Slurm runs and benchmarks #947 Persist allocation-local performance telemetry for Slurm runs — andreatnvidia — 2026-09-17 (Slurm epic Epic: Slurm batch execution v1 #850)
   • Decouple HTTP connection pool limits from max_parallel_requests at high concurrency #946 Decouple HTTP connection pool limits from max_parallel_requests — andreatnvidia — 2026-09-22 (partially addressed by fix: shard async HTTP connection pools #955; investigation ongoing)
   • Support more types of Model Providers like VertexAI and Bedrock #92 Support more Model Providers like VertexAI and Bedrock — kirit93 — 2026-09-29
   • Epic: Slurm batch execution v1 #850 Epic: Slurm batch execution v1 — andreatnvidia — 2026-09-29 (PR feat(slurm): integrate Slurm execution for 1.0.0 release #1040)
   • Harden the Slurm runtime and validate sealed release artifacts #870 Harden the Slurm runtime and validate sealed release artifacts — nabinchha (assigned) — 2026-08-15
   • Public async runs do not expose capacity diagnostics needed to explain endpoint idle time #727 Public async runs do not expose capacity diagnostics — eric-tramel (assigned) — 2026-09-17
   • Epic: Async Scheduling Resource Metadata, Admission, and Observability #645 Epic: Async Scheduling Resource Metadata, Admission, and Observability — eric-tramel (assigned) — 2026-05-14
   • refactor: introduce AsyncRunController and explicit sinks for async build/preview #447 refactor: introduce AsyncRunController and explicit sinks — andreatnvidia (assigned) — 2026-03-25 (assigned but inactive for 7 months)
   • Add more stages to processors, and allow for custom processors via callbacks #159 Add more stages to processors / custom processors via callbacks — andreatnvidia (assigned) — 2026-03-02 (assigned but inactive for ~8 months)
   • Agentic CI: Issue & PR Triage Tracker #562 Agentic CI: Issue & PR Triage Tracker — andreatnvidia — tracking issue

   PRs:

   • docs(agentic-ci): replace removed ThrottleManager reference in models architecture doc #1090 docs(agentic-ci): replace removed ThrottleManager reference — github-actions — 2026-10-26
   • chore: centralize PR reviews in Autobot #1081 chore: centralize PR reviews in Autobot — andreatnvidia — 2026-10-23
   • feat(slurm): support hosted models through native DD provider settings #1080 feat(slurm): support hosted models through native DD provider settings (draft) — dhruvnathawani — 2026-10-23
   • fix: align validation results with input index #1078 fix: align validation results with input index — suryapilla — 2026-10-23
   • fix: reseed shared sampler RNGs in forked children #1077 fix: reseed shared sampler RNGs in forked children — binaryaaron — 2026-10-23
   • fix: reset OpenTelemetry metrics state in forked children #1070 fix: reset OpenTelemetry metrics state in forked children — binaryaaron — 2026-10-23
   • fix: read raw Codex reasoning content #1063 fix: read raw Codex reasoning content — jiwasawa — 2026-10-26
   • feat(slurm): integrate Slurm execution for 1.0.0 release #1040 feat(slurm): integrate Slurm execution for 1.0.0 release (draft) — nabinchha — 2026-10-24

   Summary

   • 44 items flagged for action across 7 buckets (1 resolved, 0 duplicate, 8 decision, 10 assignment, 2 stuck PRs, 0 duplicate PRs, 23 stale)
   • 2 PRs flagged (2 stuck, 0 duplicate)
   • 23 healthy items (collapsed above); no .agentic-ci-state/ files were available, so there is no repeated-fix-attempt section
3. NVIDIA-NeMo

   deleted a comment from github-actions on May 12, 2026