Skip to content

Remove four duplicate GPU slugs from the #258 import - #280

Merged
Seungpyo1007 merged 1 commit into
developfrom
fix/gpu-duplicate-slugs
Sep 25, 2026
Merged

Seungpyo1007 merged 1 commit into
developfrom
fix/gpu-duplicate-slugs

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Sep 25, 2026 •

Copy link
Copy Markdown
Member

Follow-up to #258. Four imported GPUs duplicate existing records under a different slug spelling:

Removed Kept
geforce3-ti500 geforce3-ti-500
rtx-6000-ada-generation rtx-6000-ada
rtx-pro-6000-blackwell-workstation-edition rtx-pro-6000-blackwell-workstation (verified)
rtx-pro-6000-blackwell-max-q-workstation-edition rtx-pro-6000-blackwell-max-q

The import only caught existing slugs that extend the new one (existing.startswith(new + "-")), not the reverse. A full check of today's additions (541 GPU/CPU files, both directions plus punctuation-insensitive) found no other duplicates. The remaining hits are distinct boards (GeForce 256 DDR/SDR, FX 5200 Ultra, GTX 1660 Ti Max-Q, HD 5870 Eyefinity, ...).

#273 already dumped these slugs, so the dump refresh after this PR must git rm their pages.

Closes #1

GeForce3 Ti 500, RTX 6000 Ada Generation and the RTX PRO 6000 Blackwell
Workstation / Max-Q Workstation editions already exist as geforce3-ti-500,
rtx-6000-ada, rtx-pro-6000-blackwell-workstation and
rtx-pro-6000-blackwell-max-q. The import's dedup only caught existing
slugs that extend the new one, not the reverse.
@TechEngineBot

Copy link
Copy Markdown
Member

🔎 Data verification — Tier 0 (offline existence/trust)

Scored by app.verify; posted by TechEngineBot. Informational only — the structural gate (app.validate) is separate and authoritative for merge.

Changed records in this PR

95 record(s) scored.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 76
    "Yellow" : 19
    "Red" : 0
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
soc 🟩🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨 9 2 7 0 22.2%
smartphone 🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨 12 0 12 0 0.0%
watch 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 37 37 0 0 100.0%
cpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩 37 37 0 0 100.0%
All 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨🟨 95 76 19 0 80.0%

Full-dataset baseline

106352 record(s) scored.

%%{init: {"theme":"base","themeVariables":{"pie1":"#3fb950","pie2":"#d29922","pie3":"#f85149","pieStrokeWidth":"0px","pieOpacity":"1"}}}%%
pie showData
    title Verification bands — all records
    "Green" : 24193
    "Yellow" : 81064
    "Red" : 1095
Loading
Category Distribution Total 🟢 🟡 🔴 🟢 %
brand 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 207 122 85 0 58.9%
soc 🟩🟨🟨🟨🟨🟨🟥🟥🟥🟥🟥🟥 2105 253 831 1021 12.0%
smartphone 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 93407 17931 75408 68 19.2%
tablet 🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 3455 291 3163 1 8.4%
watch 🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟨🟥 442 80 358 4 18.1%
pda 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 140 83 57 0 59.3%
gpu 🟩🟩🟩🟩🟩🟩🟩🟨🟨🟨🟨🟨 2089 1270 819 0 60.8%
cpu 🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟨🟥 4507 4163 343 1 92.4%
All 🟩🟩🟩🟨🟨🟨🟨🟨🟨🟨🟨🟥 106352 24193 81064 1095 22.7%

Hard violations (forced red):

Count Check
1 !boost_ge_base

green = authoritative source + complete + consistent · yellow = plausible, needs confirmation · red = sparse/weak source or a hard contradiction. Promotion to verified runs in the scheduled verify-network workflow.

@Seungpyo1007
Seungpyo1007 merged commit 351eb47 into develop Sep 25, 2026
5 checks passed
@Seungpyo1007
Seungpyo1007 deleted the fix/gpu-duplicate-slugs branch September 25, 2026 12:17
@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine change review: PASS

Check Result
python -m app.validate PASS
New hard integrity anomalies vs PR base PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 0 0 0 0 0
smartphone 0 0 0 0 0 0
tablet 0 0 0 0 0 0
watch 0 0 0 0 0 0
pda 0 0 0 0 0 0
gpu 0 0 4 0 0 0
cpu 0 0 0 0 0 0

Changed record examples

gpu deleted

  • gpu/nvidia/2001/consumer/geforce3-ti500.json - GeForce3 Ti500
  • gpu/nvidia/2022/enterprise/rtx-6000-ada-generation.json - RTX 6000 Ada Generation
  • gpu/nvidia/2025/enterprise/rtx-pro-6000-blackwell-max-q-workstation-edition.json - RTX PRO 6000 Blackwell Max-Q Workstation Edition
  • gpu/nvidia/2025/enterprise/rtx-pro-6000-blackwell-workstation-edition.json - RTX PRO 6000 Blackwell Workstation Edition

Heuristic review

  • Heuristic warnings: none found.

@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine validation stats: PASS

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 207 122 85 0 207 58.9%
soc 2105 193 1912 0 2105 9.2%
smartphone 93407 17501 75906 0 93407 18.7%
tablet 3455 273 3182 0 3455 7.9%
watch 442 39 403 0 442 8.8%
pda 140 74 66 0 140 52.9%
gpu 2089 1028 1061 0 2089 49.2%
cpu 4507 2869 1638 0 4507 63.7%
all 106352 22099 84253 0 106352 20.8%

Warning

Tracked verified coverage is below 50% for tablet 7.9% (273/3455), watch 8.8% (39/442), soc 9.2% (193/2105), smartphone 18.7% (17501/93407), all 20.8% (22099/106352), gpu 49.2% (1028/2089).
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • The integrity gate blocks only hard anomalies introduced by this PR relative to its merge base.
  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py (PR head compared with PR base)
loaded CPU=4507 GPU=2089
Integrity section Flagged lines
structural 18
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 8
CPU cross-source ratio outliers (possible wrong-variant) 155
GPU cross-source ratio outliers + sanity 18

Seungpyo1007 added a commit that referenced this pull request Sep 25, 2026
Xeon thread-count imports, 2025 watches, 2025-2026 phones, Apple S6-S10
and A20 Pro SoCs, and the tablet SoC, Apple Watch, RAM and duplicate-GPU
corrections merged into develop through ca602c8. Removes the pages of the
four duplicate GPU slugs dropped in #280.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Massive dataset rebuild: CPU + brand + GPU + smartphone + SoC (1989-2026)

2 participants