Skip to content

Merge confirmed near-duplicate GPU records - #282

Merged
Seungpyo1007 merged 2 commits into
developfrom
fix/gpu-near-duplicates
Sep 25, 2026
Merged

Merge confirmed near-duplicate GPU records#282
Seungpyo1007 merged 2 commits into
developfrom
fix/gpu-near-duplicates

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Sep 25, 2026 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Member

GPU records merged

Kept ← removed (newly filled field):

  • instinct-mi250x ← radeon-instinct-mi250x — cuda_cores
  • instinct-mi300x ← radeon-instinct-mi300x — cuda_cores
  • instinct-mi350x ← radeon-instinct-mi350x — cuda_cores
  • instinct-mi355x ← radeon-instinct-mi355x — cuda_cores
  • radeon-rx-9060-xt-8gb ← radeon-rx-9060-xt-8-gb — cuda_cores
  • geforce-gtx-1060-3gb ← geforce-gtx-1060-3-gb — stream_processors
  • geforce-gtx-1060-6gb ← geforce-gtx-1060-6-gb — stream_processors
  • geforce-rtx-5060-laptop ← geforce-rtx-5060-mobile — stream_processors
  • geforce-rtx-5060-ti-8gb ← geforce-rtx-5060-ti-8-gb — stream_processors
  • geforce-rtx-5070-laptop ← geforce-rtx-5070-mobile — stream_processors
  • geforce-rtx-5070-ti-laptop ← geforce-rtx-5070-ti-mobile — stream_processors
  • geforce-rtx-5080-laptop ← geforce-rtx-5080-mobile — stream_processors
  • geforce-rtx-5090-laptop ← geforce-rtx-5090-mobile — stream_processors

All keeper records also gained unique source URLs from the removed record. Each merged pair has the same release year and agrees on populated memory capacity, bus width, and core counts. git grep against origin/develop -- data/laptop found no laptop gpu references to any removed slug.

Skipped pairs

  • instinct-mi210 / radeon-instinct-mi210 — release years 2022 and 2021 differ.
  • instinct-mi325x / radeon-instinct-mi325x — memory capacity conflicts (256 GB versus 288 GB).
  • geforce-rtx-3060-8gb / geforce-rtx-3060-8-gb — release years 2023 and 2022 differ.

Validation

PYTHONIOENCODING=utf-8 python -m app.validate passed.

Closes #1

@github-actions github-actions Bot added data Dataset changes enhancement New feature or request labels Sep 25, 2026
@Seungpyo1007 Seungpyo1007 added bug Something isn't working data Dataset changes labels Sep 25, 2026
@Seungpyo1007 Seungpyo1007 removed their assignment Sep 25, 2026
@github-actions github-actions Bot mentioned this pull request Sep 25, 2026
Open
@Seungpyo1007 Seungpyo1007 removed the enhancement New feature or request label Sep 25, 2026
@Seungpyo1007
Don't copy core counts into the other vendor's field when merging GPUs
e9b25f5 
The merged duplicates stored AMD stream processors as cuda_cores and NVIDIA
CUDA cores as stream_processors. Every keeper already had the count in its
own field, so the copies are dropped.
@Seungpyo1007

Seungpyo1007 commented Sep 25, 2026

Copy link
Copy Markdown
Member Author

Review: the merge copied core counts into the other vendor's field (cuda_cores on AMD Instinct/RX, stream_processors on GeForce). All 13 keepers already held the same count in the correct field, so the latest commit nulls the copies. Pairs and skips look right.

@github-actions github-actions Bot added the enhancement New feature or request label Sep 25, 2026
@Seungpyo1007
Seungpyo1007 merged commit 9b44ac7 into develop Sep 25, 2026
5 checks passed
@Seungpyo1007
Seungpyo1007 deleted the fix/gpu-near-duplicates branch September 25, 2026 12:41
This was referenced Sep 25, 2026
Merged
Merged
Merged
Merged
This was referenced Sep 26, 2026
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@Seungpyo1007 Seungpyo1007

@TechEngineBot TechEngineBot

Labels

bug Something isn't working data Dataset changes enhancement New feature or request

Projects

TechAPI-Project
Status: Done

Milestone

Massive dataset rebuild (1989-2026)

Development

Successfully merging this pull request may close these issues.

TechAPI dataset roadmap and status: all categories (1989-2026)

1 participant

@Seungpyo1007