Skip to content

chore(data): refresh public dump (base_model_slug + image backfill + image_license fields) - #248

Merged
Seungpyo1007 merged 1 commit into
developfrom
dump-refresh/2026-09-25
Sep 25, 2026
Merged

Seungpyo1007 merged 1 commit into
developfrom
dump-refresh/2026-09-25

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Sep 25, 2026 •

Copy link
Copy Markdown
Member

Summary

Catch-up dump refresh after PR #246 (real image backfill) and PR #247 (base_model_slug fill for 31,372 records) — plus this is the first dump to include the image_license/image_attribution fields added in TechEngine PR #84, so every smartphone page picks up those two new (mostly-null) fields.

Closes #1

Test plan

  • python -m app.validate passed

@Seungpyo1007 Seungpyo1007 added the data Dataset changes label Sep 25, 2026
@Seungpyo1007 Seungpyo1007 self-assigned this Sep 25, 2026
@github-actions github-actions Bot added the enhancement New feature or request label Sep 25, 2026
@Seungpyo1007
Seungpyo1007 merged commit e0e6a8f into develop Sep 25, 2026
2 checks passed
@Seungpyo1007
Seungpyo1007 deleted the dump-refresh/2026-09-25 branch September 25, 2026 00:14
@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine change review: PASS

Check Result
python -m app.validate PASS
New hard integrity anomalies vs PR base PASS

Changed data

Category Added Modified Deleted Added verified Added unverified Added Kaggle-sourced
brand 0 0 0 0 0 0
soc 0 0 0 0 0 0
smartphone 0 0 0 0 0 0
tablet 0 0 0 0 0 0
watch 0 0 0 0 0 0
pda 0 0 0 0 0 0
gpu 0 0 0 0 0 0
cpu 0 0 0 0 0 0

Changed record examples

  • No data file changes detected.

Heuristic review

  • Heuristic warnings: none found.

@TechEngineBot

Copy link
Copy Markdown
Member

TechEngine validation stats: PASS

Data summary

Category Total Verified Unverified Missing verified Tracked Verified % of tracked
brand 207 24 183 0 207 11.6%
soc 2104 184 1920 0 2104 8.7%
smartphone 93396 17495 75901 0 93396 18.7%
tablet 3455 248 3207 0 3455 7.2%
watch 433 39 394 0 433 9.0%
pda 140 74 66 0 140 52.9%
gpu 2030 1021 1009 0 2030 50.3%
cpu 4035 2868 1167 0 4035 71.1%
all 105800 21953 83847 0 105800 20.7%

Warning

Tracked verified coverage is below 50% for tablet 7.2% (248/3455), soc 8.7% (184/2104), watch 9.0% (39/433), brand 11.6% (24/207), smartphone 18.7% (17495/93396), all 20.7% (21953/105800).
Tracked coverage excludes records missing the verified field; see the Missing verified column for those records.
This does not fail validation. Keep imported records verified: false until manual audit, but treat this as follow-up verification work before relying on the affected categories as curated data.

Validation notes

  • The integrity gate blocks only hard anomalies introduced by this PR relative to its merge base.
  • Full advisory outlier listings are suppressed on successful runs because they are dataset-wide and mostly stable between PRs.
  • Failure runs still include a detailed log excerpt for debugging.

Key output:

## app.validate
## integrity_check.py (PR head compared with PR base)
loaded CPU=4035 GPU=2030
Integrity section Flagged lines
structural 18
CPU name/tier consistency (desktop mainstream only) 0
CPU single>multi (cinebench/geekbench — should be multi>=single) 0
CPU era-vs-score outliers 8
CPU cross-source ratio outliers (possible wrong-variant) 155
GPU cross-source ratio outliers + sanity 18

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Massive dataset rebuild: CPU + brand + GPU + smartphone + SoC (1989-2026)

2 participants