Skip to content

feat(data): fill missing software and website fields from their cited Wikidata items - #312

Merged
Seungpyo1007 merged 1 commit into
developfrom
feat/wikidata-fill-software-website
Sep 27, 2026
Merged

Seungpyo1007 merged 1 commit into
developfrom
feat/wikidata-fill-software-website

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Sep 27, 2026 •

Copy link
Copy Markdown
Member

What & why

Fills absent fields in software and website records from the Wikidata item each record already cites (source_urls). Generated by python -m app.ingest.wikidata_fill --apply (GetTechAPI/TechEngine#106). Closes #295 (link only).

Category Records Fields added
software 9,655 programming_languages 9,157, operating_systems 741, developers 102, licenses 37, release_date 13, publishers 10, genres 8
website 103 homepage_url 25, launch_date 54 (dates from 1991 on only), languages 34, owners 43
  • Only absent/empty fields are filled; a check across all 9,758 files found 0 changed existing values.
  • Item-valued properties use English labels, preferred rank first, with deprecated statements skipped. Redirected or missing items are skipped.
  • Dates need day precision (the schema has no year-only form). Website launch_date comes from P571 (inception) and ignores dates before 1991, so a newspaper's founding year is not written as its site launch.

Effect on scoring: software green 216 → 366, website green 7,623 → 7,673.

Source

Wikidata (already cited by every changed record).

Checklist

  • The PR targets develop
  • python -m app.validate passes locally
  • No slugs or paths changed

… Wikidata items

Adds values only where the field was absent, taken from the Wikidata item each
record already cites: programming languages (9,157), operating systems (741),
developers (102), licenses (37), release dates (13) and publishers/genres for
9,655 software records; homepage, launch date (1991 or later only), languages
and owners for 103 websites. No existing value changes.

Refs #295
@github-actions github-actions Bot added data Dataset changes enhancement New feature or request labels Sep 27, 2026
@Seungpyo1007
Seungpyo1007 merged commit 0af3c00 into develop Sep 27, 2026
5 checks passed
Seungpyo1007 added a commit that referenced this pull request Sep 27, 2026
…idata-filled software fields

Publishes the software/website, CPU, GPU and SoC promotions from #309-#313 and
the fields filled from each software and website record's Wikidata item (#312).

Refs #1
@Seungpyo1007
Seungpyo1007 deleted the feat/wikidata-fill-software-website branch September 30, 2026 08:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Data collection: new records (workstream)

1 participant