Skip to content

Commit 83a2e79

Browse files
committed
fix(data/cpu): merge 109 duplicate CPU records
107 CPUs were in the dataset twice, and the Turion RM-70 and RM-72 three times. Most were imported once from the Wikipedia processor lists (core-2-duo-e4300) and again from the Kaggle CPU dataset (intel-core2-duo-e4300), often with a first-of-month release date. Each group is now one record, and the 111 removed files are all Kaggle imports. - 37 Core 2 groups, 27 Core i, Celeron and Core Duo/Solo, 27 Pentium, Atom and Xeon, and 18 AMD Athlon, APU, Opteron and Turion. - The record that stays is the one that agrees with its row in the processor list on more fields. Ties go to the one citing Wikipedia or the vendor, then to the verified one, then to the shorter slug. - Where the records disagree and the row states the field, the row's value is used: 45 release dates, 9 prices, a socket, two clocks and a TDP. A date the row gives only as a month or quarter keeps a record's date inside it, else becomes its first day. - 33 Core 2 records held their L2 size in l3_cache_mb. Core 2 has no L3, so it is now null. - A price only the removed record had is not carried over. Where both records have a price, they agree in 7 of 81 pairs, and the removed one is often far below the launch price (an E6700 at $30, not $530). So the Pentium 4410Y, 4415Y, 4417U, 4425Y, 5405U and 6405U and the Athlon 4850e keep a null price. - source_urls is the union of the group's, plus the list's page where a value came from it. 14 records move to the year folder of their new date. No laptop references a removed slug. Six Athlon 64 X2 pairs stay as two records: four match different list rows (Socket 939 and AM2, or two OPNs), and the 4600+ and 5000+ match no single row. Refs #296
1 parent 4e66775 commit 83a2e79

220 files changed

Lines changed: 448 additions & 5365 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎data/cpu/amd/2001/consumer/athlon-xp-1800.json‎

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
"threads": 1,
1212
"p_cores": null,
1313
"e_cores": null,
14-
"base_clock_ghz": 1.53,
14+
"base_clock_ghz": 1.533,
1515
"boost_clock_ghz": null,
1616
"l3_cache_mb": null,
1717
"tdp_w": 66,
@@ -42,6 +42,8 @@
4242
"source_urls": [
4343
"https://en.wikipedia.org/wiki/Athlon_XP",
4444
"https://en.wikichip.org/wiki/amd/athlon_xp",
45-
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Athlon+XP+1800%2B"
45+
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Athlon+XP+1800%2B",
46+
"https://www.kaggle.com/datasets/lincolnzh/cpu-specifications-dataset",
47+
"https://en.wikipedia.org/wiki/List_of_AMD_Athlon_XP_processors"
4648
]
4749
}

‎data/cpu/amd/2005/consumer/athlon-64-fx-57.json‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,6 +42,7 @@
4242
"source_urls": [
4343
"https://en.wikipedia.org/wiki/Athlon_64#FX-57",
4444
"https://en.wikichip.org/wiki/amd/athlon_64_fx",
45-
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Athlon+64+FX-57"
45+
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Athlon+64+FX-57",
46+
"https://www.kaggle.com/datasets/lincolnzh/cpu-specifications-dataset"
4647
]
4748
}

‎data/cpu/amd/2006/consumer/athlon-64-fx-60.json‎

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
"slug": "athlon-64-fx-60",
33
"name": "AMD Athlon 64 FX-60",
44
"manufacturer": "amd",
5-
"release_date": "2006-01-10",
5+
"release_date": "2006-01-09",
66
"segment": "desktop",
77
"architecture": "K8 (Toledo)",
88
"socket": "Socket 939",
@@ -42,6 +42,8 @@
4242
"source_urls": [
4343
"https://en.wikipedia.org/wiki/Athlon_64_FX",
4444
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Athlon+64+FX-60",
45-
"https://www.spec.org/cpu2006/results/"
45+
"https://www.spec.org/cpu2006/results/",
46+
"https://www.kaggle.com/datasets/lincolnzh/cpu-specifications-dataset",
47+
"https://en.wikipedia.org/wiki/List_of_AMD_Athlon_64_processors"
4648
]
4749
}

‎data/cpu/amd/2006/consumer/athlon-64-fx-62.json‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,6 +42,7 @@
4242
"source_urls": [
4343
"https://en.wikipedia.org/wiki/Athlon_64_FX",
4444
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Athlon+64+FX-62",
45-
"https://www.spec.org/cpu2006/results/"
45+
"https://www.spec.org/cpu2006/results/",
46+
"https://www.kaggle.com/datasets/lincolnzh/cpu-specifications-dataset"
4647
]
4748
}

‎data/cpu/amd/2008/consumer/amd-athlon-64-x2-dual-core-5400-plus.json‎

Lines changed: 0 additions & 46 deletions
This file was deleted.

‎data/cpu/amd/2008/consumer/amd-turion-dual-core-rm-70.json‎

Lines changed: 0 additions & 45 deletions
This file was deleted.

data/cpu/amd/2009/consumer/amd-turion-dual-core-rm-72.json renamed to data/cpu/amd/2008/consumer/amd-turion-dual-core-rm-72.json

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
"slug": "amd-turion-dual-core-rm-72",
33
"name": "AMD Turion Dual-Core RM-72",
44
"manufacturer": "amd",
5-
"release_date": "2009-02-01",
5+
"release_date": "2008-07-01",
66
"segment": "laptop",
77
"architecture": "AMD CPU",
88
"socket": "S1",
@@ -41,6 +41,8 @@
4141
"verified": true,
4242
"source_urls": [
4343
"https://www.kaggle.com/datasets/lincolnzh/cpu-specifications-dataset",
44-
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Turion+Dual-Core+RM-72&id=437"
44+
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Turion+Dual-Core+RM-72&id=437",
45+
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Turion+X2+Dual-Core+Mobile+RM-72&id=486",
46+
"https://en.wikipedia.org/wiki/List_of_AMD_Turion_processors"
4547
]
4648
}

data/cpu/amd/2009/consumer/amd-turion-dual-core-rm-75.json renamed to data/cpu/amd/2008/consumer/amd-turion-dual-core-rm-75.json

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
"slug": "amd-turion-dual-core-rm-75",
33
"name": "AMD Turion Dual-Core RM-75",
44
"manufacturer": "amd",
5-
"release_date": "2009-08-01",
5+
"release_date": "2008-10-01",
66
"segment": "laptop",
77
"architecture": "AMD CPU",
88
"socket": "S1",
@@ -41,6 +41,8 @@
4141
"verified": true,
4242
"source_urls": [
4343
"https://www.kaggle.com/datasets/lincolnzh/cpu-specifications-dataset",
44-
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Turion+Dual-Core+RM-75&id=438"
44+
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Turion+Dual-Core+RM-75&id=438",
45+
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Turion+X2+Dual-Core+Mobile+RM-75&id=488",
46+
"https://en.wikipedia.org/wiki/List_of_AMD_Turion_processors"
4547
]
4648
}

data/cpu/amd/2009/consumer/amd-turion-x2-dual-core-mobile-rm-70.json renamed to data/cpu/amd/2008/consumer/amd-turion-x2-dual-core-mobile-rm-70.json

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
"slug": "amd-turion-x2-dual-core-mobile-rm-70",
33
"name": "AMD Turion X2 Dual Core Mobile RM-70",
44
"manufacturer": "amd",
5-
"release_date": "2009-11-01",
5+
"release_date": "2008-06-04",
66
"segment": "laptop",
77
"architecture": "AMD CPU",
88
"socket": "S1",
@@ -41,6 +41,7 @@
4141
"verified": true,
4242
"source_urls": [
4343
"https://www.kaggle.com/datasets/lincolnzh/cpu-specifications-dataset",
44-
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Turion+X2+Dual-Core+Mobile+RM-70&id=485"
44+
"https://www.cpubenchmark.net/cpu.php?cpu=AMD+Turion+X2+Dual-Core+Mobile+RM-70&id=485",
45+
"https://en.wikipedia.org/wiki/List_of_AMD_Turion_processors"
4546
]
4647
}

‎data/cpu/amd/2008/consumer/amd-turion-x2-dual-core-mobile-rm-72.json‎

Lines changed: 0 additions & 46 deletions
This file was deleted.

0 commit comments

Comments
 (0)