feat: replace Kaggle CSV with Wikipedia scraper for historical match data

Add scripts/scrape-wikipedia.ts that fetches all 22 World Cups (1930–2022)
from English Wikipedia via MediaWiki API, handles group sub-pages, AET/penalty
detection, and goal parsing, writing openfootball-format JSON to app/data/openfootball/.

Rewrite scripts/seed.ts to read these local JSON files instead of the Kaggle
CSV, producing 965 matches and 2716 goals with per-group assignments for all
historical tournaments (enabling group standings on tournament pages).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-06-15 11:39:53 +02:00
parent 83b1ad3e35
commit 5dcd22ad22
88 changed files with 95625 additions and 127 deletions
@@ -0,0 +1,76 @@
{
"groups": [
{
"name": "Group A",
"teams": [
"South Africa",
"Mexico",
"Uruguay",
"France"
]
},
{
"name": "Group B",
"teams": [
"South Korea",
"Greece",
"Argentina",
"Nigeria"
]
},
{
"name": "Group C",
"teams": [
"England",
"United States",
"Algeria",
"Slovenia"
]
},
{
"name": "Group D",
"teams": [
"Serbia",
"Ghana",
"Germany",
"Australia"
]
},
{
"name": "Group E",
"teams": [
"Netherlands",
"Denmark",
"Japan",
"Cameroon"
]
},
{
"name": "Group F",
"teams": [
"Italy",
"Paraguay",
"New Zealand",
"Slovakia"
]
},
{
"name": "Group G",
"teams": [
"Ivory Coast",
"Portugal",
"Brazil",
"North Korea"
]
},
{
"name": "Group H",
"teams": [
"Honduras",
"Chile",
"Spain",
"Switzerland"
]
}
]
}
File diff suppressed because it is too large Load Diff
File diff suppressed because it is too large Load Diff
@@ -0,0 +1,44 @@
{
"stadiums": [
{
"name": "Nelson Mandela Bay Stadium",
"city": "Port Elizabeth"
},
{
"name": "Royal Bafokeng Stadium",
"city": "Rustenburg"
},
{
"name": "Free State Stadium",
"city": "Bloemfontein"
},
{
"name": "Soccer City",
"city": "Johannesburg"
},
{
"name": "Moses Mabhida Stadium",
"city": "Durban"
},
{
"name": "Ellis Park Stadium",
"city": "Johannesburg"
},
{
"name": "Loftus Versfeld Stadium",
"city": "Pretoria"
},
{
"name": "Cape Town Stadium",
"city": "Cape Town"
},
{
"name": "Peter Mokaba Stadium",
"city": "Polokwane"
},
{
"name": "Mbombela Stadium",
"city": "Nelspruit"
}
]
}