fix: retry failed group subpages, add rate-limit detection in scraper

- Detect Wikipedia plain-text rate-limit response ("You are making too many
  requests") and wait 30s before retrying, rather than silently failing
- Increase inter-attempt delay from 3s to 15s per attempt
- Increase group subpage delay from 1.2s to 3s, year delay from 0.6s to 2s
- Re-scrape 1982, 1998, 2002, 2006 which had failed groups; all groups now
  complete — e.g. 2002 now has 64 matches including Group E (Germany/Klose)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-06-15 18:44:54 +02:00
parent d37ebe201e
commit 7e4bf2d07c
18 changed files with 1193 additions and 16 deletions
+8
View File
@@ -54,6 +54,14 @@
"New Zealand"
]
},
{
"name": "Group A",
"teams": [
"Poland",
"Belgium",
"Soviet Union"
]
},
{
"name": "Group B",
"teams": [
+65
View File
@@ -1199,6 +1199,71 @@
],
"ground": "Estadio Benito Villamarín, Seville"
},
{
"round": "Second group stage",
"group": "Group A",
"date": "1982-06-28",
"time": "21:00",
"team1": "Poland",
"team2": "Belgium",
"score": {
"ft": [
3,
0
]
},
"goals1": [
{
"name": "Zbigniew Boniek",
"minute": 4
},
{
"name": "Zbigniew Boniek",
"minute": 26
},
{
"name": "Zbigniew Boniek",
"minute": 53
}
],
"ground": "Camp Nou, Barcelona"
},
{
"round": "Second group stage",
"group": "Group A",
"date": "1982-07-01",
"time": "21:00",
"team1": "Belgium",
"team2": "Soviet Union",
"score": {
"ft": [
0,
1
]
},
"goals2": [
{
"name": "Khoren Oganesian",
"minute": 48
}
],
"ground": "Camp Nou, Barcelona"
},
{
"round": "Second group stage",
"group": "Group A",
"date": "1982-07-04",
"time": "21:00",
"team1": "Soviet Union",
"team2": "Poland",
"score": {
"ft": [
0,
0
]
},
"ground": "Camp Nou, Barcelona"
},
{
"round": "Second group stage",
"group": "Group B",