Sebastian Krüger 3308349e78 feat: add comprehensive verify command to HuggingFace downloader ...

Added new 'verify' command to artifact_huggingface_download.sh that performs comprehensive health checks on all downloaded models and their symlinks.

Features:
- Download status verification (existence, size, location, timestamps)
- Link status verification (valid, broken, or missing symlinks)
- Size mismatch detection (warns if actual differs >10% from expected)
- Per-model detailed logging with beautiful formatting
- Category-level and global statistics summaries
- Actionable fix suggestions for detected issues
- Disk space usage analysis

New Functions:
- get_model_disk_usage() - Calculate actual model file sizes
- format_bytes() - Human-readable size formatting
- verify_model_download() - Check model download status
- verify_model_links() - Verify symlink integrity
- verify_category() - Process category with verification
- display_verification_summary() - Show global results

Usage:
  artifact_huggingface_download.sh verify -c models.yaml

Output includes:
  ✓ Downloaded/Missing model counts
  ✓ Properly linked/Broken link statistics
  ✓ File sizes and locations
  ✓ Last modified timestamps
  ⚠️ Size mismatch warnings
  📊 Disk space usage per category
  💡 Fix suggestions with exact commands

🤖 Generated with Claude Code (https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

2025-11-25 13:33:37 +01:00

43 KiB

Executable File

Raw Blame History

View Raw