Switch agent discovery to ModelScope

This commit is contained in:
CoolBoy
2026-07-10 01:44:16 +08:00
parent 5460fbd108
commit 3a2fa86e1e
14 changed files with 486 additions and 53 deletions

View File

@@ -1,6 +1,6 @@
# ModelHub Submission Runner
This package automates Hugging Face model discovery and ModelHub submission.
This package automates ModelScope model discovery and ModelHub submission.
It currently supports:
- one-shot submission planning via `main.py`
@@ -15,7 +15,7 @@ It currently supports:
- `daily_runner.py`: daily wave orchestration
- `poll_runner.py`: long-running queue refiller
- `runner_common.py`: shared token / key file loading
- `hf_discovery.py`: Hugging Face model discovery and inspection
- `modelscope_discovery.py`: ModelScope model discovery and inspection
- `modelhub_client.py`: ModelHub API client
- `history_stats.py`: online history aggregation, ranking, and warnings
- `template_selector.py`: template lookup and GPU normalization
@@ -24,7 +24,7 @@ It currently supports:
## Key Files
- `KEY.md`: optional local Hugging Face and ModelHub tokens
- `KEY.md`: optional local ModelScope and ModelHub tokens
- `templates/public_submit/adapt_task_templates.jsonl`: public submit templates
The agent platform deployment should use environment variables instead of key
@@ -81,9 +81,9 @@ bash run_poll.sh --dry-run
Common flags:
- `--daily-target`: total target submissions for the day; `0` means unlimited
- `--min-downloads`: Hugging Face download floor
- `--min-downloads`: ModelScope download floor
- `--history-stats-threshold`: local ledger threshold before using online history stats
- `--max-scan-models`: hard cap on scanned HF models for a run (0 = auto)
- `--max-scan-models`: hard cap on scanned ModelScope models for a run (0 = auto)
- `--scan-multiplier`: multiplier used for auto scan cap derivation from quota/queue capacity
- `--read-concurrency`: concurrent HTTP reads while scanning model candidates (default 4)
- `--max-submits-per-run`: max tasks to submit per run cycle (0 = unlimited)
@@ -97,7 +97,7 @@ Common flags:
- `--poll-interval-seconds`: sleep when the account has no available slots
- `--idle-interval-seconds`: sleep when a cycle submits nothing
- `--max-scan-models`: hard cap on scanned HF models for this cycle (0 = auto)
- `--max-scan-models`: hard cap on scanned ModelScope models for this cycle (0 = auto)
- `--scan-multiplier`: multiplier used for auto scan cap derivation from quota/queue capacity
- `--max-submits-per-run`: max tasks to submit per poll cycle (0 = unlimited)
- `--skip-outcome-sync`: skip outcome sync before scanning