feat: derive recent queue reserve from account capacity
This commit is contained in:
@@ -120,12 +120,12 @@ bash run_poll.sh --dry-run
|
||||
memory rule as new submissions. Only tasks whose own repository size times `1.20` exceeds
|
||||
their selected GPU capacity are stopped, after a fresh account-scoped active-state check.
|
||||
Incomplete size/capacity evidence is never used for cancellation.
|
||||
- Models older than seven days may occupy only positions 1–80 of each account's active queue.
|
||||
The account pool enforces the boundary atomically. Once all accounts reach 80, discovery no
|
||||
longer expands beyond seven days. Cleanup stops OOM tasks first, recalculates the surviving
|
||||
queue order, and on startup stops old tasks still ranked 81 or later. Scheduled cleanup then
|
||||
retains positions 81–95 and stops only old tasks ranked 96 or later. Recent overflow tasks stay.
|
||||
Unknown ModelScope timestamps never authorize a cancellation.
|
||||
- Models older than seven days may occupy only the current account capacity minus its final 10
|
||||
positions. The account pool enforces this per-account boundary atomically and updates it when
|
||||
capacity probing discovers a higher limit. Cleanup stops OOM tasks first, recalculates the
|
||||
surviving queue order, and applies the same limit-minus-10 boundary on startup. Scheduled
|
||||
cleanup relaxes to limit minus 5 to avoid excessive pruning. Recent overflow tasks stay, and
|
||||
unknown ModelScope timestamps never authorize a cancellation.
|
||||
|
||||
## Important Flags
|
||||
|
||||
@@ -161,10 +161,11 @@ Common flags:
|
||||
- `--max-cycles`: optional hard stop for testing or batch windows
|
||||
- `--disable-queue-cleanup`: disable automatic OOM and old-overflow queue cleanup
|
||||
|
||||
The first automatic cleanup removes models older than seven days after each
|
||||
account's position 80. Later scheduled cleanups use position 95, while admission
|
||||
continues to reserve positions 81-100 for recent models. Override the later
|
||||
threshold with `MODELHUB_DYNAMIC_OLD_MODEL_CLEANUP_THRESHOLD`.
|
||||
The first automatic cleanup removes models older than seven days beyond each
|
||||
account's discovered capacity minus 10. Later scheduled cleanups use capacity
|
||||
minus 5, while admission continues to reserve the final 10 slots for recent
|
||||
models. Override these suffix sizes with `MODELHUB_RECENT_MODEL_RESERVE_SLOTS`
|
||||
and `MODELHUB_DYNAMIC_OLD_MODEL_CLEANUP_RESERVE_SLOTS`.
|
||||
|
||||
Failure-informed preflight is enabled by default. It rejects deterministic
|
||||
missing-file and predicted-OOM cases, clamps unsafe context-length arguments,
|
||||
|
||||
Reference in New Issue
Block a user