init: GGUF download + hygon/bi150 validation submit pipeline
This commit is contained in:
2
.gitignore
vendored
Normal file
2
.gitignore
vendored
Normal file
@@ -0,0 +1,2 @@
|
|||||||
|
.DS_Store
|
||||||
|
__pycache__/
|
||||||
15
Dockerfile
Normal file
15
Dockerfile
Normal file
@@ -0,0 +1,15 @@
|
|||||||
|
FROM modelhubxc-4pd.tencentcloudcr.com/xc_agent_platform/python:3.11-slim
|
||||||
|
|
||||||
|
ENV PYTHONUNBUFFERED=1
|
||||||
|
|
||||||
|
|
||||||
|
WORKDIR /app
|
||||||
|
|
||||||
|
COPY requirements.txt .
|
||||||
|
RUN pip install --no-cache-dir -i https://pypi.tuna.tsinghua.edu.cn/simple -r requirements.txt
|
||||||
|
|
||||||
|
COPY . .
|
||||||
|
|
||||||
|
EXPOSE 8080
|
||||||
|
|
||||||
|
CMD ["python", "main.py"]
|
||||||
21
README.md
Normal file
21
README.md
Normal file
@@ -0,0 +1,21 @@
|
|||||||
|
# xc_validation_strategy_gguf_hygon
|
||||||
|
|
||||||
|
GGUF 模型下载 + 验证任务提交流水线策略服务:批量创建 GGUF 模型下载任务
|
||||||
|
(最大并发 8,遇到并发限制自动等待重试),每个模型下载成功后立即提交
|
||||||
|
hygon / bi150 两个验证任务,之后保持 HTTP 服务存活供平台探活。
|
||||||
|
|
||||||
|
## 功能
|
||||||
|
|
||||||
|
- 登录 ModelHub 获取 Token
|
||||||
|
- 按流水线批量创建 GGUF 模型下载任务(HuggingFace 源,最大并发 8)
|
||||||
|
- 命中"最多同时 8 个下载任务"限制时原地等待 20 秒重试,不丢弃模型
|
||||||
|
- 每个模型下载成功后,立即提交 hygon_k100-ai 与 Iluvatar_bi-150 两个验证任务(llamacpp 框架)
|
||||||
|
- 下载成功的模型 ID 写入 `downloaded_success_models.txt`
|
||||||
|
- 暴露 `/health` 和 `/status` 接口满足平台运行时契约
|
||||||
|
|
||||||
|
## 平台契约说明
|
||||||
|
|
||||||
|
- Dockerfile 位于仓库根目录,基于官方轻量基础镜像
|
||||||
|
- 暴露 8080 端口并实现 `GET /health`
|
||||||
|
- 通过环境变量 `STRATEGY_ID` 获取策略 ID
|
||||||
|
- 正确处理 `SIGTERM` 信号,支持优雅停机
|
||||||
1
requirements.txt
Normal file
1
requirements.txt
Normal file
@@ -0,0 +1 @@
|
|||||||
|
requests
|
||||||
Reference in New Issue
Block a user