5ab30f7706
CI/CD Pipeline / Check push changed paths (pull_request) Has been skipped
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 3s
CI/CD Pipeline / Build Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 2s
CI/CD Pipeline / Build Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Frontend Lint (pull_request) Has been skipped
CI/CD Pipeline / Frontend Unit Tests (pull_request) Has been skipped
CI/CD Pipeline / PR Build Web Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Has been skipped
CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped
CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped
CI/CD Pipeline / ACR Image Cleanup (pull_request) Has been skipped
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 52s
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 55s
Preview Deploy / Deploy Preview Environment (pull_request) Successful in 2m12s
PR Automation / Auto Approve on CI Green (pull_request) Successful in 3m10s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 5m26s
CI/CD Pipeline / Validate - Style (pull_request) Successful in 6m46s
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Successful in 7m42s
AI Code Review / AI Code Review (pull_request) Successful in 7m59s
CI/CD Pipeline / Unit Tests (pull_request) Successful in 16m43s
CI/CD Pipeline / Validate - Security (pull_request) Successful in 18m23s
CI/CD Pipeline / Build Production API Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Deploy Production (pull_request) Has been skipped
CI/CD Pipeline / Canary Release to Production (pull_request) Has been skipped
CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped
CI/CD Pipeline / CI Gate (pull_request) Successful in 2s
PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 11m6s
ACR Cleanup / ACR Image Cleanup (pull_request_target) Successful in 25s
Preview Cleanup / Cleanup Preview Environment (pull_request) Successful in 1m4s
新增 MuseTalk 本地 GPU Worker 反向轮询能力,解决阿里云CPU服务器无法跑GPU推理的问题。
后端API层(新增):
- 表 gpu_lipsync_tasks(id/status/video_url/audio_url/result_url/worker_id/
attempt/error_msg/created_at/started_at/finished_at/last_heartbeat_at)
- 表 gpu_workers(worker_id/hostname/gpu_name/free_vram_mb/capabilities/last_heartbeat_at)
- alembic 迁移 081_add_gpu_lipsync_tasks
- 4个接口(/api/v1/gpu 前缀,长期 GPU_WORKER_TOKEN Bearer 鉴权):
* POST /gpu/register — Worker 注册/心跳
* GET /gpu/lipsync/poll?worker_id=xxx — 拉取 pending 任务(带预签名下载+PUT上传URL),
原子 UPDATE WHERE status=pending 防并发;无任务返回204
* POST /gpu/lipsync/result — multipart 上报结果(支持Worker代传文件到OSS,
或先自PUT到预签名URL再无文件上报)
* GET /gpu/lipsync/status/{task_id} — 任务状态查询
- 超时回退:processing 任务超过 gpu_task_timeout_seconds(默认300s)无心跳
自动回退 pending 重试,最多 MAX_ATTEMPTS(3) 次
- 配置项:GPU_WORKER_TOKEN / GPU_TASK_TIMEOUT_SECONDS(SharedSettings)
- OSS 存储:SharedStorageService 新增 get_upload_url 预签名 PUT URL
- CI/环境:.env/.env.staging/.env.production + render_env.sh + ci-pipeline.yml
均注入 GPU_WORKER_TOKEN
Worker脚本(deploy/gpu_worker/,零项目代码依赖,仅依赖requests):
- gpu_worker.py:启动register→5s轮询→下载视频/音频→POST本地MuseTalk /inference
→multipart回传结果→失败本地重试+上报failed→单任务串行
- requirements.txt:仅 requests>=2.31
- xiaoxia-gpu-worker.service:systemd 开机自启单元
- .env.example:环境变量样例
- README.md:Linux/Windows部署+联调+故障排查
单元测试:10个用例覆盖创建/轮询/并发认领/成功/失败重试/
最大重试失败/超时回退/注册心跳/按lipsync_job查询,全绿。
104 lines
4.0 KiB
Python
104 lines
4.0 KiB
Python
"""GPU MuseTalk 反向轮询 API Schema 定义.
|
||
|
||
面向部署在用户 RTX2060 本地的 GPU Worker 脚本,不面向前端用户。
|
||
Worker 用长期 GPU_WORKER_TOKEN 鉴权(不是用户 JWT)。
|
||
"""
|
||
|
||
from __future__ import annotations
|
||
|
||
from datetime import datetime
|
||
from typing import Optional
|
||
|
||
from pydantic import BaseModel, Field
|
||
|
||
# ── Worker 注册/心跳 ──────────────────────────────────────────────
|
||
|
||
|
||
class GpuWorkerRegisterRequest(BaseModel):
|
||
"""Worker 启动/心跳时上报自身信息."""
|
||
|
||
worker_id: str = Field(..., min_length=1, max_length=100, description="Worker 唯一 ID(机器名+UUID 等)")
|
||
hostname: str = Field("", max_length=200, description="主机名,用于运维排查")
|
||
gpu_name: str = Field("", max_length=200, description="GPU 型号,如 'NVIDIA GeForce RTX 2060'")
|
||
free_vram_mb: int = Field(0, ge=0, description="当前空闲显存(MB)")
|
||
capabilities: str = Field("musetalk", max_length=500, description="能力列表,逗号分隔,如 'musetalk'")
|
||
|
||
|
||
class GpuWorkerRegisterResponse(BaseModel):
|
||
ok: bool = True
|
||
server_time: datetime
|
||
message: str = "ok"
|
||
|
||
|
||
# ── 轮询任务 ────────────────────────────────────────────────────
|
||
|
||
|
||
class GpuLipsyncTaskPayload(BaseModel):
|
||
"""下发给 Worker 的任务载荷(含预签名下载 URL)."""
|
||
|
||
task_id: str
|
||
video_url: str = Field(..., description="人物视频预签名下载 URL(GET)")
|
||
audio_url: str = Field(..., description="驱动音频预签名下载 URL(GET)")
|
||
lipsync_job_id: str = ""
|
||
user_id: str = ""
|
||
project_id: str = ""
|
||
created_at: datetime
|
||
upload_url: str = Field(..., description="结果视频预签名上传 URL(PUT, video/mp4)")
|
||
upload_method: str = Field("PUT", description="上传方式,目前只支持 PUT")
|
||
expires_at: datetime
|
||
|
||
|
||
class GpuLipsyncPollResponse(BaseModel):
|
||
"""Worker poll 的返回:200 带任务,204 无任务."""
|
||
|
||
task: Optional[GpuLipsyncTaskPayload] = None
|
||
|
||
|
||
# ── Worker 上报结果 ──────────────────────────────────────────────
|
||
|
||
|
||
class GpuLipsyncResultRequest(BaseModel):
|
||
"""Worker 通过 multipart 上传结果时携带的字段(非文件字段)."""
|
||
|
||
task_id: str = Field(..., min_length=1, max_length=64)
|
||
worker_id: str = Field(..., min_length=1, max_length=100)
|
||
success: bool = Field(True, description="true=成功(此时必须上传 result 视频文件);false=失败")
|
||
duration_seconds: float = Field(0.0, ge=0, description="合成后视频时长(秒),成功时应填入")
|
||
error_msg: str = Field("", max_length=2000, description="失败原因,success=false 时必填")
|
||
|
||
|
||
class GpuLipsyncResultResponse(BaseModel):
|
||
ok: bool = True
|
||
task_id: str
|
||
status: str # done / failed
|
||
message: str = "ok"
|
||
|
||
|
||
# ── 业务侧查询任务状态 ────────────────────────────────────────────
|
||
|
||
|
||
class GpuLipsyncStatusResponse(BaseModel):
|
||
task_id: str
|
||
status: str
|
||
result_url: str = ""
|
||
result_duration: float = 0.0
|
||
error_msg: str = ""
|
||
worker_id: str = ""
|
||
attempt: int = 0
|
||
created_at: datetime
|
||
started_at: Optional[datetime] = None
|
||
finished_at: Optional[datetime] = None
|
||
|
||
|
||
# ── 创建任务(内部服务调用) ──────────────────────────────────────
|
||
|
||
|
||
class GpuLipsyncCreateRequest(BaseModel):
|
||
"""服务层内部创建 GPU 任务用(不通过 HTTP 暴露给 Worker/前端)."""
|
||
|
||
video_url: str # 已可访问的 OSS key 或公网 URL(API 侧会转预签名)
|
||
audio_url: str
|
||
lipsync_job_id: str = ""
|
||
user_id: str = ""
|
||
project_id: str = ""
|