fix(lipsync, P0): 对口型卡running三层防御修复 #1867

Closed
xiaoxia wants to merge 2 commits from fix/lipsync-status-refresh-reliability into develop
Owner

已由 #1916 替代(rebase到最新develop解决冲突)

已由 #1916 替代(rebase到最新develop解决冲突)
xiaoxia added 1 commit 2026-09-11 22:42:34 +08:00
fix(lipsync, P0): 修复对口型任务卡 running 状态不更新
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 1s
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 2s
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 1m35s
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 2m15s
PR Automation / Auto Approve on CI Green (pull_request) Successful in 2m42s
Preview Deploy / Deploy Preview Environment (pull_request) Successful in 3m50s
AI Code Review / AI Code Review (pull_request) Successful in 6m26s
CI/CD Pipeline / Unit Tests (pull_request) Failing after 8m25s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 8m25s
CI/CD Pipeline / Validate - Style (pull_request) Has been cancelled
CI/CD Pipeline / Validate - Security (pull_request) Has been cancelled
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Has been cancelled
CI/CD Pipeline / Build Production API Image (pull_request) Has been cancelled
CI/CD Pipeline / Build Production Web Image (pull_request) Has been cancelled
CI/CD Pipeline / Build Production Worker Image (pull_request) Has been cancelled
CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled
CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled
CI/CD Pipeline / Canary Release to Production (pull_request) Has been cancelled
CI/CD Pipeline / CI Gate (pull_request) Has been cancelled
PR Automation / Auto Merge on CI Green + Approved (pull_request) Has been cancelled
CI/CD Pipeline / Staging API Integration Tests (pull_request) Failing after 112h41m3s
CI/CD Pipeline / PR Build Web Image (pull_request) Failing after 112h41m9s
CI/CD Pipeline / Build Staging Worker Image (pull_request) Failing after 112h41m12s
CI/CD Pipeline / Build Staging Web Image (pull_request) Failing after 112h40m55s
CI/CD Pipeline / Build Staging API Image (pull_request) Failing after 112h40m55s
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Failing after 112h40m52s
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Failing after 112h40m52s
CI/CD Pipeline / ACR Image Cleanup (pull_request) Failing after 112h40m46s
CI/CD Pipeline / Staging E2E Tests (pull_request) Failing after 112h40m46s
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Failing after 112h40m48s
CI/CD Pipeline / Frontend Unit Tests (pull_request) Failing after 112h40m53s
CI/CD Pipeline / Frontend Lint (pull_request) Failing after 112h40m54s
CI/CD Pipeline / Check push changed paths (pull_request) Failing after 112h40m58s
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Failing after 113h16m3s
bfee46d6ea
根因:TTS+MediaKit都成功了,但状态回写完全依赖前端轮询触发的FastAPI background task,
background task中db.commit()异常时无try/except且无日志,静默失败导致completed永远写不回DB。

修复三层防御:
1. refresh_job_status: db.commit()包try/except+rollback,失败打完整堆栈日志
2. GET /lipsync/jobs/{id}: 距上次更新超30秒时同步刷新(不挂后台),确保stale任务被及时拉取
3. 新增Celery兜底轮询任务lipsync_tts.poll_mediakit_status:TTS提交MediaKit成功后
   链式触发,worker主动轮询到终态(最多10分钟),不依赖前端

🚀 预览环境已部署

项目 详情
PR号 #1867
预览链接 https://pr-1867.preview.xiaoxiajianji.com
API环境 staging

💡 预览环境使用 staging API 数据,请勿在预览环境中操作重要数据。

🔄 每次提交新代码后预览环境会自动更新。

🗑️ PR 关闭或合并后,预览环境会自动清理。

🚀 **预览环境已部署** | 项目 | 详情 | |------|------| | PR号 | #1867 | | 预览链接 | [https://pr-1867.preview.xiaoxiajianji.com](https://pr-1867.preview.xiaoxiajianji.com) | | API环境 | staging | > 💡 预览环境使用 staging API 数据,请勿在预览环境中操作重要数据。 > > 🔄 每次提交新代码后预览环境会自动更新。 > > 🗑️ PR 关闭或合并后,预览环境会自动清理。
auto-approve-bot added 1 commit 2026-09-11 22:53:24 +08:00
style: auto-format with black + isort + ruff + prettier [skip ci-format-check]
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 1s
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 2s
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 24s
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 25s
Preview Deploy / Deploy Preview Environment (pull_request) Successful in 1m43s
PR Automation / Auto Approve on CI Green (pull_request) Successful in 2m39s
AI Code Review / AI Code Review (pull_request) Successful in 6m28s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 7m16s
CI/CD Pipeline / Validate - Style (pull_request) Failing after 7m45s
CI/CD Pipeline / Unit Tests (pull_request) Failing after 7m46s
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Successful in 10m53s
PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 10m31s
CI/CD Pipeline / Validate - Security (pull_request) Successful in 29m34s
CI/CD Pipeline / CI Gate (pull_request) Failing after 1s
CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped
ACR Cleanup / ACR Image Cleanup (pull_request_target) Successful in 32s
Preview Cleanup / Cleanup Preview Environment (pull_request) Successful in 39s
CI/CD Pipeline / Deploy Production (pull_request) Failing after 112h0m37s
CI/CD Pipeline / Staging E2E Tests (pull_request) Failing after 112h30m13s
CI/CD Pipeline / Build Staging API Image (pull_request) Failing after 112h30m24s
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Failing after 112h30m1s
CI/CD Pipeline / Frontend Lint (pull_request) Failing after 112h30m1s
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Failing after 112h30m1s
CI/CD Pipeline / Build Staging Worker Image (pull_request) Failing after 112h30m7s
CI/CD Pipeline / Build Staging Web Image (pull_request) Failing after 112h30m7s
CI/CD Pipeline / Check push changed paths (pull_request) Failing after 112h30m8s
CI/CD Pipeline / Build Production Web Image (pull_request) Failing after 112h0m24s
CI/CD Pipeline / Build Production API Image (pull_request) Failing after 112h0m27s
CI/CD Pipeline / Canary Release to Production (pull_request) Failing after 112h0m20s
CI/CD Pipeline / Build Production Worker Image (pull_request) Failing after 112h0m24s
CI/CD Pipeline / ACR Image Cleanup (pull_request) Failing after 112h29m55s
CI/CD Pipeline / Staging API Integration Tests (pull_request) Failing after 112h29m55s
CI/CD Pipeline / Frontend Unit Tests (pull_request) Failing after 112h30m1s
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Failing after 112h29m57s
CI/CD Pipeline / PR Build Web Image (pull_request) Failing after 112h30m0s
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Failing after 113h5m12s
7325622104
xiaoxia closed this pull request 2026-09-15 02:10:58 +08:00

🗑️ 预览环境已清理

PR #1867 已关闭或合并,对应的预览环境已被清理。

如有需要,可以重新打开 PR 来重新生成预览环境。

🗑️ **预览环境已清理** PR #1867 已关闭或合并,对应的预览环境已被清理。 > 如有需要,可以重新打开 PR 来重新生成预览环境。
Some checks are pending
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 1s
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 2s
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 24s
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 25s
Preview Deploy / Deploy Preview Environment (pull_request) Successful in 1m43s
PR Automation / Auto Approve on CI Green (pull_request) Successful in 2m39s
AI Code Review / AI Code Review (pull_request) Successful in 6m28s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 7m16s
CI/CD Pipeline / Validate - Style (pull_request) Failing after 7m45s
CI/CD Pipeline / Unit Tests (pull_request) Failing after 7m46s
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Successful in 10m53s
PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 10m31s
CI/CD Pipeline / Validate - Security (pull_request) Successful in 29m34s
CI/CD Pipeline / CI Gate (pull_request) Failing after 1s
CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped
ACR Cleanup / ACR Image Cleanup (pull_request_target) Successful in 32s
Preview Cleanup / Cleanup Preview Environment (pull_request) Successful in 39s
CI/CD Pipeline / Deploy Production (pull_request) Failing after 112h0m37s
CI/CD Pipeline / Staging E2E Tests (pull_request) Failing after 112h30m13s
CI/CD Pipeline / Build Staging API Image (pull_request) Failing after 112h30m24s
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Failing after 112h30m1s
CI/CD Pipeline / Frontend Lint (pull_request) Failing after 112h30m1s
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Failing after 112h30m1s
CI/CD Pipeline / Build Staging Worker Image (pull_request) Failing after 112h30m7s
CI/CD Pipeline / Build Staging Web Image (pull_request) Failing after 112h30m7s
CI/CD Pipeline / Check push changed paths (pull_request) Failing after 112h30m8s
CI/CD Pipeline / Build Production Web Image (pull_request) Failing after 112h0m24s
CI/CD Pipeline / Build Production API Image (pull_request) Failing after 112h0m27s
CI/CD Pipeline / Canary Release to Production (pull_request) Failing after 112h0m20s
CI/CD Pipeline / Build Production Worker Image (pull_request) Failing after 112h0m24s
CI/CD Pipeline / ACR Image Cleanup (pull_request) Failing after 112h29m55s
CI/CD Pipeline / Staging API Integration Tests (pull_request) Failing after 112h29m55s
CI/CD Pipeline / Frontend Unit Tests (pull_request) Failing after 112h30m1s
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Failing after 112h29m57s
CI/CD Pipeline / PR Build Web Image (pull_request) Failing after 112h30m0s
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Failing after 113h5m12s

Pull request closed

Sign in to join this conversation.