feat(ai-avatar): 配音前置 #1875

Merged
auto-approve-bot merged 4 commits from fix/ai-avatar-tts-pre-step into develop 2026-09-13 04:22:22 +08:00

4 Commits

Author SHA1 Message Date
CI Bot ebfcfa4191 style: auto-format with black + isort + ruff + prettier [skip ci-format-check]
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 1s
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 2s
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 43s
CI/CD Pipeline / PR Build Web Image (pull_request) Successful in 1m19s
CI/CD Pipeline / Frontend Lint (pull_request) Successful in 1m26s
CI/CD Pipeline / Frontend Unit Tests (pull_request) Successful in 1m30s
Preview Deploy / Deploy Preview Environment (pull_request) Successful in 1m46s
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 1m58s
PR Automation / Auto Approve on CI Green (pull_request) Successful in 2m49s
CI/CD Pipeline / Validate - Style (pull_request) Successful in 3m16s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 3m22s
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Successful in 3m39s
AI Code Review / AI Code Review (pull_request) Successful in 6m30s
CI/CD Pipeline / Unit Tests (pull_request) Successful in 8m5s
CI/CD Pipeline / Validate - Security (pull_request) Successful in 8m56s
CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped
CI/CD Pipeline / CI Gate (pull_request) Successful in 4s
PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 6m43s
ACR Cleanup / ACR Image Cleanup (pull_request_target) Successful in 5s
Preview Cleanup / Cleanup Preview Environment (pull_request) Successful in 29s
CI/CD Pipeline / Deploy Production (pull_request) Failing after 83h2m9s
CI/CD Pipeline / Build Production API Image (pull_request) Failing after 83h2m13s
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Failing after 83h10m20s
CI/CD Pipeline / Build Staging API Image (pull_request) Failing after 83h10m25s
CI/CD Pipeline / Staging E2E Tests (pull_request) Failing after 83h9m45s
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Failing after 83h9m56s
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Failing after 83h9m56s
CI/CD Pipeline / Build Staging Worker Image (pull_request) Failing after 83h10m0s
CI/CD Pipeline / Build Staging Web Image (pull_request) Failing after 83h10m1s
CI/CD Pipeline / Check push changed paths (pull_request) Failing after 83h10m48s
CI/CD Pipeline / ACR Image Cleanup (pull_request) Failing after 83h9m44s
CI/CD Pipeline / Canary Release to Production (pull_request) Failing after 83h1m45s
CI/CD Pipeline / Build Production Worker Image (pull_request) Failing after 83h1m49s
CI/CD Pipeline / Build Production Web Image (pull_request) Failing after 83h1m49s
CI/CD Pipeline / Staging API Integration Tests (pull_request) Failing after 83h9m45s
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Failing after 83h45m9s
2026-09-12 20:12:36 +00:00
xiaoxia c2de565e09 fix(ai-avatar): 修复配音前置PR的CI错误——test import路径/TS类型/eslint warning
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 1s
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 1s
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 30s
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 31s
CI/CD Pipeline / Frontend Lint (pull_request) Successful in 55s
CI/CD Pipeline / Frontend Unit Tests (pull_request) Successful in 1m4s
Preview Deploy / Deploy Preview Environment (pull_request) Successful in 1m50s
CI/CD Pipeline / PR Build Web Image (pull_request) Successful in 2m19s
PR Automation / Auto Approve on CI Green (pull_request) Successful in 2m42s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 3m12s
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Successful in 3m51s
CI/CD Pipeline / Validate - Style (pull_request) Has been cancelled
CI/CD Pipeline / Validate - Security (pull_request) Has been cancelled
CI/CD Pipeline / Unit Tests (pull_request) Has been cancelled
CI/CD Pipeline / Build Production API Image (pull_request) Has been cancelled
CI/CD Pipeline / Build Production Web Image (pull_request) Has been cancelled
CI/CD Pipeline / Build Production Worker Image (pull_request) Has been cancelled
CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled
CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled
CI/CD Pipeline / Canary Release to Production (pull_request) Has been cancelled
CI/CD Pipeline / CI Gate (pull_request) Has been cancelled
AI Code Review / AI Code Review (pull_request) Has been cancelled
PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 1m23s
CI/CD Pipeline / Staging E2E Tests (pull_request) Failing after 83h15m2s
CI/CD Pipeline / Build Staging Web Image (pull_request) Failing after 83h15m15s
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Failing after 83h15m13s
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Failing after 83h14m44s
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Failing after 83h14m49s
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Failing after 83h14m50s
CI/CD Pipeline / Build Staging Worker Image (pull_request) Failing after 83h14m51s
CI/CD Pipeline / Build Staging API Image (pull_request) Failing after 83h14m51s
CI/CD Pipeline / ACR Image Cleanup (pull_request) Failing after 83h14m37s
CI/CD Pipeline / Staging API Integration Tests (pull_request) Failing after 83h14m37s
CI/CD Pipeline / Check push changed paths (pull_request) Failing after 83h14m55s
- test_sentence_timings.py 改为从 packages.domain.sentence_timings 导入(函数已提取)
- AiAvatarPage.tsx payload类型改为Parameters<typeof createLipsyncJob>[0]消除TS2345
- 去掉useCallback中重复的state.ttsPreview.status依赖(state已覆盖)
2026-09-13 04:06:20 +08:00
CI Bot d12632e32a style: auto-format with black + isort + ruff + prettier [skip ci-format-check]
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 2s
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 2s
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 45s
CI/CD Pipeline / Frontend Lint (pull_request) Failing after 1m3s
Preview Deploy / Deploy Preview Environment (pull_request) Failing after 1m5s
CI/CD Pipeline / Frontend Unit Tests (pull_request) Successful in 1m24s
CI/CD Pipeline / PR Build Web Image (pull_request) Failing after 1m48s
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 1m51s
PR Automation / Auto Approve on CI Green (pull_request) Successful in 2m57s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 2m56s
CI/CD Pipeline / Validate - Style (pull_request) Successful in 3m48s
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Successful in 3m53s
AI Code Review / AI Code Review (pull_request) Successful in 6m23s
CI/CD Pipeline / Unit Tests (pull_request) Failing after 7m1s
CI/CD Pipeline / Validate - Security (pull_request) Successful in 9m34s
CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped
CI/CD Pipeline / CI Gate (pull_request) Failing after 3s
PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 6m48s
CI/CD Pipeline / Build Production Web Image (pull_request) Failing after 83h33m57s
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Failing after 83h42m44s
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Failing after 83h42m50s
CI/CD Pipeline / Build Staging Worker Image (pull_request) Failing after 83h43m12s
CI/CD Pipeline / Build Staging API Image (pull_request) Failing after 83h43m13s
CI/CD Pipeline / Build Production API Image (pull_request) Failing after 83h33m34s
CI/CD Pipeline / Build Staging Web Image (pull_request) Failing after 83h43m12s
CI/CD Pipeline / Deploy Production (pull_request) Failing after 83h33m30s
CI/CD Pipeline / Build Production Worker Image (pull_request) Failing after 83h33m33s
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Failing after 83h42m25s
CI/CD Pipeline / Canary Release to Production (pull_request) Failing after 83h33m30s
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Failing after 83h42m25s
CI/CD Pipeline / ACR Image Cleanup (pull_request) Failing after 83h42m18s
CI/CD Pipeline / Staging API Integration Tests (pull_request) Failing after 83h42m18s
CI/CD Pipeline / Staging E2E Tests (pull_request) Failing after 83h42m19s
CI/CD Pipeline / Check push changed paths (pull_request) Failing after 83h43m14s
2026-09-12 19:40:10 +00:00
xiaoxia 29b0a7d90d feat(ai-avatar): 配音前置——步骤1生成配音,音频直传对口型,B-roll时间戳立即可用
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 2s
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 2s
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 2m36s
CI/CD Pipeline / Frontend Unit Tests (pull_request) Successful in 3m4s
Preview Deploy / Deploy Preview Environment (pull_request) Failing after 3m12s
CI/CD Pipeline / PR Build Web Image (pull_request) Failing after 3m7s
PR Automation / Auto Approve on CI Green (pull_request) Successful in 3m22s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 3m35s
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 4m22s
CI/CD Pipeline / Frontend Lint (pull_request) Failing after 4m33s
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Successful in 4m53s
CI/CD Pipeline / Validate - Style (pull_request) Has been cancelled
CI/CD Pipeline / Validate - Security (pull_request) Has been cancelled
CI/CD Pipeline / Unit Tests (pull_request) Has been cancelled
CI/CD Pipeline / Build Production API Image (pull_request) Has been cancelled
CI/CD Pipeline / Build Production Web Image (pull_request) Has been cancelled
CI/CD Pipeline / Build Production Worker Image (pull_request) Has been cancelled
CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled
CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled
CI/CD Pipeline / Canary Release to Production (pull_request) Has been cancelled
CI/CD Pipeline / CI Gate (pull_request) Has been cancelled
AI Code Review / AI Code Review (pull_request) Has been cancelled
PR Automation / Auto Merge on CI Green + Approved (pull_request) Has been cancelled
CI/CD Pipeline / Staging E2E Tests (pull_request) Failing after 83h49m0s
CI/CD Pipeline / Build Staging Worker Image (pull_request) Failing after 83h49m17s
CI/CD Pipeline / Build Staging Web Image (pull_request) Failing after 83h48m54s
CI/CD Pipeline / ACR Image Cleanup (pull_request) Failing after 83h48m36s
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Failing after 83h48m42s
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Failing after 83h48m48s
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Failing after 83h48m48s
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Failing after 83h48m49s
CI/CD Pipeline / Build Staging API Image (pull_request) Failing after 83h48m54s
CI/CD Pipeline / Staging API Integration Tests (pull_request) Failing after 83h48m36s
CI/CD Pipeline / Check push changed paths (pull_request) Failing after 83h49m1s
后端:
- packages/domain/sentence_timings.py:抽出 compute_sentence_timings / probe_audio_duration 等公共工具
- tasks/lipsync_tts.py:改为复用 sentence_timings 公共模块,保留 Celery 任务作为降级路径
- schemas/lipsync.py:新增 AiAvatarTtsPreviewRequest/Response;CreateLipsyncJobRequest 新增可选 audio_url/audio_duration/sentence_timings 字段
- services/lipsync_service.py:新增 preview_tts() 同步方法;create_job 支持 audio_url 直传模式(下载→ffprobe→(可选重算timings)→直接提交 MediaKit,job.status=submitted)
- routes/lipsync.py:新增 POST /lipsync/jobs/tts-preview 鉴权路由

前端:
- types.ts:AiAvatarState 新增 ttsPreview 字段,TtsPreviewStatus 类型
- hooks/useAiAvatar.ts:新增 handlePreviewTts/resetTtsPreview,文案/音色/语速变化自动重置 ttsPreview;handleGenerateLipsync 在预合成完成时把 audio_url/audio_duration/sentence_timings 直传给后端
- api/aiAvatar.ts:新增 previewTts() API 封装,createLipsyncJob 入参加可选音频直传字段
- AiAvatarPage.tsx:步骤1「下一步→」改为「🎵 生成配音」+ 进度 Modal(模拟进度/loading/错误重试);步骤2进入条件改为 ttsPreview.status==='done';B-roll 时间戳优先用 lipsyncJob、降级用 ttsPreview.sentenceTimings

测试:
- tests/unit/test_lipsync_tts_preview.py:5个新用例覆盖成功/TTS失败/下载失败降级/零时长/no_audio_url
- 全量 lipsync/tts/avatar/preview 相关 1330 用例全部通过,无回归
2026-09-13 03:29:53 +08:00