xiaoxia 54f9fe0dc1
CI/CD Pipeline / Check push changed paths (pull_request) Has been skipped
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 1s
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 1s
CI/CD Pipeline / Build Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Build Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Frontend Lint (pull_request) Has been skipped
CI/CD Pipeline / Frontend Unit Tests (pull_request) Has been skipped
CI/CD Pipeline / PR Build Web Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Has been skipped
CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped
CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped
CI/CD Pipeline / ACR Image Cleanup (pull_request) Has been skipped
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 38s
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 40s
Preview Deploy / Deploy Preview Environment (pull_request) Successful in 1m19s
PR Automation / Auto Approve on CI Green (pull_request) Successful in 2m54s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 2m56s
CI/CD Pipeline / Validate - Style (pull_request) Successful in 3m57s
AI Code Review / AI Code Review (pull_request) Successful in 6m36s
CI/CD Pipeline / Validate - Security (pull_request) Successful in 7m53s
PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 10m43s
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Successful in 19m33s
CI/CD Pipeline / Unit Tests (pull_request) Failing after 20m27s
CI/CD Pipeline / Build Production API Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production Worker Image (pull_request) Has been skipped
CI/CD Pipeline / CI Gate (pull_request) Failing after 1s
CI/CD Pipeline / Deploy Production (pull_request) Has been skipped
CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped
CI/CD Pipeline / Canary Release to Production (pull_request) Has been skipped
fix(1978): MuseTalk 封装强制用 TTS 驱动音频替换音轨 + 音频长于视频时循环画面
严重 bug:结果视频保留了源视频音轨(波形比对相关系数 0.9998,与 TTS
驱动音频无关),口型同步配的是原声。根因是最终 ffmpeg 封装没写 -map,
默认流选择把第一个输入(源视频/无声画面)的自带音轨带进了结果。

修复(deploy/gpu_worker/musetalk_server.py):
- 新增 _mux_video_with_audio() 统一封装:强制 -map 0:v:0 -map 1:a:0,
  画面只取 MuseTalk 无声产物,音轨只取第二个输入的驱动音频,AAC 128k
- 新增 _get_media_duration() 探测音视频时长
- 音频不超过视频(容差 0.25s):-c:v copy -shortest 无损秒封装
- 音频长于视频(TTS 15s vs 视频 9s 常见):-stream_loop -1 循环画面,
  h264_nvenc 硬件重编码(RTX2060),-t 精确卡到音频时长,不截短语音
- _pick_video_encoder():MUSE_VIDEO_ENCODER=auto 探测 NVENC,不可用或
  编码失败自动回退 libx264(veryfast);preset 随编码器选择
- MUSE_ENABLE_VIDEO_LOOP(默认开)/ 请求 form enable_video_loop 单任务覆盖
- 示例推理先产出无声 visual_silent.mp4(-an)再走统一 mux,真实 MuseTalk
  接入时直接把无声产物路径传给 _mux_video_with_audio
- README:新增 2.2 更新部署(wget 拉新文件+systemctl 重启)、环境变量表、
  工程记录 #9/#10

测试 test_1978_musetalk_audio_mux.py(10 用例):
- 命令构造:非循环 copy+map、容差边界、循环 stream_loop/NVENC/-t 无 -shortest、
  关循环、NVENC 失败回退 libx264(p4→veryfast)、copy 失败抛出、编码器探测
- 真实 ffmpeg 端到端(环境无 ffmpeg 自动 skip):源视频内置 200Hz 音轨+
  驱动音频 800Hz,过零率验证结果音轨主频 800Hz(非源轨),2s 画面+5s 音频
  循环输出时长≈5s;短音频路径输出≈1s 且音轨 800Hz
2026-09-20 01:47:36 +08:00

小虾 SaaS - 自动化视频剪辑平台

Python 3.12+ FastAPI PostgreSQL

自动化视频剪辑 SaaS 平台,支持素材上传、AI 分类、智能剪辑计划生成、自动化视频合成与成片管理。


✨ 核心功能

🎬 视频剪辑主链路

  • 素材上传(直传 OSS + 分片上传大文件,最大 2GB)
  • AI 智能分类与质量评分
  • 4 种剪辑模式:one_take / pip(画中画)/ voice_over(口播+B-roll)/ voice_pip
  • 剪辑计划模板 + 智能生成
  • 自动化视频合成任务(Celery 异步)
  • 成片下载与审核管理
  • 资产诊断(素材就绪度评估、缺口分析)

🔐 认证系统

  • JWT Bearer Token 认证
  • 邮箱注册 + 邮箱验证
  • 密码重置(邮箱找回)
  • bcrypt 密码加密

📋 项目管理

  • 项目 CRUD + 共享
  • 任务管理(创建/更新/状态流转/进度追踪)
  • 里程碑管理
  • 任务问题追踪

📊 素材库管理

  • 素材库创建与管理
  • 素材上传、审核状态流转(pending_review → approved/rejected)
  • 素材诊断(就绪度评分、缺口分析、智能视图)

🚀 快速开始

方式 1: Docker Compose(推荐)

# 1. 克隆仓库
git clone https://git.xiaoxiajianji.com/xiaoxia/xiaoxia-saas.git
cd xiaoxia-saas

# 2. 配置环境变量
cp .env.example .env
# 编辑 .env 填写数据库、Redis、OSS 等配置

# 3. 启动所有服务
docker-compose up -d

# 4. 访问 API 文档
open http://localhost:8000/docs

方式 2: 本地开发

# 1. 克隆仓库
git clone https://git.xiaoxiajianji.com/xiaoxia/xiaoxia-saas.git
cd xiaoxia-saas

# 2. 创建虚拟环境
python -m venv venv
source venv/bin/activate  # Windows: venv\Scripts\activate

# 3. 安装依赖
pip install -r requirements.txt

# 4. 配置环境变量
cp .env.example .env

# 5. 启动 API 服务
uvicorn apps.api.main:app --reload

# 6. 访问 API 文档
open http://localhost:8000/docs

📚 API 文档

交互式文档

核心 API 路径

认证 (/api/v1/auth)

方法 路径 说明
POST /register 用户注册
POST /login 用户登录
GET /me 获取当前用户信息
POST /password/forgot 忘记密码
POST /password/reset 重置密码

视频剪辑主链路

上传素材 → POST /api/v1/upload(直传)或 /api/v1/upload/chunk/init(分片)
   ↓
创建素材 → POST /api/v1/assets
   ↓
AI 分类 → POST /api/v1/classification-jobs
   ↓
生成剪辑计划 → POST /api/v1/projects/{id}/edit-plans/auto-generate
   ↓
创建生成任务 → POST /api/v1/generation/tasks/
   ↓
查询结果 → GET /api/v1/generation/tasks/{task_id}/results/
   ↓
获取成片 → GET /api/v1/generated-videos/{video_id}/download-url

项目管理 (/api/v1/project-management)

方法 路径 说明
GET/POST /tasks 任务列表/创建
PATCH /tasks/{id} 更新任务信息
PATCH /tasks/{id}/status 更新任务状态
PATCH /tasks/{id}/progress 更新任务进度
GET/POST /milestones 里程碑列表/创建
GET/POST /issues 问题列表/创建
PATCH /issues/{id}/resolve 解决问题

素材与上传

方法 路径 说明
POST /api/v1/upload 直传素材(multipart/form-data)
POST /api/v1/upload/direct/prepare 准备 OSS 直传签名
POST /api/v1/upload/direct/complete 确认直传完成
POST /api/v1/upload/chunk/init 初始化分片上传
POST /api/v1/upload/chunk/{id}/{index} 上传分片
POST /api/v1/upload/chunk/{id}/complete 完成分片上传
GET /api/v1/assets 素材列表
PATCH /api/v1/assets/{id}/review 更新素材审核状态
GET /api/v1/projects/{id}/asset-diagnosis 资产诊断

成片管理 (/api/v1/generated-videos)

方法 路径 说明
GET / 成片列表
GET /{video_id} 成片详情
GET /{video_id}/download-url 下载链接
PATCH /{video_id}/review 审核状态

完整 API 列表请查看 API 主线清单


🏗️ 架构

小虾 SaaS
├── packages/              # 核心业务逻辑(Clean Architecture)
│   ├── domain/           # 领域模型(dataclass)
│   ├── application/      # 用例(Use Cases)
│   ├── ports/            # 接口定义(抽象端口)
│   └── adapters/         # 适配器实现(SQLAlchemy、Redis、SMTP 等)
├── apps/                 # 应用层
│   ├── api/             # FastAPI 应用 + 路由 + Pydantic schemas
│   ├── web/             # React + Vite 前端
│   └── worker/          # Celery 异步任务(视频处理、分类等)
├── migrations/           # Alembic 数据库迁移
├── tests/               # 测试
│   ├── unit/           # 单元测试
│   ├── integration/    # 集成测试
│   └── e2e/            # 端到端测试
└── docs/                # 文档

设计模式:

  • Clean Architecture(依赖方向:外层 → 内层)
  • 依赖注入(FastAPI Depends)
  • Repository 模式(通过 ports 抽象)
  • Domain-Driven Design

🛠️ 技术栈

后端:

  • Python 3.12 + FastAPI 0.115.0
  • PostgreSQL 16(生产)
  • Redis 7(缓存 + Celery Broker)
  • Celery(异步任务:视频处理、素材导入、分类)
  • 阿里云 OSS(文件存储)

前端:

  • React 18 + TypeScript
  • Vite(构建工具)
  • Ant Design(UI 组件)

部署:

  • Docker + Docker Compose
  • Gitea + Gitea Actions(CI/CD)
  • Nginx(反向代理)

🧪 测试

# 运行所有测试
pytest tests/ -v

# 运行单元测试
pytest tests/unit -v

# 运行集成测试
pytest tests/integration -v

# 生成覆盖率报告
pytest --cov=packages --cov-report=html

📊 当前状态

模块 状态
视频剪辑主链路(Phase 7) ✅ 已完成
分片上传(最大 2GB) ✅ 已完成
4 种剪辑模式 ✅ 已完成
项目管理 + 任务追踪 ✅ 已完成
资产诊断 ✅ 已完成
认证系统(JWT) ✅ 已完成
CI/CD 流水线 ✅ 运行中
前端界面(Vite) ✅ 已完成

📄 更多文档


🤝 贡献

欢迎贡献!请查看 贡献指南

仓库地址: https://git.xiaoxiajianji.com/xiaoxia/xiaoxia-saas


License: MIT

S
Description
小虾 SaaS 自动化剪辑系统
Readme MIT 115 MiB
v2.1.0-test.9 Latest
2026-07-09 08:32:46 +08:00
Languages
Python 78.5%
TypeScript 15.8%
CSS 2.8%
Shell 2.7%
Dockerfile 0.1%
Other 0.1%