222 Commits

Author	SHA1	Message	Date
xiaoxia	3be06c5763	fix(worker): align gpu-direct title position/size with frontend preview (#2095) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-29 17:04:37 +08:00
Coze Agent	a04e363d1b	chore(worker): improve BGM preset download diagnostics + add upload helper script ... - _prepare_bgm preset branch now differentiates: preset not found / preset exists but audio_url empty (未部署) / download failure, with a clear hint to ops to upload audio and fill preset_bgm.py - final warning now surfaces enabled/audio_url/asset_id/preset_id state so triage is immediate - add scripts/upload_preset_bgm.py: one-shot uploader that uploads mp3s from ./bgm_assets/{preset_id}.mp3 to OSS preset/bgm/, sets public-read ACL, and rewrites packages/domain/preset_bgm.py with the public URL. Dry-run supported. - add bgm_assets/README.md with the 10-preset file naming table	2026-09-29 15:28:36 +08:00
Coze Agent	11c554e43a	fix(gpu-direct): passthrough template title/subtitle/BGM config ... Problem: GPU direct render MVP hardcoded title/subtitle/BGM styles and ignored template config fields: - P0 static subtitle text (subtitle.text) was never rendered - P0 title styles (font/size/color/position/stroke/shadow/bold) all hardcoded - P1 BGM volume hardcoded at 0.35, no fade/offset/adjust-db - P1 ASR subtitle styles (color/size/position/font) ignored - P2 extra_audio_tracks (TTS/voiceover) volume hardcoded at 1.0 Changes: 1. build_direct_render() now accepts title_config/subtitle_config/ bgm_config dicts + static_subtitle_text. 2. Added helpers _hex_to_drawtext_color (#RGB/#RRGGBB/#RRGGBBAA/named), _position_to_drawtext_xy (top/center/bottom), _build_drawtext_filters (shadow layer + main layer, stroke via borderw/bordercolor, bold simulated via same-color borderw). 3. Title parses font/size/color/position/stroke/shadow/bold with safe defaults; legacy title_text still used as fallback. 4. Static subtitle_text renders as full-span (0→total_duration) segment; when ASR segments are present they take priority. 5. BGM reads volume (default 0.3), volume_adjust_db (linear gain), fade_in/fade_out (afade), audio_offset (adelay ms|ms), and honors enabled=false even if path supplied. Volume clamped to [0,1.5]. 6. _try_gpu_direct() now passes cfg['title']/['subtitle']/['bgm'] whole dicts through, computes static_subtitle_text for non-auto subs, and sources extra_audio_tracks volume from audio_tracks_config (voiceover tracks) instead of hardcoding 1.0. 7. DirectRenderPlan exposes filter_complex for testing. 8. Added 24 unit tests covering: default backward-compat, color hex/BGR conversion (short/long/alpha/invalid), position (top/center/bottom), stroke, shadow (two drawtext layers), font override, enabled flag, static subtitle full-span, ASR style passthrough, BGM volume/fade/offset/adjust-db/enabled=false, extra audio volume, bold simulation, ASR vs static priority, volume clamping. Fixes template-style rendering not taking effect in GPU pipeline.	2026-09-29 14:44:11 +08:00
xiaoxia	f9f3e6bfb9	fix(worker+api): P1 封面评分时序bug + direct/complete吞ingest占位bug (#2092) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-29 04:24:48 +08:00
xiaoxia	3904a8f3b5	perf(worker): 封面抽帧三优化 — blackdetect黑屏规避+单次ffmpeg批量抽帧+并发上传+CJK字体兜底 (#2091) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-28 22:32:56 +08:00
xiaoxia	ba3e97c986	fix(worker): GPU直连支持配音素材库音轨+无声片段anullsrc+per-clip音量 (#2090) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-28 21:09:10 +08:00
xiaoxia	3106496c12	fix(worker): GPU直连管线音频bug修复+边缘裁剪入GPU省5s (#2089) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-28 20:17:54 +08:00
xiaoxia	b7a439d319	feat(cover): 默认本地ffmpeg抽帧+cv2打分，砍掉MediaKit封面86s瓶颈 (#2087) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-28 18:44:41 +08:00
灵应	8a5cfe831e	fix: 修复 gpu_direct_pipeline.py 中 concat 构建的变量名错误 ... build_direct_render 方法中列表推导式使用 _lbl 作为循环变量， 但 f-string 中误用了未定义的 l，导致 NameError。 修复: f"[{l}]" -> f"[{_lbl}]" (line 195)	2026-09-28 16:22:01 +08:00
灵应	d7d3f3184b	fix: 修复 GPU 直连管线中 l.role 变量名拼写错误 ... _can_use_gpu_direct 和 _try_gpu_direct 方法中 3 处列表推导式 误用未定义变量 l 代替循环变量 _lyr，导致 NameError 使 gpu-direct eligibility check 始终失败并 fallback 到 CPU 路径。 修复: l.role -> _lyr.role (line 2220, 2275, 2280)	2026-09-28 15:31:46 +08:00
业务服务器运维	ec9240b52a	fix: 修复 _storage_key 无法写入 EditPlanClip（slots=True） ... EditPlanClip 使用 @dataclass(slots=True)，不允许 setattr 动态添加属性。 将 _storage_key 改为存储在 clip.config 字典中，所有读取处同步修改。 - render_adapter.py: c._storage_key = sk → c.config['_storage_key'] = sk - unified_render_service.py: getattr → config.get('_storage_key') - gpu_direct_pipeline.py: getattr → config.get('_storage_key')	2026-09-28 14:46:44 +08:00
saas-backend-agent	6e8199581d	fix(gpu-direct): 修复单测+style E741，默认字体改为Noto Sans CJK SC ... - DEFAULT_DRAWTEXT_FONT 从 sans 改为 'Noto Sans CJK SC'（P4000已装中文字体） - _download_assets 返回 4-tuple 导致老单测解包失败，更新 test_render_adapter - 修复 E741 模糊变量名 l → _lbl/_lyr - ruff format 统一格式	2026-09-28 14:02:57 +08:00
CI Bot	1e23a3f094	style: auto-format with black + isort + ruff + prettier [skip ci-format-check]	2026-09-28 05:38:30 +00:00
业务服务器运维	b04a803655	feat(worker): 全GPU直连渲染，取消mezzanine CPU中间编码 ... - gpu_encoder 新增 render_inputs_to_output：多输入+filter_complex 直接交 P4000 一次出片 - 新增 gpu_direct_pipeline：原始素材/BGM 签名URL、TTS 上传、drawtext 标题/字幕、 filter_complex 完成 trim/scale/pad/concat/边缘crop/amix，末端 h264_nvenc 仅编码一次 - unified_render_service：render() 步骤4.8 接入直连，命中即出片； 不满足条件或 GPU 失败自动回退现有 mezzanine/CPU 链路；config gpu_direct_enabled 可灰度关闭 - render_adapter：_download_assets 额外返回 asset_storage_map， _do_render 给 clip 注入 _storage_key 供直连签名 消除 mezzanine 85s + 边缘裁剪 26s + 合成 2s + 中转 1s ≈ 114s CPU 开销	2026-09-28 13:30:31 +08:00
xiaoxia	e496f127a3	feat(p1): OSS 双endpoint分离 — 上传/下载走VPC内网，签名URL走公网 (#2085) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-28 11:35:13 +08:00
xiaoxia	97ad0ae2e5	fix(p0): 固化 GPU_ENCODE 到 .env.staging + MediaKit 抽帧 403 修复 (#2069) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-27 21:42:18 +08:00
CI Bot	39c064ba1c	style: auto-format with black + isort + ruff + prettier [skip ci-format-check]	2026-09-26 20:43:21 +08:00
saas-backend-agent	105ab54059	feat(gpu): 接入 P4000 NVENC 硬件编码加速 ... - packages/config/base.py: 新增 GPU_ENCODE_* 配置项（开关/endpoint/relay/secret/编码参数/fallback） - packages/shared/gpu_encoder.py: 新增 GpuEncoderClient，封装 health 探测 + mezzanine 上传 OSS + P4000 nvenc 编码 + relay 回传下载，失败抛 GpuEncodeError 触发 CPU 降级 - apps/api/app/api/routes/gpu_relay.py: 新增 internal PUT/GET/DELETE /api/v1/internal/gpu-relay/{key}（token 鉴权），P4000 PUT 编码结果，worker GET 下载 - apps/api/app/api/router.py: 注册 gpu_relay_router - apps/worker/video_processing/unified_render_service.py: _execute_ffmpeg 和 _render_pass_through 尝试 GPU 路径：CPU ultrafast mezzanine → P4000 nvenc → 输出到最终路径；任何失败自动回退到原 CPU libx264 路径 - apps/worker/worker_app/tasks/_startup.py: worker_ready 时探测 P4000 健康并打日志 - tests/unit/test_gpu_encoder.py: GpuEncoderClient 单测（health/sync 调用/失败/fallback/relay URL） 架构： - 输入：CPU 输出 libx264 ultrafast mezzanine → 上传 OSS 临时前缀 → P4000 签名 URL 下载 - 输出：P4000 PUT → 宿主机 nginx（tailscale:80）→ API /api/ 反代 → gpu_relay 路由落盘到 generated/gpu_relay/ - 回传：worker 通过 docker 网络 http://xiaoxia-api-staging:8000 GET 下载最终 mp4 到 output_path - 降级：GPU 任何环节异常（health/上传/编码/回传/下载）→ 原 CPU 路径继续执行，不影响成片	2026-09-26 20:43:21 +08:00
xiaoxia	1be658f72d	#2034 fix: dedup_enabled 关开关时彻底关闭视觉/像素扰动 (#2034) ... #2034 fix: dedup_enabled 开关同时控制批量变体的 visual/pixel 扰动 - unified_render_service._get_visual_perturbation() 开头加 dedup_enabled 守门 - edit_plan_service._build_variant_config_update 读取源 plan.dedup_enabled，关开关时不注入 visual_perturbation 和 pixel_perturbation - 保留节奏模板洗牌和 BGM 池差异化（合理多变体差异，不属于降重扰动） - 同步修复提交时尾部误写入的 SHA 行（语法修复）	2026-09-25 09:50:44 +08:00
xiaoxia	23fe5f9822	feat(generation): #2024 视频渲染后延迟到封面确认才入库（新增 AWAITING_COVER 状态 + finalize 接口） (#2026) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-24 12:34:43 +08:00
xiaoxia	4a695c6eb6	fix(title): 标题/字幕字号按 video_width/720 等比缩放，修复成片标题比预览过小 (#2023) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-23 23:17:12 +08:00
xiaoxia	fbd89b4089	feat: #1970 hflip 按 atom_clip ai_tags.has_text 放开 + 清理重复 081 migration ... - render_adapter 按非 audio 源片段顺序批量查 atom_clip.ai_tags， 仅 has_text 显式 false 标记无文字，其余（未打标签/true/null/查询失败）保守不翻转 - UnifiedRenderService 新增 clip_has_text 注入，None 维持 P1 全保守语义 - 删除残留 081_atom_clip_ai_tags.py（与 GPU PR 的 081 撞号，内容已由 082 承载）， develop alembic 恢复单 head：080→081_add_gpu_lipsync→082_atom_clip_ai_tags - 新增 19 个测试（纯函数混合标记/服务门控/适配器解析/失败回退），全量 15819 passed	2026-09-19 01:06:46 +08:00
xiaoxia	a59a6a588a	feat(#1970): 智能降重 PR2 - dedup_enabled 开关 + 6 维片段级微变换 (#1975) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-18 05:44:59 +08:00
xiaoxia	53fb25efcf	fix(#1834): 批量修复 UP 系列静态分析警告（UP007/UP006/UP017/UP035） (#1928) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-15 12:59:17 +08:00
saas-backend-agent	30094bc591	fix(backend): #1901 统一title字段名修复标题渲染不一致 ... 问题：plan.config中标题配置字段名双轨不一致——Worker sync_configs_to_plan 写 plan.config['title']（归一化 size/font/color），API writeback_edit_plan_config 写 plan.config['title_config']（不归一化），三个渲染引擎读取不一致： - video_compose_service（FFmpeg drawtext）：已读 title+fallback title_config ✅ - unified_render_service（ASS字幕）：只 title 无 fallback ❌ - subtitle_render_engine（字幕渲染）：只读 title_config ❌ 修复： - packages/application/generation_common.py writeback_edit_plan_config：统一写 plan.config['title']（而非 title_config），并做字段名归一化 font_size→size/font_preset→font/font_color→color，与 Worker sync_configs_to_plan 行为一致 - apps/worker/video_processing/subtitle_render_engine.py：_resolve_title_config 先读 plan.config['title']，fallback plan.config['title_config']（兼容存量老数据） - apps/worker/video_processing/unified_render_service.py：同样先读 'title'，text 为空时 fallback 'title_config' - apps/api/app/api/routes/generation_cover.py：封面E2标题配置读取加 title_config fallback - 单测适配：test_generation_common.py/test_writeback_edit_plan_config.py 断言改 'title' 并验证归一化 - 所有渲染路径（智能剪辑/AI数字人/封面E2）统一读 'title'，老数据通过 fallback 继续渲染	2026-09-14 19:27:29 +08:00
灵应	b9acf8c86f	fix(worker): 修复像素扰动color_balance滤镜名错误导致ffmpeg exit=8 ... 根因：像素扰动功能(bb98620)在ffmpeg滤镜链中使用了color_balance滤镜名， 但ffmpeg的实际滤镜名是colorbalance（无下划线），导致滤镜解析失败， 报错'No such filter: color_balance'，ffmpeg退出码8。 影响：任何启用了像素扰动的变体渲染（默认批量变体会随机启用）都会失败， 表现为进度卡在56%，error_message只显示ffmpeg版本banner。 修复：将ffmpeg滤镜名从color_balance=改为colorbalance=。 内部config key保持color_balance不变（避免兼容问题）。	2026-09-13 23:36:02 +08:00
灵应	ccef935ca7	fix(worker): 改进ffmpeg错误信息可见性，stderr尾部优先+error_detail不丢弃 ... 1. error_message显示stderr尾部500字符（而非头部ffmpeg banner） 2. error_detail保留stderr尾部5000字符 3. generation任务RuntimeError保留error_detail 4. 缩略图ffmpeg错误同理	2026-09-13 23:11:53 +08:00
xiaoxia	44224cfaf6	feat: 转场位置与类型随机化 (#1766) (#1786) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-08 10:17:35 +08:00
xiaoxia	98cf571ab3	feat: #1767 BGM 池差异化分配，打破变体间音频指纹一致性 (#1785) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-08 10:12:52 +08:00
CI Bot	410c390cf0	style: auto-format with black + isort + prettier [skip ci-format-check]	2026-09-07 14:03:49 +00:00
saas-backend-agent	9f85d40855	fix: 修复 compute_duplicate_rate 方法被错误嵌套到模块函数内部 ... PR #1762 查重增强时，compute_duplicate_rate 方法被意外放到 compute_structure_similarity 模块函数体内（return 之后的死代码）， 导致 VideoDeduplicator 类丢失该方法，27 个旧单测 AttributeError。 将方法移回 VideoDeduplicator 类，缩进不变。 验证：test_duplicate_rate/test_duplicate_rate_scope/ test_dedup_1702/test_bad_fingerprint_filter/test_dedup_enhanced 共 78 个测试全部通过。	2026-09-07 22:01:13 +08:00
CI Bot	ac7ab679b7	style: auto-format with black + isort + prettier [skip ci-format-check]	2026-09-07 12:28:56 +00:00
saas-backend-agent	bb98620a8a	feat: 像素级扰动滤镜降低平台查重风险 (Issue #1765) ... - generate_pixel_perturbation()：随机选 2-3 种滤镜组合 - noise: 轻微噪声 (0.01~0.02) - unsharp: 锐化/柔化 (-0.5~+0.5) - curves: 对比度微调 (0.95~1.05) - color_balance: RGB 通道偏移 - _apply_pixel_perturbation()：渲染时追加到 FFmpeg filter chain - edit_plan_service：批量变体生成时为每个变体生成不同像素扰动 - 参数幅度确保肉眼不可见（SSIM > 0.95），帧级差异 > 3% - 11 个新测试覆盖滤镜组合/参数范围/验收	2026-09-07 20:24:13 +08:00
CI Bot	07aa03da24	style: auto-format with black + isort + prettier [skip ci-format-check]	2026-09-07 11:49:16 +00:00
saas-backend-agent	add93bb9de	feat(dedup): 增加文案+结构维度查重 (Issue #P2-后端3) ... - 新增 compute_text_similarity: 字符级 Jaccard 相似度比对配音文本 - 新增 compute_structure_similarity: 片段序列相似度（数量+类型+时长分布） - 多维度融合公式: duplicate_rate = visual*0.5 + text*0.25 + structure*0.25 - 文案/结构数据缺失时降级为纯视觉维度 - 21 个新测试覆盖文本+结构+权重常量	2026-09-07 19:46:43 +08:00
CI Bot	37ebf42278	style: auto-format with black + isort + prettier [skip ci-format-check]	2026-09-07 10:21:04 +00:00
saas-backend-agent	d6a2715a26	feat: 封面智能选帧 — 帧质量评分（清晰度/亮度/色彩） ... P1-后端2：封面智能选帧 新增 cover_frame_scorer.py： - score_frame(): 评估单帧质量 0~100 分 - 清晰度 (0~40): 拉普拉斯方差，越高越清晰 - 亮度 (0~30): 80~180 舒适区间满分 - 色彩丰富度 (0~30): RGB 三维直方图非零 bin - score_frames(): 批量评分+排序 - select_best_frame(): 选出最佳帧 - 降级策略：cv2 不可用时返回 50.0 默认分 修改 thumbnail_generator.py： - extract_and_upload_cover_frames: num_frames=3→5 - 抽帧后对所有候选帧进行质量评分 - 按分数从高到低排序返回 - 统一临时文件管理（评分后清理） 修改 generation_cover.py： - E1/E2 步骤 max_frames=1→5 - 新增 _select_best_frame_from_snapshots() 辅助函数 - MediaKit 抽多帧后通过质量评分选最佳 修改 render_adapter.py： - 调用 extract_and_upload_cover_frames 时 num_frames=5 测试：test_cover_frame_scorer.py（18 个测试）	2026-09-07 18:18:19 +08:00
xiaoxia	debb3a5d67	feat(#1758): FFmpeg 渲染加速——preset medium→fast + 多线程 + 环境变量可覆盖 (#1757) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-07 16:37:35 +08:00
xiaoxia	4b3feb2d88	feat(#1754): 渲染期画面扰动——让批量视频本身更不同 (#1755) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-07 13:55:47 +08:00
xiaoxia	e83a0b86f8	fix(#1749): 批量三连修：配音严格守卫/配音时长分配+末帧冻结/素材级去重 + variant-plans 接口 (#1752) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-07 09:22:34 +08:00
xiaoxia	0469272bd6	fix(#1743): 批量变体独立选片——完整重跑单视频选片+批次20%重叠避让+查重超阈重渲+封面独立 (#1745) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-06 18:07:24 +08:00
xiaoxia	cf83c0df9f	fix(dedup): pHash阈值二次校准12→16 + 时序对齐允许±1反向抖动，修复降重同源对漏检 (#1702) (#1709) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-05 11:30:11 +08:00
xiaoxia	ca7f875224	fix(dedup): scope=user跨项目查重不做时长预过滤，同源不同时长视频可互相检出 (#1702) (#1708) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-05 10:12:50 +08:00
xiaoxia	15909a92e5	fix(dedup): check_duplicate支持exclude_video_id，修复recompute自匹配 (#1702) (#1706)	2026-09-05 09:38:17 +08:00
xiaoxia	7a4aa27f71	fix(dedup): recompute任务从file_url派生OSS下载key，修复重算404 (#1702) (#1705) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-05 08:36:19 +08:00
xiaoxia	28b3010668	fix(dedup): 修复查重率恒为0%——指纹绕开降重裁剪+局部片段复用+阈值校准+3个单位bug (#1702) (#1703) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-05 07:57:23 +08:00
xiaoxia	db244fe14c	feat: 片段时长自动对齐配音时长 (#1693)	2026-09-04 16:09:23 +08:00
xiaoxia	e86f137c3d	fix: 标题默认位置 fallback 改为 bottom，与前端 DEFAULT_TITLE_SETTINGS 对齐 (#1691)	2026-09-04 15:19:34 +08:00
xiaoxia	4633126bb4	fix: 查重系统黑屏视频过滤 — 跳过坏指纹防止虚假匹配 #1664 (#1688) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-04 14:56:47 +08:00
xiaoxia	452a484c5b	fix: 查重流程全面核实修复 — 两阶段持久化 + 重新计算查重API (#1664) (#1684) ... Co-authored-by: xiaoxia <dev@xiaoxiajianji.com> Co-committed-by: xiaoxia <dev@xiaoxiajianji.com>	2026-09-04 13:00:11 +08:00