fix: 渲染引擎全链路安全加固 P0+P1 #317

Merged

xiaoxia merged 21 commits from fix/render-engine-security-p0-p1 into develop

2026-07-14 18:15:21 +08:00

Author	SHA1	Message	Date
xiaoxia	b4b142180c	Merge branch 'develop' into fix/render-engine-security-p0-p1 CI/CD Pipeline / Frontend Lint (pull_request) Successful in 1m56s Details CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Successful in 1m59s Details CI/CD Pipeline / Build Staging API Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Staging Worker Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Staging Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Production API Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Worker Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details CI/CD Pipeline / Unit Tests (pull_request) Successful in 2m9s Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m14s Details # Conflicts: # apps/worker/video_processing/path_security.py	2026-07-14 18:15:00 +08:00
xiaoxia	de42b1960e	style: fix isort import ordering (first-party grouping) CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Successful in 45s Details CI/CD Pipeline / Unit Tests (pull_request) Successful in 1m16s Details CI/CD Pipeline / Frontend Lint (pull_request) Successful in 2m7s Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m25s Details	2026-07-14 18:03:19 +08:00
xiaoxia	f377670076	style: fix isort import ordering (first-party grouping) CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Unit Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Frontend Lint (pull_request) Has been cancelled Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been cancelled Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been cancelled Details CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled Details	2026-07-14 18:03:17 +08:00
xiaoxia	674fc6763d	style: fix isort for CI compatibility (5.x format) CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Failing after 44s Details CI/CD Pipeline / Unit Tests (pull_request) Successful in 1m34s Details CI/CD Pipeline / Frontend Lint (pull_request) Successful in 1m50s Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been skipped Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m29s Details	2026-07-14 17:52:00 +08:00
xiaoxia	405fb4c8d3	style: fix isort for CI compatibility (5.x format)	2026-07-14 17:51:59 +08:00
xiaoxia	de1816bbd9	style: fix isort import ordering CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Failing after 20s Details CI/CD Pipeline / Unit Tests (pull_request) Successful in 1m9s Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m24s Details CI/CD Pipeline / Frontend Lint (pull_request) Successful in 1m58s Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details	2026-07-14 17:42:25 +08:00
xiaoxia	bbcc8a12bd	style: fix isort import ordering CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Unit Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Frontend Lint (pull_request) Has been cancelled Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been cancelled Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been cancelled Details CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled Details	2026-07-14 17:42:24 +08:00
xiaoxia	12862b4e23	style: fix isort import ordering CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Failing after 25s Details CI/CD Pipeline / Unit Tests (pull_request) Successful in 1m19s Details CI/CD Pipeline / Frontend Lint (pull_request) Successful in 1m56s Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m30s Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details	2026-07-14 17:29:14 +08:00
xiaoxia	3b2bf414eb	style: fix isort import ordering CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Unit Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Frontend Lint (pull_request) Has been cancelled Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been cancelled Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been cancelled Details CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled Details	2026-07-14 17:29:13 +08:00
xiaoxia	f681904f61	style: fix isort import ordering CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Unit Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Frontend Lint (pull_request) Has been cancelled Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been cancelled Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been cancelled Details CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled Details	2026-07-14 17:29:12 +08:00
xiaoxia	71f7b6795b	style: black + isort format CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Failing after 34s Details CI/CD Pipeline / Unit Tests (pull_request) Successful in 1m11s Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m23s Details CI/CD Pipeline / Frontend Lint (pull_request) Successful in 2m8s Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details	2026-07-14 17:18:23 +08:00
xiaoxia	c6c234757a	style: black + isort format CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Unit Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Frontend Lint (pull_request) Has been cancelled Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been cancelled Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been cancelled Details CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled Details	2026-07-14 17:18:20 +08:00
xiaoxia	99a6b4d104	style: black + isort format CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Unit Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Frontend Lint (pull_request) Has been cancelled Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been cancelled Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been cancelled Details CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled Details	2026-07-14 17:18:17 +08:00
CI Bot	745ea06659	fix: #317 CI修复 - asset_analyzer缩进 + TTS单测SSRF兼容 CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Failing after 29s Details CI/CD Pipeline / Unit Tests (pull_request) Successful in 1m10s Details CI/CD Pipeline / Frontend Lint (pull_request) Successful in 1m47s Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m17s Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details P0-1: asset_analyzer.py 缩进错误 - 第147行起23行缩进多了一层（改subprocess时弄乱） - 修正 streams/format_info/for循环等缩进 P0-2: TTS单测因SSRF接入挂了8个 - 根因：测试mock httpx，但safe_download_*在发请求前做DNS解析 - 修复：将httpx mock替换为safe_download_bytes/safe_download_file mock - test_tts_oss_transfer.py: 4个失败修复，mock safe_download_bytes - test_tts_segment_synthesis.py: 3个失败修复，mock safe_download_file - test_tts_streaming.py: 1个失败修复，mock safe_download_bytes - 安全层单测保持独立，33个test_url_security.py全绿 76个相关测试全绿（9+24+10+33）	2026-07-14 17:11:42 +08:00
CI Bot	2f03e13928	fix: batch_download增加视频MIME类型白名单校验 CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Failing after 14s Details CI/CD Pipeline / Unit Tests (pull_request) Failing after 1m9s Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m9s Details CI/CD Pipeline / Frontend Lint (pull_request) Successful in 2m31s Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details - HTTP回退下载增加ALLOWED_VIDEO_MIME_TYPES白名单 - 包含application/octet-stream作为兜底兼容 - 6处外部下载全部接入大小+类型双重限制	2026-07-14 16:43:24 +08:00
CI Bot	334e2b1fc2	fix: 渲染引擎安全加固P0+P1 补修第二轮 CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Failing after 16s Details CI/CD Pipeline / Unit Tests (pull_request) Failing after 1m11s Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m11s Details CI/CD Pipeline / Frontend Lint (pull_request) Successful in 1m46s Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been skipped Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details - SSRF漏接点补全：TTS 3个下载点 + BGM 3个下载点全部接入 url_security.py 校验 - TTS: workflow.py (_transfer_audio_to_oss, _download_and_merge_segments) + streaming_service.py (_download_audio) - BGM: generation.py (外部直链, 预设库) + batch_download.py (HTTP回退) - 重定向防护：手动跟随重定向，每次跳转前重新校验目标 URL（禁用默认自动跟随） - 文件大小/类型限制：新增 safe_download_file/safe_download_bytes，流式下载 + 大小上限 + MIME 白名单 - 裸 subprocess 补齐：5 处全部改走统一 run_ffmpeg/run_ffprobe - asset_analyzer.py: 3处 (ffprobe + 2个ffmpeg) - ingest.py: 1处 (ffprobe) - voice_extraction.py: 1处 (ffmpeg) - URL安全模块迁移到 packages/shared/ 作为单一来源，worker 端保留向后兼容 re-export - 新增 run_ffprobe 统一工具函数到 ffmpeg_utils - 新增 7 个下载安全单测，累计 33 个 URL 安全测试	2026-07-14 16:19:39 +08:00
xiaoxia	3b80edd8c5	style: add nosec comment for bandit B108 false positive CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Successful in 38s Details CI/CD Pipeline / Unit Tests (pull_request) Successful in 1m13s Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m22s Details CI/CD Pipeline / Frontend Lint (pull_request) Successful in 2m22s Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details	2026-07-14 15:20:20 +08:00
xiaoxia	01daa72f2a	style: black + isort format CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Failing after 39s Details CI/CD Pipeline / Unit Tests (pull_request) Successful in 1m24s Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m24s Details CI/CD Pipeline / Frontend Lint (pull_request) Successful in 1m45s Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details	2026-07-14 15:12:43 +08:00
xiaoxia	e0f841fcee	style: black + isort format CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Unit Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Frontend Lint (pull_request) Has been cancelled Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been cancelled Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been cancelled Details CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled Details	2026-07-14 15:12:41 +08:00
xiaoxia	70a85b1463	style: black + isort format CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Unit Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Frontend Lint (pull_request) Has been cancelled Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been cancelled Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been cancelled Details CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled Details	2026-07-14 15:12:39 +08:00
CI Bot	9e10e31a29	fix: 渲染引擎全链路安全加固 P0+P1 CI/CD Pipeline / Validate Code Quality And Tests (pull_request) Failing after 23s Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m17s Details CI/CD Pipeline / Frontend Lint (pull_request) Failing after 15m19s Details CI/CD Pipeline / Unit Tests (pull_request) Failing after 15m19s Details CI/CD Pipeline / Build & Push Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Runtime Images (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details P0-1 SSRF防护：统一URL安全校验方案 - 新增 url_security.py：SSRF防护工具（scheme白名单、端口白名单、内网IP拦截、内网主机名拦截、DNS解析校验） - generation.py URL校验函数增加SSRF前置校验 - PiP引擎URL类型增加安全校验 - 贴纸引擎URL类型增加安全校验 P0-2 路径遍历防护：输入路径校验强化 - 新增 path_security.py：路径安全工具（路径遍历防护、local:// schema校验、文件名清理、允许目录白名单） - resolve_asset_path 加固：本地绝对路径白名单、空字节检测、存储键路径遍历拦截 - PiP引擎local_path类型：增加允许目录校验 - 贴纸引擎：区分本地路径/URL，分别增加安全校验 P1 裸subprocess统一：3处FFmpeg调用走run_ffmpeg - unified_render_service.py _extract_audio：改用 run_ffmpeg - compose_video.py：改用 run_ffmpeg - edit_plan_generation.py：改用 run_ffmpeg 新增测试： - test_url_security.py：29个SSRF防护单测 - test_path_security.py：27个路径遍历防护单测 - 原有171+105=276个单测零回归	2026-07-14 13:18:16 +08:00

fix: 渲染引擎全链路安全加固 P0+P1 #317

21 Commits