xiaoxia/xiaoxia-saas

feat: 成片 duplicate_rate 百分比 + 素材高频使用自动排除 #1573

Merged

auto-approve-bot merged 5 commits from feat/duplicate-rate-and-high-use-exclusion into develop

2026-08-31 16:56:52 +08:00

Author	SHA1	Message	Date
xiaoxia	58eac6d230	fix: AI Review 阻塞问题——null值防御 CI/CD Pipeline / Check push changed paths (pull_request) Has been skipped Details CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 0s Details CI/CD Pipeline / Build Staging API Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Staging Worker Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Staging Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Has been skipped Details CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / ACR Image Cleanup (pull_request) Has been skipped Details CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 2m48s Details CI/CD Pipeline / Frontend Lint (pull_request) Has been skipped Details CI/CD Pipeline / Frontend Unit Tests (pull_request) Has been skipped Details CI/CD Pipeline / PR Build Web Image (pull_request) Has been skipped Details Preview Deploy / Deploy Preview Environment (pull_request) Successful in 3m20s Details CI/CD Pipeline / Validate - Type Check (mypy) (pull_request) Successful in 3m57s Details CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 1m22s Details PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 4m26s Details CI/CD Pipeline / PR Build API Image (pull_request) Successful in 1m36s Details CI/CD Pipeline / Validate - Migration (alembic) (pull_request) Successful in 4m44s Details PR Automation / Auto Approve on CI Green (pull_request) Successful in 5m29s Details CI/CD Pipeline / Validate - Code Quality (pull_request) Successful in 7m50s Details AI Code Review / AI Code Review (pull_request) Successful in 8m5s Details CI/CD Pipeline / Unit Tests (pull_request) Successful in 15m35s Details CI/CD Pipeline / Build Production API Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Worker Image (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Canary Release to Production (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 8m20s Details CI/CD Pipeline / CI Gate (pull_request) Successful in 26s Details Preview Cleanup / Cleanup Preview Environment (pull_request) Successful in 3m42s Details ACR Cleanup / ACR Image Cleanup (pull_request_target) Successful in 2m57s Details 1. asset_segment_tracker.py: meta.get 改用 or [] 防御 JSON null 2. 排序 key 改用 or '' 防御 created_at 为 null	2026-08-31 16:33:42 +08:00
CI Bot	f49a359903	style: auto-format with black + isort + prettier [skip ci-format-check] CI/CD Pipeline / Check push changed paths (pull_request) Has been skipped Details CI/CD Pipeline / Build Staging API Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Staging Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Staging Worker Image (pull_request) Has been skipped Details CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 4s Details CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Has been skipped Details CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / ACR Image Cleanup (pull_request) Has been skipped Details CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 4m20s Details CI/CD Pipeline / Frontend Lint (pull_request) Has been skipped Details CI/CD Pipeline / Frontend Unit Tests (pull_request) Has been skipped Details CI/CD Pipeline / Validate - Type Check (mypy) (pull_request) Successful in 5m3s Details CI/CD Pipeline / PR Build Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Validate - Migration (alembic) (pull_request) Successful in 5m11s Details CI/CD Pipeline / PR Build API Image (pull_request) Successful in 52s Details PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 5m21s Details Preview Deploy / Deploy Preview Environment (pull_request) Successful in 5m31s Details CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 48s Details PR Automation / Auto Approve on CI Green (pull_request) Successful in 7m7s Details AI Code Review / AI Code Review (pull_request) Failing after 7m34s Details CI/CD Pipeline / Validate - Code Quality (pull_request) Successful in 8m20s Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 3m15s Details CI/CD Pipeline / Unit Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production API Image (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Web Image (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Worker Image (pull_request) Has been cancelled Details CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled Details CI/CD Pipeline / Canary Release to Production (pull_request) Has been cancelled Details CI/CD Pipeline / CI Gate (pull_request) Has been cancelled Details	2026-08-31 08:18:54 +00:00
xiaoxia	61c19c342e	fix: 修复 AI Code Review 阻塞级问题 CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 3s Details CI/CD Pipeline / Check push changed paths (pull_request) Has been skipped Details CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 4m48s Details CI/CD Pipeline / Build Staging API Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Staging Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Staging Worker Image (pull_request) Has been skipped Details PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 3m46s Details CI/CD Pipeline / Frontend Lint (pull_request) Has been skipped Details CI/CD Pipeline / Frontend Unit Tests (pull_request) Has been skipped Details CI/CD Pipeline / PR Build Web Image (pull_request) Has been skipped Details Preview Deploy / Deploy Preview Environment (pull_request) Successful in 4m14s Details CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Has been skipped Details CI/CD Pipeline / Validate - Migration (alembic) (pull_request) Successful in 4m51s Details CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Has been skipped Details CI/CD Pipeline / Validate - Type Check (mypy) (pull_request) Successful in 5m4s Details CI/CD Pipeline / PR Build API Image (pull_request) Successful in 2m10s Details CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details PR Automation / Auto Approve on CI Green (pull_request) Successful in 6m23s Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details AI Code Review / AI Code Review (pull_request) Successful in 10m11s Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 2m10s Details CI/CD Pipeline / ACR Image Cleanup (pull_request) Has been skipped Details CI/CD Pipeline / Validate - Code Quality (pull_request) Has been cancelled Details CI/CD Pipeline / Unit Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production API Image (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Web Image (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Worker Image (pull_request) Has been cancelled Details CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled Details CI/CD Pipeline / Canary Release to Production (pull_request) Has been cancelled Details CI/CD Pipeline / CI Gate (pull_request) Has been cancelled Details 1. assets.py: 修复高频排除回退逻辑 min(limit,1) → limit 2. assets.py: high_use_excluded 改用 set 提升查找效率 3. dedup.py: compute_duplicate_rate 限制查询最近100个视频避免OOM 4. 更新单元测试适配新的查询方式	2026-08-31 16:06:09 +08:00
CI Bot	6f848343f2	style: auto-format with black + isort + prettier [skip ci-format-check] CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 1s Details CI/CD Pipeline / Check push changed paths (pull_request) Has been skipped Details CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 2m36s Details AI Code Review / AI Code Review (pull_request) Failing after 4m27s Details CI/CD Pipeline / Build Staging API Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Staging Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Staging Worker Image (pull_request) Has been skipped Details PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 5m4s Details Preview Deploy / Deploy Preview Environment (pull_request) Successful in 4m44s Details CI/CD Pipeline / Frontend Lint (pull_request) Has been skipped Details CI/CD Pipeline / Frontend Unit Tests (pull_request) Has been skipped Details CI/CD Pipeline / PR Build Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Has been skipped Details CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Has been skipped Details CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Validate - Migration (alembic) (pull_request) Successful in 3m35s Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / ACR Image Cleanup (pull_request) Has been skipped Details PR Automation / Auto Approve on CI Green (pull_request) Successful in 6m30s Details CI/CD Pipeline / Validate - Type Check (mypy) (pull_request) Successful in 4m35s Details CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 1m47s Details CI/CD Pipeline / PR Build API Image (pull_request) Successful in 2m5s Details CI/CD Pipeline / Validate - Code Quality (pull_request) Successful in 8m41s Details CI/CD Pipeline / Integration Tests (pull_request) Successful in 3m54s Details CI/CD Pipeline / Unit Tests (pull_request) Successful in 13m23s Details CI/CD Pipeline / Build Production API Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Worker Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Production Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Deploy Production (pull_request) Has been skipped Details CI/CD Pipeline / Canary Release to Production (pull_request) Has been skipped Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped Details CI/CD Pipeline / CI Gate (pull_request) Successful in 26s Details	2026-08-31 07:29:06 +00:00
xiaoxia	a40de0338e	feat: 成片 duplicate_rate 百分比 + 素材高频使用自动排除 CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 15s Details CI/CD Pipeline / Check push changed paths (pull_request) Has been skipped Details CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 2m54s Details CI/CD Pipeline / Build Staging API Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Staging Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Build Staging Worker Image (pull_request) Has been skipped Details AI Code Review / AI Code Review (pull_request) Failing after 4m9s Details CI/CD Pipeline / Frontend Lint (pull_request) Has been skipped Details CI/CD Pipeline / Frontend Unit Tests (pull_request) Has been skipped Details Preview Deploy / Deploy Preview Environment (pull_request) Successful in 3m6s Details CI/CD Pipeline / PR Build Web Image (pull_request) Has been skipped Details PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 3m39s Details CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Has been skipped Details CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Has been skipped Details CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Has been skipped Details CI/CD Pipeline / Validate - Type Check (mypy) (pull_request) Successful in 3m29s Details CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Has been skipped Details CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped Details CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped Details CI/CD Pipeline / ACR Image Cleanup (pull_request) Has been skipped Details CI/CD Pipeline / PR Build API Image (pull_request) Successful in 2m46s Details PR Automation / Auto Approve on CI Green (pull_request) Successful in 7m14s Details CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 3m33s Details CI/CD Pipeline / Validate - Migration (alembic) (pull_request) Successful in 6m42s Details CI/CD Pipeline / Validate - Code Quality (pull_request) Has been cancelled Details CI/CD Pipeline / Unit Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Integration Tests (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production API Image (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Web Image (pull_request) Has been cancelled Details CI/CD Pipeline / Build Production Worker Image (pull_request) Has been cancelled Details CI/CD Pipeline / Deploy Production (pull_request) Has been cancelled Details CI/CD Pipeline / Production Browser E2E (pull_request) Has been cancelled Details CI/CD Pipeline / Canary Release to Production (pull_request) Has been cancelled Details CI/CD Pipeline / CI Gate (pull_request) Has been cancelled Details 任务一：生成视频补 duplicate_rate 百分比 - GeneratedVideoModel 加 duplicate_rate 列 (Float, nullable) - GeneratedVideo 领域实体 + repository 映射同步更新 - Alembic migration 059 - VideoDeduplicator.compute_duplicate_rate：遍历项目内已有视频， MD5精确=100%，pHash用 (1-avg_distance/64)*100，取最高值 - dedup_helpers 在指纹计算后调用并存入 duplicate_rate - VideoItemResponse schema 加 duplicate_rate 字段 - _to_video_response 透传 duplicate_rate 任务二：素材级自动排除高频使用素材 - asset_segment_tracker.get_asset_recent_use_counts：统计每个素材在最近 N 个不同 plan_id 中的使用次数 - smart_match_assets 路由加高频排除层（阈值 3 次 / 最近 5 个视频） - 排除后不够 limit 时自动放宽，宁多不少 - 异常时降级跳过排除，不影响正常选素材测试：12 个新用例覆盖 duplicate_rate 计算 + API 响应 + 高频统计	2026-08-31 15:14:34 +08:00