fix(dedup): pHash阈值二次校准12→16 + 时序对齐允许±1反向抖动，修复降重同源对漏检 (#1702) #1709
Merged
auto-approve-bot
merged 1 commits from 2026-09-05 11:30:12 +08:00
fix/dedup-threshold16-temporal-jitter-1702 into develop
1 Commits
| Author | SHA1 | Message | Date | |
|---|---|---|---|---|
 xiaoxia
|
d37a5f6a19 |
fix(dedup): pHash阈值二次校准12→16+时序对齐允许±1反向抖动，修复降重对漏检 (Issue #1702)
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 1s
CI/CD Pipeline / Check push changed paths (pull_request) Has been skipped
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 1s
CI/CD Pipeline / Frontend Lint (pull_request) Has been skipped
CI/CD Pipeline / Frontend Unit Tests (pull_request) Has been skipped
CI/CD Pipeline / PR Build Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Build Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Has been skipped
CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped
CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped
CI/CD Pipeline / ACR Image Cleanup (pull_request) Has been skipped
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 32s
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 29s
Preview Deploy / Deploy Preview Environment (pull_request) Successful in 1m21s
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Successful in 1m43s
CI/CD Pipeline / Unit Tests (pull_request) Successful in 1m44s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m44s
CI/CD Pipeline / Validate - Style (pull_request) Successful in 2m6s
PR Automation / Auto Approve on CI Green (pull_request) Successful in 3m10s
CI/CD Pipeline / Validate - Security (pull_request) Successful in 5m22s
CI/CD Pipeline / Build Production API Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Deploy Production (pull_request) Has been skipped
CI/CD Pipeline / CI Gate (pull_request) Successful in 2s
CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped
CI/CD Pipeline / Canary Release to Production (pull_request) Has been skipped
PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 2m42s
ACR Cleanup / ACR Image Cleanup (pull_request_target) Successful in 9s
AI Code Review / AI Code Review (pull_request) Successful in 6m17s
Preview Cleanup / Cleanup Preview Environment (pull_request) Successful in 17s
#1708 去掉时长预过滤后，staging 第四轮验证发现证据视频 B(11s) 对 A(20s) 仍 best_fusion=0 漏检。离线诊断（worker 容器，该用户全部 15 个真实成片指纹）： 1. 阈值 12 过严：同源降重对 B->A 中位数距离 14，<=12 仅 4/11 命中； <=16 命中 8/11=0.73。异源 13 个候选每帧全局最近邻最小距离 18， <=16 命中帧数全部为 0 → 16 检出同源且异源零误报（>=2bit 裕度）。 2. 时序对齐只允许目标索引正向 delta：密集 1s 采样下相邻帧 pHash 接近，全局最近邻在目标相邻帧间正负 1 跳变属正常，旧逻辑把同源 连续匹配拆碎，min_consecutive 门槛够不上。改为 |delta| <= neighbor_window+1（正/反向抖动均允许），大跳跃（>window）仍断段。 改动： - PHASH_THRESHOLD 12→16（SEGMENT_MATCH_THRESHOLD 跟随统一）， 常量注释记录两轮校准数据 - find_duplicate_segments 时序连贯约束 0<=delta<=w+1 → |delta|<=w+1 - 新增 6 个回归测试：阈值 16 校准边界（16 检出/18 零误报/0.73 比例）、 反向抖动保持 run、大跳跃不桥接 - 同步更新旧测试断言与不匹配哈希构造（a-b 距离 16 现算匹配） 测试：查重相关 290 passed；black/isort/ruff 全绿 |