fix: 修复 AI Code Review 阻塞级问题

1. assets.py: 修复高频排除回退逻辑 min(limit,1) → limit 2. assets.py: high_use_excluded 改用 set 提升查找效率 3. dedup.py: compute_duplicate_rate 限制查询最近100个视频避免OOM 4. 更新单元测试适配新的查询方式
2026-08-31 16:05:50 +08:00
parent 6f848343f2
commit 61c19c342e
3 changed files with 66 additions and 42 deletions
@@ -332,8 +332,17 @@ class VideoDeduplicator:
        Returns:
            duplicate_rate: 0~100 的浮点数
        """
+        # 限制查询最近 100 个视频，避免大项目内存溢出
+        from packages.adapters.sqlalchemy_impl.models import GeneratedVideoModel
+        recent_models = (
+            session.query(GeneratedVideoModel)
+            .filter(GeneratedVideoModel.project_id == project_id)
+            .order_by(GeneratedVideoModel.generated_at.desc())
+            .limit(100)
+            .all()
+        )
        video_repo = SQLAlchemyGeneratedVideoRepository(session)
-        existing_videos = video_repo.list_by_project(project_id)
+        existing_videos = [video_repo._to_domain(m) for m in recent_models]

        max_similarity = 0.0
        for existing in existing_videos: