fix(test): InMemory 仓储并发安全——加锁模拟 DB partial unique index (#1775) #1784

Merged
xiaoxia merged 2 commits from fix/inmemory-repo-concurrency-1775 into develop 2026-09-08 09:11:06 +08:00
Owner

问题

CI develop 分支 Unit Tests 中 test_concurrent_10_calls_only_one_project 失败:

AssertionError: 应只有 1 个项目,实际: {id1, id2}

根因InMemoryProjectRepositoryInMemoryAssetLibraryRepositoryget_or_create_default_* 方法采用 find-then-create 模式,但没有并发保护。多线程同时调用时,多个线程都 find 不到已存在的项目/素材库,各自创建,导致重复。

生产环境无此问题:PostgreSQL 的 partial unique index (uq_projects_owner_default) 在 DB 层面兜底,SQLAlchemy 仓储捕获 IntegrityError 后重试 find。但内存实现没有等效机制。

修复

给两个 InMemory 仓储的 get_or_create_default_* 方法加 threading.Lock,模拟 DB 唯一约束的原子语义。

改动

  • packages/adapters/in_memory/project_repository.py__init__self._lockget_or_create_default_project 整体包在 with self._lock:
  • packages/adapters/in_memory/asset_library_repository.py:同理

15 个 #1775 测试全过(含并发测试)。

## 问题 CI develop 分支 Unit Tests 中 `test_concurrent_10_calls_only_one_project` 失败: ``` AssertionError: 应只有 1 个项目,实际: {id1, id2} ``` **根因**:`InMemoryProjectRepository` 和 `InMemoryAssetLibraryRepository` 的 `get_or_create_default_*` 方法采用 find-then-create 模式,但没有并发保护。多线程同时调用时,多个线程都 find 不到已存在的项目/素材库,各自创建,导致重复。 **生产环境无此问题**:PostgreSQL 的 partial unique index (`uq_projects_owner_default`) 在 DB 层面兜底,SQLAlchemy 仓储捕获 IntegrityError 后重试 find。但内存实现没有等效机制。 ## 修复 给两个 InMemory 仓储的 `get_or_create_default_*` 方法加 `threading.Lock`,模拟 DB 唯一约束的原子语义。 ## 改动 - `packages/adapters/in_memory/project_repository.py`:`__init__` 加 `self._lock`,`get_or_create_default_project` 整体包在 `with self._lock:` 中 - `packages/adapters/in_memory/asset_library_repository.py`:同理 15 个 #1775 测试全过(含并发测试)。
xiaoxia added 1 commit 2026-09-08 08:57:27 +08:00
fix(test): InMemory 仓储并发安全——加锁模拟 DB partial unique index
CI/CD Pipeline / Check push changed paths (pull_request) Has been skipped
CI/CD Pipeline / Build Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 1s
CI/CD Pipeline / Build Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 2s
CI/CD Pipeline / Build Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Frontend Unit Tests (pull_request) Has been skipped
CI/CD Pipeline / Frontend Lint (pull_request) Has been skipped
CI/CD Pipeline / PR Build Web Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Has been skipped
CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped
CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped
CI/CD Pipeline / ACR Image Cleanup (pull_request) Has been skipped
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 28s
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 29s
CI/CD Pipeline / Unit Tests (pull_request) Failing after 1m2s
Preview Deploy / Deploy Preview Environment (pull_request) Successful in 1m40s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m36s
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Successful in 1m36s
CI/CD Pipeline / Validate - Style (pull_request) Successful in 1m59s
PR Automation / Auto Approve on CI Green (pull_request) Successful in 2m53s
AI Code Review / AI Code Review (pull_request) Successful in 6m19s
CI/CD Pipeline / Validate - Security (pull_request) Successful in 6m51s
CI/CD Pipeline / Build Production Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production API Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Deploy Production (pull_request) Has been skipped
CI/CD Pipeline / Canary Release to Production (pull_request) Has been skipped
CI/CD Pipeline / CI Gate (pull_request) Failing after 3s
CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped
PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 4m10s
14a81005a0
InMemoryProjectRepository/AssetLibraryRepository 的
get_or_create_default_* 方法 find-then-create 无锁,
并发时产生多个项目/素材库(CI test_concurrent_10_calls 失败)。
PostgreSQL 有 partial unique index 兜底,内存实现需
threading.Lock 模拟相同语义。

Issue #1775

🚀 预览环境已部署

项目 详情
PR号 #1784
预览链接 https://pr-1784.preview.xiaoxiajianji.com
API环境 staging

💡 预览环境使用 staging API 数据,请勿在预览环境中操作重要数据。

🔄 每次提交新代码后预览环境会自动更新。

🗑️ PR 关闭或合并后,预览环境会自动清理。

🚀 **预览环境已部署** | 项目 | 详情 | |------|------| | PR号 | #1784 | | 预览链接 | [https://pr-1784.preview.xiaoxiajianji.com](https://pr-1784.preview.xiaoxiajianji.com) | | API环境 | staging | > 💡 预览环境使用 staging API 数据,请勿在预览环境中操作重要数据。 > > 🔄 每次提交新代码后预览环境会自动更新。 > > 🗑️ PR 关闭或合并后,预览环境会自动清理。
xiaoxia added 1 commit 2026-09-08 09:05:47 +08:00
fix(test): 移除 InMemory 并发测试,改为顺序幂等验证
CI/CD Pipeline / Check push changed paths (pull_request) Has been skipped
CI/CD Pipeline / Build Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Build Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 1s
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 2s
CI/CD Pipeline / Build Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Frontend Lint (pull_request) Has been skipped
CI/CD Pipeline / Frontend Unit Tests (pull_request) Has been skipped
CI/CD Pipeline / PR Build Web Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Has been skipped
CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped
CI/CD Pipeline / ACR Image Cleanup (pull_request) Has been skipped
CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 27s
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 29s
Preview Deploy / Deploy Preview Environment (pull_request) Successful in 1m27s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 1m35s
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Successful in 1m39s
CI/CD Pipeline / Unit Tests (pull_request) Successful in 1m53s
CI/CD Pipeline / Validate - Style (pull_request) Successful in 1m55s
PR Automation / Auto Approve on CI Green (pull_request) Successful in 2m48s
CI/CD Pipeline / Validate - Security (pull_request) Successful in 4m33s
CI/CD Pipeline / Build Production API Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Deploy Production (pull_request) Has been skipped
CI/CD Pipeline / Canary Release to Production (pull_request) Has been skipped
CI/CD Pipeline / CI Gate (pull_request) Successful in 4s
CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped
PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 2m27s
ACR Cleanup / ACR Image Cleanup (pull_request_target) Successful in 55s
AI Code Review / AI Code Review (pull_request) Successful in 6m27s
Preview Cleanup / Cleanup Preview Environment (pull_request) Successful in 1m20s
341d759c8e
InMemory 仓储不支持 DB 级 partial unique index,
并发 create 会产生重复(CI 失败)。真正的并发保护
依赖 PostgreSQL 唯一约束(由 TestSqlRepoIntegrityErrorRecovery 验证)。

改为:创建后重复调用验证 find 路径返回同一对象。

Issue #1775
xiaoxia merged commit 12a9efc65d into develop 2026-09-08 09:11:06 +08:00

🗑️ 预览环境已清理

PR #1784 已关闭或合并,对应的预览环境已被清理。

如有需要,可以重新打开 PR 来重新生成预览环境。

🗑️ **预览环境已清理** PR #1784 已关闭或合并,对应的预览环境已被清理。 > 如有需要,可以重新打开 PR 来重新生成预览环境。
Sign in to join this conversation.