fix(gpu): 修复MuseTalk蓝色块 — Step5删除多余BGR2RGB转换,直接传BGR给VAE #2015

Merged
auto-approve-bot merged 1 commits from fix/musetalk-blue-face-bgr2rgb into develop 2026-09-23 00:08:09 +08:00
Owner

根因

Step 5 中 crop_rgb = cv2.cvtColor(crop, cv2.COLOR_BGR2RGB) 是多余转换:VAE 内部 preprocess_img 已经做了 BGR→RGB,外层再转一次导致双重转换、R/B 通道互换,表现为生成人脸发蓝。

改动

- crop_rgb = cv2.cvtColor(crop, cv2.COLOR_BGR2RGB)
- crop_resized = cv2.resize(crop_rgb, (256, 256), ...)
+ # 直接传 BGR,VAE 内部 preprocess_img 已做 BGR→RGB
+ crop_resized = cv2.resize(crop, (256, 256), ...)

该修复此前由运维直接改在 GPU 机器(rtx3060-0001)上并验证蓝色块消失,本 PR 将其纳入 develop。

GFPGAN 链路核对

修复后的色彩约定:主管线全程 BGR(encode 进 BGR,Step 7 解码输出按 BGR 与原帧融合/粘贴)。GFPGAN 段:

  • 输入:cv2.cvtColor(_face_up, BGR2RGB)
  • 输出:return_rgb=TruecvtColor(RGB2BGR) 回写 ✓

通道与修复后的 BGR 约定一致,无需改动。当前 MUSE_USE_GFPGAN=0 禁用,等基础功能确认后开启 GFPGAN 做运行时验证。

## 根因 Step 5 中 `crop_rgb = cv2.cvtColor(crop, cv2.COLOR_BGR2RGB)` 是多余转换:VAE 内部 `preprocess_img` 已经做了 BGR→RGB,外层再转一次导致**双重转换、R/B 通道互换**,表现为生成人脸发蓝。 ## 改动 ```diff - crop_rgb = cv2.cvtColor(crop, cv2.COLOR_BGR2RGB) - crop_resized = cv2.resize(crop_rgb, (256, 256), ...) + # 直接传 BGR,VAE 内部 preprocess_img 已做 BGR→RGB + crop_resized = cv2.resize(crop, (256, 256), ...) ``` 该修复此前由运维直接改在 GPU 机器(rtx3060-0001)上并验证蓝色块消失,本 PR 将其纳入 develop。 ## GFPGAN 链路核对 修复后的色彩约定:主管线全程 BGR(encode 进 BGR,Step 7 解码输出按 BGR 与原帧融合/粘贴)。GFPGAN 段: - 输入:`cv2.cvtColor(_face_up, BGR2RGB)` ✓ - 输出:`return_rgb=True` → `cvtColor(RGB2BGR)` 回写 ✓ 通道与修复后的 BGR 约定一致,**无需改动**。当前 `MUSE_USE_GFPGAN=0` 禁用,等基础功能确认后开启 GFPGAN 做运行时验证。
xiaoxia added 1 commit 2026-09-22 23:53:58 +08:00
fix(gpu): 修复MuseTalk蓝色块 — Step5删除多余BGR2RGB转换,直接传BGR给VAE
CI/CD Pipeline / Check push changed paths (pull_request) Has been skipped
CI/CD Pipeline / Dedup Check - skip PR tests when covered by push pipeline (pull_request) Successful in 1s
CI/CD Pipeline / Check if frontend-only change (pull_request) Successful in 1s
CI/CD Pipeline / Frontend Unit Tests (pull_request) Has been skipped
CI/CD Pipeline / Frontend Lint (pull_request) Has been skipped
CI/CD Pipeline / PR Build Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Build Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging API Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Web Image (pull_request) Has been skipped
CI/CD Pipeline / Retag skipped Staging Worker Image (pull_request) Has been skipped
CI/CD Pipeline / Deploy Staging (Watchtower auto-deploy) (pull_request) Has been skipped
CI/CD Pipeline / Staging E2E Tests (pull_request) Has been skipped
CI/CD Pipeline / Staging API Integration Tests (pull_request) Has been skipped
CI/CD Pipeline / ACR Image Cleanup (pull_request) Has been skipped
Preview Deploy / Deploy Preview Environment (pull_request) Successful in 1m36s
CI/CD Pipeline / PR Build API Image (pull_request) Successful in 2m49s
PR Automation / Auto Approve on CI Green (pull_request) Successful in 2m58s
CI/CD Pipeline / PR Build Worker Image (pull_request) Successful in 3m23s
CI/CD Pipeline / Integration Tests (pull_request) Successful in 4m21s
CI/CD Pipeline / Unit Tests (pull_request) Successful in 4m23s
CI/CD Pipeline / Validate - Style (pull_request) Successful in 4m47s
AI Code Review / AI Code Review (pull_request) Successful in 6m51s
CI/CD Pipeline / Validate - Python (mypy + alembic) (pull_request) Successful in 7m31s
CI/CD Pipeline / Validate - Security (pull_request) Successful in 13m24s
CI/CD Pipeline / Build Production API Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production Web Image (pull_request) Has been skipped
CI/CD Pipeline / Build Production Worker Image (pull_request) Has been skipped
CI/CD Pipeline / CI Gate (pull_request) Successful in 1s
CI/CD Pipeline / Canary Release to Production (pull_request) Has been skipped
CI/CD Pipeline / Deploy Production (pull_request) Has been skipped
CI/CD Pipeline / Production Browser E2E (pull_request) Has been skipped
PR Automation / Auto Merge on CI Green + Approved (pull_request) Successful in 11m12s
ACR Cleanup / ACR Image Cleanup (pull_request_target) Successful in 33s
Preview Cleanup / Cleanup Preview Environment (pull_request) Successful in 4m24s
ff2ff863a2
VAE内部preprocess_img已做BGR→RGB,外层再cvtColor导致双重转换、R/B通道互换(蓝脸根因)。
该修复此前由运维直接改在GPU机器上验证有效,现补提PR入develop。

GFPGAN链路色彩空间核对:修复后主管线为BGR约定(encode BGR、decode输出按BGR融合),
GFPGAN段BGR→RGB输入/return_rgb=True后RGB→BGR回写,通道一致,无需改动;
当前MUSE_USE_GFPGAN=0禁用,待基础功能确认后开启做运行时验证。

🚀 预览环境已部署

项目 详情
PR号 #2015
预览链接 https://pr-2015.preview.xiaoxiajianji.com
API环境 staging

💡 预览环境使用 staging API 数据,请勿在预览环境中操作重要数据。

🔄 每次提交新代码后预览环境会自动更新。

🗑️ PR 关闭或合并后,预览环境会自动清理。

🚀 **预览环境已部署** | 项目 | 详情 | |------|------| | PR号 | #2015 | | 预览链接 | [https://pr-2015.preview.xiaoxiajianji.com](https://pr-2015.preview.xiaoxiajianji.com) | | API环境 | staging | > 💡 预览环境使用 staging API 数据,请勿在预览环境中操作重要数据。 > > 🔄 每次提交新代码后预览环境会自动更新。 > > 🗑️ PR 关闭或合并后,预览环境会自动清理。
auto-approve-bot merged commit 1855dc54dc into develop 2026-09-23 00:08:09 +08:00
auto-approve-bot deleted branch fix/musetalk-blue-face-bgr2rgb 2026-09-23 00:08:11 +08:00

🗑️ 预览环境已清理

PR #2015 已关闭或合并,对应的预览环境已被清理。

如有需要,可以重新打开 PR 来重新生成预览环境。

🗑️ **预览环境已清理** PR #2015 已关闭或合并,对应的预览环境已被清理。 > 如有需要,可以重新打开 PR 来重新生成预览环境。
Sign in to join this conversation.